00000800:00000200:0.1F:1734015812.760129:0:3501:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800a9940d80] -> 12345-192.168.201.116@tcp (2) 00000800:00000200:3.1F:1734015812.760377:0:3491:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800a9940d80] -> 12345-192.168.201.116@tcp (2) 00000800:00000200:3.1:1734015812.760410:0:3491:0:(socklnd.c:186:ksocknal_destroy_peer()) peer_ni 12345-192.168.201.116@tcp ffff880092911000 deleted 00000800:00000010:3.1:1734015812.760412:0:3491:0:(socklnd.c:195:ksocknal_destroy_peer()) kfreed 'peer_ni': 184 at ffff880092911000. 00000800:00000200:3.1:1734015812.760415:0:3491:0:(socklnd.c:409:ksocknal_incr_conn_count()) Add conn type 1, ksnr_connected 2 ksnr_max_conns 1 00000800:00000200:3.1:1734015812.760419:0:3491:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.201.116@tcp ip 192.168.201.116:1023 00000800:00000200:3.1:1734015812.760423:0:3491:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff88006edbac00 type 2, nob 96 niov 1 nkiov 0 00000800:00000200:0.1:1734015812.760489:0:3493:0:(socklnd.c:409:ksocknal_incr_conn_count()) Add conn type 1, ksnr_connected 2 ksnr_max_conns 1 00000800:00000200:0.1:1734015812.760681:0:3492:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800a9940d80] -> 12345-192.168.201.116@tcp (4) 00000800:00000200:0.1:1734015812.760684:0:3492:0:(socklnd.c:186:ksocknal_destroy_peer()) peer_ni 12345-192.168.201.116@tcp ffff8800a9940c00 deleted 00000800:00000010:0.1:1734015812.760685:0:3492:0:(socklnd.c:195:ksocknal_destroy_peer()) kfreed 'peer_ni': 184 at ffff8800a9940c00. 00000800:00000200:0.1:1734015812.760687:0:3492:0:(socklnd.c:409:ksocknal_incr_conn_count()) Add conn type 3, ksnr_connected a ksnr_max_conns 1 00000800:00000200:0.1:1734015812.760749:0:3493:0:(socklnd.c:409:ksocknal_incr_conn_count()) Add conn type 2, ksnr_connected e ksnr_max_conns 1 00010000:00000010:1.1F:1734015812.876798:0:27:0:(ldlm_resource.c:1498:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff88012cd61300. 00010000:00000010:1.1:1734015812.876836:0:27:0:(ldlm_lock.c:176:lock_handle_free()) slab-freed 'lock': 552 at ffff88006edbc240. 00010000:00000010:0.1:1734015812.928019:0:27:0:(ldlm_resource.c:1498:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff88012b8ea900. 00010000:00000010:0.1:1734015812.928028:0:27:0:(ldlm_lock.c:176:lock_handle_free()) slab-freed 'lock': 552 at ffff88006edbd440. 00010000:00000010:2.1F:1734015812.942917:0:20:0:(ldlm_resource.c:1498:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff8800b52c9b00. 00010000:00000010:2.1:1734015812.942931:0:20:0:(ldlm_lock.c:176:lock_handle_free()) slab-freed 'lock': 552 at ffff88006edbcd80. 00010000:00000010:2.1:1734015812.942938:0:20:0:(ldlm_lock.c:176:lock_handle_free()) slab-freed 'lock': 552 at ffff880129df4240. 00080000:00000010:1.1:1734015812.970167:0:34:0:(osd_handler.c:1596:osd_oxc_free()) kfreed 'oxe': 68 at ffff8800900dd720. 00002000:00010000:0.0:1734016068.572000:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075445880 00000100:00100000:0.0:1734016068.572052:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 6972 00000100:00100000:0.0:1734016068.572063:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+15:1983:x1818247332922112:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016068.591734:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332922496 00000100:00100000:0.0:1734016068.591744:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332922496 00000100:00100000:0.0:1734016068.678680:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.687460:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.705934:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.714062:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.741890:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.753991:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.763122:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016068.767337:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27111986 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016068.767358:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27111986 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016068.767366:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27111986 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016068.767374:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc240 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016068.767379:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27111986 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016068.767387:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27111986 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016068.767410:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016068.767413:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016068.767416:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27111986 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016068.767425:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27111986 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016068.769133:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.775489:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.787400:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.798450:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.813042:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.820782:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.840199:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.847361:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.862591:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.870467:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.889988:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.898365:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.904527:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.912258:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.938476:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332928000 00000100:00100000:0.0:1734016068.938489:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332928000 00000100:00100000:0.0:1734016068.938556:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9163 00000100:00100000:0.0:1734016068.938565:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+16:9668:x1818247332928000:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016068.938586:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016068.938612:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc271119da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e2c18 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016068.938653:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc271119c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->262143) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2c03 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016068.938667:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016068.938670:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016068.938673:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc271119da lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [167936->188415] (req 167936->188415) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2c18 expref: 17 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016068.938710:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc271119c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->262143) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2c03 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016068.938726:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc271119c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->262143) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2c03 expref: 11 pid: 7682 timeout: 436 lvb_type: 0 00000100:00100000:0.0:1734016068.938740:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135e71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335038592:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016068.938857:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eea80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016068.951463:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.956952:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.964453:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.976981:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335038976:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016068.977019:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271119e8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2c1f expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016068.977037:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:0.0:1734016068.977926:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:9668:x1818247332928768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5993us (7078us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016068.977939:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9165 00000100:00100000:0.0:1734016068.978757:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.983733:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016068.995147:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.026002:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.040103:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016069.040647:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016039 00000100:00100000:0.0:1734016069.041902:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016069.043438:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968844 is committed 00000001:00080000:0.0:1734016069.043454:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968842 is committed 00000100:00100000:0.0:1734016069.049981:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.060168:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016069.060492:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016039 00000100:00100000:0.0:1734016069.076366:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.086291:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.095882:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.103026:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.107275:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.111144:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.115888:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.127493:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.136439:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.141151:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.147061:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.154345:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.163728:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.171420:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.182404:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.182466:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.191921:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.208382:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.208919:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.212845:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 6996 00000100:00100000:0.0:1734016069.212857:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247332933888:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016069.302526:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.321303:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.325703:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.338121:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.347856:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.353594:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.373264:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.391294:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.409599:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.417413:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332936320 00000100:00100000:0.0:1734016069.417426:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332936320 00000100:00100000:0.0:1734016069.417471:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1728 00000100:00100000:0.0:1734016069.417481:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007be3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:9668:x1818247332936320:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016069.417556:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016069.417597:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27111a5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2c6c expref: 21 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.417633:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016069.417637:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016069.417874:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27111a82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016069.417890:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27111a7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2c81 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.417902:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27111a82 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016069.417940:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27111a7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2c81 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.417953:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27111a7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2c81 expref: 15 pid: 6480 timeout: 436 lvb_type: 0 00000100:00100000:0.0:1734016069.417969:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e257480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335040896:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016069.418042:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016069.424218:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.430669:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332936576 00000100:00100000:0.0:1734016069.430682:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332936576 00000100:00100000:0.0:1734016069.430784:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9177 00000100:00100000:0.0:1734016069.430796:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800753cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247332936576:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016069.430847:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016069.430874:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27111a89 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e2c88 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.430918:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27111a51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2c65 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.430927:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016069.430929:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016069.430934:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27111a89 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2c88 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.430977:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27111a51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2c65 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.430990:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27111a51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2c65 expref: 7 pid: 7682 timeout: 436 lvb_type: 0 00000100:00100000:0.0:1734016069.431002:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e257480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335041024:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016069.432135:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eec00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016069.452095:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.469721:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.476260:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332937472 00000100:00100000:0.0:1734016069.476268:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332937472 00010000:00010000:0.0:1734016069.476317:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27111a89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2c88 expref: 7 pid: 7683 timeout: 436 lvb_type: 0 00000100:00100000:0.0:1734016069.476611:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2282 00000100:00100000:0.0:1734016069.476620:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247332937472:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016069.476639:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016069.476667:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27111a89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2c88 expref: 7 pid: 7683 timeout: 436 lvb_type: 0 00010000:00010000:0.0:1734016069.476679:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27111a89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2c88 expref: 7 pid: 7683 timeout: 436 lvb_type: 0 00010000:00010000:0.0:1734016069.476707:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27111a89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2c88 expref: 7 pid: 7683 timeout: 436 lvb_type: 0 00010000:00010000:0.0:1734016069.476727:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016069.476728:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016069.476747:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27111ab3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9986048->10047487) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2ca4 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.476757:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27111ab3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9986048->10047487) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2ca4 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.476793:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27111ab3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9986048->10047487) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2ca4 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016069.476826:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073946a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335041536:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016069.477564:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee780 going to sleep for 11 seconds 00000100:00100000:0.0:1734016069.482248:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332937600 00000100:00100000:0.0:1734016069.482255:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332937600 00000100:00100000:0.0:1734016069.482301:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9180 00000100:00100000:0.0:1734016069.482310:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247332937600:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016069.482576:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 5123445 -> 5123445 00002000:00010000:0.0:1734016069.482580:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016070 -> 1734016070 00002000:00010000:0.0:1734016069.482583:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016069 -> 1734016069 00002000:00010000:0.0:1734016069.482585:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016070 -> 1734016069 00002000:00010000:0.0:1734016069.482587:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 352 -> 472 00000100:00100000:0.0:1734016069.483634:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247332937600:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1323us (1852us total) trans 4294968849 rc 0/0 00000100:00100000:0.0:1734016069.483642:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9180 00000100:00100000:0.0:1734016069.487056:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332937728 00000100:00100000:0.0:1734016069.487065:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332937728 00000100:00100000:0.0:1734016069.487111:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9181 00000100:00100000:0.0:1734016069.487118:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247332937728:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016069.487141:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016069.487161:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27111aba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e2cab expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016069.487216:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073946a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335041664:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016069.487293:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee240 going to sleep for 11 seconds 00002000:00010000:0.0:1734016069.489588:0:7683:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016069 -> 1734016070 00000100:00100000:0.0:1734016069.489636:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073946a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335041664:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016069.489693:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27111aba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2cab expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016069.489716:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27111aba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2cab expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016069.489757:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:0.0:1734016069.489884:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247332937728:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2762us (2911us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016069.489898:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9181 00000100:00100000:0.0:1734016069.493436:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332937856 00000100:00100000:0.0:1734016069.493451:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332937856 00000100:00100000:0.0:1734016069.493556:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9182 00000100:00100000:0.0:1734016069.493567:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007be3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247332937856:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016069.493593:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016069.493618:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27111ac1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e2cb2 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.493653:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27111ab3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9986048->10047487) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2ca4 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.493659:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016069.493661:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016069.493664:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27111ac1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [9404416->9441279] (req 9404416->9441279) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2cb2 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.493701:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27111ab3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9986048->10047487) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2ca4 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.493713:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27111ab3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9986048->10047487) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2ca4 expref: 8 pid: 7683 timeout: 436 lvb_type: 0 00000100:00100000:0.0:1734016069.493726:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073946a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335041792:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016069.494073:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016069.506136:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78ce300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335041920:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016069.506165:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016069.506864:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007be39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247332937984:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6311us (6951us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016069.506876:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2283 00000100:00100000:0.0:1734016069.512207:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332938240 00000100:00100000:0.0:1734016069.512216:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332938240 00000100:00100000:0.0:1734016069.512271:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9184 00000100:00100000:0.0:1734016069.512277:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247332938240:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016069.512294:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016069.512313:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27111ac8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e2cb9 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016069.512376:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073946a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335042048:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016069.512460:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016069.518960:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332938368 00000100:00100000:0.0:1734016069.518969:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332938368 00000100:00100000:0.0:1734016069.519019:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9185 00000100:00100000:0.0:1734016069.519026:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247332938368:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016069.519045:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016069.519061:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27111acf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e2cc0 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016069.519113:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073946a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335042176:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016069.519189:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016069.521475:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073946a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335042176:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016069.521509:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27111acf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2cc0 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016069.521524:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27111acf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2cc0 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016069.521551:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016069.521606:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247332938368:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2578us (2717us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016069.521616:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9185 00000100:00100000:0.0:1734016069.525508:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.531964:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.537364:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.554991:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.565306:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.572016:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.580913:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.583666:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.587098:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bcc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247332940544:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 3210us (3432us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016069.587108:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9186 00000100:00100000:0.0:1734016069.603847:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.607853:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.613716:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332941440 00000100:00100000:0.0:1734016069.613724:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332941440 00000100:00100000:0.0:1734016069.614085:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9187 00000100:00100000:0.0:1734016069.614095:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247332941440:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016069.614121:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016069.614142:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27111af2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e2cce expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.614177:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27111ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9404416->9441279) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2cb2 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.614189:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016069.614191:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016069.614195:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27111af2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2cce expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.614231:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27111ac1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9404416->9441279) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2cb2 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.614245:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27111ac1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9404416->9441279) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2cb2 expref: 5 pid: 7683 timeout: 436 lvb_type: 0 00000100:00100000:0.0:1734016069.614258:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bcc1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335042560:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016069.614322:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016069.618424:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.646467:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.665975:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.676694:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.685984:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.694609:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.700495:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.705162:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.711377:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.715865:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.729248:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.737156:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.744174:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.752698:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.757933:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.764366:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016069.765272:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27111b46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016069.765281:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27111b46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:0.0:1734016069.765447:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968425 00000004:00010000:0.0:1734016069.765528:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007516c700 reply state ffff880075e35000 transno 4294968426 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27111b46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016069.765535:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016069.765629:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007516c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:9668:x1818247332944512:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 6906us (7712us total) trans 4294968426 rc 0/0 00000100:00100000:0.0:1734016069.765636:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1737 00000020:00080000:0.0:1734016069.765641:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016069.769738:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332944768 00000100:00100000:0.0:1734016069.769749:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332944768 00000100:00100000:0.0:1734016069.769798:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9197 00000100:00100000:0.0:1734016069.769826:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:9668:x1818247332944768:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016069.769847:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016069.769865:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27111b4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e2d14 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.769895:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27111b3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3604480->3633151) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2d0d expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.769902:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016069.769905:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016069.769910:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27111b4d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2d14 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.769943:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27111b3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3604480->3633151) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2d0d expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.769956:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27111b3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3604480->3633151) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2d0d expref: 8 pid: 7682 timeout: 436 lvb_type: 0 00000100:00100000:0.0:1734016069.769969:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007516ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335044096:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016069.770039:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eed80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016069.773491:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007516ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335044096:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016069.773533:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27111b4d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2d14 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016069.773551:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581680, rc 0) 00000100:00100000:0.0:1734016069.773611:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:9668:x1818247332944768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3786us (4213us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016069.773621:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9197 00000100:00100000:0.0:1734016069.779694:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247332944896:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4188us (5178us total) trans 4294968857 rc 0/0 00000100:00100000:0.0:1734016069.779708:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 264 00002000:00100000:0.0:1734016069.779719:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3604480->3633151) req@ffff880075e50000 x1818247332944896/t4294968857(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:30/0 lens 488/448 e 0 to 0 dl 1734016080 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016069.779739:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50000 with x1818247332944896 ext(3604480->3633151) 00010000:00010000:0.0:1734016069.779752:0:7689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27111b3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3604480->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2d0d expref: 11 pid: 7682 timeout: 436 lvb_type: 0 00010000:00010000:0.0:1734016069.779766:0:7689:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27111b3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3604480->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2d0d expref: 11 pid: 7682 timeout: 436 lvb_type: 0 00002000:00010000:0.0:1734016069.779774:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880075e50000 00000100:00100000:0.0:1734016069.782946:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.789066:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.792465:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.796055:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.801310:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.807778:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.815670:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.820514:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016069.821348:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27111b7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016069.821355:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27111b7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:0.0:1734016069.821444:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968427 00000004:00010000:0.0:1734016069.821489:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007516df80 reply state ffff8800749c0000 transno 4294968428 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27111b7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016069.821495:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016069.821552:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007516df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247332945920:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 5464us (5893us total) trans 4294968428 rc 0/0 00000100:00100000:0.0:1734016069.821559:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1740 00000020:00080000:0.0:1734016069.821563:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016069.824995:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.846541:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.850293:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.856914:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.877195:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.888318:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.895749:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.899112:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.902551:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.905924:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.910009:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.916048:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.923121:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.938773:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.952140:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.955480:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.959369:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.963120:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.968928:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.975146:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.980409:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.983234:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.988992:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.992708:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016069.996085:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.004657:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016070.004926:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016040 00000100:00100000:0.0:1734016070.009519:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.014511:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.031616:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.039172:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.051662:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247332953216:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 11861us (12488us total) trans 4294968860 rc 0/0 00000100:00100000:0.0:1734016070.051677:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 265 00002000:00100000:0.0:1734016070.051694:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3137536->3186687) req@ffff880074a8f100 x1818247332953216/t4294968860(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:31/0 lens 488/448 e 0 to 0 dl 1734016081 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.051704:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074a8f100 with x1818247332953216 ext(3137536->3186687) 00010000:00010000:0.0:1734016070.051718:0:13914:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27111b9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3186687) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2d45 expref: 12 pid: 7682 timeout: 437 lvb_type: 0 00010000:00010000:0.0:1734016070.051746:0:13914:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27111b9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3186687) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2d45 expref: 12 pid: 7682 timeout: 437 lvb_type: 0 00002000:00010000:0.0:1734016070.051754:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880074a8f100 00000100:00100000:0.0:1734016070.055870:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.062877:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.073639:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.089145:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.096293:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016070.096492:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016040 00000100:00100000:0.0:1734016070.104891:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016070.106674:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968861 is committed 00000001:00080000:0.0:1734016070.106687:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968860 is committed 00000100:00100000:0.0:1734016070.116028:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.122304:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.152742:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.155972:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.160890:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.182693:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.182759:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.253055:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.260570:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016070.262122:0:6480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27111bfc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016070.262130:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27111bfc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000001:00080000:0.0:1734016070.262210:0:6480:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968429 00000004:00010000:0.0:1734016070.262244:0:6480:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007bcc3480 reply state ffff88007bef8000 transno 4294968430 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27111bfc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:0.0:1734016070.262251:0:6480:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016070.262316:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bcc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+22:9668:x1818247332955904:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 8308us (9276us total) trans 4294968430 rc 0/0 00000100:00100000:0.0:1734016070.262322:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1744 00000020:00080000:0.0:1734016070.262325:0:6480:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016070.284993:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.292478:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.297852:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.303433:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.306689:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.313874:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.326564:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.336086:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.347093:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.356004:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332957952 00000100:00100000:0.0:1734016070.356014:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332957952 00000100:00100000:0.0:1734016070.356071:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9221 00000100:00100000:0.0:1734016070.356078:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b132300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247332957952:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016070.356099:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016070.356122:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27111c57 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e2dd8 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016070.356184:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800736c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335047808:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016070.356244:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016070.371505:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.382420:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.387933:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332958848 00000100:00100000:0.0:1734016070.387945:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332958848 00002000:00010000:0.0:1734016070.387984:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (1468100->18446744073709551615) 00002000:00100000:0.0:1734016070.387989:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075008700 with x1818247332958848 ext(1468100->18446744073709551615) 00002000:00010000:0.0:1734016070.388000:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075008700. 00000100:00100000:0.0:1734016070.388884:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7042 00000100:00100000:0.0:1734016070.388897:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247332958848:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016070.390408:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 4100626 -> 1468100 00002000:00010000:0.0:1734016070.390417:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016070 -> 1734016071 00002000:00010000:0.0:1734016070.390419:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016070 -> 1734016070 00002000:00010000:0.0:1734016070.390421:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016070 -> 1734016071 00002000:00010000:0.0:1734016070.390423:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 488 -> 304 00000100:00100000:0.0:1734016070.390523:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247332958848:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1622us (2795us total) trans 4294968867 rc 0/0 00000100:00100000:0.0:1734016070.390539:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7042 00002000:00010000:0.0:1734016070.390545:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (1468100->18446744073709551615) 00002000:00100000:0.0:1734016070.390549:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075008700 with x1818247332958848 ext(1468100->18446744073709551615) 00002000:00010000:0.0:1734016070.390557:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075008700. 00000100:00100000:0.0:1734016070.393387:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.401509:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.432465:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332959616 00000100:00100000:0.0:1734016070.432471:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332959616 00010000:00010000:0.0:1734016070.432495:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27111c5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4079616->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2ddf expref: 8 pid: 7682 timeout: 437 lvb_type: 0 00000100:00100000:0.0:1734016070.432514:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2300 00000100:00100000:0.0:1734016070.432518:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247332959616:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016070.432529:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016070.432546:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27111c5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4079616->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2ddf expref: 8 pid: 7682 timeout: 437 lvb_type: 0 00010000:00010000:0.0:1734016070.432555:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27111c5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4079616->4104191) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2ddf expref: 8 pid: 7682 timeout: 437 lvb_type: 0 00010000:00010000:0.0:1734016070.432578:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27111c5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4079616->4104191) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2ddf expref: 8 pid: 7682 timeout: 437 lvb_type: 0 00010000:00010000:0.0:1734016070.432594:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016070.432596:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016070.432602:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27111c8f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->995327) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e02 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016070.432610:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27111c8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->995327) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e02 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016070.432636:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27111c8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->995327) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e02 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016070.432646:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800736c9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335048832:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016070.432682:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016070.437711:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800736c9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335048832:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016070.437746:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016070.438092:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247332959616:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5571us (6034us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016070.438103:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2300 00000100:00100000:0.0:1734016070.442939:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332960128 00000100:00100000:0.0:1734016070.442955:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332960128 00002000:00100000:0.0:1734016070.443011:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (987136->991231) req@ffff880075008a80 x1818247332960128/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:31/0 lens 488/0 e 0 to 0 dl 1734016081 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.443025:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075008a80 with x1818247332960128 ext(987136->991231) 00002000:00010000:0.0:1734016070.443032:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075008a80 00000100:00100000:0.0:1734016070.443064:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7044 00000100:00100000:0.0:1734016070.443071:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247332960128:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016070.443282:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247332960128:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 209us (780us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016070.443294:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7044 00002000:00100000:0.0:1734016070.443301:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (987136->991231) req@ffff880075008a80 x1818247332960128/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:31/0 lens 488/4536 e 0 to 0 dl 1734016081 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.443308:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075008a80 with x1818247332960128 ext(987136->991231) 00002000:00010000:0.0:1734016070.443311:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075008a80 00000100:00100000:0.0:1734016070.464264:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332960768 00000100:00100000:0.0:1734016070.464276:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332960768 00000100:00100000:0.0:1734016070.464446:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9229 00000100:00100000:0.0:1734016070.464455:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:9668:x1818247332960768:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016070.464473:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016070.464489:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27111cab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e2e17 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016070.464522:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27111c8f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 991232->995327) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e02 expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016070.464529:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27111ca4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e10 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016070.464535:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016070.464537:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016070.464540:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27111cab lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [151552->208895] (req 151552->208895) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e17 expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016070.464571:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27111ca4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e10 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016070.464588:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27111ca4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e10 expref: 7 pid: 7682 timeout: 437 lvb_type: 1 00000100:00100000:0.0:1734016070.464601:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800736c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335048960:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016070.464965:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27111c8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 991232->995327) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e02 expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016070.464974:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27111c8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 991232->995327) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e02 expref: 12 pid: 7682 timeout: 437 lvb_type: 0 00000100:00100000:0.0:1734016070.464984:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800736c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335049088:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016070.465609:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1734016070.471192:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27111ca4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e10 expref: 7 pid: 7682 timeout: 437 lvb_type: 1 00000100:00100000:0.0:1734016070.471221:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800736c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335048960:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016070.471233:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27111c8f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 991232->995327) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e02 expref: 13 pid: 7682 timeout: 437 lvb_type: 0 00000100:00100000:0.0:1734016070.471240:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800736c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335049088:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016070.471262:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27111cab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->208895) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e17 expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016070.471276:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:0.0:1734016070.471312:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:9668:x1818247332960768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6859us (7302us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016070.471320:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9229 00000100:00100000:0.0:1734016070.474915:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335049216:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016070.474947:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016070.475018:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075009880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247332961024:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4677us (5152us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016070.475034:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2302 00000100:00100000:0.0:1734016070.475709:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.486996:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.513078:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.523303:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332962176 00000100:00100000:0.0:1734016070.523318:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332962176 00002000:00100000:0.0:1734016070.523385:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9080832->9105248) req@ffff88007500aa00 x1818247332962176/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:31/0 lens 488/0 e 0 to 0 dl 1734016081 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.523396:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007500aa00 with x1818247332962176 ext(9080832->9105248) 00010000:00010000:0.0:1734016070.523408:0:13914:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27111cab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e17 expref: 12 pid: 7682 timeout: 437 lvb_type: 0 00010000:00010000:0.0:1734016070.523425:0:13914:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27111cab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e17 expref: 12 pid: 7682 timeout: 437 lvb_type: 0 00002000:00010000:0.0:1734016070.523433:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007500aa00 00000100:00100000:0.0:1734016070.523474:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 266 00000100:00100000:0.0:1734016070.523484:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007500aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247332962176:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016070.527541:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007500aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247332962176:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4041us (4310us total) trans 4294968869 rc 0/0 00000100:00100000:0.0:1734016070.527555:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 266 00002000:00100000:0.0:1734016070.527567:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9080832->9105248) req@ffff88007500aa00 x1818247332962176/t4294968869(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:31/0 lens 488/448 e 0 to 0 dl 1734016081 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.527578:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007500aa00 with x1818247332962176 ext(9080832->9105248) 00010000:00010000:0.0:1734016070.527593:0:13914:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27111cab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e17 expref: 14 pid: 7682 timeout: 437 lvb_type: 0 00010000:00010000:0.0:1734016070.527612:0:13914:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27111cab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e17 expref: 14 pid: 7682 timeout: 437 lvb_type: 0 00002000:00010000:0.0:1734016070.527620:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007500aa00 00000100:00100000:0.0:1734016070.531532:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332962304 00000100:00100000:0.0:1734016070.531545:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332962304 00010000:00010000:0.0:1734016070.531585:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27111cab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e17 expref: 14 pid: 7682 timeout: 437 lvb_type: 0 00000100:00100000:0.0:1734016070.531620:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2303 00000100:00100000:0.0:1734016070.531625:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247332962304:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016070.531643:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1734016070.531670:0:6466:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 304 -> 352 00010000:00010000:0.0:1734016070.531677:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27111cab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 151552->208895) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e17 expref: 14 pid: 7682 timeout: 437 lvb_type: 0 00010000:00010000:0.0:1734016070.531697:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27111cab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 151552->208895) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e17 expref: 14 pid: 7682 timeout: 437 lvb_type: 0 00010000:00010000:0.0:1734016070.531731:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27111cab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 151552->208895) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e17 expref: 14 pid: 7682 timeout: 437 lvb_type: 0 00010000:00010000:0.0:1734016070.531765:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016070.531766:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016070.531773:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27111cce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4284416->4296703) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e3a expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016070.531782:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27111cce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4284416->4296703) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e3a expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016070.531866:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27111cce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4284416->4296703) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2e3a expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016070.531882:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800736ca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335049984:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016070.531941:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016070.536551:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800736ca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335049984:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016070.536582:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016070.536638:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247332962304:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5009us (5265us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016070.536655:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2303 00000100:00100000:0.0:1734016070.545990:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332962688 00000100:00100000:0.0:1734016070.546000:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332962688 00002000:00100000:0.0:1734016070.546052:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6287360->9105407) req@ffff88007500b100 x1818247332962688/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:31/0 lens 488/0 e 0 to 0 dl 1734016081 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.546063:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007500b100 with x1818247332962688 ext(6287360->9105407) 00002000:00010000:0.0:1734016070.546068:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007500b100 00000100:00100000:0.0:1734016070.546106:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7047 00000100:00100000:0.0:1734016070.546113:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007500b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247332962688:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016070.582581:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007500b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247332962688:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 36454us (36718us total) trans 0 rc 2818048/2818048 00000100:00100000:0.0:1734016070.582594:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7047 00002000:00100000:0.0:1734016070.582610:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6287360->9105407) req@ffff88007500b100 x1818247332962688/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:31/0 lens 488/440 e 0 to 0 dl 1734016081 ref 1 fl Complete:/200/0 rc 2818048/2818048 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.582620:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007500b100 with x1818247332962688 ext(6287360->9105407) 00002000:00010000:0.0:1734016070.582627:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007500b100 00000100:00100000:0.0:1734016070.623666:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332963328 00000100:00100000:0.0:1734016070.623678:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332963328 00002000:00100000:0.0:1734016070.623742:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2715648->2719743) req@ffff880075009500 x1818247332963328/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:31/0 lens 488/0 e 0 to 0 dl 1734016081 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.623751:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075009500 with x1818247332963328 ext(2715648->2719743) 00002000:00010000:0.0:1734016070.623758:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075009500 00000100:00100000:0.0:1734016070.623796:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7048 00000100:00100000:0.0:1734016070.623838:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247332963328:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016070.624048:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247332963328:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 211us (488us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016070.624060:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7048 00002000:00100000:0.0:1734016070.624068:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2715648->2719743) req@ffff880075009500 x1818247332963328/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:31/0 lens 488/4536 e 0 to 0 dl 1734016081 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.624075:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075009500 with x1818247332963328 ext(2715648->2719743) 00002000:00010000:0.0:1734016070.624078:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075009500 00000100:00100000:0.0:1734016070.641039:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332963840 00000100:00100000:0.0:1734016070.641051:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332963840 00002000:00100000:0.0:1734016070.641104:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2707456->2711551) req@ffff880075155500 x1818247332963840/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:31/0 lens 488/0 e 0 to 0 dl 1734016081 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.641114:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075155500 with x1818247332963840 ext(2707456->2711551) 00002000:00010000:0.0:1734016070.641120:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075155500 00000100:00100000:0.0:1734016070.641307:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7050 00000100:00100000:0.0:1734016070.641315:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247332963840:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016070.641707:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247332963840:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 391us (1652us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016070.641713:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7050 00002000:00100000:0.0:1734016070.641727:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2707456->2711551) req@ffff880075155500 x1818247332963840/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:31/0 lens 488/4536 e 0 to 0 dl 1734016081 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.641734:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075155500 with x1818247332963840 ext(2707456->2711551) 00002000:00010000:0.0:1734016070.641738:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075155500 00000100:00100000:0.0:1734016070.649772:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332964096 00000100:00100000:0.0:1734016070.649784:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332964096 00002000:00100000:0.0:1734016070.649990:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2703360->2707455) req@ffff88007516ca80 x1818247332964096/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:31/0 lens 488/0 e 0 to 0 dl 1734016081 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.650007:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007516ca80 with x1818247332964096 ext(2703360->2707455) 00002000:00010000:0.0:1734016070.650013:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007516ca80 00000100:00100000:0.0:1734016070.650302:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7051 00000100:00100000:0.0:1734016070.650308:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007516ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247332964096:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016070.650512:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007516ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247332964096:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 202us (1926us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016070.650519:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7051 00002000:00100000:0.0:1734016070.650526:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2703360->2707455) req@ffff88007516ca80 x1818247332964096/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:31/0 lens 488/4536 e 0 to 0 dl 1734016081 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.650533:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007516ca80 with x1818247332964096 ext(2703360->2707455) 00002000:00010000:0.0:1734016070.650536:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007516ca80 00000100:00100000:0.0:1734016070.677596:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332965120 00000100:00100000:0.0:1734016070.677604:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332965120 00002000:00100000:0.0:1734016070.677643:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2686976->2691071) req@ffff8800a78cea00 x1818247332965120/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:31/0 lens 488/0 e 0 to 0 dl 1734016081 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.677652:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cea00 with x1818247332965120 ext(2686976->2691071) 00002000:00010000:0.0:1734016070.677657:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cea00 00000100:00100000:0.0:1734016070.677689:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7055 00000100:00100000:0.0:1734016070.677694:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247332965120:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016070.677889:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247332965120:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 193us (376us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016070.677896:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7055 00002000:00100000:0.0:1734016070.677901:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2686976->2691071) req@ffff8800a78cea00 x1818247332965120/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:31/0 lens 488/4536 e 0 to 0 dl 1734016081 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.677909:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cea00 with x1818247332965120 ext(2686976->2691071) 00002000:00010000:0.0:1734016070.677911:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cea00 00000100:00100000:0.0:1734016070.683889:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.689665:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800736c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1983:x1818247332965504:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 5484us (5764us total) trans 4294968872 rc 0/0 00000100:00100000:0.0:1734016070.689684:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7057 00002000:00100000:0.0:1734016070.689699:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2682880->2719743) req@ffff8800736c8e00 x1818247332965504/t4294968872(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:31/0 lens 488/448 e 0 to 0 dl 1734016081 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.689708:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800736c8e00 with x1818247332965504 ext(2682880->2719743) 00002000:00010000:0.0:1734016070.689726:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800736c8e00 00000100:00100000:0.0:1734016070.695201:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.701116:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016070.705517:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968872 is committed 00000001:00080000:0.0:1734016070.705546:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968869 is committed 00000100:00100000:0.0:1734016070.708792:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.731679:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.738703:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.746706:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.751621:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.757132:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.768131:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.776194:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.788347:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.794391:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332967296 00000100:00100000:0.0:1734016070.794405:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332967296 00002000:00100000:0.0:1734016070.794464:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6246400->6250495) req@ffff880075e51f80 x1818247332967296/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:31/0 lens 488/0 e 0 to 0 dl 1734016081 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.794476:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e51f80 with x1818247332967296 ext(6246400->6250495) 00002000:00010000:0.0:1734016070.794482:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e51f80 00000100:00100000:0.0:1734016070.794851:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7058 00000100:00100000:0.0:1734016070.794861:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247332967296:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016070.795099:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247332967296:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 240us (817us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016070.795106:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7058 00002000:00100000:0.0:1734016070.795111:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6246400->6250495) req@ffff880075e51f80 x1818247332967296/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:31/0 lens 488/4536 e 0 to 0 dl 1734016081 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.795117:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e51f80 with x1818247332967296 ext(6246400->6250495) 00002000:00010000:0.0:1734016070.795120:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e51f80 00000100:00100000:0.0:1734016070.798053:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.802932:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.812754:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.817264:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800736c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247332967936:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4206us (4497us total) trans 4294968875 rc 0/0 00000100:00100000:0.0:1734016070.817285:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7061 00002000:00100000:0.0:1734016070.817305:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6230016->9291345) req@ffff8800736c9c00 x1818247332967936/t4294968875(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:31/0 lens 504/448 e 0 to 0 dl 1734016081 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.817316:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800736c9c00 with x1818247332967936 ext(6230016->9291345) 00002000:00010000:0.0:1734016070.817325:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800736c9c00 00000100:00100000:0.0:1734016070.821017:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.825636:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016070.828852:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968875 is committed 00000001:00080000:0.0:1734016070.828875:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968874 is committed 00000100:00100000:0.0:1734016070.838135:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.838175:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332968448 00000100:00100000:0.0:1734016070.838184:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332968448 00002000:00100000:0.0:1734016070.838239:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5566464->5631999) req@ffff8800736ca680 x1818247332968448/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:31/0 lens 488/0 e 0 to 0 dl 1734016081 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.838249:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800736ca680 with x1818247332968448 ext(5566464->5631999) 00002000:00010000:0.0:1734016070.838256:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800736ca680 00000100:00100000:0.0:1734016070.838280:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7062 00000100:00100000:0.0:1734016070.838286:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800736ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247332968448:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016070.851681:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.865179:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.868233:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800736cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247332968832:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 2818us (3055us total) trans 4294968876 rc 0/0 00000100:00100000:0.0:1734016070.868248:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7064 00002000:00100000:0.0:1734016070.868260:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5545984->5599231) req@ffff8800736cad80 x1818247332968832/t4294968876(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:31/0 lens 488/448 e 0 to 0 dl 1734016081 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.868269:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800736cad80 with x1818247332968832 ext(5545984->5599231) 00002000:00010000:0.0:1734016070.868273:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800736cad80 00000100:00100000:0.0:1734016070.878517:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016070.880106:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968876 is committed 00000100:00100000:0.0:1734016070.882926:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.893141:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.901160:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.906938:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.922909:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.929239:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.956038:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.961974:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.962039:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016070.962080:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332970368 00000100:00100000:0.0:1734016070.962093:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332970368 00002000:00100000:0.0:1734016070.962154:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (8388608->9293823) req@ffff88007bfa8000 x1818247332970368/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:31/0 lens 488/0 e 0 to 0 dl 1734016081 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.962164:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bfa8000 with x1818247332970368 ext(8388608->9293823) 00002000:00010000:0.0:1734016070.962170:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bfa8000 00000100:00100000:0.0:1734016070.962207:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332970240 00000100:00100000:0.0:1734016070.962211:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332970240 00002000:00100000:0.0:1734016070.962223:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8388607) req@ffff88007bfa8380 x1818247332970240/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:31/0 lens 504/0 e 0 to 0 dl 1734016081 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016070.962231:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bfa8380 with x1818247332970240 ext(4190208->8388607) 00002000:00010000:0.0:1734016070.962234:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bfa8380 00000100:00100000:0.0:1734016070.962249:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7066 00000100:00100000:0.0:1734016070.962256:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bfa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247332970368:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016070.964350:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7067 00000100:00100000:0.0:1734016070.964363:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bfa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247332970240:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016071.002537:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.006864:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.008026:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016071.008261:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016041 00000100:00100000:0.0:1734016071.008319:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332970880 00000100:00100000:0.0:1734016071.008323:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332970880 00000100:00100000:0.0:1734016071.008351:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 190 00000100:00100000:0.0:1734016071.008356:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bfa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+29:1982:x1818247332970880:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1734016071.008384:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bfa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+29:1982:x1818247332970880:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 27us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016071.008390:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 190 00000100:00080000:0.0:1734016071.008404:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016041 00000100:00080000:0.0:1734016071.008406:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016041 00000100:00100000:0.0:1734016071.055862:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016071.056860:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016041 00000100:00100000:0.0:1734016071.059074:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.072662:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.075203:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335052160:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016071.075244:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27111d3e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4128768->4157439] (req 4128768->4157439) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2eaa expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016071.075263:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:0.0:1734016071.075596:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.078753:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.085073:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.090049:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.102289:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.107165:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.119178:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.125088:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.130354:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.133930:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.141922:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.146553:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.149531:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247332973184:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 2519us (2969us total) trans 4294968878 rc 0/0 00000100:00100000:0.0:1734016071.149545:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 268 00002000:00100000:0.0:1734016071.149557:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7880704->7901183) req@ffff88012cdb8000 x1818247332973184/t4294968878(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:32/0 lens 488/448 e 0 to 0 dl 1734016082 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016071.149566:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdb8000 with x1818247332973184 ext(7880704->7901183) 00010000:00010000:0.0:1734016071.149577:0:7689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27111d61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7880704->7901183) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2ecd expref: 9 pid: 7683 timeout: 438 lvb_type: 0 00010000:00010000:0.0:1734016071.149596:0:7689:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27111d61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7880704->7901183) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2ecd expref: 9 pid: 7683 timeout: 438 lvb_type: 0 00002000:00010000:0.0:1734016071.149603:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cdb8000 00000100:00100000:0.0:1734016071.151490:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.155570:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.161277:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.165043:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.168762:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.174662:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.178948:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.185568:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.189576:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.193502:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.198001:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.201404:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.205934:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.209987:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.213282:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.215938:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247332976768:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 2456us (2656us total) trans 4294968879 rc 0/0 00000100:00100000:0.0:1734016071.215950:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7083 00002000:00100000:0.0:1734016071.215960:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1024000->1077247) req@ffff88012cdbb480 x1818247332976768/t4294968879(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:32/0 lens 488/448 e 0 to 0 dl 1734016082 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016071.215969:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdbb480 with x1818247332976768 ext(1024000->1077247) 00002000:00010000:0.0:1734016071.215974:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdbb480 00000100:00100000:0.0:1734016071.218382:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.228754:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.234179:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.238127:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.243397:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.246946:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.252539:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.275768:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.282161:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.286690:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.296230:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.305963:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.309194:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.314276:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.321330:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.326961:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.331326:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.337159:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.340257:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.349541:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.352231:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.354983:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.360949:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.365862:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.371163:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.375536:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.378616:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.382906:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.385598:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.388092:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.391102:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.393352:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.396559:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.399101:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.402073:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.405620:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.408286:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.410999:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.414498:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.418684:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.424515:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.428376:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.432761:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332986624 00000100:00100000:0.0:1734016071.432772:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332986624 00000100:00100000:0.0:1734016071.432849:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1757 00000100:00100000:0.0:1734016071.432857:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+29:9668:x1818247332986624:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016071.432930:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016071.432962:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27111d8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2ee9 expref: 29 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016071.432996:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016071.433002:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016071.433210:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27111dc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016071.433228:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27111db5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2f0c expref: 25 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016071.433236:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27111dc3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016071.433275:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27111db5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2f0c expref: 25 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016071.433289:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27111db5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2f0c expref: 25 pid: 6480 timeout: 438 lvb_type: 0 00000100:00100000:0.0:1734016071.433304:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335054720:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016071.433384:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016071.437018:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335054720:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016071.437046:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27111dc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016071.442502:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.457405:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.462178:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.578399:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.601253:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332988928 00000100:00100000:0.0:1734016071.601263:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332988928 00000100:00100000:0.0:1734016071.601312:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9279 00000100:00100000:0.0:1734016071.601320:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247332988928:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016071.601337:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016071.601355:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27111e09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e2f4b expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016071.601387:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27111dca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2f1a expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016071.601394:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016071.601396:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016071.601399:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27111e09 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4866048->4907007] (req 4866048->4907007) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2f4b expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016071.601432:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27111dca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2f1a expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016071.601443:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27111dca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2f1a expref: 7 pid: 7682 timeout: 438 lvb_type: 0 00000100:00100000:0.0:1734016071.601455:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335055744:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016071.601526:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016071.605199:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335055744:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016071.605240:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27111e09 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4866048->4907007] (req 4866048->4907007) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2f4b expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016071.605256:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:0.0:1734016071.605308:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247332988928:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3989us (4698us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016071.605317:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9279 00000100:00100000:0.0:1734016071.625363:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e53480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335055872:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016071.625392:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016071.625454:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247332989056:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7364us (8224us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016071.625467:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2316 00000100:00100000:0.0:1734016071.630483:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247332989440 00000100:00100000:0.0:1734016071.630494:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247332989440 00000100:00100000:0.0:1734016071.630552:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9280 00000100:00100000:0.0:1734016071.630559:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247332989440:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016071.630585:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016071.630601:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27111e10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e2f52 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016071.630660:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335056000:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016071.630740:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016071.645510:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.655205:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.664135:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.667502:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.672157:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.703576:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.712430:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.713648:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.716637:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7122 00000100:00100000:0.0:1734016071.716656:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073942a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1984:x1818247332991104:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016071.796631:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.812234:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.816012:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.820476:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.832248:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.845041:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.859938:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.869764:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.877706:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.884969:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.889512:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.896611:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1982:x1818247332993024:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 6522us (7101us total) trans 4294968889 rc 0/0 00000100:00100000:0.0:1734016071.896624:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 270 00002000:00100000:0.0:1734016071.896635:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (10002432->10051167) req@ffff88007bd3fb80 x1818247332993024/t4294968889(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:32/0 lens 488/448 e 0 to 0 dl 1734016082 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016071.896644:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3fb80 with x1818247332993024 ext(10002432->10051167) 00010000:00010000:0.0:1734016071.896655:0:7689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27111e1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4276224->4333567) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2f60 expref: 14 pid: 7682 timeout: 439 lvb_type: 0 00010000:00010000:0.0:1734016071.896670:0:7689:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27111e1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4276224->4333567) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2f60 expref: 14 pid: 7682 timeout: 439 lvb_type: 0 00002000:00010000:0.0:1734016071.896677:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007bd3fb80 00000100:00100000:0.0:1734016071.912703:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.916140:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.919961:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.923780:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.929609:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.936224:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.944062:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.948750:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.952079:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247332994560:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2609us (3331us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016071.952091:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9300 00000100:00100000:0.0:1734016071.955407:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.962139:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.976867:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.982743:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.989974:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016071.994583:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016072.003821:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016042 00000100:00100000:0.0:1734016072.018999:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.023781:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.030756:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.037854:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.041555:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.052859:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3506:1818247335059712:0@lo:400:kworker.0 00000100:00100000:0.0:1734016072.052913:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016072.052939:0:3506:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1734016072.052943:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3506:1818247335059584:0@lo:400:kworker.0 00000100:00100000:0.0:1734016072.052962:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016072.052971:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335060096:0@lo:400:kworker.0 00000100:00100000:0.0:1734016072.052997:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016072.053016:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335059840:0@lo:400:kworker.0 00000100:00100000:0.0:1734016072.053033:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016072.053045:0:3503:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1734016072.053050:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3503:1818247335059968:0@lo:400:kworker.0 00000100:00100000:0.0:1734016072.053064:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016072.053608:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3506:1818247335059584:0@lo:400:kworker.0 00000100:00100000:0.0:1734016072.053617:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335060096:0@lo:400:kworker.0 00000100:00100000:0.0:1734016072.053624:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3506:1818247335059712:0@lo:400:kworker.0 00000100:00100000:0.0:1734016072.053648:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3503:1818247335059968:0@lo:400:kworker.0 00000100:00100000:0.0:1734016072.053655:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335059840:0@lo:400:kworker.0 00000100:00100000:0.0:1734016072.058636:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.128230:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.142276:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.160443:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.169078:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.181452:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.194117:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.204075:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.210374:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.240714:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.240774:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.301902:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.307516:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335060864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1734016072.307566:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016072.308390:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335060864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1734016072.309172:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.311314:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016072.312953:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968894 is committed 00000001:00080000:0.0:1734016072.312983:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968892 is committed 00000100:00100000:0.0:1734016072.321404:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.328250:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.374422:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.394084:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.400959:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016072.402816:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27111f0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016072.402822:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27111f0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:0.0:1734016072.402903:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968443 00000004:00010000:0.0:1734016072.402952:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012b15df80 reply state ffff880075e31000 transno 4294968444 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27111f0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016072.402963:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016072.441365:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.481641:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.499790:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.526098:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.559448:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.559503:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.666839:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.701779:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7139 00000100:00100000:0.0:1734016072.701793:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333002112:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016072.792998:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.801296:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.820578:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.850506:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.850564:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.859040:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.865137:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.903782:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.903864:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.903913:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.903956:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333003520 00000100:00100000:0.0:1734016072.903966:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333003520 00002000:00100000:0.0:1734016072.904008:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->7909375) req@ffff8800a78cf800 x1818247333003520/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:33/0 lens 504/0 e 0 to 0 dl 1734016083 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016072.904018:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cf800 with x1818247333003520 ext(0->7909375) 00002000:00010000:0.0:1734016072.904023:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cf800 00000100:00100000:0.0:1734016072.904049:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333003776 00000100:00100000:0.0:1734016072.904052:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333003776 00002000:00100000:0.0:1734016072.904062:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8388607) req@ffff8800a78cd500 x1818247333003776/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:33/0 lens 504/0 e 0 to 0 dl 1734016083 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016072.904069:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cd500 with x1818247333003776 ext(4190208->8388607) 00002000:00010000:0.0:1734016072.904072:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cd500 00000100:00100000:0.0:1734016072.905344:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7143 00000100:00100000:0.0:1734016072.905350:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333004032:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016072.977473:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.982456:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016072.996471:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.005488:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.019106:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.028503:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.065644:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.071185:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.077345:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00002000:00010000:0.0:1734016073.080458:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016072 -> 1734016073 00000100:00100000:0.0:1734016073.080490:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335063168:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016073.080527:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27111f91 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e307f expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016073.080541:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27111f91 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e307f expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016073.081734:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:0.0:1734016073.081939:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333005312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4278us (4601us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016073.081948:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9325 00000100:00100000:0.0:1734016073.085933:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.091494:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.096052:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.102055:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.108868:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016073.109637:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016043 00000100:00100000:0.0:1734016073.114379:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.118404:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.122453:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.131087:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.135939:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.143638:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.147171:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.150860:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016073.151394:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27111fc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016073.151400:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27111fc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:0.0:1734016073.151479:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968449 00000004:00010000:0.0:1734016073.151516:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800750d0700 reply state ffff8800753a6000 transno 4294968450 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27111fc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016073.151522:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016073.151578:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+30:9668:x1818247333007232:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 4200us (4416us total) trans 4294968450 rc 0/0 00000100:00100000:0.0:1734016073.151587:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1776 00000020:00080000:0.0:1734016073.151591:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016073.165652:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.172931:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.178843:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.183411:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.187164:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.195033:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.209347:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.219981:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.230101:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.236694:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.246947:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.278771:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.304427:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.313369:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.333182:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.341183:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.343396:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.353409:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.361864:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.370075:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.377319:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.393892:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.393962:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.543710:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.574875:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.588560:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.605457:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.618046:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.640411:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.652263:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.663044:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335067136:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016073.663097:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711207f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3135 expref: 14 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016073.663115:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711207f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3135 expref: 14 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016073.663153:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:0.0:1734016073.663225:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333012480:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9458us (10973us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016073.663236:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9348 00000100:00100000:0.0:1734016073.667865:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.678311:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.791136:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.804451:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.813863:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.826458:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.835885:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.851170:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.855135:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.858886:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.869553:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.879346:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.884109:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.910748:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.910856:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.994770:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016073.999309:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.006615:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016074.006926:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016044 00000100:00100000:0.0:1734016074.014864:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.031384:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.038955:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.043842:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.051724:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.055985:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.059581:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.064178:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.070074:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.073935:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.077743:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.092480:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016074.095283:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016044 00000100:00100000:0.0:1734016074.099148:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016074.101981:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968908 is committed 00000001:00080000:0.0:1734016074.101995:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968907 is committed 00000100:00100000:0.0:1734016074.111695:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.123434:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.129699:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.142358:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.150704:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.155257:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.160359:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.164994:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.168914:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.172623:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.178643:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.178715:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.184552:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.188753:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.196585:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.204011:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.211323:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.234866:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.234940:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.304875:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.307922:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.316305:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.328696:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.347888:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.356566:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.367002:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.371206:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.386124:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.391990:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.400336:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.404550:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.412909:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.420248:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.430349:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.445994:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.450610:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.457479:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.472538:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.487976:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.569026:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.569622:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.700850:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 274 00000100:00100000:0.0:1734016074.700870:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333028352:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016074.707688:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333028352:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 6814us (13225us total) trans 4294968912 rc 0/0 00000100:00100000:0.0:1734016074.707701:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 274 00002000:00100000:0.0:1734016074.707717:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7221248->7241727) req@ffff880073b9ce00 x1818247333028352/t4294968912(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:35/0 lens 488/448 e 0 to 0 dl 1734016085 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016074.707727:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9ce00 with x1818247333028352 ext(7221248->7241727) 00010000:00010000:0.0:1734016074.707742:0:13914:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27112127 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7221248->7241727) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e31dd expref: 9 pid: 7683 timeout: 441 lvb_type: 0 00010000:00010000:0.0:1734016074.707759:0:13914:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27112127 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7221248->7241727) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e31dd expref: 9 pid: 7683 timeout: 441 lvb_type: 0 00002000:00010000:0.0:1734016074.707796:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880073b9ce00 00000100:00100000:0.0:1734016074.743974:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.750472:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.758684:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.764178:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333028992:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 5078us (5485us total) trans 4294968913 rc 0/0 00000100:00100000:0.0:1734016074.764195:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 275 00002000:00100000:0.0:1734016074.764213:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3723264->3776511) req@ffff880075fc7100 x1818247333028992/t4294968913(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:35/0 lens 488/448 e 0 to 0 dl 1734016085 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016074.764224:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7100 with x1818247333028992 ext(3723264->3776511) 00010000:00010000:0.0:1734016074.764236:0:7689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711213c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->3776511) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e31f2 expref: 10 pid: 7683 timeout: 441 lvb_type: 0 00010000:00010000:0.0:1734016074.764254:0:7689:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711213c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->3776511) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e31f2 expref: 10 pid: 7683 timeout: 441 lvb_type: 0 00002000:00010000:0.0:1734016074.764262:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880075fc7100 00000100:00100000:0.0:1734016074.775973:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.832253:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.838667:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.838733:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.838774:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333029632 00000100:00100000:0.0:1734016074.838789:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333029632 00002000:00100000:0.0:1734016074.838892:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (4194304->8388607) req@ffff880075fc7b80 x1818247333029632/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:35/0 lens 488/0 e 0 to 0 dl 1734016085 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016074.838906:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7b80 with x1818247333029632 ext(4194304->8388607) 00002000:00010000:0.0:1734016074.838915:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc7b80 00000100:00100000:0.0:1734016074.840091:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7192 00000100:00100000:0.0:1734016074.840103:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333029632:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016074.935348:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.940928:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.948775:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.969516:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.976444:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.976506:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333030656 00000100:00100000:0.0:1734016074.976518:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333030656 00002000:00100000:0.0:1734016074.976578:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3248128->3252223) req@ffff880075fc5f80 x1818247333030656/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:35/0 lens 488/0 e 0 to 0 dl 1734016085 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016074.976591:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc5f80 with x1818247333030656 ext(3248128->3252223) 00002000:00010000:0.0:1734016074.976597:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc5f80 00000100:00100000:0.0:1734016074.976628:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7194 00000100:00100000:0.0:1734016074.976638:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333030656:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016074.976876:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333030656:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 239us (446us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016074.976885:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7194 00002000:00100000:0.0:1734016074.976892:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3248128->3252223) req@ffff880075fc5f80 x1818247333030656/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:35/0 lens 488/4536 e 0 to 0 dl 1734016085 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016074.976899:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc5f80 with x1818247333030656 ext(3248128->3252223) 00002000:00010000:0.0:1734016074.976902:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc5f80 00000100:00100000:0.0:1734016074.982030:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016074.992506:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.007008:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.011964:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016075.014101:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016045 00000100:00100000:0.0:1734016075.016242:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016075.017631:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016045 00000100:00100000:0.0:1734016075.021915:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.031592:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.036167:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.042605:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.053299:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.057313:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.066572:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.077907:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.081252:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.085308:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.095714:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.110307:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.115363:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.124331:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.133448:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.142903:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.146329:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.152934:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.160941:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.185086:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.199267:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.204943:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.208993:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.211772:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.223200:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.253183:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.256495:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016075.259450:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968917 is committed 00000001:00080000:0.0:1734016075.259498:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968916 is committed 00000100:00100000:0.0:1734016075.262950:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.272114:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.294455:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.300915:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.316101:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.320441:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.325225:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.329374:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.335112:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.340184:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.346230:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.351370:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.357617:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.362740:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.370316:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.375974:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.380947:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.385309:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.408569:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.414881:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.435855:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.440968:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.453075:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.481309:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.491366:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016075.493079:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968920 is committed 00000001:00080000:0.0:1734016075.493094:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968919 is committed 00000100:00100000:0.0:1734016075.506156:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.519116:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.534967:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333043072 00000100:00100000:0.0:1734016075.534983:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333043072 00000100:00100000:0.0:1734016075.541430:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.578238:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333043584 00000100:00100000:0.0:1734016075.578252:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333043584 00002000:00100000:0.0:1734016075.578319:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (4194304->7471103) req@ffff8800752a5880 x1818247333043584/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:36/0 lens 488/0 e 0 to 0 dl 1734016086 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016075.578331:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800752a5880 with x1818247333043584 ext(4194304->7471103) 00002000:00010000:0.0:1734016075.578340:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800752a5880 00000100:00100000:0.0:1734016075.578383:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7224 00000100:00100000:0.0:1734016075.578391:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333043584:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016075.628383:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333043584:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 49976us (50240us total) trans 0 rc 3276800/3276800 00000100:00100000:0.0:1734016075.628399:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7224 00002000:00100000:0.0:1734016075.628414:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (4194304->7471103) req@ffff8800752a5880 x1818247333043584/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:36/0 lens 488/440 e 0 to 0 dl 1734016086 ref 1 fl Complete:/200/0 rc 3276800/3276800 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016075.628425:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800752a5880 with x1818247333043584 ext(4194304->7471103) 00002000:00010000:0.0:1734016075.628432:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800752a5880 00000100:00100000:0.0:1734016075.652588:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.670472:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.670524:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.670548:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333044224 00000100:00100000:0.0:1734016075.670552:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333044224 00010000:00010000:0.0:1734016075.670968:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711224d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 786432->831487) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e32bd expref: 8 pid: 7682 timeout: 442 lvb_type: 0 00000100:00100000:0.0:1734016075.687926:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333044352 00000100:00100000:0.0:1734016075.687944:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333044352 00000100:00100000:0.0:1734016075.716676:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333044992 00000100:00100000:0.0:1734016075.716688:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333044992 00000100:00100000:0.0:1734016075.716854:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1791 00000100:00100000:0.0:1734016075.717564:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333044992:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016075.717661:0:7704:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016075.717699:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271121d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3262 expref: 14 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016075.717746:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016075.717752:0:7704:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016075.718030:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27112270 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016075.718046:0:7704:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271121b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3246 expref: 18 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016075.718055:0:7704:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27112270 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016075.718097:0:7704:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271121b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3246 expref: 18 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016075.718114:0:7704:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271121b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3246 expref: 18 pid: 13956 timeout: 442 lvb_type: 0 00000100:00100000:0.0:1734016075.718133:0:7704:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074939180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335077120:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016075.718229:0:7704:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016075.722277:0:7704:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074939180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335077120:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016075.722318:0:7704:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27112270 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016075.723945:0:7704:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27112270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016075.723956:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27112270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:0.0:1734016075.724088:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968460 00000004:00010000:0.0:1734016075.724146:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800752a6300 reply state ffff88012d858000 transno 4294968461 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27112270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016075.724154:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016075.725124:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333044992:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 8257us (8832us total) trans 4294968461 rc 0/0 00000100:00100000:0.0:1734016075.725133:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1791 00000020:00080000:0.0:1734016075.725139:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1734016075.730922:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27112270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016075.730939:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27112270 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016075.730949:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27112270 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016075.730961:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a75818c0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016075.730966:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27112270 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016075.730975:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27112270 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016075.730999:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016075.731002:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016075.731007:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27112270 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016075.731013:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27112270 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016075.734215:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333045376 00000100:00100000:0.0:1734016075.734227:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333045376 00000100:00100000:0.0:1734016075.734623:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1792 00000100:00100000:0.0:1734016075.734642:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:9668:x1818247333045376:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016075.734683:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016075.734710:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27112277 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e32e0 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016075.734901:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc2711227e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016075.734922:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc2711227e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016075.734937:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc2711227e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:0.0:1734016075.734977:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 6373451 00000004:00200000:0.0:1734016075.734983:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016075.735006:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc2711227e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016075.735034:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27112277 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e32e0 expref: 17 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016075.735055:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc2711227e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e32e0 expref: 16 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016075.735065:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016075.735069:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016075.735073:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581b00, rc 0) 00000100:00100000:0.0:1734016075.735139:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333045376:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 497us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016075.735146:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1792 00000100:00100000:0.0:1734016075.755481:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.775319:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.781038:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.789210:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.800141:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.811690:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.821297:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.826266:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.833774:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.840255:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.843474:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.848418:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.853724:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.859248:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.859298:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.864677:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.875263:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333049344 00000100:00100000:0.0:1734016075.875279:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333049344 00000100:00100000:0.0:1734016075.875344:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1797 00000100:00100000:0.0:1734016075.875354:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:9668:x1818247333049344:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016075.875379:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016075.875402:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc271122cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3311 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016075.875528:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc271122d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016075.875547:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc271122d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016075.875562:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc271122d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:0.0:1734016075.875596:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 961894 00000004:00200000:0.0:1734016075.875602:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016075.875637:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc271122d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016075.875662:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc271122cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3311 expref: 19 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016075.875684:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc271122d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3311 expref: 18 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016075.875693:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016075.875696:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016075.875700:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:0.0:1734016075.875773:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:9668:x1818247333049344:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 419us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016075.875782:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1797 00000100:00100000:0.0:1734016075.882912:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.883137:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9418 00000100:00100000:0.0:1734016075.883146:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333049472:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016075.883171:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016075.883193:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc271122d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3318 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016075.883262:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335078144:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016075.883346:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eea80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016075.888948:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.893643:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e51c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335078272:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016075.893698:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271122e0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e331f expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016075.893718:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271122e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e331f expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016075.893780:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd680, rc 0) 00000100:00100000:0.0:1734016075.893977:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333049600:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4810us (5040us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016075.893988:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9419 00000100:00100000:0.0:1734016075.900551:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.904651:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.908577:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.914829:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333050240 00000100:00100000:0.0:1734016075.914841:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333050240 00000100:00100000:0.0:1734016075.914904:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9420 00000100:00100000:0.0:1734016075.914913:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333050240:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016075.914936:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016075.914963:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc271122fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e332d expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016075.914989:0:7683:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 961894, mtime: 0x675afc4c, atime: 0x675afc4b, ctime: 0x675afc4c, blocks: 0x2a0 00010000:00010000:0.0:1734016075.915015:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016075.915017:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016075.915027:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc271122fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e332d expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016075.915044:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc271122fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e332d expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016075.915055:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:0.0:1734016075.915109:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333050240:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 196us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016075.915118:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9420 00000100:00100000:0.0:1734016075.919060:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.923700:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.930272:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.938868:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.943764:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.949700:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.965947:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016075.968473:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc2711231f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016075.968482:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc2711231f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:0.0:1734016075.968587:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968468 00000004:00010000:0.0:1734016075.968653:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075e51c00 reply state ffff88007beff000 transno 4294968469 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc2711231f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016075.968661:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016075.969142:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+23:9668:x1818247333051392:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 9230us (10815us total) trans 4294968469 rc 0/0 00000100:00100000:0.0:1734016075.969149:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1801 00000020:00080000:0.0:1734016075.969153:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016075.971447:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.977658:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.986237:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.990313:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.995972:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016075.998340:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016075.999953:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016045 00000100:00100000:0.0:1734016076.000765:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333052416 00000100:00100000:0.0:1734016076.000775:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333052416 00000100:00100000:0.0:1734016076.000900:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 133 00000100:00100000:0.0:1734016076.000909:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333052416:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1734016076.000998:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333052416:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 89us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016076.001007:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 133 00000100:00100000:0.0:1734016076.003997:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.012221:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.022301:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016076.023009:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016046 00000100:00100000:0.0:1734016076.026883:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.030396:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.036539:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.043168:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.056956:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.062141:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.067405:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e53b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335080064:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016076.067439:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016076.067504:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333053824:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4860us (5383us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016076.067517:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2381 00000100:00100000:0.0:1734016076.072173:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.076222:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.084455:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.110897:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.110954:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.111305:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.223038:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.251478:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.261274:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.269770:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.277346:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.284970:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.312434:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016076.318175:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968931 is committed 00000001:00080000:0.0:1734016076.318196:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968930 is committed 00000100:00100000:0.0:1734016076.356472:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.361843:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.361910:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.361973:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333056640 00000100:00100000:0.0:1734016076.361983:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333056640 00002000:00100000:0.0:1734016076.362041:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8388607) req@ffff88012db09f80 x1818247333056640/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:37/0 lens 504/0 e 0 to 0 dl 1734016087 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016076.362055:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db09f80 with x1818247333056640 ext(4190208->8388607) 00002000:00010000:0.0:1734016076.362062:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db09f80 00000100:00100000:0.0:1734016076.362102:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333056768 00000100:00100000:0.0:1734016076.362105:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333056768 00002000:00100000:0.0:1734016076.362118:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8388608->9846783) req@ffff88012db08700 x1818247333056768/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:37/0 lens 488/0 e 0 to 0 dl 1734016087 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016076.362125:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db08700 with x1818247333056768 ext(8388608->9846783) 00002000:00010000:0.0:1734016076.362127:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db08700 00000100:00100000:0.0:1734016076.362139:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7244 00000100:00100000:0.0:1734016076.362152:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333056640:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016076.474984:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.478058:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.482199:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.504367:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.507976:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.514890:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.519655:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333058176 00000100:00100000:0.0:1734016076.519667:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333058176 00002000:00100000:0.0:1734016076.519715:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2428928->2494463) req@ffff880075e53b80 x1818247333058176/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:37/0 lens 504/0 e 0 to 0 dl 1734016087 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016076.519725:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e53b80 with x1818247333058176 ext(2428928->2494463) 00002000:00010000:0.0:1734016076.519732:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e53b80 00000100:00100000:0.0:1734016076.519770:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7248 00000100:00100000:0.0:1734016076.519777:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333058176:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016076.532258:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.540171:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.549334:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016076.558444:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968932 is committed 00000100:00100000:0.0:1734016076.568116:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.571902:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.588471:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333059456 00000100:00100000:0.0:1734016076.588476:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333059456 00002000:00100000:0.0:1734016076.588494:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8388607) req@ffff880075e52300 x1818247333059456/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:37/0 lens 504/0 e 0 to 0 dl 1734016087 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016076.588505:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e52300 with x1818247333059456 ext(4190208->8388607) 00002000:00010000:0.0:1734016076.588511:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e52300 00000100:00100000:0.0:1734016076.588534:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333059840 00000100:00100000:0.0:1734016076.588536:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333059840 00002000:00100000:0.0:1734016076.589335:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8388608->9846783) req@ffff880075e53480 x1818247333059840/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:37/0 lens 488/0 e 0 to 0 dl 1734016087 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016076.589344:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e53480 with x1818247333059840 ext(8388608->9846783) 00002000:00010000:0.0:1734016076.589348:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e53480 00000100:00100000:0.0:1734016076.589367:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7253 00000100:00100000:0.0:1734016076.589371:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333059840:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016076.656764:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.660950:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.669570:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333060224 00000100:00100000:0.0:1734016076.669583:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333060224 00010000:00010000:0.0:1734016076.669639:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271123dc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e33ce expref: 7 pid: 7682 timeout: 443 lvb_type: 1 00000100:00100000:0.0:1734016076.669676:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2386 00000100:00100000:0.0:1734016076.669684:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333060224:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016076.669700:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016076.669724:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271123dc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e33ce expref: 7 pid: 7682 timeout: 443 lvb_type: 1 00010000:00010000:0.0:1734016076.669735:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271123dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e33ce expref: 7 pid: 7682 timeout: 443 lvb_type: 1 00010000:00010000:0.0:1734016076.669763:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016076.669845:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333060224:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 160us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016076.669855:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2386 00000100:00100000:0.0:1734016076.688957:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.698718:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.703683:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.720998:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.724480:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.724529:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333061504 00000100:00100000:0.0:1734016076.724540:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333061504 00002000:00100000:0.0:1734016076.724593:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (352256->405503) req@ffff880130408700 x1818247333061504/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:37/0 lens 488/0 e 0 to 0 dl 1734016087 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016076.724605:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880130408700 with x1818247333061504 ext(352256->405503) 00010000:00010000:0.0:1734016076.724628:0:7687:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271123e3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 352256->405503) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e33d5 expref: 6 pid: 7683 timeout: 443 lvb_type: 0 00010000:00010000:0.0:1734016076.724645:0:7687:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271123e3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 352256->405503) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e33d5 expref: 6 pid: 7683 timeout: 443 lvb_type: 0 00002000:00010000:0.0:1734016076.724653:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130408700 00000100:00100000:0.0:1734016076.724683:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 278 00000100:00100000:0.0:1734016076.724691:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333061504:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016076.744117:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.751873:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.755094:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.765504:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.768703:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.781647:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.785720:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.789444:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.797492:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.801217:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.805061:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.808862:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.812964:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.816738:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.822601:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.826765:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.831210:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.835074:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.838529:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.842250:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.851950:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.855138:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016076.864778:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968934 is committed 00000100:00100000:0.0:1734016076.875861:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.897132:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.909165:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.921410:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e51500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335083136:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016076.921475:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27112414 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3406 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016076.921496:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27112414 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3406 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016076.921530:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:0.0:1734016076.923573:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333067264:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11892us (14401us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016076.923588:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9449 00000100:00100000:0.0:1734016076.930554:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333067392 00000100:00100000:0.0:1734016076.930569:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333067392 00000100:00100000:0.0:1734016076.937723:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.949120:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e50380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335083392:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016076.949158:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016076.949241:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075140a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333067520:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 11092us (11527us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016076.949260:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2391 00000100:00100000:0.0:1734016076.952498:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.955965:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.961171:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.971597:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.977358:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.985594:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016076.989644:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.012065:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.017147:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.029938:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016077.030791:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016047 00000100:00100000:0.0:1734016077.044360:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016077.045534:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016047 00000100:00100000:0.0:1734016077.057896:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.059240:0:3503:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1734016077.059257:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67a75f73-9674-4938-8c12-63813a36f078:3503:1818247335084416:0@lo:400:kworker.0 00000100:00100000:0.0:1734016077.059774:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1734016077.063105:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016047 00000001:00080000:0.0:1734016077.076518:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968938 is committed 00000001:00080000:0.0:1734016077.076568:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968937 is committed 00000100:00100000:0.0:1734016077.080038:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.088469:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.091945:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9458 00000100:00100000:0.0:1734016077.091963:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333069696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016077.091990:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016077.092016:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27112461 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e343e expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.092048:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016077.092050:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016077.092061:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27112461 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e343e expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016077.092081:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27112461 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e343e expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016077.092093:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:0.0:1734016077.092172:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333069696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 213us (3717us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016077.092179:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9458 00000100:00100000:0.0:1734016077.098412:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.107146:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.114866:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.122398:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.153749:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.153849:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.162822:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.174928:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.178311:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.184771:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.200711:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.205009:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.210350:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.223598:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.231008:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.260617:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.266010:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.272093:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.275574:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.287111:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.299469:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.313127:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.315354:0:7686:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335086976 00000100:00100000:0.0:1734016077.315361:0:7686:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335086976 00000100:00100000:0.0:1734016077.315395:0:7686:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1734016077.315400:0:7686:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335086976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1734016077.315427:0:7686:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 490160704 pending 0 free 3923677184 avail 3692154880 00000100:00100000:0.0:1734016077.315460:0:7686:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335086976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016077.315468:0:7686:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1734016077.317293:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.320582:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.335519:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.349328:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.353220:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.372174:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.380727:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.390361:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.395892:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016077.410347:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968943 is committed 00000001:00080000:0.0:1734016077.410373:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968942 is committed 00000100:00100000:0.0:1734016077.416339:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.419902:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.423731:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.426286:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.434342:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.434428:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.441460:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.446450:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.450327:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016077.452951:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968945 is committed 00000001:00080000:0.0:1734016077.452965:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968944 is committed 00000100:00100000:0.0:1734016077.462222:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.466778:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.476398:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.485270:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.492983:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.499255:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.505278:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.513590:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.519427:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.522238:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.532749:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.539179:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.542479:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.549721:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.555058:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.564522:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.574427:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.584434:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.595420:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.609920:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.609990:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.621960:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333081216 00000100:00100000:0.0:1734016077.621969:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333081216 00000100:00100000:0.0:1734016077.622012:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9481 00000100:00100000:0.0:1734016077.622018:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333081216:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016077.622039:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016077.622057:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27112541 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e34df expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016077.622110:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335088896:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016077.622167:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00002000:00010000:0.0:1734016077.625920:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016077 -> 1734016078 00002000:00010000:0.0:1734016077.625928:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016077 -> 1734016078 00000100:00100000:0.0:1734016077.625949:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335088896:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016077.625984:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27112541 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e34df expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016077.625998:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27112541 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e34df expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016077.626103:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:0.0:1734016077.626276:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333081216:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4254us (4389us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016077.626285:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9481 00000100:00100000:0.0:1734016077.629593:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333081344 00000100:00100000:0.0:1734016077.629608:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333081344 00000100:00100000:0.0:1734016077.629873:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9482 00000100:00100000:0.0:1734016077.629884:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333081344:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016077.629907:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016077.629925:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27112548 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e34e6 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016077.629987:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335089024:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016077.630069:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016077.634574:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335089024:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016077.634633:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27112548 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e34e6 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016077.634653:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27112548 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e34e6 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016077.634686:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:0.0:1734016077.634749:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333081344:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4866us (5239us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016077.634758:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9482 00000100:00100000:0.0:1734016077.639749:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333081472 00000100:00100000:0.0:1734016077.639758:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333081472 00000100:00100000:0.0:1734016077.639851:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9483 00000100:00100000:0.0:1734016077.639859:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333081472:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016077.640089:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016077.640108:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc2711254f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e34ed expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.640135:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc2711253a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5115904->5128191) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e34d8 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.640140:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016077.640142:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016077.640145:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc2711254f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7127040->7192575] (req 7127040->7192575) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e34ed expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.640170:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc2711253a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5115904->5128191) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e34d8 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.640184:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc2711253a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5115904->5128191) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e34d8 expref: 6 pid: 7683 timeout: 444 lvb_type: 0 00000100:00100000:0.0:1734016077.640195:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335089152:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016077.640338:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016077.644526:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.650234:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.661677:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.692405:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333082496 00000100:00100000:0.0:1734016077.692413:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333082496 00000100:00100000:0.0:1734016077.692460:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1817 00000100:00100000:0.0:1734016077.692467:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+26:9668:x1818247333082496:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016077.692512:0:6480:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016077.692537:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27112510 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e34b5 expref: 26 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.692561:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016077.692565:0:6480:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016077.692724:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27112572 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016077.692737:0:6480:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc271124df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3492 expref: 24 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.692744:0:6480:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27112572 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016077.692775:0:6480:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc271124df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3492 expref: 24 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.692787:0:6480:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc271124df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3492 expref: 24 pid: 13956 timeout: 444 lvb_type: 0 00000100:00100000:0.0:1734016077.692830:0:6480:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1818247335089920:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016077.692908:0:6480:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eec00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016077.699244:0:6480:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1818247335089920:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016077.699274:0:6480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27112572 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016077.700379:0:6480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27112572 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016077.700386:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27112572 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000001:00080000:0.0:1734016077.700497:0:6480:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968478 00000004:00010000:0.0:1734016077.700549:0:6480:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075142300 reply state ffff88012d85b000 transno 4294968479 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27112572 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:0.0:1734016077.700556:0:6480:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016077.700649:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+28:9668:x1818247333082496:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 8181us (8585us total) trans 4294968479 rc 0/0 00000100:00100000:0.0:1734016077.700655:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1817 00000020:00080000:0.0:1734016077.700660:0:6480:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016077.714780:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333082880 00000100:00100000:0.0:1734016077.714788:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333082880 00000100:00100000:0.0:1734016077.722606:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335090176:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016077.722626:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016077.722666:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075141c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333082880:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5893us (9438us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016077.722675:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2410 00000100:00100000:0.0:1734016077.728777:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333083136 00000100:00100000:0.0:1734016077.728788:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333083136 00000100:00100000:0.0:1734016077.728963:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1818 00000100:00100000:0.0:1734016077.728973:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:9668:x1818247333083136:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016077.729003:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016077.729024:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27112580 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3517 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.729104:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27112587 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016077.729116:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27112587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016077.729130:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27112587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:0.0:1734016077.729153:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 9953871 00000004:00200000:0.0:1734016077.729156:0:6480:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016077.729170:0:6480:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27112587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016077.729191:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27112580 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3517 expref: 29 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.729225:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27112587 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3517 expref: 28 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.729233:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016077.729236:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016077.729239:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:0.0:1734016077.729298:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+28:9668:x1818247333083136:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 326us (2065us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016077.729304:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1818 00000100:00100000:0.0:1734016077.736091:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333083392 00000100:00100000:0.0:1734016077.736101:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333083392 00000100:00100000:0.0:1734016077.736163:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7302 00000100:00100000:0.0:1734016077.736171:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333083392:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:0.0:1734016077.736206:0:13914:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc2711258e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.736220:0:13914:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27112579 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3510 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.736226:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016077.736227:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016077.736231:0:13914:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc2711258e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6004736->6041599] (req 6004736->6041599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.736259:0:13914:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27112579 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3510 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.736269:0:13914:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27112579 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3510 expref: 7 pid: 7683 timeout: 444 lvb_type: 0 00000100:00100000:0.0:1734016077.736286:0:13914:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335090304:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016077.736349:0:13914:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016077.740629:0:13914:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335090304:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016077.740653:0:13914:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc2711258e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6004736->6041599] (req 6004736->6041599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016077.748589:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016077 -> 1734016078 00002000:00010000:0.0:1734016077.748593:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 904 -> 976 00010000:00010000:0.0:1734016077.748613:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc2711258e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6004736->6041599] (req 6004736->6041599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.748622:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc2711258e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6004736->6041599] (req 6004736->6041599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.748629:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc2711258e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6004736->6041599] (req 6004736->6041599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.748634:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7580000 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016077.748638:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc2711258e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6004736->6041599] (req 6004736->6041599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.748644:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc2711258e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6004736->6041599] (req 6004736->6041599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.748660:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc2711258e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6004736->6041599] (req 6004736->6041599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016077.748666:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc2711258e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6004736->6041599] (req 6004736->6041599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016077.750109:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333083392:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 13927us (15511us total) trans 4294968949 rc 0/0 00000100:00100000:0.0:1734016077.750120:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7302 00000100:00100000:0.0:1734016077.760218:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.772137:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.778776:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.783687:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.790151:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.795097:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.799242:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.803401:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.808783:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.818352:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.828589:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.832993:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.839672:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.849760:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.857691:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.865976:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.874548:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.881274:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.884533:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.891033:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.908239:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.914399:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.922417:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.928901:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.934945:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.940042:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.945551:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.961194:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.965726:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.969685:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.977664:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.984248:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.984310:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.991641:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016077.998042:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.009255:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.025858:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.043630:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016078.044509:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016048 00000100:00100000:0.0:1734016078.048588:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.062218:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.073383:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.081711:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.102082:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.133329:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.137443:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.142311:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.169328:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.180466:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.181721:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.259689:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.266163:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.277630:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.284860:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.293534:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.301998:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.309105:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.320661:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.324923:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.337979:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.342982:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.348468:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.354335:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.359554:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.364742:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.369467:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.373594:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.379628:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.385298:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.390240:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.396173:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.400421:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.404988:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.409947:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.419455:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016078.419950:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016048 00000100:00100000:0.0:1734016078.423014:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.427787:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.441679:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.446876:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.453344:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.458730:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.465698:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.472076:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.480000:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.488557:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.492932:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.498607:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.511531:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.523963:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.541763:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00002000:00010000:0.0:1734016078.553937:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1400 -> 1504 00010000:00010000:0.0:1734016078.553954:0:7688:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271126d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6496256->6549503] (req 6496256->6549503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016078.553965:0:7688:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271126d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6496256->6549503] (req 6496256->6549503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016078.553974:0:7688:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271126d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6496256->6549503] (req 6496256->6549503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016078.553981:0:7688:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd680 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016078.553984:0:7688:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271126d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6496256->6549503] (req 6496256->6549503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016078.553997:0:7688:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271126d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6496256->6549503] (req 6496256->6549503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016078.554015:0:7688:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271126d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6496256->6549503] (req 6496256->6549503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016078.554022:0:7688:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271126d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6496256->6549503] (req 6496256->6549503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016078.554150:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333098624:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 38383us (42632us total) trans 4294968959 rc 0/0 00000100:00100000:0.0:1734016078.554162:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7331 00000100:00100000:0.0:1734016078.558471:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.565575:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.570615:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.573757:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075140e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335096320:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016078.573783:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016078.573876:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e256a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333099264:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3080us (3263us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016078.573890:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2426 00000100:00100000:0.0:1734016078.581045:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.585164:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.601431:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333099904 00000100:00100000:0.0:1734016078.601448:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333099904 00002000:00010000:0.0:1734016078.601493:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (10387916->18446744073709551615) 00002000:00100000:0.0:1734016078.601498:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075140700 with x1818247333099904 ext(10387916->18446744073709551615) 00002000:00010000:0.0:1734016078.601516:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075140700. 00000100:00100000:0.0:1734016078.601561:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7332 00000100:00100000:0.0:1734016078.601569:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333099904:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016078.601904:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8446872 -> 10387916 00002000:00010000:0.0:1734016078.601909:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016079 -> 1734016079 00002000:00010000:0.0:1734016078.601912:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016078 -> 1734016078 00002000:00010000:0.0:1734016078.601914:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016079 -> 1734016079 00002000:00010000:0.0:1734016078.601916:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1408 -> 1408 00000100:00100000:0.0:1734016078.602013:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333099904:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 441us (1795us total) trans 4294968961 rc 0/0 00000100:00100000:0.0:1734016078.602022:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7332 00002000:00010000:0.0:1734016078.602025:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (10387916->18446744073709551615) 00002000:00100000:0.0:1734016078.602027:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075140700 with x1818247333099904 ext(10387916->18446744073709551615) 00002000:00010000:0.0:1734016078.602032:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075140700. 00000100:00100000:0.0:1734016078.613108:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.645669:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.653401:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333100544 00000100:00100000:0.0:1734016078.653412:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333100544 00000100:00100000:0.0:1734016078.653463:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9533 00000100:00100000:0.0:1734016078.653470:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333100544:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016078.654784:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968962 is committed 00000100:00100000:0.0:1734016078.661426:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333100672 00000100:00100000:0.0:1734016078.661437:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333100672 00000100:00100000:0.0:1734016078.661521:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1828 00000100:00100000:0.0:1734016078.661532:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+31:9668:x1818247333100672:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016078.661566:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016078.661609:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc271126f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e363d expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016078.661730:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc271126fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016078.661744:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc271126fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016078.661756:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc271126fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016078.661784:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 10387916 00000004:00200000:0.0:1734016078.661789:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016078.661843:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc271126fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016078.661869:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc271126f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e363d expref: 33 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016078.661914:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc271126fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e363d expref: 32 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016078.661923:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016078.661926:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016078.661929:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582d00, rc 0) 00000100:00100000:0.0:1734016078.661981:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+32:9668:x1818247333100672:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 450us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016078.661989:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1828 00000100:00100000:0.0:1734016078.667237:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333100800 00000100:00100000:0.0:1734016078.667247:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333100800 00000100:00100000:0.0:1734016078.667307:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9534 00000100:00100000:0.0:1734016078.667315:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333100800:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016078.667336:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016078.667358:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27112701 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3644 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016078.667438:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e255880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335096576:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016078.667496:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eeb40 going to sleep for 11 seconds 00002000:00010000:0.0:1734016078.675512:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016078 -> 1734016079 00002000:00010000:0.0:1734016078.675524:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 1408 -> 1504 00000100:00100000:0.0:1734016078.675549:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e255880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335096576:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016078.675596:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27112701 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3644 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016078.675611:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27112701 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3644 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016078.675640:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016078.675702:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333100800:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8386us (8555us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016078.675713:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9534 00000100:00100000:0.0:1734016078.683906:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333100928 00000100:00100000:0.0:1734016078.683915:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333100928 00000100:00100000:0.0:1734016078.683969:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9535 00000100:00100000:0.0:1734016078.683977:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333100928:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016078.684002:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016078.684022:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27112708 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e364b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016078.684056:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271126e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 335872->393215) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3636 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016078.684063:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016078.684065:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016078.684070:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27112708 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [9957376->9961471] (req 9957376->9961471) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e364b expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016078.684113:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271126e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 335872->393215) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3636 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016078.684128:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271126e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 335872->393215) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3636 expref: 5 pid: 7683 timeout: 445 lvb_type: 0 00000100:00100000:0.0:1734016078.684145:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e255880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335096704:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016078.684238:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016078.691863:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e255880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335096704:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016078.691904:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27112708 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [9957376->9961471] (req 9957376->9961471) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e364b expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016078.691919:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:0.0:1734016078.691972:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333100928:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7995us (8180us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016078.691984:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9535 00000100:00100000:0.0:1734016078.739796:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.758173:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333101824 00000100:00100000:0.0:1734016078.758182:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333101824 00000100:00100000:0.0:1734016078.758234:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1830 00000100:00100000:0.0:1734016078.758240:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+27:9668:x1818247333101824:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016078.758288:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016078.758316:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc2711271d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3659 expref: 27 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016078.758348:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016078.758352:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016078.758481:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27112724 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016078.758495:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc271126fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e363d expref: 31 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016078.758502:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27112724 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016078.758533:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc271126fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e363d expref: 31 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016078.758545:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc271126fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e363d expref: 31 pid: 13956 timeout: 445 lvb_type: 0 00000100:00100000:0.0:1734016078.758557:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e255c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335096960:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016078.758632:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee780 going to sleep for 11 seconds 00000100:00100000:0.0:1734016078.777129:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016078.783353:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27112724 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016078.783363:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27112724 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016078.783370:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27112724 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016078.783376:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581f80 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016078.783380:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27112724 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016078.783386:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27112724 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016078.783402:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016078.783405:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016078.783408:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27112724 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016078.783413:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27112724 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016078.792655:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.801261:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.807753:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.813168:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.820143:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.830140:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.840050:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.849552:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.853009:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.858089:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.858116:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333103488 00000100:00100000:0.0:1734016078.858124:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333103488 00002000:00100000:0.0:1734016078.858171:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (6103040->6107135) req@ffff88012e255c00 x1818247333103488/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:39/0 lens 488/0 e 0 to 0 dl 1734016089 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016078.858182:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e255c00 with x1818247333103488 ext(6103040->6107135) 00002000:00010000:0.0:1734016078.858186:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e255c00 00000100:00100000:0.0:1734016078.858205:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7337 00000100:00100000:0.0:1734016078.858210:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333103488:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016078.858391:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333103488:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 179us (312us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016078.858398:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7337 00002000:00100000:0.0:1734016078.858404:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (6103040->6107135) req@ffff88012e255c00 x1818247333103488/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:39/0 lens 488/4536 e 0 to 0 dl 1734016089 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016078.858410:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e255c00 with x1818247333103488 ext(6103040->6107135) 00002000:00010000:0.0:1734016078.858413:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e255c00 00000100:00100000:0.0:1734016078.863688:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.868243:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.874286:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.878375:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.882131:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.885511:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.891388:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.898297:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.909119:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.912345:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.916533:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.920036:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.924191:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.928467:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.932897:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.937014:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.941585:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.945469:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.945525:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.964665:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.970218:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.976915:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.981119:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.982616:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333108608:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1134us (1506us total) trans 4294968964 rc 0/0 00000100:00100000:0.0:1734016078.982628:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7355 00002000:00100000:0.0:1734016078.982638:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6090752->6103039) req@ffff88012b130380 x1818247333108608/t4294968964(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:39/0 lens 12776/448 e 0 to 0 dl 1734016089 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016078.982645:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b130380 with x1818247333108608 ext(6090752->6103039) 00002000:00010000:0.0:1734016078.982650:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b130380 00000100:00100000:0.0:1734016078.984696:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.990932:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016078.995943:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.006164:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016079.006402:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016049 00000100:00100000:0.0:1734016079.010468:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00002000:00010000:0.0:1734016079.017918:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1304 -> 1376 00010000:00010000:0.0:1734016079.017935:0:7688:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112786 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6230016->6266879] (req 6230016->6266879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.017947:0:7688:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112786 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6230016->6266879] (req 6230016->6266879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.017956:0:7688:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112786 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6230016->6266879] (req 6230016->6266879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.017962:0:7688:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd200 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016079.017967:0:7688:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112786 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6230016->6266879] (req 6230016->6266879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.017975:0:7688:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112786 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6230016->6266879] (req 6230016->6266879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.017998:0:7688:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112786 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6230016->6266879] (req 6230016->6266879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.018004:0:7688:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112786 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6230016->6266879] (req 6230016->6266879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016079.018130:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333109248:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 11182us (11968us total) trans 4294968965 rc 0/0 00000100:00100000:0.0:1734016079.018141:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7356 00000100:00100000:0.0:1734016079.023270:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.028316:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.032195:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.038884:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.038916:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.044471:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.051377:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.057532:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.061981:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.066013:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.070652:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.074233:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.081916:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.088966:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.094638:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.099106:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.104709:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.111397:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.129136:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.130345:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.203721:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.213069:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016079.213709:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016049 00010000:00010000:0.0:1734016079.214432:0:6480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271127a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016079.214439:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271127a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000001:00080000:0.0:1734016079.214568:0:6480:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968488 00000004:00010000:0.0:1734016079.214640:0:6480:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007487ea00 reply state ffff880136918000 transno 4294968489 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271127a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:0.0:1734016079.214653:0:6480:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016079.214742:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+31:9668:x1818247333113856:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 10667us (11037us total) trans 4294968489 rc 0/0 00000100:00100000:0.0:1734016079.214749:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1833 00000020:00080000:0.0:1734016079.214752:0:6480:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016079.217379:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.222755:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.239162:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.245370:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.257314:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.261857:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.276673:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.309769:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.318297:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.327198:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.339756:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.345384:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.345411:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333116160 00000100:00100000:0.0:1734016079.345419:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333116160 00010000:00010000:0.0:1734016079.345456:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc271127e8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e36ec expref: 31 pid: 6480 timeout: 446 lvb_type: 0 00000100:00100000:0.0:1734016079.345498:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2441 00000100:00100000:0.0:1734016079.345505:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+31:1982:x1818247333116160:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016079.345518:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016079.345524:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc271127e8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e36ec expref: 31 pid: 6480 timeout: 446 lvb_type: 0 00010000:00010000:0.0:1734016079.345538:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc271127e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e36ec expref: 31 pid: 6480 timeout: 446 lvb_type: 0 00010000:00010000:0.0:1734016079.345562:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016079.345566:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc271127f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016079.345584:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc271127f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016079.345590:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc271127f6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016079.345604:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016079.345643:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+31:1982:x1818247333116160:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 137us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016079.345649:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2441 00010000:00010000:0.0:1734016079.352201:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc271127f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016079.352219:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc271127f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016079.352225:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc271127f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016079.352232:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4b40 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016079.352236:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc271127f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016079.352242:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc271127f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016079.352262:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016079.352265:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016079.352270:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc271127f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016079.352274:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc271127f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016079.352655:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.358003:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.363690:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333116544 00000100:00100000:0.0:1734016079.363700:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333116544 00002000:00010000:0.0:1734016079.363739:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (2222362->18446744073709551615) 00002000:00100000:0.0:1734016079.363744:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073791180 with x1818247333116544 ext(2222362->18446744073709551615) 00002000:00010000:0.0:1734016079.363754:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073791180. 00000100:00100000:0.0:1734016079.363787:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7373 00000100:00100000:0.0:1734016079.363794:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333116544:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016079.364461:0:14005:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 2024851 -> 2222362 00002000:00010000:0.0:1734016079.364465:0:14005:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016079 -> 1734016079 00002000:00010000:0.0:1734016079.364468:0:14005:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016079 -> 1734016079 00002000:00010000:0.0:1734016079.364469:0:14005:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016079 -> 1734016079 00002000:00010000:0.0:1734016079.364471:0:14005:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 672 -> 672 00000100:00100000:0.0:1734016079.364527:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333116544:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 733us (1061us total) trans 4294968969 rc 0/0 00000100:00100000:0.0:1734016079.364533:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7373 00002000:00010000:0.0:1734016079.364536:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (2222362->18446744073709551615) 00002000:00100000:0.0:1734016079.364538:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073791180 with x1818247333116544 ext(2222362->18446744073709551615) 00002000:00010000:0.0:1734016079.364543:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073791180. 00000100:00100000:0.0:1734016079.368242:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.372181:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.377643:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.381938:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.387357:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.392169:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.397146:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.401516:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.404740:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.407890:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.411601:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.417897:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.421307:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.426142:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.436007:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.466463:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.479176:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.482758:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.487220:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.498404:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.504693:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016079.516097:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968971 is committed 00000100:00100000:0.0:1734016079.520497:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.525148:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.529153:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.534254:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.539895:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.544673:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b133100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335100928:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016079.544709:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27112835 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3716 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.544724:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:0.0:1734016079.545053:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333122048:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4856us (5164us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016079.545062:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9560 00000100:00100000:0.0:1734016079.550289:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333122304 00000100:00100000:0.0:1734016079.550299:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333122304 00002000:00010000:0.0:1734016079.550330:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (8061175->18446744073709551615) 00002000:00100000:0.0:1734016079.550335:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b131880 with x1818247333122304 ext(8061175->18446744073709551615) 00002000:00010000:0.0:1734016079.550346:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b131880. 00000100:00100000:0.0:1734016079.550694:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7391 00000100:00100000:0.0:1734016079.550701:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333122304:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016079.551035:0:14005:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8441856 -> 8061175 00002000:00010000:0.0:1734016079.551038:0:14005:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016080 -> 1734016080 00002000:00010000:0.0:1734016079.551041:0:14005:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016079 -> 1734016079 00002000:00010000:0.0:1734016079.551043:0:14005:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016080 -> 1734016080 00002000:00010000:0.0:1734016079.551044:0:14005:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 880 -> 792 00000100:00100000:0.0:1734016079.551975:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333122304:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1270us (1781us total) trans 4294968972 rc 0/0 00000100:00100000:0.0:1734016079.551986:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7391 00002000:00010000:0.0:1734016079.551992:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (8061175->18446744073709551615) 00002000:00100000:0.0:1734016079.551995:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b131880 with x1818247333122304 ext(8061175->18446744073709551615) 00002000:00010000:0.0:1734016079.552003:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b131880. 00000100:00100000:0.0:1734016079.559493:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333122560 00000100:00100000:0.0:1734016079.559502:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333122560 00000100:00100000:0.0:1734016079.559555:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9561 00000100:00100000:0.0:1734016079.559563:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333122560:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016079.559776:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8061175 -> 8061175 00002000:00010000:0.0:1734016079.559779:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016080 -> 1734016080 00002000:00010000:0.0:1734016079.559781:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016079 -> 1734016079 00002000:00010000:0.0:1734016079.559782:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016080 -> 1734016079 00002000:00010000:0.0:1734016079.559784:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 792 -> 880 00000100:00100000:0.0:1734016079.559858:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333122560:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 294us (444us total) trans 4294968973 rc 0/0 00000100:00100000:0.0:1734016079.559865:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9561 00000100:00100000:0.0:1734016079.564340:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.569106:0:14005:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b131c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14005:1818247335101184:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016079.569134:0:14005:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711284a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016079.569896:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016079.572001:0:14005:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711284a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.572010:0:14005:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711284a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016079.575501:0:14005:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016079 -> 1734016080 00002000:00010000:0.0:1734016079.575506:0:14005:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 880 -> 888 00010000:00010000:0.0:1734016079.575522:0:14005:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711284a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.575535:0:14005:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711284a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.575543:0:14005:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711284a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.575548:0:14005:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc480 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016079.575553:0:14005:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711284a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.575560:0:14005:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711284a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.575589:0:14005:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711284a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.575594:0:14005:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711284a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016079.575720:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333122816:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 10150us (11382us total) trans 4294968974 rc 0/0 00000100:00100000:0.0:1734016079.575734:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7392 00000100:00100000:0.0:1734016079.578318:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.588113:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333123328 00000100:00100000:0.0:1734016079.588120:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333123328 00010000:00010000:0.0:1734016079.588147:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27112851 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3724 expref: 8 pid: 7683 timeout: 446 lvb_type: 1 00000100:00100000:0.0:1734016079.588169:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2447 00000100:00100000:0.0:1734016079.588176:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333123328:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016079.588190:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016079.588208:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27112851 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3724 expref: 8 pid: 7683 timeout: 446 lvb_type: 1 00010000:00010000:0.0:1734016079.588219:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27112851 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3724 expref: 8 pid: 7683 timeout: 446 lvb_type: 1 00010000:00010000:0.0:1734016079.588243:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27112851 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3724 expref: 8 pid: 7683 timeout: 446 lvb_type: 1 00010000:00010000:0.0:1734016079.588270:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016079.588273:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016079.588279:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27112858 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->3993599) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e372b expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.588288:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27112858 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->3993599) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e372b expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.588318:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27112858 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->3993599) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e372b expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016079.588333:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335101440:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016079.588374:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016079.594860:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335101440:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016079.594887:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016079.594948:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333123328:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6770us (7029us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016079.594960:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2447 00000100:00100000:0.0:1734016079.609477:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333123584 00000100:00100000:0.0:1734016079.609487:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333123584 00002000:00100000:0.0:1734016079.609525:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff8800752a5c00 x1818247333123584/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:40/0 lens 488/0 e 0 to 0 dl 1734016090 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016079.609533:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800752a5c00 with x1818247333123584 ext(0->4194303) 00002000:00010000:0.0:1734016079.609538:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800752a5c00 00000100:00100000:0.0:1734016079.609578:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7393 00000100:00100000:0.0:1734016079.609584:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333123584:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016079.692455:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333123840:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 63196us (63382us total) trans 0 rc 3870720/3870720 00000100:00100000:0.0:1734016079.692469:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7394 00002000:00100000:0.0:1734016079.692481:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (4194304->8065023) req@ffff88012b132d80 x1818247333123840/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:40/0 lens 488/440 e 0 to 0 dl 1734016090 ref 1 fl Complete:/200/0 rc 3870720/3870720 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016079.692492:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b132d80 with x1818247333123840 ext(4194304->8065023) 00002000:00010000:0.0:1734016079.692499:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b132d80 00000100:00100000:0.0:1734016079.703893:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333123968:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 13525us (14142us total) trans 4294968975 rc 0/0 00000100:00100000:0.0:1734016079.703909:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7395 00002000:00100000:0.0:1734016079.703925:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3940352->3993599) req@ffff8800752a6a00 x1818247333123968/t4294968975(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:40/0 lens 488/448 e 0 to 0 dl 1734016090 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016079.703934:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800752a6a00 with x1818247333123968 ext(3940352->3993599) 00002000:00010000:0.0:1734016079.703940:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800752a6a00 00000100:00100000:0.0:1734016079.706273:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333124096 00000100:00100000:0.0:1734016079.706283:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333124096 00000100:00100000:0.0:1734016079.706341:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1842 00000100:00100000:0.0:1734016079.706350:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+33:9668:x1818247333124096:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:0.0:1734016079.706508:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+33:9668:x1818247333124096:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 159us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016079.706514:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1842 00000100:00100000:0.0:1734016079.757039:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333124864 00000100:00100000:0.0:1734016079.757055:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333124864 00000100:00100000:0.0:1734016079.757177:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7396 00000100:00100000:0.0:1734016079.757188:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333124864:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:0.0:1734016079.757265:0:14005:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc2711287b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.757285:0:14005:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27112858 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->3993599) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e372b expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.757292:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016079.757295:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016079.757298:0:14005:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc2711287b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [655360->667647] (req 655360->667647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.757344:0:14005:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27112858 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->3993599) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e372b expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016079.757358:0:14005:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27112858 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->3993599) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e372b expref: 7 pid: 7683 timeout: 446 lvb_type: 0 00000100:00100000:0.0:1734016079.757377:0:14005:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad4380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14005:1818247335101824:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016079.757473:0:14005:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016079.773151:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.780421:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.790186:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.801731:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.814334:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.854458:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.871843:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.923960:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.974594:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.988315:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016079.998306:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.010024:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.028385:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.042658:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.061303:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016080.061709:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016050 00000100:00100000:0.0:1734016080.074130:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00002000:00100000:1.0:1734016080.074287:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6369280->6373375) req@ffff880073ad7800 x1818247333127552/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:41/0 lens 488/0 e 0 to 0 dl 1734016091 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016080.074303:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad7800 with x1818247333127552 ext(6369280->6373375) 00002000:00010000:1.0:1734016080.074308:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad7800 00000100:00100000:1.0:1734016080.074336:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7401 00000100:00100000:1.0:1734016080.074342:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333127552:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016080.074484:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333127552:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 142us (361us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016080.074490:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7401 00002000:00100000:1.0:1734016080.074495:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6369280->6373375) req@ffff880073ad7800 x1818247333127552/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:41/0 lens 488/4536 e 0 to 0 dl 1734016091 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016080.074500:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad7800 with x1818247333127552 ext(6369280->6373375) 00002000:00010000:1.0:1734016080.074503:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad7800 00000100:00100000:0.0:1734016080.085106:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.098492:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.110224:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.110470:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333128320 00000100:00100000:1.0:1734016080.110479:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333128320 00002000:00100000:1.0:1734016080.110521:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6356992->6361087) req@ffff880073ad4380 x1818247333128320/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:41/0 lens 488/0 e 0 to 0 dl 1734016091 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016080.110530:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4380 with x1818247333128320 ext(6356992->6361087) 00002000:00010000:1.0:1734016080.110534:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4380 00000100:00100000:1.0:1734016080.110573:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7404 00000100:00100000:1.0:1734016080.110578:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333128320:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016080.110722:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333128320:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 143us (506us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016080.110728:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7404 00002000:00100000:1.0:1734016080.110733:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6356992->6361087) req@ffff880073ad4380 x1818247333128320/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:41/0 lens 488/4536 e 0 to 0 dl 1734016091 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016080.110740:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4380 with x1818247333128320 ext(6356992->6361087) 00002000:00010000:1.0:1734016080.110743:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4380 00000100:00100000:0.0:1734016080.117159:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.129676:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.130633:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333128832 00000100:00100000:1.0:1734016080.130647:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333128832 00002000:00100000:1.0:1734016080.130720:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6348800->6352895) req@ffff880075188380 x1818247333128832/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:41/0 lens 488/0 e 0 to 0 dl 1734016091 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016080.130730:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075188380 with x1818247333128832 ext(6348800->6352895) 00002000:00010000:1.0:1734016080.130735:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075188380 00000100:00100000:1.0:1734016080.130773:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7406 00000100:00100000:1.0:1734016080.130779:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333128832:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016080.130998:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333128832:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 217us (1333us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016080.131006:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7406 00002000:00100000:1.0:1734016080.131012:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6348800->6352895) req@ffff880075188380 x1818247333128832/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:41/0 lens 488/4536 e 0 to 0 dl 1734016091 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016080.131019:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075188380 with x1818247333128832 ext(6348800->6352895) 00002000:00010000:1.0:1734016080.131022:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075188380 00000100:00100000:0.0:1734016080.138340:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.148747:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.149843:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333129344 00000100:00100000:1.0:1734016080.149853:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333129344 00002000:00100000:1.0:1734016080.149904:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6340608->6344703) req@ffff880075188a80 x1818247333129344/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:41/0 lens 488/0 e 0 to 0 dl 1734016091 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016080.149913:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075188a80 with x1818247333129344 ext(6340608->6344703) 00002000:00010000:1.0:1734016080.149918:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075188a80 00000100:00100000:1.0:1734016080.149956:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7408 00000100:00100000:1.0:1734016080.149962:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333129344:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016080.150118:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333129344:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 155us (1378us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016080.150124:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7408 00002000:00100000:1.0:1734016080.150129:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6340608->6344703) req@ffff880075188a80 x1818247333129344/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:41/0 lens 488/4536 e 0 to 0 dl 1734016091 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016080.150136:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075188a80 with x1818247333129344 ext(6340608->6344703) 00002000:00010000:1.0:1734016080.150138:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075188a80 00000100:00100000:0.0:1734016080.156129:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.165995:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.166292:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333129856 00000100:00100000:1.0:1734016080.166302:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333129856 00002000:00100000:1.0:1734016080.166340:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6332416->6336511) req@ffff880075189180 x1818247333129856/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:41/0 lens 488/0 e 0 to 0 dl 1734016091 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016080.166350:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075189180 with x1818247333129856 ext(6332416->6336511) 00002000:00010000:1.0:1734016080.166355:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075189180 00000100:00100000:1.0:1734016080.166388:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7410 00000100:00100000:1.0:1734016080.166395:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333129856:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016080.166567:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333129856:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 170us (580us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016080.166574:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7410 00002000:00100000:1.0:1734016080.166580:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6332416->6336511) req@ffff880075189180 x1818247333129856/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:41/0 lens 488/4536 e 0 to 0 dl 1734016091 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016080.166591:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075189180 with x1818247333129856 ext(6332416->6336511) 00002000:00010000:1.0:1734016080.166595:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075189180 00000100:00100000:0.0:1734016080.175189:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.184854:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.185713:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333130368 00000100:00100000:1.0:1734016080.185723:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333130368 00002000:00100000:1.0:1734016080.185774:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6324224->6328319) req@ffff880075189880 x1818247333130368/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:41/0 lens 488/0 e 0 to 0 dl 1734016091 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016080.185784:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075189880 with x1818247333130368 ext(6324224->6328319) 00002000:00010000:1.0:1734016080.185789:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075189880 00000100:00100000:1.0:1734016080.185855:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7412 00000100:00100000:1.0:1734016080.185863:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333130368:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016080.186077:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333130368:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 212us (1277us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016080.186085:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7412 00002000:00100000:1.0:1734016080.186091:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6324224->6328319) req@ffff880075189880 x1818247333130368/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:41/0 lens 488/4536 e 0 to 0 dl 1734016091 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016080.186098:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075189880 with x1818247333130368 ext(6324224->6328319) 00002000:00010000:1.0:1734016080.186101:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075189880 00000100:00100000:0.0:1734016080.191041:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.203991:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.205674:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333130880 00000100:00100000:1.0:1734016080.205686:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333130880 00002000:00100000:1.0:1734016080.205728:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6316032->6320127) req@ffff880075189f80 x1818247333130880/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:41/0 lens 488/0 e 0 to 0 dl 1734016091 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016080.205737:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075189f80 with x1818247333130880 ext(6316032->6320127) 00002000:00010000:1.0:1734016080.205741:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075189f80 00000100:00100000:1.0:1734016080.205771:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7414 00000100:00100000:1.0:1734016080.205776:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333130880:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016080.205935:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333130880:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 157us (1953us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016080.205942:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7414 00002000:00100000:1.0:1734016080.205947:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6316032->6320127) req@ffff880075189f80 x1818247333130880/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:41/0 lens 488/4536 e 0 to 0 dl 1734016091 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016080.205952:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075189f80 with x1818247333130880 ext(6316032->6320127) 00002000:00010000:1.0:1734016080.205954:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075189f80 00000100:00100000:0.0:1734016080.213525:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.224153:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.225433:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333131264 00000100:00100000:1.0:1734016080.225444:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333131264 00000100:00100000:1.0:1734016080.225500:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9575 00000100:00100000:1.0:1734016080.225508:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007518a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333131264:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016080.225527:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016080.225544:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271128ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3778 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016080.225587:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27112897 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2007039) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3755 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016080.225595:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016080.225597:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016080.225600:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271128ba lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3854336->3891199] (req 3854336->3891199) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3778 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016080.225631:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27112897 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2007039) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3755 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016080.225643:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27112897 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2007039) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3755 expref: 6 pid: 7684 timeout: 447 lvb_type: 0 00000100:00100000:1.0:1734016080.225663:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335102848:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016080.225726:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016080.230877:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335102848:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016080.230914:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271128ba lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3854336->3891199] (req 3854336->3891199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3778 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016080.230938:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499eac0, rc 0) 00000100:00100000:1.0:1734016080.231009:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007518a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333131264:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5500us (6868us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016080.231018:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9575 00000100:00100000:0.0:1734016080.233424:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.240043:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.240099:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333131520 00000100:00100000:1.0:1734016080.240107:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333131520 00000100:00100000:1.0:1734016080.240153:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9576 00000100:00100000:1.0:1734016080.240159:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007518ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333131520:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016080.240705:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8061175 -> 8061175 00002000:00010000:1.0:1734016080.240708:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016080 -> 1734016080 00002000:00010000:1.0:1734016080.240713:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016080 -> 1734016079 00002000:00010000:1.0:1734016080.240715:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016080 -> 1734016080 00002000:00010000:1.0:1734016080.240716:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1040 -> 1040 00000100:00100000:1.0:1734016080.240766:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007518ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333131520:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 607us (728us total) trans 4294968978 rc 0/0 00000100:00100000:1.0:1734016080.240772:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9576 00000100:00100000:0.0:1734016080.245419:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.245535:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333131776 00000100:00100000:1.0:1734016080.245545:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333131776 00000100:00100000:1.0:1734016080.245624:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7416 00000100:00100000:1.0:1734016080.245631:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007518b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333131776:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:1.0:1734016080.245667:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271128c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016080.245682:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271128ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->3891199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3778 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016080.245689:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016080.245691:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016080.245694:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271128c1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [9015296->9043967] (req 9015296->9043967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016080.245729:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271128ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->3891199) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3778 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016080.245740:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271128ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->3891199) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3778 expref: 8 pid: 7683 timeout: 447 lvb_type: 0 00000100:00100000:1.0:1734016080.245754:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335103104:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016080.245853:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016080.252041:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.252338:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335103104:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016080.252364:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271128c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [9015296->9043967] (req 9015296->9043967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016080.253114:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271128c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9015296->9043967] (req 9015296->9043967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016080.253123:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271128c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9015296->9043967] (req 9015296->9043967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016080.259176:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8061175 -> 9043968 00002000:00010000:0.0:1734016080.259180:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016079 -> 1734016080 00002000:00010000:0.0:1734016080.259183:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1040 -> 1096 00010000:00010000:0.0:1734016080.259195:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271128c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9015296->9043967] (req 9015296->9043967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016080.259203:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271128c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9015296->9043967] (req 9015296->9043967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016080.259211:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271128c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9015296->9043967] (req 9015296->9043967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016080.259222:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499c900 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016080.259226:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271128c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9015296->9043967] (req 9015296->9043967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016080.259235:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271128c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9015296->9043967] (req 9015296->9043967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016080.259256:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271128c1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9015296->9043967] (req 9015296->9043967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016080.259262:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271128c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9015296->9043967] (req 9015296->9043967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016080.259367:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007518b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333131776:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 13730us (13950us total) trans 4294968979 rc 0/0 00000100:00100000:0.0:1734016080.259377:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7416 00000100:00100000:0.0:1734016080.261766:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.261893:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333132032 00000100:00100000:1.0:1734016080.261905:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333132032 00000100:00100000:1.0:1734016080.262154:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9577 00000100:00100000:1.0:1734016080.262161:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007518b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333132032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016080.262183:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016080.262207:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271128c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e377f expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016080.262234:0:7683:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 9043968, mtime: 0x675afc50, atime: 0x675afc50, ctime: 0x675afc50, blocks: 0x448 00010000:00010000:1.0:1734016080.262252:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016080.262254:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016080.262262:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271128c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e377f expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.262275:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271128c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e377f expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.262285:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499eac0, rc 0) 00000100:00100000:1.0:1734016080.262698:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007518b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333132032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 535us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016080.262705:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9577 00000100:00100000:0.0:1734016080.266065:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.266211:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333132160 00000100:00100000:1.0:1734016080.266224:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333132160 00000100:00100000:1.0:1734016080.266279:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9578 00000100:00100000:1.0:1734016080.266286:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007518bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333132160:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016080.266307:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016080.266326:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271128cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3786 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016080.266352:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016080.266354:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016080.266361:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271128cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3786 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.266372:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271128cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3786 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.266381:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016080.266438:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007518bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333132160:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 152us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016080.266445:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9578 00000100:00100000:0.0:1734016080.296638:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.296683:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.296714:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.298330:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7418 00000100:00100000:1.0:1734016080.298341:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333132416:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016080.372726:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333132416:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 74369us (76025us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016080.372742:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7418 00002000:00100000:1.0:1734016080.372760:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff880075608380 x1818247333132416/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:41/0 lens 488/440 e 0 to 0 dl 1734016091 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016080.372771:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075608380 with x1818247333132416 ext(0->4194303) 00002000:00010000:1.0:1734016080.372781:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075608380 00000100:00100000:0.0:1734016080.390524:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.401258:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.429431:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.460007:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.467192:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.485343:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.491743:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.496500:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.504086:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333134464 00000100:00100000:0.0:1734016080.504097:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333134464 00000100:00100000:0.0:1734016080.504153:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9581 00000100:00100000:0.0:1734016080.504161:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333134464:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016080.504428:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 6543827 -> 6543827 00002000:00010000:0.0:1734016080.504432:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016081 -> 1734016081 00002000:00010000:0.0:1734016080.504434:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016080 -> 1734016080 00002000:00010000:0.0:1734016080.504436:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016081 -> 1734016081 00002000:00010000:0.0:1734016080.504439:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 952 -> 952 00000100:00100000:0.0:1734016080.504504:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333134464:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 342us (840us total) trans 4294968981 rc 0/0 00000100:00100000:0.0:1734016080.504512:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9581 00000100:00100000:0.0:1734016080.508953:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.513776:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.514023:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333134720 00000100:00100000:1.0:1734016080.514035:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333134720 00000100:00100000:1.0:1734016080.514099:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9582 00000100:00100000:1.0:1734016080.514107:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333134720:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016080.514140:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016080.514164:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711290e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e37a9 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016080.514249:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335104000:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016080.514355:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016080.516431:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335104000:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016080.516479:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711290e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37a9 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.516496:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711290e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37a9 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.516520:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016080.516579:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333134720:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2471us (2822us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016080.516588:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9582 00000100:00100000:0.0:1734016080.519181:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.519323:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333134848 00000100:00100000:1.0:1734016080.519335:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333134848 00000100:00100000:1.0:1734016080.519385:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9583 00000100:00100000:1.0:1734016080.519392:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333134848:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016080.519413:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016080.519433:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27112915 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e37b0 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016080.519496:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335104128:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016080.519581:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016080.522439:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335104128:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016080.522494:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27112915 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37b0 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.522515:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27112915 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37b0 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.522529:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016080.522597:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333134848:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3204us (3425us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016080.522609:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9583 00000100:00100000:0.0:1734016080.526050:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.526189:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333134976 00000100:00100000:1.0:1734016080.526199:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333134976 00000100:00100000:1.0:1734016080.526782:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9584 00000100:00100000:1.0:1734016080.526790:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333134976:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016080.526853:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016080.527025:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc2711291c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e37b7 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016080.527104:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335104256:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016080.527199:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016080.530890:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335104256:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016080.530936:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc2711291c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37b7 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.530951:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc2711291c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37b7 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.530967:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016080.531039:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333134976:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4247us (5001us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016080.531048:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9584 00000100:00100000:0.0:1734016080.533134:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.533246:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333135104 00000100:00100000:1.0:1734016080.533255:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333135104 00000100:00100000:1.0:1734016080.533295:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9585 00000100:00100000:1.0:1734016080.533301:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333135104:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016080.533321:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016080.533341:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27112923 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e37be expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016080.533399:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335104384:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016080.533664:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016080.535751:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335104384:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016080.535791:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27112923 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37be expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.535878:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27112923 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37be expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.535891:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016080.535937:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333135104:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2635us (2812us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016080.535945:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9585 00000100:00100000:0.0:1734016080.550061:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.550163:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.552088:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7423 00000100:00100000:1.0:1734016080.552102:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333135616:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016080.585238:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333135616:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 33121us (35056us total) trans 0 rc 2351104/2351104 00000100:00100000:1.0:1734016080.585252:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7423 00002000:00100000:1.0:1734016080.585265:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (4190208->6545407) req@ffff88007560b100 x1818247333135616/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:41/0 lens 504/440 e 0 to 0 dl 1734016091 ref 1 fl Complete:/200/0 rc 2351104/2351104 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016080.585274:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560b100 with x1818247333135616 ext(4190208->6545407) 00002000:00010000:1.0:1734016080.585282:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560b100 00000100:00100000:0.0:1734016080.624512:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.626156:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333135744 00000100:00100000:1.0:1734016080.626182:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333135744 00000100:00100000:1.0:1734016080.626286:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9586 00000100:00100000:1.0:1734016080.626300:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333135744:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016080.626339:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016080.626377:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc2711292a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e37c5 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016080.626457:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335104512:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016080.626564:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f780 going to sleep for 11 seconds 00002000:00010000:1.0:1734016080.628347:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016080 -> 1734016081 00000100:00100000:1.0:1734016080.628382:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335104512:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016080.628424:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc2711292a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37c5 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.628438:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc2711292a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37c5 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.628490:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f180, rc 0) 00000100:00100000:1.0:1734016080.628641:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333135744:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2341us (4146us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016080.628653:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9586 00000100:00100000:1.0:1734016080.630851:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333135872 00000100:00100000:1.0:1734016080.630863:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333135872 00000100:00100000:1.0:1734016080.631217:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9587 00000100:00100000:1.0:1734016080.631230:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333135872:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016080.631254:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016080.631288:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27112931 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e37cc expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016080.631366:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335104640:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016080.631453:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016080.633127:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335104640:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016080.633163:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27112931 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37cc expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.633177:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27112931 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37cc expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.633189:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016080.633247:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333135872:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2018us (2575us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016080.633255:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9587 00000100:00100000:1.0:1734016080.635857:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333136000 00000100:00100000:1.0:1734016080.636044:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333136000 00000100:00100000:1.0:1734016080.636113:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9588 00000100:00100000:1.0:1734016080.636124:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333136000:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016080.636152:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016080.636176:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27112938 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e37d3 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016080.636253:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335104768:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016080.636329:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016080.640279:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335104768:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016080.640328:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27112938 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37d3 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.640354:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27112938 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37d3 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.640369:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d8c0, rc 0) 00000100:00100000:1.0:1734016080.640510:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333136000:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4385us (4841us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016080.640519:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9588 00000100:00100000:1.0:1734016080.643594:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333136128 00000100:00100000:1.0:1734016080.643611:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333136128 00000100:00100000:1.0:1734016080.643751:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9589 00000100:00100000:1.0:1734016080.643761:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333136128:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016080.643792:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016080.643858:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc2711293f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e37da expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016080.643946:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335104896:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016080.644042:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016080.646185:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335104896:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016080.646229:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc2711293f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37da expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.646244:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc2711293f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37da expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.646261:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016080.646327:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333136128:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2567us (2914us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016080.646338:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9589 00000100:00100000:0.0:1734016080.654181:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.654284:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333136384 00000100:00100000:1.0:1734016080.654298:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333136384 00000100:00100000:1.0:1734016080.654355:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9590 00000100:00100000:1.0:1734016080.654364:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333136384:12345-192.168.201.16@tcp:16:fsx.0 00000100:00100000:1.0:1734016080.668877:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333136384:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 14500us (14694us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016080.668892:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9590 00000100:00100000:1.0:1734016080.674867:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333136512 00000100:00100000:1.0:1734016080.674884:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333136512 00000100:00100000:1.0:1734016080.674957:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9591 00000100:00100000:1.0:1734016080.674968:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333136512:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016080.675000:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016080.675033:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27112946 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e37e1 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016080.675113:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335105024:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016080.675211:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f780 going to sleep for 11 seconds 00002000:00010000:1.0:1734016080.677376:0:7683:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 952 -> 968 00000100:00100000:1.0:1734016080.677410:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335105024:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016080.677451:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27112946 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37e1 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.677471:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27112946 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37e1 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.678875:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016080.678986:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333136512:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4012us (4301us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016080.678998:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9591 00000100:00100000:0.0:1734016080.685029:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.685119:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333136640 00000100:00100000:1.0:1734016080.685127:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333136640 00000100:00100000:1.0:1734016080.685169:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9592 00000100:00100000:1.0:1734016080.685177:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333136640:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016080.685197:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016080.685214:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711294d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e37e8 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016080.685270:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335105152:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016080.685342:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016080.688333:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335105152:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016080.692050:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711294d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37e8 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.692090:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711294d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37e8 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.692135:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016080.692596:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333136640:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7414us (7574us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016080.692609:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9592 00010000:00010000:0.0:1734016080.722227:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27112954 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3784704->3813375] (req 3784704->3813375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016080.722248:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27112954 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3784704->3813375] (req 3784704->3813375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016080.722259:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27112954 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3784704->3813375] (req 3784704->3813375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016080.722267:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4900 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016080.722271:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27112954 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3784704->3813375] (req 3784704->3813375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016080.722279:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27112954 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3784704->3813375] (req 3784704->3813375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016080.722300:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27112954 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3784704->3813375] (req 3784704->3813375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016080.722306:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27112954 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3784704->3813375] (req 3784704->3813375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016080.722418:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333136896:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 23911us (24223us total) trans 0 rc 28672/28672 00000100:00100000:0.0:1734016080.722429:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7425 00000100:00100000:0.0:1734016080.725586:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.725721:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333137152 00000100:00100000:1.0:1734016080.725735:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333137152 00000100:00100000:1.0:1734016080.725854:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9593 00000100:00100000:1.0:1734016080.725862:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333137152:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016080.725891:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016080.725920:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711295b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e37ef expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016080.725940:0:7683:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 6543827, mtime: 0x675afc51, atime: 0x675afc50, ctime: 0x675afc51, blocks: 0x3c8 00010000:00010000:1.0:1734016080.725961:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016080.725964:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016080.725973:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711295b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37ef expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.725988:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711295b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37ef expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.725998:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016080.726070:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333137152:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 208us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016080.726077:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9593 00000100:00100000:0.0:1734016080.731830:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333137280 00000100:00100000:0.0:1734016080.731843:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333137280 00000100:00100000:0.0:1734016080.731904:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9594 00000100:00100000:0.0:1734016080.731913:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333137280:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016080.731935:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016080.731959:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27112962 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e37f6 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016080.731986:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016080.731988:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016080.731996:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27112962 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37f6 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016080.732011:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27112962 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37f6 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016080.732020:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582f40, rc 0) 00000100:00100000:0.0:1734016080.732073:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333137280:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 161us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016080.732079:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9594 00000100:00100000:1.0:1734016080.765068:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333137664 00000100:00100000:1.0:1734016080.765081:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333137664 00002000:00100000:1.0:1734016080.765133:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (4194304->6545407) req@ffff880075447480 x1818247333137664/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:41/0 lens 488/0 e 0 to 0 dl 1734016091 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016080.765146:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075447480 with x1818247333137664 ext(4194304->6545407) 00002000:00010000:1.0:1734016080.765152:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075447480 00000100:00100000:1.0:1734016080.765172:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333137536 00000100:00100000:1.0:1734016080.765174:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333137536 00002000:00100000:1.0:1734016080.765186:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff880075446a00 x1818247333137536/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:41/0 lens 488/0 e 0 to 0 dl 1734016091 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016080.765193:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075446a00 with x1818247333137536 ext(0->4194303) 00002000:00010000:1.0:1734016080.765196:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075446a00 00000100:00100000:1.0:1734016080.765229:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7426 00000100:00100000:1.0:1734016080.765237:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333137664:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016080.806277:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333137664:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 41026us (41335us total) trans 0 rc 2351104/2351104 00000100:00100000:1.0:1734016080.806288:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7426 00002000:00100000:1.0:1734016080.806300:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (4194304->6545407) req@ffff880075447480 x1818247333137664/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:41/0 lens 488/440 e 0 to 0 dl 1734016091 ref 1 fl Complete:/200/0 rc 2351104/2351104 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016080.806310:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075447480 with x1818247333137664 ext(4194304->6545407) 00002000:00010000:1.0:1734016080.806317:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075447480 00000100:00100000:0.0:1734016080.848995:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.849123:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333137920 00000100:00100000:1.0:1734016080.849140:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333137920 00000100:00100000:1.0:1734016080.849234:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9595 00000100:00100000:1.0:1734016080.849243:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333137920:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016080.849273:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016080.849302:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112969 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e37fd expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016080.849337:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711295b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37ef expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.849346:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27112962 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37f6 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.849352:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016080.849354:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016080.849357:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112969 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1937408->1986559] (req 1937408->1986559) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37fd expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016080.849403:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27112962 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37f6 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.849416:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27112962 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37f6 expref: 6 pid: 7684 timeout: 447 lvb_type: 1 00000100:00100000:1.0:1734016080.849429:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335105408:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016080.849540:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711295b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37ef expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016080.849558:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711295b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37ef expref: 7 pid: 7683 timeout: 447 lvb_type: 1 00000100:00100000:1.0:1734016080.849571:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335105536:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016080.849588:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f480 going to sleep for 11 seconds 00000100:00100000:1.0:1734016080.854574:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335105408:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016080.854594:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335105536:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016080.854645:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112969 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1937408->1986559] (req 1937408->1986559) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37fd expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016080.854667:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016080.854722:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333137920:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5479us (5742us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016080.854734:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9595 00000100:00100000:0.0:1734016080.862404:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.878292:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.888036:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.888087:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333138432 00000100:00100000:0.0:1734016080.888097:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333138432 00002000:00100000:0.0:1734016080.888141:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1982464->1986559) req@ffff88012e254e00 x1818247333138432/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:41/0 lens 488/0 e 0 to 0 dl 1734016091 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016080.888156:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e254e00 with x1818247333138432 ext(1982464->1986559) 00002000:00010000:0.0:1734016080.888161:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e254e00 00000100:00100000:0.0:1734016080.888186:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7428 00000100:00100000:0.0:1734016080.888192:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333138432:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016080.888341:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333138432:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 149us (320us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016080.888349:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7428 00002000:00100000:0.0:1734016080.888355:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1982464->1986559) req@ffff88012e254e00 x1818247333138432/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:41/0 lens 488/4536 e 0 to 0 dl 1734016091 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016080.888362:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e254e00 with x1818247333138432 ext(1982464->1986559) 00002000:00010000:0.0:1734016080.888365:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e254e00 00000100:00100000:0.0:1734016080.896951:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.897075:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333138560 00000100:00100000:1.0:1734016080.897088:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333138560 00000100:00100000:1.0:1734016080.897133:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9596 00000100:00100000:1.0:1734016080.897140:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333138560:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016080.897162:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016080.897181:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27112970 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3804 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016080.897236:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335105792:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016080.897317:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016080.904699:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.918523:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.937865:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.941122:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016080.941399:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333139200 00000100:00100000:1.0:1734016080.941417:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333139200 00002000:00010000:1.0:1734016080.941461:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (9872055->18446744073709551615) 00002000:00100000:1.0:1734016080.941466:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e255f80 with x1818247333139200 ext(9872055->18446744073709551615) 00002000:00010000:1.0:1734016080.941479:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e255f80. 00000100:00100000:1.0:1734016080.941515:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7429 00000100:00100000:1.0:1734016080.941523:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333139200:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016080.941788:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 6543827 -> 9872055 00002000:00010000:1.0:1734016080.941791:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016081 -> 1734016081 00002000:00010000:1.0:1734016080.941793:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016081 -> 1734016080 00002000:00010000:1.0:1734016080.941795:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016081 -> 1734016081 00002000:00010000:1.0:1734016080.941796:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 968 -> 968 00000100:00100000:1.0:1734016080.941883:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333139200:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 360us (768us total) trans 4294968983 rc 0/0 00000100:00100000:1.0:1734016080.941892:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7429 00002000:00010000:1.0:1734016080.941895:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (9872055->18446744073709551615) 00002000:00100000:1.0:1734016080.941897:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e255f80 with x1818247333139200 ext(9872055->18446744073709551615) 00002000:00010000:1.0:1734016080.941901:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e255f80. 00000100:00100000:0.0:1734016080.951294:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.971380:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.986031:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.991141:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016080.998731:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.005615:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016081.006818:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016051 00000100:00100000:0.0:1734016081.007573:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.007621:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.007984:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333140352 00000100:00100000:1.0:1734016081.007989:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333140352 00000100:00100000:1.0:1734016081.008022:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 136 00000100:00100000:1.0:1734016081.008028:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333140352:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1734016081.008062:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333140352:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 34us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016081.008069:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 136 00000100:00080000:0.0:1734016081.008420:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016051 00000100:00080000:0.0:1734016081.008424:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016051 00000100:00100000:0.0:1734016081.014019:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.020387:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.026132:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.026308:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333140736 00000100:00100000:1.0:1734016081.026321:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333140736 00010000:00010000:1.0:1734016081.026375:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112969 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->1986559) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37fd expref: 6 pid: 7683 timeout: 448 lvb_type: 0 00000100:00100000:1.0:1734016081.026432:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2461 00000100:00100000:1.0:1734016081.026440:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333140736:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016081.026460:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016081.026481:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112969 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1937408->1986559) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37fd expref: 6 pid: 7683 timeout: 448 lvb_type: 0 00010000:00010000:1.0:1734016081.026494:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112969 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1937408->1986559) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e37fd expref: 6 pid: 7683 timeout: 448 lvb_type: 0 00010000:00010000:1.0:1734016081.026528:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016081.026530:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016081.026550:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271129a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1568768->1617919) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3827 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016081.026561:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271129a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1568768->1617919) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3827 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016081.026609:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271129a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1568768->1617919) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3827 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016081.026624:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335106560:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016081.026696:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016081.033420:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e50000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335106560:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016081.033444:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016081.033488:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333140736:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7048us (7369us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016081.033497:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2461 00000100:00100000:0.0:1734016081.036005:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.044607:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016081.046495:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016051 00000100:00100000:0.0:1734016081.049591:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.058058:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.070458:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.075776:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.097989:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.143975:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.152838:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333142016 00000100:00100000:0.0:1734016081.152847:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333142016 00000100:00100000:0.0:1734016081.153425:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9608 00000100:00100000:0.0:1734016081.153433:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333142016:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016081.153455:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016081.153477:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271129d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3858 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016081.153560:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335107328:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016081.154306:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016081.163655:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.171579:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016081.176945:0:13914:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271129e0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7045120->7049215] (req 7045120->7049215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016081.176961:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271129e0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7045120->7049215] (req 7045120->7049215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016081.177075:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271129e0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7045120->7049215] (req 7045120->7049215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016081.177083:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271129e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7045120->7049215] (req 7045120->7049215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016081.177089:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271129e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7045120->7049215] (req 7045120->7049215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016081.177095:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc900 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016081.177097:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271129e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7045120->7049215] (req 7045120->7049215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016081.177104:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271129e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7045120->7049215] (req 7045120->7049215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016081.177124:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271129e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7045120->7049215] (req 7045120->7049215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016081.177130:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271129e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7045120->7049215] (req 7045120->7049215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016081.177232:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333142272:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 13237us (13587us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016081.177242:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7433 00000100:00100000:1.0:1734016081.184749:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.189285:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.193774:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.202754:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.208644:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.216044:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.225178:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.233630:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.234497:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333143552 00000100:00100000:1.0:1734016081.234518:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333143552 00002000:00100000:1.0:1734016081.234605:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2617344->9875455) req@ffff8800749e9880 x1818247333143552/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 504/0 e 0 to 0 dl 1734016092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.234618:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e9880 with x1818247333143552 ext(2617344->9875455) 00002000:00010000:1.0:1734016081.234625:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e9880 00000100:00100000:1.0:1734016081.234930:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7434 00000100:00100000:1.0:1734016081.234942:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333143552:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016081.239620:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333143552:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 4656us (5987us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1734016081.239637:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7434 00002000:00100000:1.0:1734016081.239655:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2617344->9875455) req@ffff8800749e9880 x1818247333143552/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 504/440 e 0 to 0 dl 1734016092 ref 1 fl Complete:/200/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.239673:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e9880 with x1818247333143552 ext(2617344->9875455) 00002000:00010000:1.0:1734016081.239679:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e9880 00000100:00100000:0.0:1734016081.242496:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.242743:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333143808 00000100:00100000:1.0:1734016081.242758:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333143808 00002000:00100000:1.0:1734016081.242854:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2613248->2617343) req@ffff8800749eb480 x1818247333143808/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/0 e 0 to 0 dl 1734016092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.242864:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749eb480 with x1818247333143808 ext(2613248->2617343) 00002000:00010000:1.0:1734016081.242872:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749eb480 00000100:00100000:1.0:1734016081.243146:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7435 00000100:00100000:1.0:1734016081.243155:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333143808:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016081.243723:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333143808:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 566us (1244us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016081.243731:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7435 00002000:00100000:1.0:1734016081.243739:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2613248->2617343) req@ffff8800749eb480 x1818247333143808/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/4536 e 0 to 0 dl 1734016092 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.243747:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749eb480 with x1818247333143808 ext(2613248->2617343) 00002000:00010000:1.0:1734016081.243750:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749eb480 00000100:00100000:0.0:1734016081.247420:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.247619:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333144064 00000100:00100000:1.0:1734016081.247630:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333144064 00002000:00100000:1.0:1734016081.247686:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2609152->2613247) req@ffff8800749e9c00 x1818247333144064/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/0 e 0 to 0 dl 1734016092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.247696:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e9c00 with x1818247333144064 ext(2609152->2613247) 00002000:00010000:1.0:1734016081.247701:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e9c00 00000100:00100000:1.0:1734016081.248061:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7436 00000100:00100000:1.0:1734016081.248070:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333144064:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016081.248249:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333144064:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 179us (843us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016081.248255:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7436 00002000:00100000:1.0:1734016081.248261:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2609152->2613247) req@ffff8800749e9c00 x1818247333144064/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/4536 e 0 to 0 dl 1734016092 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.248267:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e9c00 with x1818247333144064 ext(2609152->2613247) 00002000:00010000:1.0:1734016081.248270:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e9c00 00000100:00100000:0.0:1734016081.251467:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.258292:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016081.260662:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968989 is committed 00000001:00080000:0.0:1734016081.260685:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968985 is committed 00000100:00100000:0.0:1734016081.265688:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.274213:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.281754:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.294199:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.302907:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.313710:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.325390:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016081.325913:0:7688:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27112a26 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5259264->5308415] (req 5259264->5308415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016081.325922:0:7688:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27112a26 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5259264->5308415] (req 5259264->5308415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016081.339586:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.345039:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.357173:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.364959:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.364996:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.369025:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.384281:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.384583:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333146496 00000100:00100000:1.0:1734016081.384592:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333146496 00002000:00100000:1.0:1734016081.384632:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6340608->6344703) req@ffff880130408e00 x1818247333146496/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/0 e 0 to 0 dl 1734016092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.384641:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880130408e00 with x1818247333146496 ext(6340608->6344703) 00002000:00010000:1.0:1734016081.384646:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130408e00 00000100:00100000:1.0:1734016081.384672:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7440 00000100:00100000:1.0:1734016081.384677:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333146496:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016081.384820:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333146496:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 142us (547us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016081.384826:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7440 00002000:00100000:1.0:1734016081.384831:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6340608->6344703) req@ffff880130408e00 x1818247333146496/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/4536 e 0 to 0 dl 1734016092 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.384838:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880130408e00 with x1818247333146496 ext(6340608->6344703) 00002000:00010000:1.0:1734016081.384840:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130408e00 00000100:00100000:0.0:1734016081.390173:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.395701:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.397468:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333147008 00000100:00100000:1.0:1734016081.397485:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333147008 00002000:00100000:1.0:1734016081.397593:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6332416->6336511) req@ffff8800750c0e00 x1818247333147008/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/0 e 0 to 0 dl 1734016092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.397602:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0e00 with x1818247333147008 ext(6332416->6336511) 00002000:00010000:1.0:1734016081.397608:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c0e00 00000100:00100000:1.0:1734016081.397647:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7442 00000100:00100000:1.0:1734016081.397653:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333147008:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016081.397864:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333147008:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 210us (2173us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016081.397872:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7442 00002000:00100000:1.0:1734016081.397878:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6332416->6336511) req@ffff8800750c0e00 x1818247333147008/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/4536 e 0 to 0 dl 1734016092 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.397884:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0e00 with x1818247333147008 ext(6332416->6336511) 00002000:00010000:1.0:1734016081.397887:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c0e00 00000100:00100000:0.0:1734016081.408407:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.416234:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.416632:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333147776 00000100:00100000:1.0:1734016081.416643:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333147776 00002000:00100000:1.0:1734016081.416703:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6320128->6324223) req@ffff8800750c2680 x1818247333147776/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/0 e 0 to 0 dl 1734016092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.416713:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c2680 with x1818247333147776 ext(6320128->6324223) 00002000:00010000:1.0:1734016081.416720:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c2680 00000100:00100000:1.0:1734016081.416756:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7445 00000100:00100000:1.0:1734016081.416763:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333147776:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016081.416984:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333147776:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 220us (765us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016081.416990:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7445 00002000:00100000:1.0:1734016081.416995:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6320128->6324223) req@ffff8800750c2680 x1818247333147776/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/4536 e 0 to 0 dl 1734016092 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.417001:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c2680 with x1818247333147776 ext(6320128->6324223) 00002000:00010000:1.0:1734016081.417003:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c2680 00000100:00100000:0.0:1734016081.420430:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.427318:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.427430:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333148288 00000100:00100000:1.0:1734016081.427438:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333148288 00002000:00100000:1.0:1734016081.427483:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6311936->6316031) req@ffff8800750c1c00 x1818247333148288/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/0 e 0 to 0 dl 1734016092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.427492:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c1c00 with x1818247333148288 ext(6311936->6316031) 00002000:00010000:1.0:1734016081.427498:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c1c00 00000100:00100000:1.0:1734016081.427531:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7447 00000100:00100000:1.0:1734016081.427545:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333148288:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016081.427706:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333148288:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 161us (398us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016081.427712:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7447 00002000:00100000:1.0:1734016081.427717:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6311936->6316031) req@ffff8800750c1c00 x1818247333148288/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/4536 e 0 to 0 dl 1734016092 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.427724:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c1c00 with x1818247333148288 ext(6311936->6316031) 00002000:00010000:1.0:1734016081.427727:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c1c00 00000100:00100000:0.0:1734016081.438143:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.441447:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.441660:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333148800 00000100:00100000:1.0:1734016081.441671:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333148800 00002000:00100000:1.0:1734016081.441722:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6303744->6307839) req@ffff88012db09180 x1818247333148800/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/0 e 0 to 0 dl 1734016092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.441731:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db09180 with x1818247333148800 ext(6303744->6307839) 00002000:00010000:1.0:1734016081.441737:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db09180 00000100:00100000:0.0:1734016081.451462:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.451635:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333149056 00000100:00100000:1.0:1734016081.451650:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333149056 00002000:00100000:1.0:1734016081.451701:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6299648->6303743) req@ffff88012db08a80 x1818247333149056/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/0 e 0 to 0 dl 1734016092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.451713:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db08a80 with x1818247333149056 ext(6299648->6303743) 00002000:00010000:1.0:1734016081.451720:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db08a80 00000100:00100000:1.0:1734016081.451760:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7450 00000100:00100000:1.0:1734016081.451768:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333149056:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016081.451990:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333149056:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 221us (536us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016081.451997:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7450 00002000:00100000:1.0:1734016081.452003:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6299648->6303743) req@ffff88012db08a80 x1818247333149056/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/4536 e 0 to 0 dl 1734016092 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.452010:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db08a80 with x1818247333149056 ext(6299648->6303743) 00002000:00010000:1.0:1734016081.452012:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db08a80 00000100:00100000:0.0:1734016081.457334:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.466384:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.466733:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333149568 00000100:00100000:1.0:1734016081.466747:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333149568 00002000:00100000:1.0:1734016081.466789:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6291456->6295551) req@ffff88012db08380 x1818247333149568/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/0 e 0 to 0 dl 1734016092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.466832:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db08380 with x1818247333149568 ext(6291456->6295551) 00002000:00010000:1.0:1734016081.466838:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db08380 00000100:00100000:1.0:1734016081.466880:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7452 00000100:00100000:1.0:1734016081.466888:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333149568:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016081.467087:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333149568:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 198us (714us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016081.467094:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7452 00002000:00100000:1.0:1734016081.467100:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6291456->6295551) req@ffff88012db08380 x1818247333149568/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/4536 e 0 to 0 dl 1734016092 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.467107:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db08380 with x1818247333149568 ext(6291456->6295551) 00002000:00010000:1.0:1734016081.467109:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db08380 00000100:00100000:0.0:1734016081.472269:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.477716:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.477835:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333149952 00000100:00100000:1.0:1734016081.477846:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333149952 00002000:00100000:1.0:1734016081.477888:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6287360->6348799) req@ffff88012db0b480 x1818247333149952/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/0 e 0 to 0 dl 1734016092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.477899:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db0b480 with x1818247333149952 ext(6287360->6348799) 00002000:00010000:1.0:1734016081.477905:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db0b480 00000100:00100000:1.0:1734016081.477944:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7454 00000100:00100000:1.0:1734016081.477951:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333149952:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016081.491593:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333149952:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 13620us (13865us total) trans 4294968990 rc 0/0 00000100:00100000:1.0:1734016081.491617:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7454 00002000:00100000:1.0:1734016081.491636:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6287360->6348799) req@ffff88012db0b480 x1818247333149952/t4294968990(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/448 e 0 to 0 dl 1734016092 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.491650:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db0b480 with x1818247333149952 ext(6287360->6348799) 00002000:00010000:1.0:1734016081.491660:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db0b480 00000100:00100000:0.0:1734016081.497435:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.514568:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.514680:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333150336 00000100:00100000:1.0:1734016081.514690:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333150336 00002000:00100000:1.0:1734016081.514741:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1933312->1937407) req@ffff88012e71b100 x1818247333150336/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/0 e 0 to 0 dl 1734016092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.514751:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71b100 with x1818247333150336 ext(1933312->1937407) 00002000:00010000:1.0:1734016081.514757:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e71b100 00000100:00100000:0.0:1734016081.539303:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.539443:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333150592 00000100:00100000:1.0:1734016081.539455:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333150592 00002000:00100000:1.0:1734016081.539513:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1929216->1933311) req@ffff88012e718000 x1818247333150592/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/0 e 0 to 0 dl 1734016092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.539525:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e718000 with x1818247333150592 ext(1929216->1933311) 00002000:00010000:1.0:1734016081.539540:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e718000 00000100:00100000:0.0:1734016081.550344:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.565657:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.572223:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.589585:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.597797:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.604888:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333151744 00000100:00100000:0.0:1734016081.604902:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333151744 00010000:00010000:0.0:1734016081.604941:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711298c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3812 expref: 14 pid: 6480 timeout: 448 lvb_type: 0 00000100:00100000:0.0:1734016081.605470:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2468 00000100:00100000:0.0:1734016081.605480:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333151744:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016081.605497:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016081.605504:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711298c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3812 expref: 14 pid: 6480 timeout: 448 lvb_type: 0 00010000:00010000:0.0:1734016081.605516:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711298c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3812 expref: 14 pid: 6480 timeout: 448 lvb_type: 0 00010000:00010000:0.0:1734016081.605549:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711298c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3812 expref: 14 pid: 6480 timeout: 448 lvb_type: 0 00010000:00010000:0.0:1734016081.606003:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016081.606007:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27112a5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016081.606017:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27112a5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016081.606026:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27112a5e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016081.606065:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016081.606132:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333151744:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 652us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016081.606140:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2468 00010000:00010000:0.0:1734016081.611263:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27112a5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016081.611277:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27112a5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016081.611284:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27112a5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016081.611289:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd200 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016081.611293:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27112a5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016081.611299:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27112a5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016081.611314:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016081.611317:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016081.611320:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27112a5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016081.611324:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27112a5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016081.618293:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333152128 00000100:00100000:1.0:1734016081.618303:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333152128 00010000:00010000:1.0:1734016081.618331:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27112a50 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e38ba expref: 7 pid: 7682 timeout: 448 lvb_type: 1 00000100:00100000:1.0:1734016081.618372:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333152000 00000100:00100000:1.0:1734016081.618375:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333152000 00010000:00010000:1.0:1734016081.618386:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27112a57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e38c1 expref: 7 pid: 7683 timeout: 448 lvb_type: 1 00000100:00100000:1.0:1734016081.618402:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2469 00000100:00100000:1.0:1734016081.618409:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333152128:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016081.618425:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016081.618447:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27112a50 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e38ba expref: 7 pid: 7682 timeout: 448 lvb_type: 1 00010000:00010000:1.0:1734016081.618456:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27112a50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e38ba expref: 7 pid: 7682 timeout: 448 lvb_type: 1 00010000:00010000:1.0:1734016081.618485:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27112a50 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e38ba expref: 7 pid: 7682 timeout: 448 lvb_type: 1 00010000:00010000:1.0:1734016081.618505:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016081.618548:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333152128:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 139us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016081.618555:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2469 00000100:00100000:1.0:1734016081.618568:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2470 00000100:00100000:1.0:1734016081.618572:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a780bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333152000:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016081.618579:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016081.618586:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27112a57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e38c1 expref: 7 pid: 7683 timeout: 448 lvb_type: 1 00010000:00010000:1.0:1734016081.618596:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27112a57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e38c1 expref: 7 pid: 7683 timeout: 448 lvb_type: 1 00010000:00010000:1.0:1734016081.618606:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27112a57 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e38c1 expref: 7 pid: 7683 timeout: 448 lvb_type: 1 00010000:00010000:1.0:1734016081.618619:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016081.618620:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016081.618626:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27112a65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e38c8 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016081.618633:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27112a65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e38c8 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016081.618670:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27112a65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e38c8 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016081.618687:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335109888:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016081.618731:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016081.622622:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.623514:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335109888:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016081.623546:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016081.623597:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a780bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333152000:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5023us (5432us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016081.623609:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2470 00000100:00100000:0.0:1734016081.636172:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.639625:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.653246:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.668694:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.669253:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333152768 00000100:00100000:0.0:1734016081.669270:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333152768 00000100:00100000:0.0:1734016081.669361:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1853 00000100:00100000:0.0:1734016081.669372:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333152768:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016081.669419:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016081.669448:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27112a88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e38e4 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016081.669578:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27112a8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016081.669594:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27112a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016081.669606:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27112a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:0.0:1734016081.669633:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 1942582 00000004:00200000:0.0:1734016081.669637:0:6480:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016081.669655:0:6480:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27112a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016081.669674:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27112a88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e38e4 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016081.669886:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27112a8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e38e4 expref: 17 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016081.669897:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016081.669900:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016081.669903:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580900, rc 0) 00000100:00100000:0.0:1734016081.669966:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:9668:x1818247333152768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 598us (5190us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016081.669973:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1853 00000100:00100000:0.0:1734016081.674035:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.679780:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335110272:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016081.679872:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27112a96 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e38eb expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016081.679892:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27112a96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e38eb expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016081.680946:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:0.0:1734016081.681249:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333152896:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6979us (7222us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016081.681265:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9631 00000100:00100000:1.0:1734016081.685180:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.685260:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333153024 00000100:00100000:0.0:1734016081.685272:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333153024 00000100:00100000:0.0:1734016081.685335:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9632 00000100:00100000:0.0:1734016081.685343:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333153024:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016081.685362:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016081.685383:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27112a9d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e38f2 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016081.685437:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335110400:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016081.685506:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016081.703679:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.711611:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.713759:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333153408 00000100:00100000:1.0:1734016081.713768:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333153408 00010000:00010000:1.0:1734016081.713813:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27112a65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e38c8 expref: 7 pid: 7683 timeout: 448 lvb_type: 0 00000100:00100000:1.0:1734016081.713881:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2471 00000100:00100000:1.0:1734016081.713888:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333153408:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016081.713904:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016081.713929:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27112a65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e38c8 expref: 7 pid: 7683 timeout: 448 lvb_type: 0 00010000:00010000:1.0:1734016081.713941:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27112a65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e38c8 expref: 7 pid: 7683 timeout: 448 lvb_type: 0 00010000:00010000:1.0:1734016081.713967:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27112a65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e38c8 expref: 7 pid: 7683 timeout: 448 lvb_type: 0 00010000:00010000:1.0:1734016081.713996:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016081.713999:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016081.714008:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27112aab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 970752->974847) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3900 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016081.714018:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27112aab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 970752->974847) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3900 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016081.714066:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27112aab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 970752->974847) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3900 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016081.714082:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335110784:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016081.714152:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016081.720979:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013040bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335110784:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016081.721011:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016081.721080:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333153408:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7190us (9485us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016081.721093:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2471 00000100:00100000:0.0:1734016081.721311:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.759452:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.765965:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.774479:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.774548:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.794082:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.800391:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.808256:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.815740:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.819341:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.837404:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.845041:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.862268:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.876014:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.882598:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.890339:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.896929:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.907877:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.912972:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.916615:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.921960:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.926830:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333158144:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4570us (4850us total) trans 4294968992 rc 0/0 00000100:00100000:0.0:1734016081.926843:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7475 00002000:00100000:0.0:1734016081.926855:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1204224->1265663) req@ffff880075de8000 x1818247333158144/t4294968992(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:42/0 lens 488/448 e 0 to 0 dl 1734016092 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016081.926864:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075de8000 with x1818247333158144 ext(1204224->1265663) 00002000:00010000:0.0:1734016081.926870:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075de8000 00000100:00100000:0.0:1734016081.930965:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.940291:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.946608:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.958685:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.966463:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335111424:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016081.966504:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27112ac7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e391c expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016081.966518:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27112ac7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e391c expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016081.966580:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd440, rc 0) 00000100:00100000:0.0:1734016081.966645:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333158656:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6963us (7975us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016081.966656:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9640 00000100:00100000:0.0:1734016081.975688:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.983893:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016081.992069:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016081.993431:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333159168 00000100:00100000:1.0:1734016081.993444:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333159168 00002000:00100000:1.0:1734016081.993492:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1048576->1052671) req@ffff880075de9880 x1818247333159168/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/0 e 0 to 0 dl 1734016092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.993502:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075de9880 with x1818247333159168 ext(1048576->1052671) 00002000:00010000:1.0:1734016081.993509:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075de9880 00000100:00100000:1.0:1734016081.993549:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7476 00000100:00100000:1.0:1734016081.993555:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333159168:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016081.994630:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333159168:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1071us (2571us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016081.994638:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7476 00002000:00100000:1.0:1734016081.994648:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1048576->1052671) req@ffff880075de9880 x1818247333159168/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:42/0 lens 488/4536 e 0 to 0 dl 1734016092 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016081.994655:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075de9880 with x1818247333159168 ext(1048576->1052671) 00002000:00010000:1.0:1734016081.994658:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075de9880 00000100:00100000:0.0:1734016082.003234:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.022035:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.025146:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.030349:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.032941:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.041290:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.046461:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.046944:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333160448 00000100:00100000:1.0:1734016082.046956:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333160448 00002000:00100000:1.0:1734016082.047482:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (999424->1052671) req@ffff880075dead80 x1818247333160448/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:43/0 lens 488/0 e 0 to 0 dl 1734016093 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016082.047491:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075dead80 with x1818247333160448 ext(999424->1052671) 00010000:00010000:1.0:1734016082.047498:0:13914:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112ace lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 999424->1052671) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3923 expref: 6 pid: 7682 timeout: 449 lvb_type: 0 00010000:00010000:1.0:1734016082.047509:0:13914:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112ace lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 999424->1052671) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3923 expref: 6 pid: 7682 timeout: 449 lvb_type: 0 00002000:00010000:1.0:1734016082.047515:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880075dead80 00000100:00100000:1.0:1734016082.047542:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 282 00000100:00100000:1.0:1734016082.047547:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333160448:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016082.054818:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333160448:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 7243us (8344us total) trans 4294968994 rc 0/0 00000100:00100000:0.0:1734016082.054831:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 282 00002000:00100000:0.0:1734016082.054843:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (999424->1052671) req@ffff880075dead80 x1818247333160448/t4294968994(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:43/0 lens 488/448 e 0 to 0 dl 1734016093 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016082.054853:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075dead80 with x1818247333160448 ext(999424->1052671) 00010000:00010000:0.0:1734016082.054863:0:13914:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112ace lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 999424->1052671) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3923 expref: 8 pid: 7682 timeout: 449 lvb_type: 0 00010000:00010000:0.0:1734016082.054879:0:13914:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112ace lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 999424->1052671) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3923 expref: 8 pid: 7682 timeout: 449 lvb_type: 0 00002000:00010000:0.0:1734016082.054886:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880075dead80 00000100:00100000:0.0:1734016082.063288:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.069655:0:3505:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3505:1818247335112576:0@lo:400:kworker.0 00000100:00100000:1.0:1734016082.069723:0:3505:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016082.069749:0:3505:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335113088:0@lo:400:kworker.0 00000100:00100000:1.0:1734016082.069768:0:3505:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016082.069790:0:3505:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1734016082.069794:0:3505:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3505:1818247335112704:0@lo:400:kworker.0 00000100:00100000:1.0:1734016082.069831:0:3505:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016082.069886:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335112832:0@lo:400:kworker.0 00000100:00100000:0.0:1734016082.069912:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016082.069927:0:3503:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1734016082.069933:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67a75f73-9674-4938-8c12-63813a36f078:3503:1818247335112448:0@lo:400:kworker.0 00000100:00100000:0.0:1734016082.069958:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016082.071016:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335113088 00000100:00100000:1.0:1734016082.071029:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335113088 00000100:00100000:1.0:1734016082.071085:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335112832 00000100:00100000:1.0:1734016082.071088:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335112832 00000100:00100000:1.0:1734016082.071107:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1734016082.071116:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335113088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016082.071195:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335113088:12345-0@lo:400:kworker.0 Request processed in 80us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016082.071203:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1734016082.071222:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1734016082.071226:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335112832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016082.071250:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335112832:12345-0@lo:400:kworker.0 Request processed in 24us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016082.071254:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1734016082.071297:0:3505:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335113088:0@lo:400:kworker.0 00000100:00100000:0.0:1734016082.071569:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3503:1818247335112960:0@lo:400:kworker.0 00000100:00100000:0.0:1734016082.071607:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016082.071865:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335112832:0@lo:400:kworker.0 00000100:00100000:0.0:1734016082.071879:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67a75f73-9674-4938-8c12-63813a36f078:3503:1818247335112448:0@lo:400:kworker.0 00000100:00100000:0.0:1734016082.073602:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3503:1818247335112960:0@lo:400:kworker.0 00000100:00100000:0.0:1734016082.076052:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.080921:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.083890:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.088628:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.093708:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.097251:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.101197:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.104920:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.105047:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333162368 00000100:00100000:1.0:1734016082.105063:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333162368 00000100:00100000:1.0:1734016082.105142:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9647 00000100:00100000:1.0:1734016082.105152:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:9668:x1818247333162368:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016082.105183:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016082.105216:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112b1b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3954 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.105264:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27112b0d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1306623) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3946 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.105274:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112b14 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e394d expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.105282:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016082.105284:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016082.105288:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112b1b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1171456->1216511] (req 1171456->1216511) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3954 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.105340:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112b14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e394d expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.105355:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112b14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e394d expref: 9 pid: 7683 timeout: 449 lvb_type: 1 00000100:00100000:1.0:1734016082.105369:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335113216:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016082.105463:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27112b0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1306623) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3946 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.105474:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27112b0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1306623) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3946 expref: 7 pid: 7682 timeout: 449 lvb_type: 0 00000100:00100000:1.0:1734016082.105484:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335113344:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016082.105503:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016082.110795:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335113216:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016082.110854:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335113344:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016082.110899:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112b1b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1171456->1216511] (req 1171456->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3954 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.110922:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016082.110983:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:9668:x1818247333162368:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5832us (6079us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016082.110997:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9647 00000100:00100000:0.0:1734016082.113400:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.113511:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.116086:0:7685:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335113600 00000100:00100000:0.0:1734016082.116097:0:7685:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335113600 00000100:00100000:0.0:1734016082.116155:0:7685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1734016082.116162:0:7685:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335113600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1734016082.116195:0:7685:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 980120128 pending 77824 free 3923324928 avail 3691716608 00000100:00100000:0.0:1734016082.116235:0:7685:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335113600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016082.116242:0:7685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1734016082.125508:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333162752 00000100:00100000:1.0:1734016082.125520:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333162752 00000100:00100000:1.0:1734016082.125588:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9648 00000100:00100000:1.0:1734016082.125596:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333162752:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016082.126076:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 1942582 -> 1942582 00002000:00010000:1.0:1734016082.126080:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016082 -> 1734016082 00002000:00010000:1.0:1734016082.126082:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016082 -> 1734016082 00002000:00010000:1.0:1734016082.126085:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016082 -> 1734016082 00002000:00010000:1.0:1734016082.126086:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 984 -> 968 00000100:00100000:1.0:1734016082.126153:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333162752:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 557us (790us total) trans 4294968995 rc 0/0 00000100:00100000:1.0:1734016082.126159:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9648 00000100:00100000:0.0:1734016082.135145:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.145781:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.152515:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.158650:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.167738:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.175985:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.182106:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.188148:0:13914:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335113984:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016082.188175:0:13914:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27112b30 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1138688->1150975] (req 1138688->1150975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016082.188939:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016082.190171:0:13914:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27112b30 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1138688->1150975] (req 1138688->1150975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016082.190179:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27112b30 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1138688->1150975] (req 1138688->1150975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016082.190286:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27112b30 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1138688->1150975] (req 1138688->1150975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016082.190294:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27112b30 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1138688->1150975] (req 1138688->1150975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016082.190299:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27112b30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1138688->1150975] (req 1138688->1150975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016082.190305:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcb40 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016082.190309:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27112b30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1138688->1150975] (req 1138688->1150975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016082.190315:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27112b30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1138688->1150975] (req 1138688->1150975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016082.190325:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27112b30 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1138688->1150975] (req 1138688->1150975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016082.190331:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27112b30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1138688->1150975] (req 1138688->1150975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016082.190377:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333164288:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 8102us (8287us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1734016082.190384:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7487 00000100:00100000:0.0:1734016082.194787:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.200325:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.206013:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.206344:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333164928 00000100:00100000:1.0:1734016082.206354:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333164928 00010000:00010000:1.0:1734016082.206388:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27112b37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3969 expref: 10 pid: 7683 timeout: 449 lvb_type: 1 00000100:00100000:1.0:1734016082.206437:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2479 00000100:00100000:1.0:1734016082.206445:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333164928:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016082.206460:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016082.206487:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27112b37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3969 expref: 10 pid: 7683 timeout: 449 lvb_type: 1 00010000:00010000:1.0:1734016082.206497:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27112b37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3969 expref: 10 pid: 7683 timeout: 449 lvb_type: 1 00010000:00010000:1.0:1734016082.206986:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27112b37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3969 expref: 10 pid: 7683 timeout: 449 lvb_type: 1 00010000:00010000:1.0:1734016082.207014:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016082.207016:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016082.207023:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27112b3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3121152->3182591] (req 3121152->3182591) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.207035:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27112b3e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3121152->3182591] (req 3121152->3182591) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.207078:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016082.207145:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333164928:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 698us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016082.207152:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2479 00000001:00080000:0.0:1734016082.216990:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968996 is committed 00000001:00080000:0.0:1734016082.217040:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968993 is committed 00000100:00100000:0.0:1734016082.223145:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.230216:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.230332:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333165184 00000100:00100000:1.0:1734016082.230342:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333165184 00000100:00100000:1.0:1734016082.230476:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9653 00000100:00100000:1.0:1734016082.230484:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333165184:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016082.230507:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016082.230534:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112b4c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3977 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.230566:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27112b45 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3970 expref: 5 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.230574:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016082.230578:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016082.230582:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112b4c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1179648->1208319] (req 1179648->1208319) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3977 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.230613:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27112b45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3970 expref: 5 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.230624:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27112b45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3970 expref: 5 pid: 7683 timeout: 449 lvb_type: 1 00000100:00100000:1.0:1734016082.230637:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335114240:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016082.230951:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016082.234316:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335114240:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016082.234360:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112b4c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1179648->1208319] (req 1179648->1208319) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3977 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.234379:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016082.234427:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333165184:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3942us (4218us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016082.234438:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9653 00000100:00100000:0.0:1734016082.236404:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.236553:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333165312 00000100:00100000:1.0:1734016082.236559:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333165312 00010000:00010000:1.0:1734016082.236586:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27112b45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3970 expref: 6 pid: 7683 timeout: 449 lvb_type: 1 00000100:00100000:1.0:1734016082.236625:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2480 00000100:00100000:1.0:1734016082.236631:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333165312:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016082.236643:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016082.236661:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27112b45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3970 expref: 6 pid: 7683 timeout: 449 lvb_type: 1 00010000:00010000:1.0:1734016082.236671:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27112b45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3970 expref: 6 pid: 7683 timeout: 449 lvb_type: 1 00010000:00010000:1.0:1734016082.236691:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27112b45 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3970 expref: 6 pid: 7683 timeout: 449 lvb_type: 1 00010000:00010000:1.0:1734016082.236705:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016082.236707:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016082.236712:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112b4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1208319) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3977 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.236720:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112b4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1208319) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3977 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.236747:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112b4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1208319) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3977 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016082.236760:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335114368:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016082.236822:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016082.242395:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335114368:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016082.242423:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016082.242472:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333165312:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5838us (6075us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016082.242484:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2480 00000100:00100000:0.0:1734016082.243075:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.243497:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333165440 00000100:00100000:1.0:1734016082.243504:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333165440 00000100:00100000:1.0:1734016082.243554:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9654 00000100:00100000:1.0:1734016082.243560:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333165440:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016082.243793:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 3182592 -> 3182592 00002000:00010000:1.0:1734016082.243796:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016082 -> 1734016082 00002000:00010000:1.0:1734016082.243831:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016082 -> 1734016082 00002000:00010000:1.0:1734016082.243833:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016082 -> 1734016082 00002000:00010000:1.0:1734016082.243835:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1088 -> 1088 00000100:00100000:1.0:1734016082.243905:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333165440:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 343us (831us total) trans 4294968997 rc 0/0 00000100:00100000:1.0:1734016082.243912:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9654 00000100:00100000:0.0:1734016082.247527:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333165568 00000100:00100000:0.0:1734016082.247539:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333165568 00000100:00100000:0.0:1734016082.247640:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9655 00000100:00100000:0.0:1734016082.247650:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333165568:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016082.247677:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016082.247698:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27112b53 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e397e expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016082.247774:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335114496:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016082.247879:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016082.253381:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333165696 00000100:00100000:0.0:1734016082.253389:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333165696 00000100:00100000:0.0:1734016082.253978:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9656 00000100:00100000:0.0:1734016082.253985:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333165696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016082.254005:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016082.254022:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27112b5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3985 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016082.254073:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130409180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335114624:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016082.254143:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016082.264776:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333165952 00000100:00100000:0.0:1734016082.264786:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333165952 00002000:00100000:0.0:1734016082.264840:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (528384->3182591) req@ffff880075444e00 x1818247333165952/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:43/0 lens 504/0 e 0 to 0 dl 1734016093 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016082.264851:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075444e00 with x1818247333165952 ext(528384->3182591) 00002000:00010000:0.0:1734016082.264857:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075444e00 00000100:00100000:0.0:1734016082.264889:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7489 00000100:00100000:0.0:1734016082.264897:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333165952:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016082.284310:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.290338:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.295192:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.298137:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.301955:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.307871:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.312347:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.315662:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.319920:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.324155:0:7686:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335114752 00000100:00100000:1.0:1734016082.324163:0:7686:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335114752 00000100:00100000:1.0:1734016082.324202:0:7686:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1734016082.324209:0:7686:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335114752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1734016082.324241:0:7686:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 490160704 pending 0 free 3923677184 avail 3692154880 00000100:00100000:1.0:1734016082.324285:0:7686:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335114752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016082.324291:0:7686:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1734016082.325536:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.328929:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.334611:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.338653:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.343706:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.348207:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333169408:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 3707us (4501us total) trans 4294968998 rc 0/0 00000100:00100000:0.0:1734016082.348218:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7503 00002000:00100000:0.0:1734016082.348229:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (475136->532479) req@ffff88007493b480 x1818247333169408/t4294968998(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:43/0 lens 488/448 e 0 to 0 dl 1734016093 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016082.348237:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007493b480 with x1818247333169408 ext(475136->532479) 00002000:00010000:0.0:1734016082.348242:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007493b480 00000100:00100000:0.0:1734016082.352754:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016082.354209:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294968998 is committed 00000100:00100000:0.0:1734016082.359369:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.375972:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.404786:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.420515:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.429940:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.430070:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333170304 00000100:00100000:1.0:1734016082.430080:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333170304 00010000:00010000:1.0:1734016082.430122:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112b4c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1208319) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3977 expref: 7 pid: 7682 timeout: 449 lvb_type: 0 00000100:00100000:1.0:1734016082.432009:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2481 00000100:00100000:1.0:1734016082.432017:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333170304:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016082.432036:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016082.432059:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112b4c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->1208319) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3977 expref: 7 pid: 7682 timeout: 449 lvb_type: 0 00010000:00010000:1.0:1734016082.432069:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112b4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->1208319) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3977 expref: 7 pid: 7682 timeout: 449 lvb_type: 0 00010000:00010000:1.0:1734016082.432091:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016082.432093:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016082.432096:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27112b76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2576384->2625535] (req 2576384->2625535) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.432103:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27112b76 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2576384->2625535] (req 2576384->2625535) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.432122:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016082.432175:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333170304:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 159us (2250us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016082.432181:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2481 00000100:00100000:0.0:1734016082.444340:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.449198:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.453200:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.460078:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.460275:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333170944 00000100:00100000:1.0:1734016082.460284:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333170944 00000100:00100000:1.0:1734016082.460654:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9662 00000100:00100000:1.0:1734016082.460660:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333170944:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016082.460681:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016082.460696:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27112b8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e39a8 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.460723:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27112b7d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39a1 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.460729:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016082.460731:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016082.460734:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27112b8b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39a8 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.460759:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27112b7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39a1 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.460769:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27112b7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39a1 expref: 7 pid: 7683 timeout: 449 lvb_type: 1 00000100:00100000:1.0:1734016082.460781:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335115520:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016082.460859:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016082.464859:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016082.465250:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27112b7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39a1 expref: 8 pid: 7683 timeout: 449 lvb_type: 1 00000100:00100000:1.0:1734016082.465268:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335115520:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016082.465293:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27112b8b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39a8 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.465303:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016082.465331:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333170944:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4670us (5261us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016082.465528:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9662 00000100:00100000:0.0:1734016082.469647:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335115648:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016082.469670:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016082.469735:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a780a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333171072:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4594us (4940us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016082.469746:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2483 00000100:00100000:0.0:1734016082.480279:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.532954:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.551232:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.559147:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.559669:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333171840 00000100:00100000:1.0:1734016082.559683:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333171840 00000100:00100000:1.0:1734016082.559758:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9663 00000100:00100000:1.0:1734016082.559770:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333171840:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016082.562425:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969000 is committed 00000100:00100000:1.0:1734016082.565795:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333171840:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 6014us (6650us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016082.565849:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9663 00000100:00100000:1.0:1734016082.570485:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.570527:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333171968 00000100:00100000:0.0:1734016082.570538:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333171968 00000100:00100000:0.0:1734016082.570590:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1857 00000100:00100000:0.0:1734016082.570599:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:9668:x1818247333171968:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016082.570619:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016082.570642:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27112b92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e39af expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016082.570733:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27112b99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016082.570746:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27112b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016082.570757:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27112b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:0.0:1734016082.570782:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 3782840 00000004:00200000:0.0:1734016082.570786:0:6480:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016082.570821:0:6480:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27112b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016082.570848:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27112b92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39af expref: 22 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016082.570865:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27112b99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39af expref: 21 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016082.570872:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016082.570875:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016082.570878:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582f40, rc 0) 00000100:00100000:0.0:1734016082.570926:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:9668:x1818247333171968:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 327us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016082.570933:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1857 00000100:00100000:0.0:1734016082.588366:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.588476:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333172224 00000100:00100000:1.0:1734016082.588486:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333172224 00000100:00100000:1.0:1734016082.588539:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1858 00000100:00100000:1.0:1734016082.588547:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:9668:x1818247333172224:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016082.588744:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112ba0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016082.588761:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27112b99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39af expref: 20 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.588768:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112ba0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016082.588825:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27112b99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39af expref: 20 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.588837:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27112b99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39af expref: 20 pid: 6480 timeout: 449 lvb_type: 0 00000100:00100000:1.0:1734016082.588849:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335115776:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016082.588919:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016082.595190:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335115776:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016082.595225:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112ba0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016082.597168:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016082.597615:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016082.597622:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:0.0:1734016082.597717:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968504 00000004:00010000:0.0:1734016082.597753:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075dea680 reply state ffff880075246000 transno 4294968505 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016082.597759:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016082.597836:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+16:9668:x1818247333172224:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 9289us (9483us total) trans 4294968505 rc 0/0 00000100:00100000:0.0:1734016082.597842:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1858 00000020:00080000:0.0:1734016082.597845:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1734016082.604246:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333172480 00000100:00100000:1.0:1734016082.604256:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333172480 00000100:00100000:1.0:1734016082.604301:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9664 00000100:00100000:1.0:1734016082.604310:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333172480:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016082.604331:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016082.604348:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112ba7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e39b6 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.604374:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27112b8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39a8 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.604381:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016082.604383:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016082.604386:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112ba7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39b6 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.604421:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27112b8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39a8 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.604432:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27112b8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39a8 expref: 5 pid: 7682 timeout: 449 lvb_type: 0 00000100:00100000:1.0:1734016082.604446:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335115904:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016082.604511:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016082.609636:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335115904:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016082.609684:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112ba7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39b6 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.609703:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016082.610218:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333172480:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5907us (6275us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016082.610226:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9664 00000100:00100000:0.0:1734016082.618972:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.637735:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.647536:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.652691:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333172992 00000100:00100000:1.0:1734016082.652702:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333172992 00000100:00100000:1.0:1734016082.652762:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9665 00000100:00100000:1.0:1734016082.652769:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333172992:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016082.652794:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016082.652852:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27112bbc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e39c4 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016082.652933:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335116160:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016082.653022:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016082.657101:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335116160:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016082.657152:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27112bbc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39c4 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.657172:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27112bbc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39c4 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.657184:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016082.657237:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333172992:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4467us (4874us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016082.657245:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9665 00000100:00100000:0.0:1734016082.661753:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.662280:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333173120 00000100:00100000:1.0:1734016082.662294:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333173120 00000100:00100000:1.0:1734016082.662363:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9666 00000100:00100000:1.0:1734016082.662374:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333173120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016082.662404:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016082.662428:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27112bc3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e39cb expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016082.662502:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335116288:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016082.663900:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016082.666101:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335116288:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016082.666145:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27112bc3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39cb expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.666160:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27112bc3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39cb expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.666180:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016082.666228:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333173120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3855us (4490us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016082.666236:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9666 00000100:00100000:1.0:1734016082.673098:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333173248 00000100:00100000:1.0:1734016082.673107:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333173248 00000100:00100000:1.0:1734016082.673149:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9667 00000100:00100000:1.0:1734016082.673155:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333173248:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016082.673172:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016082.673187:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112bca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e39d2 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.673213:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112ba7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39b6 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.673219:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016082.673221:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016082.673224:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112bca lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3702784->3764223] (req 3702784->3764223) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39d2 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.673257:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112ba7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39b6 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.673268:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112ba7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39b6 expref: 7 pid: 7682 timeout: 449 lvb_type: 0 00000100:00100000:1.0:1734016082.673285:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335116416:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016082.673358:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016082.681145:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335116416:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016082.681189:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112bca lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3702784->3764223] (req 3702784->3764223) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39d2 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.681206:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016082.683683:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333173248:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10502us (10645us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016082.683699:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9667 00000100:00100000:0.0:1734016082.685542:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333173376 00000100:00100000:0.0:1734016082.685557:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333173376 00010000:00010000:0.0:1734016082.685612:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112ba7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39b6 expref: 8 pid: 7682 timeout: 449 lvb_type: 0 00000100:00100000:0.0:1734016082.685663:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2486 00000100:00100000:0.0:1734016082.685672:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333173376:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016082.685696:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016082.685732:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112ba7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39b6 expref: 8 pid: 7682 timeout: 449 lvb_type: 0 00010000:00010000:0.0:1734016082.685747:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112ba7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39b6 expref: 8 pid: 7682 timeout: 449 lvb_type: 0 00010000:00010000:0.0:1734016082.685782:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112ba7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39b6 expref: 8 pid: 7682 timeout: 449 lvb_type: 0 00010000:00010000:0.0:1734016082.685848:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016082.685851:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016082.685861:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112bca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3764223) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39d2 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016082.685872:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112bca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3764223) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39d2 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016082.685923:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112bca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3764223) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39d2 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016082.685939:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073945500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335116544:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016082.686015:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016082.691665:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073945500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335116544:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016082.691703:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016082.691776:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333173376:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6102us (6944us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016082.691792:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2486 00000100:00100000:0.0:1734016082.702951:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.704841:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333173504 00000100:00100000:1.0:1734016082.704855:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333173504 00000100:00100000:1.0:1734016082.704922:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9668 00000100:00100000:1.0:1734016082.704930:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333173504:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016082.705885:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10139116 -> 10139116 00002000:00010000:1.0:1734016082.705892:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016083 -> 1734016083 00002000:00010000:1.0:1734016082.705895:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016082 -> 1734016082 00002000:00010000:1.0:1734016082.705897:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016083 -> 1734016083 00002000:00010000:1.0:1734016082.705899:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1168 -> 1104 00000100:00100000:1.0:1734016082.706186:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333173504:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1251us (3243us total) trans 4294969002 rc 0/0 00000100:00100000:1.0:1734016082.706199:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9668 00000100:00100000:1.0:1734016082.710134:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333173632 00000100:00100000:1.0:1734016082.710146:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333173632 00000100:00100000:1.0:1734016082.710210:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9669 00000100:00100000:1.0:1734016082.710216:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333173632:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016082.710245:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016082.710270:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112bd1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e39d9 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.710304:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112bca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3764223) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39d2 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.710313:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016082.710315:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016082.710319:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112bd1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6164480->6217727] (req 6164480->6217727) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39d9 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.710353:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112bca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3764223) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39d2 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.710364:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112bca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3764223) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39d2 expref: 6 pid: 7682 timeout: 449 lvb_type: 0 00000100:00100000:1.0:1734016082.710380:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335116672:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016082.710446:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016082.713088:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335116672:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016082.713148:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112bd1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6164480->6217727] (req 6164480->6217727) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39d9 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.713183:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016082.713250:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333173632:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3031us (3204us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016082.713263:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9669 00000100:00100000:0.0:1734016082.713299:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.713338:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333173760 00000100:00100000:0.0:1734016082.713348:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333173760 00010000:00010000:0.0:1734016082.713383:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112bca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39d2 expref: 7 pid: 7682 timeout: 449 lvb_type: 0 00000100:00100000:0.0:1734016082.713410:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2487 00000100:00100000:0.0:1734016082.713418:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333173760:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016082.713440:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016082.713470:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112bca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39d2 expref: 7 pid: 7682 timeout: 449 lvb_type: 0 00010000:00010000:0.0:1734016082.713487:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112bca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->3764223) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39d2 expref: 7 pid: 7682 timeout: 449 lvb_type: 0 00010000:00010000:0.0:1734016082.713536:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112bca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->3764223) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39d2 expref: 7 pid: 7682 timeout: 449 lvb_type: 0 00010000:00010000:0.0:1734016082.713565:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016082.713567:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016082.713575:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112bd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6164480->6217727) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39d9 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016082.713586:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112bd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6164480->6217727) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39d9 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016082.713623:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112bd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6164480->6217727) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39d9 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016082.713639:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758ad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335116800:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016082.713679:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016082.722763:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758ad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335116800:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016082.722821:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016082.722886:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333173760:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9467us (9586us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016082.722900:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2487 00000100:00100000:1.0:1734016082.727221:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333174016 00000100:00100000:1.0:1734016082.727236:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333174016 00000100:00100000:1.0:1734016082.727296:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9671 00000100:00100000:1.0:1734016082.727304:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333174016:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016082.727333:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016082.727360:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27112bd8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e39e0 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016082.727452:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335116928:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016082.727569:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016082.732399:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335116928:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016082.732449:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27112bd8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39e0 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.732462:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27112bd8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39e0 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.732480:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016082.732556:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333174016:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5252us (5502us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016082.732568:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9671 00000100:00100000:1.0:1734016082.734542:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333174144 00000100:00100000:1.0:1734016082.734552:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333174144 00000100:00100000:1.0:1734016082.734612:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9672 00000100:00100000:1.0:1734016082.734621:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333174144:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016082.734646:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016082.734677:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112bdf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e39e7 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016082.734743:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335117056:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016082.734856:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016082.744963:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335117056:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016082.745028:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112bdf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39e7 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.745047:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27112bdf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e39e7 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.745078:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016082.745771:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333174144:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11145us (11305us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016082.745785:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9672 00000100:00100000:0.0:1734016082.755366:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.768680:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333174400 00000100:00100000:1.0:1734016082.768700:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333174400 00000100:00100000:1.0:1734016082.768797:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9673 00000100:00100000:1.0:1734016082.768855:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333174400:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016082.769147:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10139116 -> 10139116 00002000:00010000:1.0:1734016082.769151:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016083 -> 1734016083 00002000:00010000:1.0:1734016082.769153:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016082 -> 1734016082 00002000:00010000:1.0:1734016082.769156:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016083 -> 1734016082 00002000:00010000:1.0:1734016082.769158:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1104 -> 1120 00000100:00100000:1.0:1734016082.769240:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333174400:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 385us (2550us total) trans 4294969004 rc 0/0 00000100:00100000:1.0:1734016082.769250:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9673 00000100:00100000:0.0:1734016082.773983:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333174528 00000100:00100000:0.0:1734016082.773996:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333174528 00000100:00100000:0.0:1734016082.774070:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9674 00000100:00100000:0.0:1734016082.774081:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333174528:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016082.774110:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016082.774136:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27112bf4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e39f5 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016082.774215:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335117184:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016082.774305:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016082.786860:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333174656 00000100:00100000:0.0:1734016082.786874:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333174656 00000100:00100000:0.0:1734016082.786939:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9675 00000100:00100000:0.0:1734016082.786948:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333174656:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016082.786977:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016082.787000:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27112bfb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e39fc expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016082.787085:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335117312:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016082.787179:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016082.794745:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.801163:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016082.809964:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969005 is committed 00000001:00080000:0.0:1734016082.810003:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969002 is committed 00000100:00100000:0.0:1734016082.817035:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.825700:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.835554:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016082.837941:0:13914:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112c10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [483328->520191] (req 483328->520191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016082.837952:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112c10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [483328->520191] (req 483328->520191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.846269:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112c10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [483328->520191] (req 483328->520191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.846283:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112c10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [483328->520191] (req 483328->520191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.846291:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112c10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [483328->520191] (req 483328->520191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.846296:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd200 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016082.846300:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112c10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [483328->520191] (req 483328->520191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.846307:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112c10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [483328->520191] (req 483328->520191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.846324:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112c10 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [483328->520191] (req 483328->520191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.846332:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112c10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [483328->520191] (req 483328->520191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016082.846475:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333175424:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 20452us (20793us total) trans 4294969006 rc 0/0 00000100:00100000:1.0:1734016082.846484:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7510 00000100:00100000:0.0:1734016082.850270:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.855263:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.856547:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333175808 00000100:00100000:1.0:1734016082.856561:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333175808 00000100:00100000:1.0:1734016082.856795:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9678 00000100:00100000:1.0:1734016082.856824:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333175808:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016082.856850:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016082.856877:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27112c1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3a11 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.856914:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016082.856917:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016082.856928:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27112c1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a11 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.856949:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27112c1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a11 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.856964:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016082.857468:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333175808:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 644us (2212us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016082.857477:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9678 00000100:00100000:0.0:1734016082.860958:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.869860:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.874000:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333176320 00000100:00100000:1.0:1734016082.874011:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333176320 00000100:00100000:1.0:1734016082.874055:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9679 00000100:00100000:1.0:1734016082.874062:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333176320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016082.874086:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016082.874108:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27112c2c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3a18 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.874141:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112c17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a0a expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.874150:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27112c1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a11 expref: 5 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.874156:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016082.874158:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016082.874160:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27112c2c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a18 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.874195:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27112c1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a11 expref: 5 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.874207:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27112c1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a11 expref: 5 pid: 7682 timeout: 450 lvb_type: 1 00000100:00100000:1.0:1734016082.874221:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335117824:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016082.874283:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112c17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a0a expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.874290:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112c17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a0a expref: 8 pid: 7683 timeout: 450 lvb_type: 1 00000100:00100000:1.0:1734016082.874298:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073791880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335117952:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016082.874312:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00010000:00010000:0.0:1734016082.874596:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27112c25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016082.874605:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27112c25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016082.874612:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27112c25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016082.874619:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbdf80 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016082.874623:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27112c25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016082.874628:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27112c25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016082.874642:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016082.874645:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016082.874650:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27112c25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016082.874655:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27112c25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00000100:00100000:0.0:1734016082.883256:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.883302:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016082.883893:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27112c1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a11 expref: 5 pid: 7682 timeout: 450 lvb_type: 1 00000100:00100000:1.0:1734016082.883913:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335117824:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016082.883951:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112c17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a0a expref: 9 pid: 7683 timeout: 450 lvb_type: 1 00000100:00100000:1.0:1734016082.883960:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073791880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335117952:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016082.883983:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27112c2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a18 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.883992:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016082.884018:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333176320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9957us (10260us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016082.884026:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9679 00000100:00100000:0.0:1734016082.888274:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.895679:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.904372:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.904554:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333176960 00000100:00100000:1.0:1734016082.904569:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333176960 00000100:00100000:1.0:1734016082.904654:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9680 00000100:00100000:1.0:1734016082.904665:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333176960:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016082.904699:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016082.904728:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27112c41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3a26 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016082.904867:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073791880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335118208:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016082.904956:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016082.908280:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073791880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335118208:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016082.908332:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27112c41 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a26 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.908346:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27112c41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a26 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.908555:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016082.908604:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333176960:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3940us (4247us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016082.908612:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9680 00000100:00100000:0.0:1734016082.912205:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.912496:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333177088 00000100:00100000:1.0:1734016082.912524:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333177088 00000100:00100000:1.0:1734016082.913294:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9681 00000100:00100000:1.0:1734016082.913308:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333177088:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016082.913343:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016082.913373:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27112c48 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3a2d expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016082.913465:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073791880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335118336:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016082.913567:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016082.917718:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073791880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335118336:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016082.917780:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27112c48 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a2d expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.917842:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27112c48 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a2d expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016082.918019:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016082.918088:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333177088:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4780us (5894us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016082.918099:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9681 00000100:00100000:0.0:1734016082.921639:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.921908:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333177216 00000100:00100000:1.0:1734016082.921926:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333177216 00000100:00100000:1.0:1734016082.921983:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9682 00000100:00100000:1.0:1734016082.921992:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333177216:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016082.922019:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016082.922045:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27112c4f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3a34 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.922082:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27112c2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a18 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.922091:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016082.922094:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016082.922098:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27112c4f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [299008->364543] (req 299008->364543) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a34 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.922138:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27112c2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a18 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016082.922150:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27112c2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a18 expref: 7 pid: 7682 timeout: 450 lvb_type: 0 00000100:00100000:1.0:1734016082.922166:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073791880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335118464:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016082.922243:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016082.928007:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.934012:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.940388:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.946082:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.952171:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.959315:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.963869:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.970991:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.977780:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.986632:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016082.991626:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016082.998475:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.002914:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.008171:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.015354:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333179264 00000100:00100000:0.0:1734016083.015368:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333179264 00000100:00100000:0.0:1734016083.015418:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9692 00000100:00100000:0.0:1734016083.015428:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333179264:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016083.015455:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016083.015482:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27112c95 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3a6c expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016083.015530:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112c87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->1744895) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a65 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016083.015538:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016083.015542:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016083.015545:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27112c95 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a6c expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016083.015587:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112c87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->1744895) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a65 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016083.015600:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112c87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->1744895) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a65 expref: 8 pid: 7682 timeout: 450 lvb_type: 0 00000100:00100000:0.0:1734016083.015614:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075652680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335119744:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016083.016108:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee780 going to sleep for 11 seconds 00000100:00100000:0.0:1734016083.021112:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016083.021484:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333179392 00000100:00100000:1.0:1734016083.021491:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333179392 00010000:00010000:1.0:1734016083.021787:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112c87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->1744895) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a65 expref: 9 pid: 7682 timeout: 450 lvb_type: 0 00000100:00100000:1.0:1734016083.022153:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2496 00000100:00100000:1.0:1734016083.022160:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075650380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333179392:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016083.022175:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016083.022194:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112c87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->1744895) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a65 expref: 9 pid: 7682 timeout: 450 lvb_type: 0 00010000:00010000:1.0:1734016083.022206:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112c87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->1744895) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a65 expref: 9 pid: 7682 timeout: 450 lvb_type: 0 00010000:00010000:1.0:1734016083.022226:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112c87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->1744895) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a65 expref: 9 pid: 7682 timeout: 450 lvb_type: 0 00010000:00010000:1.0:1734016083.022415:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016083.022418:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016083.022427:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27112c95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a6c expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016083.022437:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27112c95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a6c expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016083.022481:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27112c95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a6c expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016083.022496:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335119872:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016083.022572:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016083.026217:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016083.028853:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335119872:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016083.028881:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016083.028911:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075650380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333179392:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6751us (7807us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016083.028922:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2496 00000100:00100000:0.0:1734016083.031788:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.037257:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.038998:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1866 00000100:00100000:0.0:1734016083.039017:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+17:9668:x1818247333179776:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016083.039137:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016083.039182:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d8c0/0x5e3a3adc27112caa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3a7a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016083.039345:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27112cb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016083.039366:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27112cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016083.039382:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27112cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:1.0:1734016083.039424:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 1532372 00000004:00200000:1.0:1734016083.039429:0:6480:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016083.039457:0:6480:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27112cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016083.039492:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d8c0/0x5e3a3adc27112caa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a7a expref: 19 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016083.040791:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27112cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a7a expref: 18 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016083.040846:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016083.040850:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016083.040855:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016083.040953:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333179776:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1939us (3715us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016083.040964:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1866 00000100:00100000:0.0:1734016083.045903:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.049772:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075de8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335120000:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016083.049975:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27112cb8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a81 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016083.049996:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27112cb8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a81 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016083.050026:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd680, rc 0) 00000100:00100000:1.0:1734016083.050194:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333179904:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3938us (4312us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016083.050207:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9693 00000100:00100000:0.0:1734016083.057034:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016083.058762:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333180032 00000100:00100000:1.0:1734016083.058780:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333180032 00000100:00100000:1.0:1734016083.058922:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9694 00000100:00100000:1.0:1734016083.058932:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333180032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016083.058963:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016083.058998:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27112cbf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3a88 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016083.059038:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27112c95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a6c expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016083.059048:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016083.059050:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016083.059055:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27112cbf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6246400->6254591] (req 6246400->6254591) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a88 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016083.059099:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27112c95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a6c expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016083.059113:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27112c95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a6c expref: 8 pid: 7683 timeout: 450 lvb_type: 0 00000100:00100000:1.0:1734016083.059127:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335120128:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016083.059234:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016083.064817:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335120128:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016083.064860:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27112cbf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6246400->6254591] (req 6246400->6254591) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a88 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016083.064879:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f180, rc 0) 00000100:00100000:1.0:1734016083.065452:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:9668:x1818247333180032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6520us (8430us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016083.065462:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9694 00000100:00100000:0.0:1734016083.070616:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016083.072369:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333180160 00000100:00100000:1.0:1734016083.072387:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333180160 00010000:00010000:1.0:1734016083.072433:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27112c95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a6c expref: 9 pid: 7683 timeout: 450 lvb_type: 0 00000100:00100000:1.0:1734016083.072489:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2497 00000100:00100000:1.0:1734016083.072497:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a780b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333180160:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016083.072528:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016083.072549:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27112c95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a6c expref: 9 pid: 7683 timeout: 450 lvb_type: 0 00010000:00010000:1.0:1734016083.072561:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27112c95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a6c expref: 9 pid: 7683 timeout: 450 lvb_type: 0 00010000:00010000:1.0:1734016083.072595:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27112c95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a6c expref: 9 pid: 7683 timeout: 450 lvb_type: 0 00010000:00010000:1.0:1734016083.072622:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016083.072624:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016083.072632:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27112cbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6246400->6254591) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a88 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016083.072642:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27112cbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6246400->6254591) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a88 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016083.072685:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27112cbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6246400->6254591) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a88 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016083.072703:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335120256:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016083.072792:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016083.090550:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016083.091243:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335120256:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016083.091261:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016083.091280:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a780b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333180160:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 18784us (20682us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016083.091287:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2497 00000100:00100000:0.0:1734016083.094395:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.104774:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016083.110523:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.110842:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333180800 00000100:00100000:0.0:1734016083.110849:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333180800 00010000:00010000:0.0:1734016083.110886:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27112cbf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6246400->6254591) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a88 expref: 10 pid: 7683 timeout: 450 lvb_type: 0 00000100:00100000:0.0:1734016083.110928:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2498 00000100:00100000:0.0:1734016083.110936:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333180800:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016083.110952:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016083.110981:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27112cbf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6246400->6254591) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a88 expref: 10 pid: 7683 timeout: 450 lvb_type: 0 00010000:00010000:0.0:1734016083.110995:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27112cbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6246400->6254591) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a88 expref: 10 pid: 7683 timeout: 450 lvb_type: 0 00010000:00010000:0.0:1734016083.111022:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27112cbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6246400->6254591) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a88 expref: 10 pid: 7683 timeout: 450 lvb_type: 0 00010000:00010000:0.0:1734016083.111045:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016083.111047:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016083.111053:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112ccd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5521408->5566463] (req 5521408->5566463) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016083.111063:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27112ccd lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5521408->5566463] (req 5521408->5566463) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016083.111102:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016083.111153:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333180800:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 216us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016083.111161:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2498 00000100:00100000:0.0:1734016083.119661:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.124973:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.131098:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.136341:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016083.143680:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.143916:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333181568 00000100:00100000:0.0:1734016083.143931:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333181568 00010000:00010000:0.0:1734016083.143981:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27112cd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a96 expref: 9 pid: 7682 timeout: 450 lvb_type: 1 00000100:00100000:0.0:1734016083.144035:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2500 00000100:00100000:0.0:1734016083.144045:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333181568:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016083.144069:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016083.144101:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27112cd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a96 expref: 9 pid: 7682 timeout: 450 lvb_type: 1 00010000:00010000:0.0:1734016083.144116:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27112cd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a96 expref: 9 pid: 7682 timeout: 450 lvb_type: 1 00010000:00010000:0.0:1734016083.144159:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27112cd4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a96 expref: 9 pid: 7682 timeout: 450 lvb_type: 1 00010000:00010000:0.0:1734016083.144192:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016083.144195:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016083.144205:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27112ce2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a9d expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016083.144214:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27112ce2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a9d expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016083.144261:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27112ce2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3a9d expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016083.144275:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335120896:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016083.144346:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eec00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016083.150120:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.158009:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016083.165369:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.172008:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.176307:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.192230:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.197288:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016083.197409:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333182720 00000100:00100000:1.0:1734016083.197421:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333182720 00002000:00100000:1.0:1734016083.197469:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (4194304->5054463) req@ffff8800a7aad850 x1818247333182720/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:44/0 lens 488/0 e 0 to 0 dl 1734016094 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016083.197480:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7aad850 with x1818247333182720 ext(4194304->5054463) 00002000:00010000:1.0:1734016083.197486:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7aad850 00000100:00100000:1.0:1734016083.197528:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7516 00000100:00100000:1.0:1734016083.197536:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333182720:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016083.213349:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333182720:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 15801us (16061us total) trans 0 rc 860160/860160 00000100:00100000:0.0:1734016083.213364:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7516 00002000:00100000:0.0:1734016083.213378:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (4194304->5054463) req@ffff8800a7aad850 x1818247333182720/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:44/0 lens 488/440 e 0 to 0 dl 1734016094 ref 1 fl Complete:/200/0 rc 860160/860160 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016083.213388:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7aad850 with x1818247333182720 ext(4194304->5054463) 00002000:00010000:0.0:1734016083.213394:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7aad850 00000100:00100000:0.0:1734016083.266189:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.280884:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.292527:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.296619:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.304256:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.312700:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.320334:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.327281:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.335052:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.343558:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.350340:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.371896:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.374789:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.379360:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.385608:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.391091:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.396421:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.403430:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.410617:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.415602:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.422234:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.425784:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.449666:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.459395:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.473687:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.480928:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.491766:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016083.494150:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333186816 00000100:00100000:1.0:1734016083.494174:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333186816 00000100:00100000:1.0:1734016083.494298:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1872 00000100:00100000:1.0:1734016083.494312:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+19:9668:x1818247333186816:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016083.494355:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016083.494401:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f180/0x5e3a3adc27112d8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3b14 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016083.494571:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27112d91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016083.494591:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27112d91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016083.494606:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27112d91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:1.0:1734016083.494643:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 3421237 00000004:00200000:1.0:1734016083.494653:0:6480:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016083.494684:0:6480:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27112d91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016083.494715:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f180/0x5e3a3adc27112d8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b14 expref: 21 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016083.494751:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27112d91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b14 expref: 20 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016083.494761:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016083.494764:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016083.494768:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016083.494879:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333186816:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 569us (3133us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016083.494889:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1872 00000100:00100000:0.0:1734016083.503518:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.519629:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.567505:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333187328 00000100:00100000:0.0:1734016083.567522:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333187328 00002000:00100000:0.0:1734016083.567616:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->3424255) req@ffff880075de8e00 x1818247333187328/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:44/0 lens 488/0 e 0 to 0 dl 1734016094 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016083.567630:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075de8e00 with x1818247333187328 ext(0->3424255) 00002000:00010000:0.0:1734016083.567637:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075de8e00 00000100:00100000:0.0:1734016083.567699:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7521 00000100:00100000:0.0:1734016083.567711:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333187328:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016083.653375:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016083.670928:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016083.676180:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016083.676483:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333187712 00000100:00100000:1.0:1734016083.676488:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333187712 00000100:00100000:1.0:1734016083.676530:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9717 00000100:00100000:1.0:1734016083.676535:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333187712:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016083.676945:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 3421237 -> 3421237 00002000:00010000:1.0:1734016083.676949:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016084 -> 1734016084 00002000:00010000:1.0:1734016083.676950:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016083 -> 1734016083 00002000:00010000:1.0:1734016083.676952:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016084 -> 1734016084 00002000:00010000:1.0:1734016083.676954:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1008 -> 960 00000100:00100000:1.0:1734016083.676971:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333187712:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 435us (801us total) trans 4294969018 rc 0/0 00000100:00100000:1.0:1734016083.676976:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9717 00000100:00100000:0.0:1734016083.700045:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333187840 00000100:00100000:0.0:1734016083.700059:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333187840 00000100:00100000:0.0:1734016083.700114:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9718 00000100:00100000:0.0:1734016083.700123:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333187840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016083.700149:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016083.700189:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27112dad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3b30 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016083.700261:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335123840:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016083.700358:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016083.717417:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333187968 00000100:00100000:0.0:1734016083.717432:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333187968 00000100:00100000:0.0:1734016083.717586:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9719 00000100:00100000:0.0:1734016083.717596:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333187968:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016083.717630:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016083.717657:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27112db4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3b37 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016083.717739:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335123968:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016083.720318:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016083.753061:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333188224 00000100:00100000:0.0:1734016083.753078:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333188224 00002000:00100000:0.0:1734016083.753149:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->3424255) req@ffff880075deb480 x1818247333188224/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:44/0 lens 488/0 e 0 to 0 dl 1734016094 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016083.753163:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075deb480 with x1818247333188224 ext(0->3424255) 00002000:00010000:0.0:1734016083.753171:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075deb480 00000100:00100000:0.0:1734016083.753214:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7522 00000100:00100000:0.0:1734016083.753222:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333188224:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016083.824217:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333188224:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 70978us (71292us total) trans 0 rc 3424256/3424256 00000100:00100000:1.0:1734016083.824238:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7522 00002000:00100000:1.0:1734016083.824258:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->3424255) req@ffff880075deb480 x1818247333188224/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:44/0 lens 488/440 e 0 to 0 dl 1734016094 ref 1 fl Complete:/200/0 rc 3424256/3424256 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016083.824268:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075deb480 with x1818247333188224 ext(0->3424255) 00002000:00010000:1.0:1734016083.824277:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075deb480 00000100:00100000:0.0:1734016083.849605:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.871300:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.895901:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016083.896028:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333188736 00000100:00100000:1.0:1734016083.896041:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333188736 00000100:00100000:1.0:1734016083.897370:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7523 00000100:00100000:1.0:1734016083.897383:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333188736:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:1.0:1734016083.897432:0:7688:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27112dc9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016083.897452:0:7688:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27112da6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->479231) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b29 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016083.897459:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016083.897461:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016083.897464:0:7688:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27112dc9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [135168->184319] (req 135168->184319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016083.897511:0:7688:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27112da6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->479231) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b29 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016083.897525:0:7688:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27112da6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->479231) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b29 expref: 8 pid: 7683 timeout: 451 lvb_type: 0 00000100:00100000:1.0:1734016083.897540:0:7688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335124352:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016083.897630:0:7688:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016083.904920:0:7688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335124352:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016083.904959:0:7688:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27112dc9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [135168->184319] (req 135168->184319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016083.921718:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016083.923044:0:7688:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27112dc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [135168->184319] (req 135168->184319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016083.923054:0:7688:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27112dc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [135168->184319] (req 135168->184319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016083.945214:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969019 is committed 00000001:00080000:0.0:1734016083.945249:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969017 is committed 00000100:00100000:0.0:1734016083.947791:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.957619:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016083.971091:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00002000:00010000:0.0:1734016083.983449:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1048 -> 1072 00010000:00010000:0.0:1734016083.983467:0:7688:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112dd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1052672->1077247] (req 1052672->1077247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016083.983481:0:7688:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112dd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1052672->1077247] (req 1052672->1077247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016083.983488:0:7688:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112dd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1052672->1077247] (req 1052672->1077247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016083.983509:0:7688:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc480 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016083.983513:0:7688:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112dd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1052672->1077247] (req 1052672->1077247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016083.983521:0:7688:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112dd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1052672->1077247] (req 1052672->1077247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016083.983539:0:7688:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112dd7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1052672->1077247] (req 1052672->1077247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016083.983544:0:7688:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112dd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1052672->1077247] (req 1052672->1077247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016083.985169:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333189248:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 26320us (27560us total) trans 4294969020 rc 0/0 00000100:00100000:0.0:1734016083.985185:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7524 00000100:00100000:0.0:1734016083.990066:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016083.990152:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333189504 00000100:00100000:1.0:1734016083.990164:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333189504 00000100:00100000:1.0:1734016083.990220:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9723 00000100:00100000:1.0:1734016083.990227:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333189504:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016083.990245:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016083.990269:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27112dde lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3b53 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016083.990294:0:7683:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 3421237, mtime: 0x675afc54, atime: 0x675afc53, ctime: 0x675afc54, blocks: 0x430 00010000:00010000:1.0:1734016083.990320:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016083.990322:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016083.990330:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27112dde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b53 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016083.990349:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27112dde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b53 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016083.990360:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016083.990420:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333189504:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 192us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016083.990426:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9723 00000100:00100000:0.0:1734016083.993902:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.006521:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.006867:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333189760 00000100:00100000:1.0:1734016084.006881:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333189760 00010000:00010000:1.0:1734016084.006933:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27112dde lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b53 expref: 7 pid: 7683 timeout: 451 lvb_type: 1 00000100:00100000:1.0:1734016084.006988:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2512 00000100:00100000:1.0:1734016084.006998:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333189760:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016084.007022:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016084.007048:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27112dde lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b53 expref: 7 pid: 7683 timeout: 451 lvb_type: 1 00010000:00010000:1.0:1734016084.007064:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27112dde lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b53 expref: 7 pid: 7683 timeout: 451 lvb_type: 1 00010000:00010000:1.0:1734016084.007101:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016084.007105:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016084.007113:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112de5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->53247) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b5a expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.007124:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112de5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->53247) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b5a expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.007164:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27112de5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->53247) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b5a expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016084.007180:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335124736:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016084.007250:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016084.011263:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.011424:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335124736:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016084.011461:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016084.011528:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333189760:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4530us (5019us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016084.011544:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2512 00000100:00100000:0.0:1734016084.023835:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.023933:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333190016 00000100:00100000:1.0:1734016084.023944:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333190016 00000100:00100000:1.0:1734016084.024934:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9726 00000100:00100000:1.0:1734016084.024947:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333190016:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016084.024972:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016084.025002:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27112dec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3b61 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016084.025096:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335124864:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016084.025204:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f480 going to sleep for 11 seconds 00002000:00010000:1.0:1734016084.026720:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016083 -> 1734016084 00000100:00100000:1.0:1734016084.026743:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335124864:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016084.026780:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27112dec lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b61 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.026793:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27112dec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b61 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.026849:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016084.026896:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333190016:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1950us (3098us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016084.026906:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9726 00000100:00100000:1.0:1734016084.029244:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333190144 00000100:00100000:1.0:1734016084.029254:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333190144 00000100:00100000:1.0:1734016084.029300:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9727 00000100:00100000:1.0:1734016084.029306:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333190144:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016084.029323:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016084.029339:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27112df3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3b68 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016084.029386:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335124992:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016084.029440:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f480 going to sleep for 11 seconds 00000100:00100000:1.0:1734016084.031513:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335124992:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016084.031549:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27112df3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b68 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.031566:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27112df3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b68 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.031577:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016084.031859:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333190144:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2550us (2707us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016084.031870:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9727 00000100:00100000:0.0:1734016084.041272:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.041980:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333190272 00000100:00100000:1.0:1734016084.041999:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333190272 00000100:00100000:1.0:1734016084.042076:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9728 00000100:00100000:1.0:1734016084.042085:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333190272:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016084.042697:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 3421237 -> 3421237 00002000:00010000:1.0:1734016084.042700:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016084 -> 1734016084 00002000:00010000:1.0:1734016084.042703:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016084 -> 1734016083 00002000:00010000:1.0:1734016084.042705:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016084 -> 1734016084 00002000:00010000:1.0:1734016084.042706:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1024 -> 928 00000100:00100000:1.0:1734016084.042757:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333190272:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 672us (1496us total) trans 4294969022 rc 0/0 00000100:00100000:1.0:1734016084.042765:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9728 00000100:00100000:0.0:1734016084.044886:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.044913:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333190400 00000100:00100000:1.0:1734016084.045034:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333190400 00000100:00100000:1.0:1734016084.045648:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9729 00000100:00100000:1.0:1734016084.045657:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333190400:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016084.045677:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016084.045696:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27112dfa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3b6f expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016084.045754:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335125120:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016084.048476:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016084.059087:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.070399:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.078299:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.084935:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.093401:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.098219:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.104733:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075dead80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335125888:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016084.104759:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016084.104848:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333191168:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6287us (6628us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016084.104860:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2513 00000100:00100000:1.0:1734016084.105073:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333191424 00000100:00100000:1.0:1734016084.105082:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333191424 00002000:00100000:1.0:1734016084.105120:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (700416->704511) req@ffff880075debb80 x1818247333191424/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/0 e 0 to 0 dl 1734016095 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016084.105130:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075debb80 with x1818247333191424 ext(700416->704511) 00002000:00010000:1.0:1734016084.105134:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075debb80 00000100:00100000:1.0:1734016084.105376:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7525 00000100:00100000:1.0:1734016084.105383:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333191424:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016084.105536:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333191424:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 153us (1432us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016084.105543:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7525 00002000:00100000:1.0:1734016084.105548:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (700416->704511) req@ffff880075debb80 x1818247333191424/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/4536 e 0 to 0 dl 1734016095 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016084.105556:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075debb80 with x1818247333191424 ext(700416->704511) 00002000:00010000:1.0:1734016084.105559:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075debb80 00000100:00100000:0.0:1734016084.109758:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.115171:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.119440:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.119716:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333192192 00000100:00100000:1.0:1734016084.119727:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333192192 00002000:00100000:1.0:1734016084.119775:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (688128->692223) req@ffff880073945880 x1818247333192192/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/0 e 0 to 0 dl 1734016095 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016084.119784:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073945880 with x1818247333192192 ext(688128->692223) 00002000:00010000:1.0:1734016084.119789:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073945880 00000100:00100000:1.0:1734016084.119860:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7528 00000100:00100000:1.0:1734016084.119868:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333192192:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016084.120114:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333192192:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 244us (687us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016084.120124:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7528 00002000:00100000:1.0:1734016084.120132:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (688128->692223) req@ffff880073945880 x1818247333192192/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/4536 e 0 to 0 dl 1734016095 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016084.120139:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073945880 with x1818247333192192 ext(688128->692223) 00002000:00010000:1.0:1734016084.120142:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073945880 00000100:00100000:0.0:1734016084.123530:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.127849:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.128036:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333192704 00000100:00100000:1.0:1734016084.128045:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333192704 00002000:00100000:1.0:1734016084.128084:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (679936->684031) req@ffff880073945500 x1818247333192704/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/0 e 0 to 0 dl 1734016095 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016084.128095:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073945500 with x1818247333192704 ext(679936->684031) 00002000:00010000:1.0:1734016084.128102:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073945500 00000100:00100000:1.0:1734016084.128136:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7530 00000100:00100000:1.0:1734016084.128142:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333192704:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016084.128290:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333192704:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 147us (454us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016084.128295:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7530 00002000:00100000:1.0:1734016084.128300:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (679936->684031) req@ffff880073945500 x1818247333192704/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/4536 e 0 to 0 dl 1734016095 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016084.128306:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073945500 with x1818247333192704 ext(679936->684031) 00002000:00010000:1.0:1734016084.128309:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073945500 00000100:00100000:0.0:1734016084.132722:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.138030:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.138218:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333193216 00000100:00100000:1.0:1734016084.138228:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333193216 00002000:00100000:1.0:1734016084.138277:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (671744->675839) req@ffff8800749ad880 x1818247333193216/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/0 e 0 to 0 dl 1734016095 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016084.138288:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad880 with x1818247333193216 ext(671744->675839) 00002000:00010000:1.0:1734016084.138293:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ad880 00000100:00100000:1.0:1734016084.138329:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7532 00000100:00100000:1.0:1734016084.138337:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333193216:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016084.138540:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333193216:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 203us (528us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016084.138547:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7532 00002000:00100000:1.0:1734016084.138552:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (671744->675839) req@ffff8800749ad880 x1818247333193216/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/4536 e 0 to 0 dl 1734016095 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016084.138559:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad880 with x1818247333193216 ext(671744->675839) 00002000:00010000:1.0:1734016084.138562:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ad880 00000100:00100000:0.0:1734016084.141618:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.145589:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.145945:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333193728 00000100:00100000:1.0:1734016084.145958:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333193728 00002000:00100000:1.0:1734016084.146025:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (663552->667647) req@ffff8800749ad180 x1818247333193728/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/0 e 0 to 0 dl 1734016095 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016084.146039:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad180 with x1818247333193728 ext(663552->667647) 00002000:00010000:1.0:1734016084.146046:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ad180 00000100:00100000:1.0:1734016084.146098:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7534 00000100:00100000:1.0:1734016084.146109:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333193728:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016084.146341:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333193728:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 233us (764us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016084.146350:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7534 00002000:00100000:1.0:1734016084.146356:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (663552->667647) req@ffff8800749ad180 x1818247333193728/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/4536 e 0 to 0 dl 1734016095 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016084.146364:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad180 with x1818247333193728 ext(663552->667647) 00002000:00010000:1.0:1734016084.146369:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ad180 00000100:00100000:0.0:1734016084.149400:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.153486:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.153746:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333194240 00000100:00100000:1.0:1734016084.153758:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333194240 00002000:00100000:1.0:1734016084.153888:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (655360->659455) req@ffff8800749ad500 x1818247333194240/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/0 e 0 to 0 dl 1734016095 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016084.153901:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad500 with x1818247333194240 ext(655360->659455) 00002000:00010000:1.0:1734016084.153908:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ad500 00000100:00100000:1.0:1734016084.153941:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7536 00000100:00100000:1.0:1734016084.153946:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333194240:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016084.154110:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333194240:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 163us (642us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016084.154116:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7536 00002000:00100000:1.0:1734016084.154121:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (655360->659455) req@ffff8800749ad500 x1818247333194240/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/4536 e 0 to 0 dl 1734016095 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016084.154128:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad500 with x1818247333194240 ext(655360->659455) 00002000:00010000:1.0:1734016084.154130:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ad500 00000100:00100000:0.0:1734016084.159165:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.163736:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.163964:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333194752 00000100:00100000:1.0:1734016084.163972:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333194752 00002000:00100000:1.0:1734016084.164018:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (647168->651263) req@ffff8800749ac380 x1818247333194752/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/0 e 0 to 0 dl 1734016095 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016084.164032:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ac380 with x1818247333194752 ext(647168->651263) 00002000:00010000:1.0:1734016084.164037:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ac380 00000100:00100000:1.0:1734016084.164064:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7538 00000100:00100000:1.0:1734016084.164069:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333194752:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016084.164222:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333194752:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 151us (500us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016084.164228:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7538 00002000:00100000:1.0:1734016084.164235:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (647168->651263) req@ffff8800749ac380 x1818247333194752/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/4536 e 0 to 0 dl 1734016095 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016084.164240:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ac380 with x1818247333194752 ext(647168->651263) 00002000:00010000:1.0:1734016084.164243:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ac380 00000100:00100000:0.0:1734016084.167048:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.171671:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.171782:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333195264 00000100:00100000:1.0:1734016084.171792:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333195264 00002000:00100000:1.0:1734016084.171863:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (638976->643071) req@ffff8800749ae300 x1818247333195264/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/0 e 0 to 0 dl 1734016095 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016084.171873:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ae300 with x1818247333195264 ext(638976->643071) 00002000:00010000:1.0:1734016084.171879:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ae300 00000100:00100000:1.0:1734016084.171913:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7540 00000100:00100000:1.0:1734016084.171920:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333195264:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016084.172075:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333195264:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 153us (412us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016084.172082:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7540 00002000:00100000:1.0:1734016084.172088:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (638976->643071) req@ffff8800749ae300 x1818247333195264/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/4536 e 0 to 0 dl 1734016095 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016084.172095:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ae300 with x1818247333195264 ext(638976->643071) 00002000:00010000:1.0:1734016084.172098:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ae300 00000100:00100000:0.0:1734016084.177305:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.178069:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7541 00000100:00100000:1.0:1734016084.178079:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333195392:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016084.181795:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333195392:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 3703us (4488us total) trans 4294969023 rc 0/0 00000100:00100000:0.0:1734016084.181833:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7541 00002000:00100000:0.0:1734016084.181847:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (638976->704511) req@ffff8800749adc00 x1818247333195392/t4294969023(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/448 e 0 to 0 dl 1734016095 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016084.181857:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749adc00 with x1818247333195392 ext(638976->704511) 00002000:00010000:0.0:1734016084.181865:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749adc00 00000100:00100000:0.0:1734016084.184128:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.188182:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016084.189959:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969023 is committed 00000001:00080000:0.0:1734016084.190002:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969022 is committed 00000100:00100000:0.0:1734016084.193991:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.201776:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.208179:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.216249:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.224765:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.231855:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.236237:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.236287:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333196672 00000100:00100000:1.0:1734016084.236297:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333196672 00010000:00010000:1.0:1734016084.236331:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27112e1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 700416->704511) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b92 expref: 7 pid: 7683 timeout: 451 lvb_type: 0 00000100:00100000:1.0:1734016084.236373:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2514 00000100:00100000:1.0:1734016084.236380:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333196672:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016084.236394:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016084.236417:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27112e1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 700416->704511) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b92 expref: 7 pid: 7683 timeout: 451 lvb_type: 0 00010000:00010000:1.0:1734016084.236429:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27112e1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 700416->704511) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b92 expref: 7 pid: 7683 timeout: 451 lvb_type: 0 00010000:00010000:1.0:1734016084.236452:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27112e1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 700416->704511) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3b92 expref: 7 pid: 7683 timeout: 451 lvb_type: 0 00010000:00010000:1.0:1734016084.236467:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016084.236469:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016084.236474:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27112e47 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1888256->1900543] (req 1888256->1900543) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.236496:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27112e47 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1888256->1900543] (req 1888256->1900543) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.236519:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016084.236563:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333196672:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 183us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016084.236570:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2514 00000100:00100000:0.0:1734016084.243437:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.244025:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9741 00000100:00100000:1.0:1734016084.244037:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333196800:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016084.244066:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016084.244100:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27112e4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3bbc expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016084.244136:0:7682:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 3421237, mtime: 0x675afc54, atime: 0x675afc54, ctime: 0x675afc54, blocks: 0x400 00010000:00010000:1.0:1734016084.244164:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016084.244168:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016084.244178:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27112e4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bbc expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.244197:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27112e4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bbc expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.244212:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016084.244287:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333196800:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 252us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016084.244299:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9741 00000100:00100000:0.0:1734016084.251311:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.256071:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.264585:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.269246:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.269289:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.269443:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333197824 00000100:00100000:1.0:1734016084.269450:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333197824 00010000:00010000:1.0:1734016084.269496:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27112e55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bc3 expref: 7 pid: 7683 timeout: 451 lvb_type: 1 00000100:00100000:1.0:1734016084.269525:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333197952 00000100:00100000:1.0:1734016084.269528:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333197952 00010000:00010000:1.0:1734016084.269537:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27112e4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bbc expref: 7 pid: 7682 timeout: 451 lvb_type: 1 00000100:00100000:1.0:1734016084.269561:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2515 00000100:00100000:1.0:1734016084.269568:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333197824:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016084.269582:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016084.269607:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27112e55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bc3 expref: 7 pid: 7683 timeout: 451 lvb_type: 1 00010000:00010000:1.0:1734016084.269617:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27112e55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bc3 expref: 7 pid: 7683 timeout: 451 lvb_type: 1 00010000:00010000:1.0:1734016084.269639:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27112e55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bc3 expref: 7 pid: 7683 timeout: 451 lvb_type: 1 00010000:00010000:1.0:1734016084.269660:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016084.269710:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333197824:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 142us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016084.269720:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2515 00000100:00100000:1.0:1734016084.269737:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2516 00000100:00100000:1.0:1734016084.269741:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333197952:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016084.269746:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016084.269752:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27112e4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bbc expref: 7 pid: 7682 timeout: 451 lvb_type: 1 00010000:00010000:1.0:1734016084.269763:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27112e4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bbc expref: 7 pid: 7682 timeout: 451 lvb_type: 1 00010000:00010000:1.0:1734016084.269773:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27112e4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bbc expref: 7 pid: 7682 timeout: 451 lvb_type: 1 00010000:00010000:1.0:1734016084.269781:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016084.269783:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016084.269787:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27112e6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [16384->40959] (req 16384->40959) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.269796:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27112e6a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [16384->40959] (req 16384->40959) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.269845:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016084.269857:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333197952:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 115us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016084.269863:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2516 00000001:00080000:0.0:1734016084.282015:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969024 is committed 00000100:00100000:0.0:1734016084.285931:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.286362:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333198080 00000100:00100000:1.0:1734016084.286372:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333198080 00000100:00100000:1.0:1734016084.286427:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9743 00000100:00100000:1.0:1734016084.286434:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333198080:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016084.286456:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016084.286478:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27112e71 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3bca expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016084.286511:0:7682:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 3421237, mtime: 0x675afc54, atime: 0x675afc54, ctime: 0x675afc54, blocks: 0x428 00010000:00010000:1.0:1734016084.286532:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016084.286534:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016084.286541:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27112e71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bca expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.286556:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27112e71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bca expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.286566:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499eac0, rc 0) 00000100:00100000:1.0:1734016084.286626:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333198080:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 191us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016084.286632:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9743 00000100:00100000:0.0:1734016084.290725:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.298444:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.302531:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.308090:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.313786:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.323122:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.329749:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333199232 00000100:00100000:1.0:1734016084.329760:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333199232 00000100:00100000:0.0:1734016084.335050:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.335356:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333199360 00000100:00100000:1.0:1734016084.335362:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333199360 00010000:00010000:1.0:1734016084.335387:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27112e7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3248128->3264511) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bd1 expref: 7 pid: 7683 timeout: 451 lvb_type: 0 00000100:00100000:1.0:1734016084.335417:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2519 00000100:00100000:1.0:1734016084.335422:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333199360:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016084.335433:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016084.335450:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27112e7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3248128->3264511) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bd1 expref: 7 pid: 7683 timeout: 451 lvb_type: 0 00010000:00010000:1.0:1734016084.335460:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27112e7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3248128->3264511) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bd1 expref: 7 pid: 7683 timeout: 451 lvb_type: 0 00010000:00010000:1.0:1734016084.335479:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27112e7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3248128->3264511) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bd1 expref: 7 pid: 7683 timeout: 451 lvb_type: 0 00010000:00010000:1.0:1734016084.335508:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016084.335511:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016084.335516:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27112e8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bd8 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.335524:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27112e8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bd8 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.335551:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27112e8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bd8 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016084.335563:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335127552:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016084.335924:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:0.0:1734016084.338848:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.338976:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335127552:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016084.339007:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016084.339070:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333199360:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3645us (4024us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016084.339083:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2519 00000100:00100000:0.0:1734016084.351868:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.351930:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.425921:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.431136:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333200128:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4986us (5210us total) trans 4294969027 rc 0/0 00000100:00100000:0.0:1734016084.431152:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7550 00002000:00100000:0.0:1734016084.431166:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (6098944->6142962) req@ffff880075df1880 x1818247333200128/t4294969027(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/448 e 0 to 0 dl 1734016095 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016084.431182:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075df1880 with x1818247333200128 ext(6098944->6142962) 00002000:00010000:0.0:1734016084.431188:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075df1880 00000100:00100000:0.0:1734016084.432954:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.437119:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016084.438367:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969027 is committed 00000001:00080000:0.0:1734016084.438385:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969025 is committed 00000100:00100000:0.0:1734016084.442793:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.450034:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.460205:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.460266:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333200896 00000100:00100000:1.0:1734016084.460273:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333200896 00010000:00010000:1.0:1734016084.460301:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27112e8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bd8 expref: 7 pid: 7683 timeout: 451 lvb_type: 0 00000100:00100000:1.0:1734016084.460333:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2520 00000100:00100000:1.0:1734016084.460339:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333200896:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016084.460355:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1734016084.460372:0:7698:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016084 -> 1734016085 00002000:00010000:1.0:1734016084.460375:0:7698:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016084 -> 1734016085 00002000:00010000:1.0:1734016084.460377:0:7698:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1064 -> 1152 00010000:00010000:1.0:1734016084.460382:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27112e8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bd8 expref: 7 pid: 7683 timeout: 451 lvb_type: 0 00010000:00010000:1.0:1734016084.460391:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27112e8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bd8 expref: 7 pid: 7683 timeout: 451 lvb_type: 0 00010000:00010000:1.0:1734016084.460410:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27112e8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bd8 expref: 7 pid: 7683 timeout: 451 lvb_type: 0 00010000:00010000:1.0:1734016084.460425:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016084.460427:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016084.460431:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27112ea2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [10121216->10166271] (req 10121216->10166271) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.460444:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27112ea2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [10121216->10166271] (req 10121216->10166271) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.460572:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016084.460617:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333200896:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 276us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016084.460625:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2520 00000001:00080000:0.0:1734016084.471211:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969028 is committed 00000100:00100000:0.0:1734016084.474447:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.478226:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.478527:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333201152 00000100:00100000:1.0:1734016084.478544:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333201152 00000100:00100000:1.0:1734016084.478618:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1877 00000100:00100000:1.0:1734016084.478626:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:9668:x1818247333201152:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016084.478660:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016084.478685:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499eac0/0x5e3a3adc27112eb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3bed expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.478782:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27112eb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016084.478794:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27112eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016084.478844:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27112eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:1.0:1734016084.478866:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 6142963 00000004:00200000:1.0:1734016084.478870:0:6480:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016084.478883:0:6480:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27112eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016084.478907:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499eac0/0x5e3a3adc27112eb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bed expref: 26 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.478930:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27112eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bed expref: 25 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.478937:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016084.478940:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016084.478942:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016084.478982:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+25:9668:x1818247333201152:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 357us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016084.478988:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1877 00000100:00100000:0.0:1734016084.481729:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.482472:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333201280 00000100:00100000:1.0:1734016084.482491:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333201280 00000100:00100000:1.0:1734016084.482927:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9749 00000100:00100000:1.0:1734016084.482938:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333201280:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016084.482965:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016084.482983:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27112ebe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3bf4 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.483010:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016084.483013:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016084.483023:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27112ebe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bf4 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.483045:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27112ebe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bf4 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.483066:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016084.483138:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333201280:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 202us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016084.483145:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9749 00000100:00100000:0.0:1734016084.486354:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.491253:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.491302:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.491767:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333201536 00000100:00100000:1.0:1734016084.491770:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333201536 00010000:00010000:1.0:1734016084.492885:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27112ebe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bf4 expref: 7 pid: 7682 timeout: 451 lvb_type: 1 00000100:00100000:1.0:1734016084.492927:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2521 00000100:00100000:1.0:1734016084.492933:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333201536:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016084.492949:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016084.492977:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27112ebe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bf4 expref: 7 pid: 7682 timeout: 451 lvb_type: 1 00010000:00010000:1.0:1734016084.492989:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27112ebe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bf4 expref: 7 pid: 7682 timeout: 451 lvb_type: 1 00010000:00010000:1.0:1734016084.493015:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27112ebe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bf4 expref: 7 pid: 7682 timeout: 451 lvb_type: 1 00010000:00010000:1.0:1734016084.493039:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016084.493083:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333201536:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 150us (1780us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016084.493089:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2521 00000100:00100000:0.0:1734016084.497114:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.500851:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.500952:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333201920 00000100:00100000:1.0:1734016084.500961:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333201920 00000100:00100000:1.0:1734016084.501006:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9752 00000100:00100000:1.0:1734016084.501011:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333201920:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016084.501027:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016084.501044:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27112ecc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3c02 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016084.501094:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335128192:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016084.501149:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00002000:00010000:1.0:1734016084.503024:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016084 -> 1734016085 00000100:00100000:1.0:1734016084.503050:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335128192:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016084.503088:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27112ecc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c02 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.503104:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27112ecc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c02 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.503117:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016084.503640:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333201920:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2626us (2795us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016084.503648:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9752 00000100:00100000:1.0:1734016084.506512:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333202048 00000100:00100000:1.0:1734016084.506522:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333202048 00000100:00100000:1.0:1734016084.506569:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9753 00000100:00100000:1.0:1734016084.506576:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333202048:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016084.506597:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016084.506614:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27112ed3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3c09 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016084.506676:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335128320:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016084.506740:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016084.508625:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335128320:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016084.508670:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27112ed3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c09 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.508686:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27112ed3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c09 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.508717:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016084.508777:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333202048:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2200us (2367us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016084.508785:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9753 00000100:00100000:0.0:1734016084.512092:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.512192:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333202176 00000100:00100000:1.0:1734016084.512203:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333202176 00000100:00100000:1.0:1734016084.512255:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9754 00000100:00100000:1.0:1734016084.512262:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333202176:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016084.512284:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016084.512306:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27112eda lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3c10 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016084.512354:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335128448:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016084.512432:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016084.514760:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335128448:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016084.514853:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27112eda lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c10 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.514870:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27112eda lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c10 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.514886:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016084.514958:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333202176:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2695us (2876us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016084.514965:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9754 00000100:00100000:0.0:1734016084.517087:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.517376:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333202304 00000100:00100000:1.0:1734016084.517393:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333202304 00000100:00100000:1.0:1734016084.517551:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9755 00000100:00100000:1.0:1734016084.517562:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333202304:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016084.517592:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016084.517630:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27112ee1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3c17 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.517679:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27112ec5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10010624->10022911) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bfb expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.517689:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016084.517692:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016084.517696:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27112ee1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [204800->229375] (req 204800->229375) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c17 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.517752:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27112ec5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10010624->10022911) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bfb expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.517769:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27112ec5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10010624->10022911) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3bfb expref: 6 pid: 7683 timeout: 451 lvb_type: 0 00000100:00100000:1.0:1734016084.517786:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335128576:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016084.517928:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016084.521686:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335128576:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016084.521724:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27112ee1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [204800->229375] (req 204800->229375) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c17 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.521745:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f180, rc 0) 00000100:00100000:1.0:1734016084.521846:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333202304:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4284us (4768us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016084.521855:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9755 00000100:00100000:0.0:1734016084.523145:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.528772:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.529376:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333202560 00000100:00100000:1.0:1734016084.529386:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333202560 00000100:00100000:1.0:1734016084.529647:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9756 00000100:00100000:1.0:1734016084.529653:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333202560:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016084.530697:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10166272 -> 10166272 00002000:00010000:1.0:1734016084.530705:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016085 -> 1734016085 00002000:00010000:1.0:1734016084.530708:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016084 -> 1734016084 00002000:00010000:1.0:1734016084.530710:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016085 -> 1734016084 00002000:00010000:1.0:1734016084.530713:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1264 -> 1312 00000100:00100000:1.0:1734016084.530792:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333202560:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1134us (3003us total) trans 4294969030 rc 0/0 00000100:00100000:1.0:1734016084.531644:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9756 00000100:00100000:0.0:1734016084.533383:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.533720:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333202688 00000100:00100000:1.0:1734016084.533731:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333202688 00000100:00100000:1.0:1734016084.534080:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9757 00000100:00100000:1.0:1734016084.534087:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333202688:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016084.534110:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016084.534134:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27112ee8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3c1e expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016084.534198:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335128832:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016084.534269:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00002000:00010000:1.0:1734016084.536437:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016084 -> 1734016085 00000100:00100000:1.0:1734016084.536465:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335128832:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016084.536506:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27112ee8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c1e expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.536520:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27112ee8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c1e expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.536700:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016084.536755:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333202688:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2667us (3376us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016084.536764:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9757 00000100:00100000:0.0:1734016084.539953:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.540028:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333202816 00000100:00100000:1.0:1734016084.540041:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333202816 00000100:00100000:1.0:1734016084.540244:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9758 00000100:00100000:1.0:1734016084.540253:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333202816:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016084.540277:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016084.540302:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27112eef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3c25 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016084.540366:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335128960:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016084.540757:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016084.543774:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335128960:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016084.543883:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27112eef lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c25 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.543902:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27112eef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c25 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.544134:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d8c0, rc 0) 00000100:00100000:1.0:1734016084.544243:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333202816:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3989us (4300us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016084.544253:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9758 00000100:00100000:1.0:1734016084.547235:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.552405:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016084.553468:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27112ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016084.553478:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27112ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:0.0:1734016084.553588:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968516 00000004:00010000:0.0:1734016084.553639:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880073790000 reply state ffff88012e3b5000 transno 4294968517 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27112ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016084.553647:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016084.554820:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+24:9668:x1818247333203072:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 7428us (7594us total) trans 4294968517 rc 0/0 00000100:00100000:0.0:1734016084.554826:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1878 00000020:00080000:0.0:1734016084.554830:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016084.567135:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.572986:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.573192:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333203584 00000100:00100000:1.0:1734016084.573203:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333203584 00000100:00100000:1.0:1734016084.573256:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9759 00000100:00100000:1.0:1734016084.573263:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333203584:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016084.573286:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016084.573309:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27112f0b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3c33 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016084.573362:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335129216:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016084.573430:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016084.578025:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335129216:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016084.578084:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27112f0b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c33 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.578103:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27112f0b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c33 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.578341:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016084.578711:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333203584:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5443us (5730us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016084.578724:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9759 00000100:00100000:0.0:1734016084.585452:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.586766:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333203712 00000100:00100000:1.0:1734016084.586779:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333203712 00000100:00100000:1.0:1734016084.586871:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9760 00000100:00100000:1.0:1734016084.586882:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333203712:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016084.586913:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016084.586940:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27112f12 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3c3a expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016084.587014:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335129344:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016084.587090:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016084.593439:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335129344:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016084.593523:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27112f12 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c3a expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.593544:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27112f12 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c3a expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.594158:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016084.594228:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333203712:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7347us (8791us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016084.594238:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9760 00000100:00100000:1.0:1734016084.600719:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333203840 00000100:00100000:1.0:1734016084.600731:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333203840 00000100:00100000:1.0:1734016084.600882:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9761 00000100:00100000:1.0:1734016084.600889:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333203840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016084.600909:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016084.600926:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27112f19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3c41 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016084.600978:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335129472:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016084.601035:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016084.604236:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335129472:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016084.604295:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27112f19 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c41 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.604318:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27112f19 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c41 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016084.605790:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016084.606750:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333203840:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5848us (6180us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016084.606762:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9761 00000100:00100000:0.0:1734016084.617751:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.617869:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333203968 00000100:00100000:1.0:1734016084.617880:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333203968 00000100:00100000:1.0:1734016084.618555:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9762 00000100:00100000:1.0:1734016084.618563:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333203968:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016084.618585:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016084.618607:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27112f20 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3c48 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.618642:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27112ee1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->229375) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c17 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.618648:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016084.618651:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016084.618655:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27112f20 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3084288->3088383] (req 3084288->3088383) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c48 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.618689:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27112ee1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->229375) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c17 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.618708:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27112ee1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->229375) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c17 expref: 8 pid: 7682 timeout: 451 lvb_type: 0 00000100:00100000:1.0:1734016084.618722:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335129600:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016084.618785:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016084.624702:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.624852:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335129600:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016084.624888:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27112f20 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3084288->3088383] (req 3084288->3088383) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c48 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.624908:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016084.624953:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333203968:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6390us (7213us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016084.624961:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9762 00000100:00100000:0.0:1734016084.642207:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.711560:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.714581:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7554 00000100:00100000:1.0:1734016084.714594:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333204608:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:1.0:1734016084.714646:0:13914:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112f27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.714671:0:13914:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27112f20 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3084288->3088383) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c48 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.714678:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016084.714682:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016084.714685:0:13914:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112f27 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3780608->3788799] (req 3780608->3788799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.714734:0:13914:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27112f20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3084288->3088383) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c48 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.714747:0:13914:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27112f20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3084288->3088383) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c48 expref: 6 pid: 7682 timeout: 451 lvb_type: 0 00000100:00100000:1.0:1734016084.714761:0:13914:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335129856:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016084.714885:0:13914:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016084.721509:0:13914:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335129856:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016084.721543:0:13914:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112f27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3780608->3788799] (req 3780608->3788799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016084.724147:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016084.727361:0:13914:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112f27 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3780608->3788799] (req 3780608->3788799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.727378:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112f27 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3780608->3788799] (req 3780608->3788799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016084.729596:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969032 is committed 00000001:00080000:0.0:1734016084.729638:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969029 is committed 00002000:00010000:0.0:1734016084.730087:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 3784220 -> 3788800 00002000:00010000:0.0:1734016084.730093:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1112 -> 1128 00010000:00010000:0.0:1734016084.730111:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112f27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3780608->3788799] (req 3780608->3788799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016084.730124:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112f27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3780608->3788799] (req 3780608->3788799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016084.730139:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112f27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3780608->3788799] (req 3780608->3788799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016084.730148:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499e880 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016084.730153:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112f27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3780608->3788799] (req 3780608->3788799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016084.730161:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112f27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3780608->3788799] (req 3780608->3788799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016084.730185:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112f27 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3780608->3788799] (req 3780608->3788799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016084.730190:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27112f27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3780608->3788799] (req 3780608->3788799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016084.731862:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333204608:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 17258us (20299us total) trans 4294969032 rc 0/0 00000100:00100000:0.0:1734016084.731875:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7554 00000100:00100000:0.0:1734016084.735768:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.738037:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1880 00000100:00100000:1.0:1734016084.738048:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+23:9668:x1818247333204864:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016084.738082:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016084.738108:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27112f2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3c4f expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.738216:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27112f35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016084.738229:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27112f35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016084.738239:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27112f35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:1.0:1734016084.738263:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 3784220 00000004:00200000:1.0:1734016084.738266:0:6480:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016084.738279:0:6480:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27112f35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016084.738297:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27112f2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c4f expref: 25 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.738317:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27112f35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c4f expref: 24 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.738325:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016084.738328:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016084.738330:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016084.738386:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+24:9668:x1818247333204864:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 341us (2637us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016084.738393:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1880 00000100:00100000:1.0:1734016084.742379:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.746852:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.774330:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.774389:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333205248 00000100:00100000:0.0:1734016084.774401:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333205248 00010000:00010000:0.0:1734016084.774448:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27112f3c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c56 expref: 9 pid: 7682 timeout: 451 lvb_type: 1 00000100:00100000:0.0:1734016084.774511:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2527 00000100:00100000:0.0:1734016084.774524:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333205248:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016084.774543:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016084.774568:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27112f3c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c56 expref: 9 pid: 7682 timeout: 451 lvb_type: 1 00010000:00010000:0.0:1734016084.774581:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27112f3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c56 expref: 9 pid: 7682 timeout: 451 lvb_type: 1 00010000:00010000:0.0:1734016084.774611:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016084.774613:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016084.774622:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27112f43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 495616->499711) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c5d expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016084.774634:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27112f43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 495616->499711) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c5d expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016084.774679:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27112f43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 495616->499711) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c5d expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016084.774695:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335130112:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016084.774765:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016084.777346:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.777460:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335130112:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016084.777492:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016084.777531:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333205248:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3009us (3215us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016084.777540:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2527 00000100:00100000:0.0:1734016084.794740:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.794848:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333205760 00000100:00100000:0.0:1734016084.794863:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333205760 00002000:00100000:0.0:1734016084.794927:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (491520->495615) req@ffff8800758ad500 x1818247333205760/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/0 e 0 to 0 dl 1734016095 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016084.794939:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758ad500 with x1818247333205760 ext(491520->495615) 00002000:00010000:0.0:1734016084.794945:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758ad500 00000100:00100000:0.0:1734016084.794983:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7556 00000100:00100000:0.0:1734016084.794991:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333205760:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016084.795188:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333205760:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 197us (468us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016084.795197:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7556 00002000:00100000:0.0:1734016084.795203:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (491520->495615) req@ffff8800758ad500 x1818247333205760/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/4536 e 0 to 0 dl 1734016095 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016084.795212:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758ad500 with x1818247333205760 ext(491520->495615) 00002000:00010000:0.0:1734016084.795215:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758ad500 00000100:00100000:0.0:1734016084.802490:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.807779:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7557 00000100:00100000:0.0:1734016084.807793:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333206016:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016084.808065:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333206016:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 275us (5598us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016084.808073:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7557 00002000:00100000:0.0:1734016084.808086:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (487424->491519) req@ffff8800758aea00 x1818247333206016/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 488/4536 e 0 to 0 dl 1734016095 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016084.808094:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758aea00 with x1818247333206016 ext(487424->491519) 00002000:00010000:0.0:1734016084.808099:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758aea00 00000100:00100000:0.0:1734016084.812097:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.815081:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.815122:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333206400 00000100:00100000:0.0:1734016084.815134:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333206400 00002000:00100000:0.0:1734016084.815191:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (483328->499711) req@ffff88012b131f80 x1818247333206400/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 16872/0 e 0 to 0 dl 1734016095 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016084.815203:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b131f80 with x1818247333206400 ext(483328->499711) 00002000:00010000:0.0:1734016084.815208:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b131f80 00000100:00100000:0.0:1734016084.815241:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7559 00000100:00100000:0.0:1734016084.815249:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333206400:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016084.820139:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333206400:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 2611us (2795us total) trans 4294969033 rc 0/0 00000100:00100000:0.0:1734016084.820170:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7559 00002000:00100000:0.0:1734016084.820204:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (483328->499711) req@ffff88012b131f80 x1818247333206400/t4294969033(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:45/0 lens 16872/448 e 0 to 0 dl 1734016095 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016084.820220:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b131f80 with x1818247333206400 ext(483328->499711) 00002000:00010000:0.0:1734016084.820227:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b131f80 00000100:00100000:0.0:1734016084.823886:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016084.825452:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969033 is committed 00000100:00100000:0.0:1734016084.840142:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.853335:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.863934:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.864097:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333207168 00000100:00100000:1.0:1734016084.864107:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333207168 00000100:00100000:1.0:1734016084.864168:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1882 00000100:00100000:1.0:1734016084.864177:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+24:9668:x1818247333207168:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016084.864243:0:6480:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016084.864275:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27112f35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c4f expref: 24 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.864300:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016084.864305:0:6480:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016084.864504:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112f58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016084.864518:0:6480:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27112f04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c2c expref: 24 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.864525:0:6480:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112f58 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016084.864557:0:6480:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27112f04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c2c expref: 24 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016084.864569:0:6480:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27112f04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c2c expref: 24 pid: 6479 timeout: 451 lvb_type: 0 00000100:00100000:1.0:1734016084.864581:0:6480:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1818247335130496:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016084.864647:0:6480:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016084.870711:0:6480:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1818247335130496:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016084.870773:0:6480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112f58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:0.0:1734016084.871641:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.871795:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333207296 00000100:00100000:1.0:1734016084.871860:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333207296 00010000:00010000:1.0:1734016084.871909:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27112f04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c2c expref: 25 pid: 6479 timeout: 451 lvb_type: 0 00000100:00100000:1.0:1734016084.872389:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2528 00000100:00100000:1.0:1734016084.872402:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+25:1981:x1818247333207296:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016084.872425:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016084.872434:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27112f04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c2c expref: 25 pid: 6479 timeout: 451 lvb_type: 0 00010000:00010000:1.0:1734016084.872450:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27112f04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c2c expref: 25 pid: 6479 timeout: 451 lvb_type: 0 00010000:00010000:1.0:1734016084.872490:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27112f04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c2c expref: 25 pid: 6479 timeout: 451 lvb_type: 0 00010000:00010000:1.0:1734016084.872519:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016084.872525:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112f58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016084.872537:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112f58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016084.872547:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112f58 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016084.872573:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016084.872638:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:1981:x1818247333207296:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 240us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016084.872646:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2528 00010000:00010000:1.0:1734016084.872685:0:6480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112f58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016084.872692:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112f58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000001:00080000:1.0:1734016084.872862:0:6480:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968518 00000004:00010000:1.0:1734016084.872920:0:6480:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012b130700 reply state ffff880075247000 transno 4294968519 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112f58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:1.0:1734016084.872931:0:6480:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016084.873014:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+26:9668:x1818247333207168:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 8839us (9230us total) trans 4294968519 rc 0/0 00000100:00100000:1.0:1734016084.873021:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1882 00000020:00080000:1.0:1734016084.873025:0:6480:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1734016084.877242:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.877376:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333207424 00000100:00100000:0.0:1734016084.877390:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333207424 00002000:00010000:0.0:1734016084.877441:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (7691589->18446744073709551615) 00002000:00100000:0.0:1734016084.877447:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790380 with x1818247333207424 ext(7691589->18446744073709551615) 00002000:00010000:0.0:1734016084.877464:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073790380. 00000100:00100000:0.0:1734016084.877515:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7560 00000100:00100000:0.0:1734016084.877524:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333207424:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016084.877792:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 3788800 -> 7691589 00002000:00010000:0.0:1734016084.877796:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016085 -> 1734016085 00002000:00010000:0.0:1734016084.877797:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016085 -> 1734016084 00002000:00010000:0.0:1734016084.877819:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016085 -> 1734016085 00002000:00010000:0.0:1734016084.877821:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1128 -> 1128 00000100:00100000:0.0:1734016084.877882:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333207424:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 357us (657us total) trans 4294969034 rc 0/0 00000100:00100000:0.0:1734016084.877890:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7560 00002000:00010000:0.0:1734016084.877893:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (7691589->18446744073709551615) 00002000:00100000:0.0:1734016084.877895:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790380 with x1818247333207424 ext(7691589->18446744073709551615) 00002000:00010000:0.0:1734016084.877900:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073790380. 00000100:00100000:0.0:1734016084.884626:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.912058:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.919654:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.919900:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333207936 00000100:00100000:1.0:1734016084.919913:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333207936 00000100:00100000:1.0:1734016084.919974:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1883 00000100:00100000:1.0:1734016084.919982:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+25:9668:x1818247333207936:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:1.0:1734016084.920139:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+25:9668:x1818247333207936:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 157us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016084.920146:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1883 00000100:00100000:0.0:1734016084.922445:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016084.926393:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969035 is committed 00000100:00100000:0.0:1734016084.932861:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.948356:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.966402:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016084.977024:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016084.997780:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016085.046536:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969036 is committed 00000100:00100000:0.0:1734016085.061638:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016085.061760:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333208960 00000100:00100000:1.0:1734016085.061778:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333208960 00000100:00100000:1.0:1734016085.061897:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1885 00000100:00100000:1.0:1734016085.061908:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+25:9668:x1818247333208960:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016085.061946:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016085.061973:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27112f82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3c87 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016085.062139:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112f89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016085.062155:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016085.062169:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:1.0:1734016085.062201:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 7691589 00000004:00200000:1.0:1734016085.062207:0:6480:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016085.062232:0:6480:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016085.062261:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27112f82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c87 expref: 27 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016085.062304:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112f89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c87 expref: 26 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016085.062314:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016085.062318:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016085.062321:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016085.062391:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+26:9668:x1818247333208960:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 485us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016085.062399:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1885 00000100:00100000:0.0:1734016085.069497:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016085.074152:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016055 00000100:00100000:0.0:1734016085.079674:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.100589:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.104776:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.120637:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.126298:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016085.127975:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016085.128001:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333210112 00000100:00100000:1.0:1734016085.128008:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333210112 00010000:00010000:1.0:1734016085.128033:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27112f90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c8e expref: 8 pid: 7683 timeout: 452 lvb_type: 1 00000100:00100000:1.0:1734016085.128056:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333209984 00000100:00100000:1.0:1734016085.128058:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333209984 00010000:00010000:1.0:1734016085.128067:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27112f9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c95 expref: 6 pid: 7682 timeout: 452 lvb_type: 1 00000100:00100000:1.0:1734016085.128081:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2530 00000100:00100000:1.0:1734016085.128087:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333210112:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016085.128102:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016085.128126:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27112f90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c8e expref: 8 pid: 7683 timeout: 452 lvb_type: 1 00010000:00010000:1.0:1734016085.128135:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27112f90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c8e expref: 8 pid: 7683 timeout: 452 lvb_type: 1 00010000:00010000:1.0:1734016085.128158:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27112f90 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c8e expref: 8 pid: 7683 timeout: 452 lvb_type: 1 00010000:00010000:1.0:1734016085.128176:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016085.128194:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333210112:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 107us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016085.128200:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2530 00000100:00100000:1.0:1734016085.128212:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2531 00000100:00100000:1.0:1734016085.128217:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333209984:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016085.128223:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016085.128229:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27112f9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c95 expref: 6 pid: 7682 timeout: 452 lvb_type: 1 00010000:00010000:1.0:1734016085.128238:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27112f9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c95 expref: 6 pid: 7682 timeout: 452 lvb_type: 1 00010000:00010000:1.0:1734016085.128249:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27112f9e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c95 expref: 6 pid: 7682 timeout: 452 lvb_type: 1 00010000:00010000:1.0:1734016085.128258:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016085.128260:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016085.128265:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27112fac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3059711) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c9c expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016085.128275:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27112fac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3059711) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c9c expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016085.128306:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27112fac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3059711) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c9c expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016085.128319:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073791880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335131264:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016085.128356:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016085.139423:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073791880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335131264:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016085.139458:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016085.139530:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333209984:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 11309us (11554us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016085.139542:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2531 00000100:00100000:0.0:1734016085.139853:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016085.146002:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016085.157325:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.170798:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.181028:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016085.189269:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.190077:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333210880 00000100:00100000:0.0:1734016085.190087:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333210880 00010000:00010000:0.0:1734016085.190120:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27112fac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c9c expref: 8 pid: 7683 timeout: 452 lvb_type: 0 00000100:00100000:0.0:1734016085.190162:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2532 00000100:00100000:0.0:1734016085.190170:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b42c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333210880:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016085.190182:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016085.190200:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27112fac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3026944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c9c expref: 8 pid: 7683 timeout: 452 lvb_type: 0 00010000:00010000:0.0:1734016085.190211:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27112fac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3026944->3059711) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c9c expref: 8 pid: 7683 timeout: 452 lvb_type: 0 00010000:00010000:0.0:1734016085.190230:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27112fac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3026944->3059711) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c9c expref: 8 pid: 7683 timeout: 452 lvb_type: 0 00010000:00010000:0.0:1734016085.190249:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016085.190252:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016085.190257:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27112fc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8040448->8077311) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3cb8 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.190265:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27112fc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8040448->8077311) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3cb8 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.190296:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27112fc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8040448->8077311) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3cb8 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016085.190309:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335131904:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016085.190367:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016085.196360:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016085.202245:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.211659:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016085.224372:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.224710:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333211520 00000100:00100000:0.0:1734016085.224724:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333211520 00000100:00100000:0.0:1734016085.225262:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9780 00000100:00100000:0.0:1734016085.225272:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333211520:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016085.225295:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016085.225319:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27112fd6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3cbf expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016085.225345:0:7682:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 8314880, mtime: 0x675afc55, atime: 0x675afc55, ctime: 0x675afc55, blocks: 0x5b0 00010000:00010000:0.0:1734016085.225368:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016085.225370:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016085.225379:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27112fd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3cbf expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016085.225402:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27112fd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3cbf expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016085.225416:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00000100:00100000:0.0:1734016085.225488:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333211520:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 215us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016085.225495:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9780 00000100:00100000:0.0:1734016085.232627:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.239495:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.247958:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.250894:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.250930:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.257763:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.268701:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.283340:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.297112:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.312362:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.324601:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.333246:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.341406:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016085.341520:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333213440 00000100:00100000:1.0:1734016085.341529:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333213440 00000100:00100000:1.0:1734016085.341586:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9788 00000100:00100000:1.0:1734016085.341594:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333213440:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016085.341612:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016085.341631:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27113015 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3cf0 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016085.341657:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016085.341660:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016085.341667:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27113015 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3cf0 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016085.341682:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27113015 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3cf0 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016085.341694:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016085.341850:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333213440:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 255us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016085.341856:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9788 00000100:00100000:0.0:1734016085.362663:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.366778:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016085.366907:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333213824 00000100:00100000:1.0:1734016085.366921:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333213824 00002000:00100000:1.0:1734016085.366968:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (4194304->8314879) req@ffff8800752a5500 x1818247333213824/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:46/0 lens 488/0 e 0 to 0 dl 1734016096 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016085.366978:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800752a5500 with x1818247333213824 ext(4194304->8314879) 00002000:00010000:1.0:1734016085.366984:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800752a5500 00000100:00100000:1.0:1734016085.367020:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7570 00000100:00100000:1.0:1734016085.367028:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333213824:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016085.463997:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.465864:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333213824:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 98834us (99093us total) trans 0 rc 4120576/4120576 00000100:00100000:0.0:1734016085.465873:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7570 00002000:00100000:0.0:1734016085.465883:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (4194304->8314879) req@ffff8800752a5500 x1818247333213824/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:46/0 lens 488/440 e 0 to 0 dl 1734016096 ref 1 fl Complete:/200/0 rc 4120576/4120576 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016085.465891:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800752a5500 with x1818247333213824 ext(4194304->8314879) 00010000:00010000:0.0:1734016085.465897:0:13914:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc2711300e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ce9 expref: 10 pid: 7683 timeout: 452 lvb_type: 1 00010000:00010000:0.0:1734016085.465906:0:13914:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc2711300e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ce9 expref: 10 pid: 7683 timeout: 452 lvb_type: 1 00002000:00010000:0.0:1734016085.465912:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800752a5500 00000100:00100000:0.0:1734016085.480487:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075de9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335133056:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016085.480502:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075dead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335133184:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016085.480533:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc2711301c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1773568->1777663] (req 1773568->1777663) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3cf7 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.480553:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd680, rc 0) 00000100:00100000:0.0:1734016085.480599:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:9668:x1818247333214080:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 15769us (16612us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016085.480608:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9789 00000100:00100000:0.0:1734016085.489918:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.511671:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.517618:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.521120:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.525204:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.528256:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.531673:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.537037:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.542341:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.549395:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.554572:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.560937:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.565943:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.571924:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.578096:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.586073:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.595603:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.601704:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333218304:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4564us (6087us total) trans 4294969040 rc 0/0 00000100:00100000:0.0:1734016085.601728:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7586 00002000:00100000:0.0:1734016085.601750:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (1716224->1777663) req@ffff88007487e680 x1818247333218304/t4294969040(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:46/0 lens 488/448 e 0 to 0 dl 1734016096 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016085.601762:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487e680 with x1818247333218304 ext(1716224->1777663) 00002000:00010000:0.0:1734016085.601772:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487e680 00000100:00080000:0.0:1734016085.609254:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016055 00000100:00100000:0.0:1734016085.611194:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.613933:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333218560:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 1846us (2741us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016085.613949:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9790 00000100:00100000:1.0:1734016085.620442:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016085.625892:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016085.632658:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969041 is committed 00000100:00100000:0.0:1734016085.637094:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.643402:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.648705:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.654545:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.662629:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.676788:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.685723:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016085.685953:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333219968 00000100:00100000:1.0:1734016085.685963:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333219968 00000100:00100000:1.0:1734016085.686021:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1887 00000100:00100000:1.0:1734016085.686028:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:9668:x1818247333219968:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016085.686082:0:6480:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016085.686111:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27112f66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c72 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016085.686138:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016085.686143:0:6480:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016085.686303:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27113046 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016085.686316:0:6480:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112f89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c87 expref: 13 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016085.686321:0:6480:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27113046 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016085.686349:0:6480:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112f89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c87 expref: 13 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016085.686359:0:6480:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27112f89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3c87 expref: 13 pid: 6480 timeout: 452 lvb_type: 0 00000100:00100000:1.0:1734016085.686372:0:6480:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073791880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1818247335134080:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016085.686425:0:6480:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016085.691548:0:6480:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073791880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1818247335134080:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016085.691586:0:6480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27113046 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:0.0:1734016085.692202:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016085.693672:0:6480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27113046 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016085.693679:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27113046 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000001:00080000:1.0:1734016085.693767:0:6480:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968520 00000004:00010000:1.0:1734016085.693843:0:6480:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007487d180 reply state ffff880075242000 transno 4294968521 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27113046 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:1.0:1734016085.693852:0:6480:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016085.695650:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333219968:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 9613us (9930us total) trans 4294968521 rc 0/0 00000100:00100000:1.0:1734016085.695659:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1887 00000020:00080000:1.0:1734016085.695666:0:6480:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016085.699152:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.704756:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.708705:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.713924:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016085.714072:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333220608 00000100:00100000:1.0:1734016085.714083:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333220608 00000100:00100000:1.0:1734016085.714159:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1888 00000100:00100000:1.0:1734016085.714168:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:9668:x1818247333220608:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016085.714195:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016085.714223:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27113054 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3d21 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016085.714351:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc2711305b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016085.714366:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc2711305b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016085.714375:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc2711305b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:1.0:1734016085.714399:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 9566033 00000004:00200000:1.0:1734016085.714403:0:6480:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016085.714418:0:6480:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc2711305b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016085.714438:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27113054 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d21 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016085.714456:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc2711305b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d21 expref: 14 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016085.714477:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016085.714480:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016085.714483:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016085.714551:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:9668:x1818247333220608:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 383us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016085.714561:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1888 00000100:00100000:0.0:1734016085.717483:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.721244:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075de9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335134464:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016085.721280:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27113062 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d28 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016085.721292:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27113062 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d28 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016085.721337:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:0.0:1734016085.721632:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333220736:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3903us (4168us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016085.721641:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9797 00000100:00100000:1.0:1734016085.724959:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.725050:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333220864 00000100:00100000:0.0:1734016085.725066:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333220864 00000100:00100000:0.0:1734016085.725137:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9798 00000100:00100000:0.0:1734016085.725146:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333220864:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016085.725170:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016085.725195:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27113069 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3d2f expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016085.725262:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e255180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335134592:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016085.725337:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee780 going to sleep for 11 seconds 00000100:00100000:0.0:1734016085.734252:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333220992 00000100:00100000:0.0:1734016085.734265:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333220992 00000100:00100000:0.0:1734016085.737103:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1889 00000100:00100000:0.0:1734016085.737127:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:9668:x1818247333220992:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016085.737169:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016085.737198:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27113070 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3d36 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.737349:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27113077 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016085.737371:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27113077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016085.737387:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27113077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:0.0:1734016085.737419:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 9566033 00000004:00200000:0.0:1734016085.737424:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016085.737446:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27113077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016085.737484:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27113070 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d36 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.737547:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27113077 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d36 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.737560:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016085.737563:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016085.737567:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016085.737630:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333220992:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 507us (4225us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016085.737637:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1889 00000100:00100000:0.0:1734016085.742168:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016085.745904:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.745981:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333221376 00000100:00100000:0.0:1734016085.745990:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333221376 00000100:00100000:0.0:1734016085.746073:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7589 00000100:00100000:0.0:1734016085.746080:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333221376:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:0.0:1734016085.746118:0:13914:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711307e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.746134:0:13914:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711304d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d1a expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.746140:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016085.746142:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016085.746145:0:13914:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711307e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5185536->5210111] (req 5185536->5210111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.746179:0:13914:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711304d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d1a expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.746190:0:13914:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711304d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d1a expref: 8 pid: 7682 timeout: 452 lvb_type: 0 00000100:00100000:0.0:1734016085.746204:0:13914:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e255f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335134720:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016085.746272:0:13914:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016085.751080:0:13914:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e255f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335134720:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016085.751114:0:13914:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711307e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5185536->5210111] (req 5185536->5210111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016085.752243:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016085.752713:0:13914:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711307e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5185536->5210111] (req 5185536->5210111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.752722:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711307e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5185536->5210111] (req 5185536->5210111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.756780:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711307e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5185536->5210111] (req 5185536->5210111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.756797:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711307e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5185536->5210111] (req 5185536->5210111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.756841:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711307e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5185536->5210111] (req 5185536->5210111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.756848:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581680 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016085.756852:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711307e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5185536->5210111] (req 5185536->5210111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.756859:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711307e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5185536->5210111] (req 5185536->5210111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.756883:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711307e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5185536->5210111] (req 5185536->5210111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.756888:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711307e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5185536->5210111] (req 5185536->5210111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016085.757006:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333221376:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 10917us (11104us total) trans 0 rc 24576/24576 00000100:00100000:0.0:1734016085.757018:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7589 00000100:00100000:0.0:1734016085.759976:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333221632 00000100:00100000:0.0:1734016085.759989:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333221632 00000100:00100000:0.0:1734016085.760057:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9800 00000100:00100000:0.0:1734016085.760068:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333221632:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016085.760097:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016085.760129:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113085 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3d3d expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016085.760153:0:7682:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 9566033, mtime: 0x675afc56, atime: 0x675afc55, ctime: 0x675afc56, blocks: 0x678 00010000:00010000:0.0:1734016085.760173:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016085.760176:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016085.760185:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113085 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d3d expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016085.760201:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113085 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d3d expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016085.760217:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:0.0:1734016085.760902:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333221632:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 835us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016085.760909:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9800 00000100:00100000:0.0:1734016085.763614:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333221760 00000100:00100000:0.0:1734016085.763626:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333221760 00000100:00100000:0.0:1734016085.763677:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9801 00000100:00100000:0.0:1734016085.763686:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333221760:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016085.763713:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016085.763733:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711308c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3d44 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.763766:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113085 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d3d expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016085.763775:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016085.763777:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016085.763781:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711308c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1896448->1925119] (req 1896448->1925119) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d44 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.763924:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113085 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d3d expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016085.763937:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113085 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d3d expref: 9 pid: 7682 timeout: 452 lvb_type: 1 00000100:00100000:0.0:1734016085.763955:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e255f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335134848:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016085.764027:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016085.766562:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e255f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335134848:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016085.766594:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711308c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1896448->1925119] (req 1896448->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d44 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016085.766609:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581680, rc 0) 00000100:00100000:0.0:1734016085.766697:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:9668:x1818247333221760:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3011us (3163us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016085.766705:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9801 00000100:00100000:0.0:1734016085.766888:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.771072:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335134976:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016085.771103:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016085.771164:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333221888:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4204us (4276us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016085.771176:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2544 00000100:00100000:1.0:1734016085.772841:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333222016 00000100:00100000:1.0:1734016085.772850:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333222016 00000100:00100000:1.0:1734016085.772901:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9802 00000100:00100000:1.0:1734016085.772908:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333222016:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016085.773716:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9566033 -> 9566033 00002000:00010000:1.0:1734016085.773722:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016086 -> 1734016086 00002000:00010000:1.0:1734016085.773724:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016085 -> 1734016085 00002000:00010000:1.0:1734016085.773726:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016086 -> 1734016086 00002000:00010000:1.0:1734016085.773729:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1656 -> 1656 00000100:00100000:1.0:1734016085.775375:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333222016:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 2448us (2756us total) trans 4294969045 rc 0/0 00000100:00100000:1.0:1734016085.775389:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9802 00000100:00100000:1.0:1734016085.783725:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333222144 00000100:00100000:1.0:1734016085.783735:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333222144 00000100:00100000:1.0:1734016085.783873:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9803 00000100:00100000:1.0:1734016085.783880:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333222144:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016085.784101:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9566033 -> 9566033 00002000:00010000:1.0:1734016085.784104:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016086 -> 1734016086 00002000:00010000:1.0:1734016085.784106:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016085 -> 1734016085 00002000:00010000:1.0:1734016085.784107:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016086 -> 1734016085 00002000:00010000:1.0:1734016085.784109:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1656 -> 1736 00000100:00100000:1.0:1734016085.784157:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333222144:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 277us (565us total) trans 4294969046 rc 0/0 00000100:00100000:1.0:1734016085.784164:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9803 00000100:00100000:0.0:1734016085.788408:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333222272 00000100:00100000:0.0:1734016085.788417:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333222272 00000100:00100000:0.0:1734016085.788474:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9804 00000100:00100000:0.0:1734016085.788483:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333222272:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016085.788504:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016085.788518:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27113093 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3d4b expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016085.788574:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e256680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335135104:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016085.788639:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016085.812186:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.830929:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.839997:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.844251:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.859229:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.868048:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.879556:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.903170:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.903249:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.947642:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.947696:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016085.951186:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7594 00000100:00100000:1.0:1734016085.951204:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333224320:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016085.953506:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016085.953529:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333224448 00000100:00100000:0.0:1734016085.953538:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333224448 00002000:00100000:0.0:1734016085.953578:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (8388608->9568255) req@ffff88012e255f80 x1818247333224448/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:46/0 lens 488/0 e 0 to 0 dl 1734016096 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016085.953587:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e255f80 with x1818247333224448 ext(8388608->9568255) 00002000:00010000:0.0:1734016085.953593:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e255f80 00000100:00100000:0.0:1734016085.953610:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7595 00000100:00100000:0.0:1734016085.953615:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333224448:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016086.022119:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.023559:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.023601:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.023923:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333224832 00000100:00100000:1.0:1734016086.023927:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333224832 00000100:00100000:1.0:1734016086.023958:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 200 00000100:00100000:1.0:1734016086.023963:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333224832:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1734016086.023987:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333224832:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 25us (1880us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016086.023992:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 200 00000100:00100000:0.0:1734016086.027232:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333224448:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 73615us (73735us total) trans 0 rc 1179648/1179648 00000100:00100000:0.0:1734016086.027238:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7595 00002000:00100000:0.0:1734016086.027242:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (8388608->9568255) req@ffff88012e255f80 x1818247333224448/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:46/0 lens 488/440 e 0 to 0 dl 1734016096 ref 1 fl Complete:/200/0 rc 1179648/1179648 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016086.027248:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e255f80 with x1818247333224448 ext(8388608->9568255) 00002000:00010000:0.0:1734016086.027251:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e255f80 00000100:00100000:0.0:1734016086.035936:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016086.037317:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016056 00000100:00100000:0.0:1734016086.041770:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.041935:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333225216 00000100:00100000:1.0:1734016086.041944:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333225216 00000100:00100000:1.0:1734016086.042069:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1890 00000100:00100000:1.0:1734016086.042076:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333225216:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:1.0:1734016086.042226:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333225216:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 149us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016086.042234:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1890 00000100:00100000:0.0:1734016086.044760:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.045780:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9809 00000100:00100000:0.0:1734016086.045791:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333225344:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016086.053112:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969047 is committed 00000001:00080000:0.0:1734016086.053131:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969046 is committed 00000100:00100000:0.0:1734016086.057534:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.068503:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.078174:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.086325:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.100221:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.115069:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.118429:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.121916:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.127544:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.127597:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.128770:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333226752 00000100:00100000:0.0:1734016086.128780:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333226752 00010000:00010000:0.0:1734016086.128832:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271130e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d83 expref: 7 pid: 7683 timeout: 453 lvb_type: 1 00000100:00100000:0.0:1734016086.128878:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333226624 00000100:00100000:0.0:1734016086.128882:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333226624 00010000:00010000:0.0:1734016086.128893:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271130ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d8a expref: 7 pid: 7682 timeout: 453 lvb_type: 1 00000100:00100000:0.0:1734016086.128912:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2549 00000100:00100000:0.0:1734016086.128919:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333226752:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016086.128933:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016086.128961:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271130e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d83 expref: 7 pid: 7683 timeout: 453 lvb_type: 1 00010000:00010000:0.0:1734016086.128971:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271130e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d83 expref: 7 pid: 7683 timeout: 453 lvb_type: 1 00010000:00010000:0.0:1734016086.128998:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271130e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d83 expref: 7 pid: 7683 timeout: 453 lvb_type: 1 00010000:00010000:0.0:1734016086.129019:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016086.129042:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333226752:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 123us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016086.129048:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2549 00000100:00100000:0.0:1734016086.129059:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2550 00000100:00100000:0.0:1734016086.129062:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333226624:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016086.129068:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016086.129076:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271130ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d8a expref: 7 pid: 7682 timeout: 453 lvb_type: 1 00010000:00010000:0.0:1734016086.129085:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271130ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d8a expref: 7 pid: 7682 timeout: 453 lvb_type: 1 00010000:00010000:0.0:1734016086.129098:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271130ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d8a expref: 7 pid: 7682 timeout: 453 lvb_type: 1 00010000:00010000:0.0:1734016086.129109:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016086.129111:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016086.129118:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc271130f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1282047) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d91 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.129127:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc271130f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1282047) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d91 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.129157:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc271130f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1282047) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d91 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016086.129170:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075884000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335136640:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016086.129202:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016086.133279:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.139436:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.144707:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.157268:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.161668:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.168716:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333227776 00000100:00100000:0.0:1734016086.168726:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333227776 00010000:00010000:0.0:1734016086.168765:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc2711305b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d21 expref: 14 pid: 6480 timeout: 453 lvb_type: 0 00000100:00100000:0.0:1734016086.168824:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2552 00000100:00100000:0.0:1734016086.168831:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247333227776:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016086.168844:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016086.168850:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc2711305b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d21 expref: 14 pid: 6480 timeout: 453 lvb_type: 0 00010000:00010000:0.0:1734016086.168861:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc2711305b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d21 expref: 14 pid: 6480 timeout: 453 lvb_type: 0 00010000:00010000:0.0:1734016086.168881:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc2711305b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3d21 expref: 14 pid: 6480 timeout: 453 lvb_type: 0 00010000:00010000:0.0:1734016086.169699:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016086.169705:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711310a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016086.169713:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711310a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016086.169719:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711310a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016086.169751:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016086.169821:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333227776:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 970us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016086.169828:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2552 00000100:00100000:0.0:1734016086.174449:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.182057:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.190622:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.204711:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.206086:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1892 00000100:00100000:1.0:1734016086.206100:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:9668:x1818247333228288:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016086.206136:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016086.206162:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27113118 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3da6 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.206280:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc2711311f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016086.206299:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc2711311f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016086.206312:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc2711311f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:1.0:1734016086.206342:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 4915514 00000004:00200000:1.0:1734016086.206346:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016086.206366:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc2711311f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016086.206391:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27113118 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3da6 expref: 17 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.206418:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc2711311f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3da6 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.206427:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016086.206430:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016086.206434:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016086.206516:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333228288:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 419us (1823us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016086.206525:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1892 00000100:00100000:0.0:1734016086.212157:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.218002:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.225771:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.236782:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.244286:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00002000:00010000:0.0:1734016086.254334:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 4915514 -> 7360512 00002000:00010000:0.0:1734016086.254341:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1472 -> 1592 00010000:00010000:0.0:1734016086.254365:0:7688:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113142 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7299072->7360511] (req 7299072->7360511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.254381:0:7688:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113142 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7299072->7360511] (req 7299072->7360511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.254389:0:7688:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113142 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7299072->7360511] (req 7299072->7360511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.254396:0:7688:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbdf80 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016086.254402:0:7688:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113142 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7299072->7360511] (req 7299072->7360511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.254411:0:7688:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7299072->7360511] (req 7299072->7360511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.254441:0:7688:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113142 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7299072->7360511] (req 7299072->7360511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.254464:0:7688:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113142 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7299072->7360511] (req 7299072->7360511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016086.255137:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333228928:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 17163us (18360us total) trans 4294969051 rc 0/0 00000100:00100000:0.0:1734016086.255151:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7600 00000100:00100000:1.0:1734016086.258746:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.262682:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.268990:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.275268:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.275325:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.276202:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333229824 00000100:00100000:1.0:1734016086.276208:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333229824 00010000:00010000:1.0:1734016086.276227:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27113149 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dc2 expref: 8 pid: 7682 timeout: 453 lvb_type: 1 00000100:00100000:1.0:1734016086.276252:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2555 00000100:00100000:1.0:1734016086.276261:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333229696:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016086.276278:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016086.276303:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27113150 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dc9 expref: 6 pid: 7683 timeout: 453 lvb_type: 1 00010000:00010000:1.0:1734016086.276316:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27113150 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dc9 expref: 6 pid: 7683 timeout: 453 lvb_type: 1 00010000:00010000:1.0:1734016086.276345:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27113150 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dc9 expref: 6 pid: 7683 timeout: 453 lvb_type: 1 00010000:00010000:1.0:1734016086.276376:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016086.276426:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333229696:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 167us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016086.276432:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2555 00000100:00100000:1.0:1734016086.276448:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2556 00000100:00100000:1.0:1734016086.276460:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333229824:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016086.276468:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016086.276474:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27113149 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dc2 expref: 8 pid: 7682 timeout: 453 lvb_type: 1 00010000:00010000:1.0:1734016086.276483:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27113149 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dc2 expref: 8 pid: 7682 timeout: 453 lvb_type: 1 00010000:00010000:1.0:1734016086.276498:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27113149 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dc2 expref: 8 pid: 7682 timeout: 453 lvb_type: 1 00010000:00010000:1.0:1734016086.276506:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016086.276507:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016086.276511:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113157 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [10432512->10481663] (req 10432512->10481663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.276519:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113157 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [10432512->10481663] (req 10432512->10481663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.276538:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016086.276553:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333229824:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 100us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016086.276559:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2556 00010000:00010000:1.0:1734016086.276580:0:7688:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113157 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10432512->10481663] (req 10432512->10481663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.276587:0:7688:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113157 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10432512->10481663] (req 10432512->10481663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016086.283953:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7360512 -> 10481664 00002000:00010000:1.0:1734016086.283960:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1592 -> 1688 00010000:00010000:1.0:1734016086.283979:0:7688:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113157 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10432512->10481663] (req 10432512->10481663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.283996:0:7688:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113157 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10432512->10481663] (req 10432512->10481663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.284008:0:7688:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113157 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10432512->10481663] (req 10432512->10481663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.284017:0:7688:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd680 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016086.284022:0:7688:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113157 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10432512->10481663] (req 10432512->10481663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.284030:0:7688:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113157 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10432512->10481663] (req 10432512->10481663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.284054:0:7688:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113157 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10432512->10481663] (req 10432512->10481663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.284060:0:7688:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113157 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10432512->10481663] (req 10432512->10481663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016086.284195:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333229568:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 14648us (15214us total) trans 4294969052 rc 0/0 00000100:00100000:1.0:1734016086.284211:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7601 00000100:00100000:0.0:1734016086.287957:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333229952 00000100:00100000:0.0:1734016086.287975:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333229952 00000100:00100000:0.0:1734016086.288583:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9823 00000100:00100000:0.0:1734016086.288594:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333229952:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016086.288626:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016086.288662:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc2711315e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3dd0 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016086.288708:0:7683:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 10481664, mtime: 0x675afc56, atime: 0x675afc55, ctime: 0x675afc56, blocks: 0x698 00010000:00010000:0.0:1734016086.288743:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016086.288746:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016086.288757:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc2711315e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dd0 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016086.288776:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc2711315e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dd0 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016086.288795:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016086.288929:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333229952:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 336us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016086.288937:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9823 00000100:00100000:0.0:1734016086.291756:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.323323:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.323370:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.323418:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.323564:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333230336 00000100:00100000:1.0:1734016086.323576:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333230336 00002000:00100000:1.0:1734016086.323625:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff880073946300 x1818247333230336/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:47/0 lens 488/0 e 0 to 0 dl 1734016097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016086.323636:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073946300 with x1818247333230336 ext(0->4194303) 00002000:00010000:1.0:1734016086.323641:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073946300 00000100:00100000:1.0:1734016086.323656:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333230592 00000100:00100000:1.0:1734016086.323658:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333230592 00002000:00100000:1.0:1734016086.323665:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (4194304->8388607) req@ffff880073947800 x1818247333230592/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:47/0 lens 488/0 e 0 to 0 dl 1734016097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016086.323671:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073947800 with x1818247333230592 ext(4194304->8388607) 00002000:00010000:1.0:1734016086.323673:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073947800 00000100:00100000:1.0:1734016086.323678:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333230848 00000100:00100000:1.0:1734016086.323679:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333230848 00002000:00100000:1.0:1734016086.323685:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (8388608->10481663) req@ffff880073944e00 x1818247333230848/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:47/0 lens 488/0 e 0 to 0 dl 1734016097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016086.323690:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073944e00 with x1818247333230848 ext(8388608->10481663) 00002000:00010000:1.0:1734016086.323692:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073944e00 00000100:00100000:1.0:1734016086.323699:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7602 00000100:00100000:1.0:1734016086.323705:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333230336:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016086.374091:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333230848:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 45276us (50656us total) trans 0 rc 2093056/2093056 00000100:00100000:0.0:1734016086.374107:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7604 00002000:00100000:0.0:1734016086.374126:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8388608->10481663) req@ffff880073944e00 x1818247333230848/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:47/0 lens 488/440 e 0 to 0 dl 1734016097 ref 1 fl Complete:/200/0 rc 2093056/2093056 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016086.374136:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073944e00 with x1818247333230848 ext(8388608->10481663) 00002000:00010000:0.0:1734016086.374143:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073944e00 00000100:00100000:1.0:1734016086.410779:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333230336:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 87059us (87459us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016086.410795:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7602 00002000:00100000:1.0:1734016086.410848:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff880073946300 x1818247333230336/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:47/0 lens 488/440 e 0 to 0 dl 1734016097 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016086.410859:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073946300 with x1818247333230336 ext(0->4194303) 00002000:00010000:1.0:1734016086.410867:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073946300 00000100:00100000:0.0:1734016086.439473:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.445896:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333230592:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 120319us (122509us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016086.445911:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7603 00002000:00100000:1.0:1734016086.445924:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (4194304->8388607) req@ffff880073947800 x1818247333230592/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:47/0 lens 488/440 e 0 to 0 dl 1734016097 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016086.445941:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073947800 with x1818247333230592 ext(4194304->8388607) 00002000:00010000:1.0:1734016086.445948:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073947800 00000100:00100000:0.0:1734016086.457796:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.463028:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.465184:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333231360 00000100:00100000:1.0:1734016086.465209:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333231360 00000100:00100000:1.0:1734016086.465300:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9825 00000100:00100000:1.0:1734016086.465315:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333231360:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016086.465344:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016086.465375:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27113173 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3dde expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.465414:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc2711315e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dd0 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016086.465425:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27113165 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dd7 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016086.465433:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016086.465435:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016086.465439:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27113173 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dde expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.465485:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27113165 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dd7 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016086.465500:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27113165 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dd7 expref: 6 pid: 7682 timeout: 453 lvb_type: 1 00000100:00100000:1.0:1734016086.465519:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335138048:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016086.465601:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc2711315e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dd0 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016086.465609:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc2711315e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dd0 expref: 7 pid: 7683 timeout: 453 lvb_type: 1 00000100:00100000:1.0:1734016086.465617:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073791500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335138176:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016086.465634:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016086.476232:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.478089:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333231488 00000100:00100000:0.0:1734016086.478109:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333231488 00010000:00010000:0.0:1734016086.478162:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc2711315e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dd0 expref: 7 pid: 7683 timeout: 453 lvb_type: 1 00000100:00100000:0.0:1734016086.478204:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2558 00000100:00100000:0.0:1734016086.478212:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333231488:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016086.478231:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016086.478262:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc2711315e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dd0 expref: 7 pid: 7683 timeout: 453 lvb_type: 1 00010000:00010000:0.0:1734016086.478273:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc2711315e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dd0 expref: 7 pid: 7683 timeout: 453 lvb_type: 1 00010000:00010000:0.0:1734016086.478311:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc2711315e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dd0 expref: 7 pid: 7683 timeout: 453 lvb_type: 1 00010000:00010000:0.0:1734016086.478347:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016086.478392:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333231488:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 179us (2165us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016086.478400:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2558 00000100:00100000:0.0:1734016086.485094:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.492593:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.492759:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333231744 00000100:00100000:1.0:1734016086.492770:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333231744 00002000:00010000:1.0:1734016086.492853:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6621459->18446744073709551615) 00002000:00100000:1.0:1734016086.492857:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073945180 with x1818247333231744 ext(6621459->18446744073709551615) 00002000:00010000:1.0:1734016086.492868:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073945180. 00000100:00100000:1.0:1734016086.492889:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7605 00000100:00100000:1.0:1734016086.492896:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333231744:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016086.495656:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10481664 -> 6621459 00002000:00010000:1.0:1734016086.495668:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016086 -> 1734016087 00002000:00010000:1.0:1734016086.495671:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016085 -> 1734016085 00002000:00010000:1.0:1734016086.495673:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016086 -> 1734016087 00002000:00010000:1.0:1734016086.495675:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1688 -> 1472 00000100:00100000:1.0:1734016086.495751:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333231744:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 2852us (3172us total) trans 4294969053 rc 0/0 00000100:00100000:1.0:1734016086.495763:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7605 00002000:00010000:1.0:1734016086.495770:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6621459->18446744073709551615) 00002000:00100000:1.0:1734016086.495773:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073945180 with x1818247333231744 ext(6621459->18446744073709551615) 00002000:00010000:1.0:1734016086.495778:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073945180. 00000100:00100000:0.0:1734016086.498379:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.508121:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.515568:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016086.525345:0:7688:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27113188 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1024000->1036287] (req 1024000->1036287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.525358:0:7688:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27113188 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1024000->1036287] (req 1024000->1036287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.525365:0:7688:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27113188 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1024000->1036287] (req 1024000->1036287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.525375:0:7688:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbf180 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016086.525379:0:7688:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27113188 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1024000->1036287] (req 1024000->1036287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.525386:0:7688:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27113188 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1024000->1036287] (req 1024000->1036287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.525409:0:7688:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27113188 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1024000->1036287] (req 1024000->1036287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.525414:0:7688:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27113188 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1024000->1036287] (req 1024000->1036287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016086.525543:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333232128:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 15751us (17429us total) trans 4294969054 rc 0/0 00000100:00100000:0.0:1734016086.525552:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7606 00000100:00100000:0.0:1734016086.531552:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.532313:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333232384 00000100:00100000:1.0:1734016086.532327:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333232384 00000100:00100000:1.0:1734016086.532393:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1896 00000100:00100000:1.0:1734016086.532400:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:9668:x1818247333232384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016086.532424:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016086.532457:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f180/0x5e3a3adc2711318f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3dec expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.532564:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d680/0x5e3a3adc27113196 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016086.532580:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d680/0x5e3a3adc27113196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016086.532592:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d680/0x5e3a3adc27113196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:1.0:1734016086.532621:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 6621459 00000004:00200000:1.0:1734016086.532625:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016086.532644:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d680/0x5e3a3adc27113196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016086.532671:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f180/0x5e3a3adc2711318f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dec expref: 15 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.532713:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d680/0x5e3a3adc27113196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3dec expref: 14 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.532723:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016086.532727:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016086.532731:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016086.532814:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:9668:x1818247333232384:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 399us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016086.532821:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1896 00000100:00100000:0.0:1734016086.535982:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.539411:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.542655:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.548588:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.553063:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.553315:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333233408 00000100:00100000:1.0:1734016086.553332:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333233408 00002000:00100000:1.0:1734016086.553381:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3940352->3944447) req@ffff8800a78cc700 x1818247333233408/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:47/0 lens 488/0 e 0 to 0 dl 1734016097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016086.553391:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cc700 with x1818247333233408 ext(3940352->3944447) 00002000:00010000:1.0:1734016086.553397:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cc700 00000100:00100000:1.0:1734016086.553423:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7609 00000100:00100000:1.0:1734016086.553433:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333233408:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016086.553618:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333233408:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 185us (569us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016086.553625:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7609 00002000:00100000:1.0:1734016086.553630:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3940352->3944447) req@ffff8800a78cc700 x1818247333233408/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:47/0 lens 488/4536 e 0 to 0 dl 1734016097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016086.553637:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cc700 with x1818247333233408 ext(3940352->3944447) 00002000:00010000:1.0:1734016086.553640:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cc700 00000100:00100000:0.0:1734016086.556994:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.561156:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.562020:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333233920 00000100:00100000:1.0:1734016086.562034:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333233920 00002000:00100000:1.0:1734016086.562095:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3932160->3936255) req@ffff880073b9ea00 x1818247333233920/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:47/0 lens 488/0 e 0 to 0 dl 1734016097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016086.562107:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9ea00 with x1818247333233920 ext(3932160->3936255) 00002000:00010000:1.0:1734016086.562115:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9ea00 00000100:00100000:1.0:1734016086.562356:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7611 00000100:00100000:1.0:1734016086.562363:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333233920:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016086.562767:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333233920:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 401us (1629us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016086.562774:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7611 00002000:00100000:1.0:1734016086.562780:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3932160->3936255) req@ffff880073b9ea00 x1818247333233920/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:47/0 lens 488/4536 e 0 to 0 dl 1734016097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016086.562787:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9ea00 with x1818247333233920 ext(3932160->3936255) 00002000:00010000:1.0:1734016086.562790:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9ea00 00000100:00100000:0.0:1734016086.566138:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.566241:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333234176 00000100:00100000:1.0:1734016086.566251:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333234176 00002000:00100000:1.0:1734016086.566297:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3928064->3932159) req@ffff880073b9e680 x1818247333234176/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:47/0 lens 488/0 e 0 to 0 dl 1734016097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016086.566308:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9e680 with x1818247333234176 ext(3928064->3932159) 00002000:00010000:1.0:1734016086.566313:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9e680 00000100:00100000:1.0:1734016086.566586:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7612 00000100:00100000:1.0:1734016086.566595:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333234176:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016086.567098:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333234176:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 502us (974us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016086.567106:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7612 00002000:00100000:1.0:1734016086.567112:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3928064->3932159) req@ffff880073b9e680 x1818247333234176/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:47/0 lens 488/4536 e 0 to 0 dl 1734016097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016086.567118:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9e680 with x1818247333234176 ext(3928064->3932159) 00002000:00010000:1.0:1734016086.567121:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9e680 00000100:00100000:0.0:1734016086.569928:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.574014:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.574062:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.578072:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.582045:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.588113:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.592373:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.614569:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.614658:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.614836:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333235328 00000100:00100000:1.0:1734016086.614850:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333235328 00002000:00100000:1.0:1734016086.614915:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4280319) req@ffff880073b9df80 x1818247333235328/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:47/0 lens 504/0 e 0 to 0 dl 1734016097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016086.614926:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9df80 with x1818247333235328 ext(0->4280319) 00002000:00010000:1.0:1734016086.614931:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9df80 00000100:00100000:1.0:1734016086.614951:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333235584 00000100:00100000:1.0:1734016086.614953:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333235584 00002000:00100000:1.0:1734016086.614968:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (4190208->6623231) req@ffff880073b9d500 x1818247333235584/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:47/0 lens 504/0 e 0 to 0 dl 1734016097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016086.614975:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9d500 with x1818247333235584 ext(4190208->6623231) 00002000:00010000:1.0:1734016086.614977:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9d500 00000100:00100000:0.0:1734016086.615005:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7613 00000100:00100000:0.0:1734016086.615013:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333235328:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016086.704050:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.711982:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333235712:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 7746us (7924us total) trans 4294969056 rc 0/0 00000100:00100000:0.0:1734016086.711999:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7615 00002000:00100000:0.0:1734016086.712012:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (4222976->4280319) req@ffff880073b9e300 x1818247333235712/t4294969056(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:47/0 lens 488/448 e 0 to 0 dl 1734016097 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016086.712021:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9e300 with x1818247333235712 ext(4222976->4280319) 00002000:00010000:0.0:1734016086.712028:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9e300 00000100:00100000:0.0:1734016086.715022:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.717510:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016086.719122:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969056 is committed 00000001:00080000:0.0:1734016086.719134:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969055 is committed 00000100:00100000:0.0:1734016086.725414:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333236096 00000100:00100000:0.0:1734016086.725425:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333236096 00000100:00100000:0.0:1734016086.725515:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9833 00000100:00100000:0.0:1734016086.725526:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333236096:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016086.725550:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016086.725572:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc271131ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3e16 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016086.725646:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335139328:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016086.725714:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016086.734757:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.747615:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.760544:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00002000:00010000:0.0:1734016086.774396:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1648 -> 1688 00010000:00010000:0.0:1734016086.774429:0:7688:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc271131dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1810432->1830911] (req 1810432->1830911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.774455:0:7688:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc271131dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1810432->1830911] (req 1810432->1830911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.774466:0:7688:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc271131dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1810432->1830911] (req 1810432->1830911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.774475:0:7688:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd440 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016086.774480:0:7688:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc271131dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1810432->1830911] (req 1810432->1830911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.774492:0:7688:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc271131dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1810432->1830911] (req 1810432->1830911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.774526:0:7688:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc271131dc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1810432->1830911] (req 1810432->1830911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.774540:0:7688:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc271131dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1810432->1830911] (req 1810432->1830911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016086.776669:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333236480:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 27800us (29048us total) trans 4294969057 rc 0/0 00000100:00100000:0.0:1734016086.776698:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7616 00000100:00100000:1.0:1734016086.779492:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.790084:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.795050:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.795101:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.795187:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333237248 00000100:00100000:0.0:1734016086.795199:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333237248 00010000:00010000:0.0:1734016086.795246:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271131e3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e24 expref: 8 pid: 7683 timeout: 453 lvb_type: 1 00000100:00100000:0.0:1734016086.795275:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333237120 00000100:00100000:0.0:1734016086.795277:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333237120 00010000:00010000:0.0:1734016086.795286:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271131ea lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e2b expref: 7 pid: 7683 timeout: 453 lvb_type: 1 00000100:00100000:0.0:1734016086.795303:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2565 00000100:00100000:0.0:1734016086.795631:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333237248:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016086.795641:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016086.795652:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271131e3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e24 expref: 8 pid: 7683 timeout: 453 lvb_type: 1 00010000:00010000:0.0:1734016086.795663:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271131e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e24 expref: 8 pid: 7683 timeout: 453 lvb_type: 1 00010000:00010000:0.0:1734016086.795683:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016086.795686:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016086.795697:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271131f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 167936->212991) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e32 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.795709:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271131f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 167936->212991) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e32 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.795753:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271131f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 167936->212991) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e32 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016086.795768:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335139968:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016086.795851:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016086.804540:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335139968:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016086.804574:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016086.804629:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333237248:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9317us (9599us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016086.804708:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2565 00000100:00100000:0.0:1734016086.806003:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.811642:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.820922:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.831867:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.839410:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.846930:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.853548:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.862439:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.868254:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.874384:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.878430:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.888749:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.895699:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.895766:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.896938:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333239168 00000100:00100000:1.0:1734016086.896950:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333239168 00010000:00010000:1.0:1734016086.896988:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27113222 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e63 expref: 7 pid: 7683 timeout: 454 lvb_type: 1 00000100:00100000:1.0:1734016086.897029:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333239296 00000100:00100000:1.0:1734016086.897033:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333239296 00010000:00010000:1.0:1734016086.897042:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711321b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1077248->1081343) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e5c expref: 8 pid: 7683 timeout: 454 lvb_type: 0 00000100:00100000:1.0:1734016086.897058:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2568 00000100:00100000:1.0:1734016086.897064:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333239168:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016086.897077:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016086.897096:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27113222 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e63 expref: 7 pid: 7683 timeout: 454 lvb_type: 1 00010000:00010000:1.0:1734016086.897107:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27113222 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e63 expref: 7 pid: 7683 timeout: 454 lvb_type: 1 00010000:00010000:1.0:1734016086.897132:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27113222 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e63 expref: 7 pid: 7683 timeout: 454 lvb_type: 1 00010000:00010000:1.0:1734016086.897156:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016086.897184:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333239168:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 120us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016086.897190:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2568 00000100:00100000:1.0:1734016086.897204:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2569 00000100:00100000:1.0:1734016086.897208:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333239296:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016086.897214:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016086.897220:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711321b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1077248->1081343) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e5c expref: 8 pid: 7683 timeout: 454 lvb_type: 0 00010000:00010000:1.0:1734016086.897228:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711321b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1077248->1081343) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e5c expref: 8 pid: 7683 timeout: 454 lvb_type: 0 00010000:00010000:1.0:1734016086.897237:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711321b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1077248->1081343) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e5c expref: 8 pid: 7683 timeout: 454 lvb_type: 0 00010000:00010000:1.0:1734016086.897244:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016086.897246:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016086.897254:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113230 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4014079) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e6a expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.897261:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113230 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4014079) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e6a expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.897290:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113230 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4014079) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e6a expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016086.897305:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073791500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335141248:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016086.897346:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016086.900895:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.907079:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.912128:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00002000:00010000:0.0:1734016086.918339:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016086 -> 1734016087 00010000:00010000:0.0:1734016086.918357:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27113237 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [118784->126975] (req 118784->126975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.918370:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27113237 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [118784->126975] (req 118784->126975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.918379:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27113237 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [118784->126975] (req 118784->126975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.918387:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd200 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016086.918392:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27113237 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [118784->126975] (req 118784->126975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.918401:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27113237 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [118784->126975] (req 118784->126975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.918433:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27113237 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [118784->126975] (req 118784->126975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016086.918450:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27113237 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [118784->126975] (req 118784->126975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016086.918605:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333239680:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 11226us (11541us total) trans 4294969061 rc 0/0 00000100:00100000:0.0:1734016086.918619:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7619 00000100:00100000:0.0:1734016086.921736:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.926940:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.931979:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.937262:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075dea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335141632:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016086.937290:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016086.937567:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333240192:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5251us (5586us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016086.937581:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2571 00000100:00100000:0.0:1734016086.942351:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.951258:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.956558:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.963400:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.967077:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.975955:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.978757:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.985926:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.989988:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016086.990045:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.991960:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2574 00000100:00100000:1.0:1734016086.991968:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b42c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333241728:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016086.991980:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016086.991992:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27113268 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e94 expref: 8 pid: 7683 timeout: 454 lvb_type: 1 00010000:00010000:1.0:1734016086.992000:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27113268 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e94 expref: 8 pid: 7683 timeout: 454 lvb_type: 1 00010000:00010000:1.0:1734016086.992011:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27113268 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3e94 expref: 8 pid: 7683 timeout: 454 lvb_type: 1 00010000:00010000:1.0:1734016086.992025:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016086.992027:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016086.992034:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8912896->8937471) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ea2 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.992043:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8912896->8937471) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ea2 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016086.992075:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8912896->8937471) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ea2 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016086.992090:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073791500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335142528:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016086.992135:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f780 going to sleep for 11 seconds 00000100:00100000:0.0:1734016086.996982:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016086.997081:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073791500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335142528:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016086.997105:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016086.997154:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b42c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333241728:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5185us (7107us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016086.997166:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2574 00000100:00100000:0.0:1734016087.000345:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016087.001046:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016057 00000100:00100000:0.0:1734016087.006330:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.010068:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.010390:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333242368 00000100:00100000:1.0:1734016087.010404:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333242368 00010000:00010000:1.0:1734016087.010471:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113276 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8912896->8937471) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ea2 expref: 8 pid: 7682 timeout: 454 lvb_type: 0 00000100:00100000:1.0:1734016087.010534:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2575 00000100:00100000:1.0:1734016087.010545:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333242368:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016087.010568:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016087.010595:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113276 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8912896->8937471) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ea2 expref: 8 pid: 7682 timeout: 454 lvb_type: 0 00010000:00010000:1.0:1734016087.010609:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113276 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8912896->8937471) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ea2 expref: 8 pid: 7682 timeout: 454 lvb_type: 0 00010000:00010000:1.0:1734016087.010652:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016087.010655:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016087.010661:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27113284 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1298432->1351679] (req 1298432->1351679) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016087.010674:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27113284 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1298432->1351679] (req 1298432->1351679) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016087.010702:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016087.010763:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333242368:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 221us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016087.010770:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2575 00000100:00100000:0.0:1734016087.017038:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.020297:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.023745:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.031919:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333242880 00000100:00100000:0.0:1734016087.031933:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333242880 00000100:00100000:0.0:1734016087.031998:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9861 00000100:00100000:0.0:1734016087.032006:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333242880:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016087.032713:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8934981 -> 8934981 00002000:00010000:0.0:1734016087.032721:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016086 -> 1734016086 00002000:00010000:0.0:1734016087.032724:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016087 -> 1734016087 00002000:00010000:0.0:1734016087.032727:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016086 -> 1734016086 00002000:00010000:0.0:1734016087.032729:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1840 -> 1728 00000100:00100000:0.0:1734016087.032838:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333242880:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 791us (1574us total) trans 4294969064 rc 0/0 00000100:00100000:0.0:1734016087.032845:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9861 00000100:00100000:0.0:1734016087.037473:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.046556:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.051928:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.062054:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.066404:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.066550:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333243648 00000100:00100000:1.0:1734016087.066563:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333243648 00000100:00100000:1.0:1734016087.066631:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9864 00000100:00100000:1.0:1734016087.066639:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333243648:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016087.066666:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016087.066691:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271132ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3ecc expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016087.066717:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016087.066719:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016087.066728:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271132ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ecc expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016087.066747:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271132ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ecc expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016087.066760:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016087.066854:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333243648:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 215us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016087.066861:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9864 00000100:00100000:0.0:1734016087.069592:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.075569:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335144064:0@lo:400:kworker.0 00000100:00100000:0.0:1734016087.075684:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016087.075726:0:3503:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1734016087.075731:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67a75f73-9674-4938-8c12-63813a36f078:3503:1818247335143680:0@lo:400:kworker.0 00000100:00100000:0.0:1734016087.075765:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016087.075779:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3503:1818247335144192:0@lo:400:kworker.0 00000100:00100000:0.0:1734016087.075831:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016087.076860:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.076938:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.076957:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333243904 00000100:00080000:0.0:1734016087.076959:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016057 00000100:00100000:1.0:1734016087.076961:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333243904 00000100:00080000:0.0:1734016087.076964:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016057 00000100:00080000:0.0:1734016087.076966:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016057 00000100:00080000:0.0:1734016087.076969:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016057 00000100:00100000:0.0:1734016087.076987:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67a75f73-9674-4938-8c12-63813a36f078:3503:1818247335143680:0@lo:400:kworker.0 00010000:00010000:1.0:1734016087.076996:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271132ae lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ecc expref: 11 pid: 7682 timeout: 454 lvb_type: 1 00000100:00100000:0.0:1734016087.076997:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3503:1818247335144192:0@lo:400:kworker.0 00000100:00100000:0.0:1734016087.077006:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335144064:0@lo:400:kworker.0 00000100:00100000:1.0:1734016087.077020:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333244032 00000100:00100000:1.0:1734016087.077024:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333244032 00010000:00010000:1.0:1734016087.077036:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271132a7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ec5 expref: 7 pid: 7683 timeout: 454 lvb_type: 1 00000100:00100000:1.0:1734016087.077053:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2578 00000100:00100000:1.0:1734016087.077057:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333243904:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016087.077069:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016087.077094:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271132ae lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ecc expref: 11 pid: 7682 timeout: 454 lvb_type: 1 00010000:00010000:1.0:1734016087.077105:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271132ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ecc expref: 11 pid: 7682 timeout: 454 lvb_type: 1 00010000:00010000:1.0:1734016087.078055:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271132ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ecc expref: 10 pid: 7682 timeout: 454 lvb_type: 1 00010000:00010000:1.0:1734016087.078080:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016087.078083:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016087.078092:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271132b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9781248->9789439) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ed3 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016087.078103:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271132b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9781248->9789439) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ed3 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016087.078143:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271132b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9781248->9789439) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ed3 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016087.078157:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335144448:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016087.078194:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016087.080162:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.080248:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335144448:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016087.080274:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016087.080314:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333243904:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3256us (3459us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016087.080326:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2578 00000100:00100000:0.0:1734016087.080942:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9866 00000100:00100000:0.0:1734016087.080951:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333244160:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016087.081310:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8934981 -> 9786552 00002000:00010000:0.0:1734016087.081313:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016086 -> 1734016087 00002000:00010000:0.0:1734016087.081316:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016087 -> 1734016087 00002000:00010000:0.0:1734016087.081318:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016086 -> 1734016087 00002000:00010000:0.0:1734016087.081321:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1728 -> 1744 00000100:00100000:0.0:1734016087.081366:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333244160:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 416us (1218us total) trans 4294969065 rc 0/0 00000100:00100000:0.0:1734016087.081373:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9866 00000100:00100000:0.0:1734016087.083068:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.091121:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.098547:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.106553:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.115433:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.115757:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333244928 00000100:00100000:1.0:1734016087.115769:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333244928 00010000:00010000:1.0:1734016087.116126:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271132b5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9781248->9789439) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ed3 expref: 10 pid: 7683 timeout: 454 lvb_type: 0 00000100:00100000:1.0:1734016087.116181:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2580 00000100:00100000:1.0:1734016087.116192:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333244928:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016087.116210:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016087.116236:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271132b5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 9781248->9789439) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ed3 expref: 10 pid: 7683 timeout: 454 lvb_type: 0 00010000:00010000:1.0:1734016087.116249:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271132b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 9781248->9789439) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ed3 expref: 10 pid: 7683 timeout: 454 lvb_type: 0 00010000:00010000:1.0:1734016087.116282:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016087.116285:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016087.116290:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271132d1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [6209536->6250495] (req 6209536->6250495) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016087.116301:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271132d1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [6209536->6250495] (req 6209536->6250495) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016087.116335:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016087.117550:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333244928:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1357us (2136us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016087.117560:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2580 00000100:00100000:0.0:1734016087.123321:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335145088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1734016087.123402:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016087.123757:0:7685:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335145088 00000100:00100000:1.0:1734016087.123772:0:7685:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335145088 00000100:00100000:1.0:1734016087.123862:0:7685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1734016087.123873:0:7685:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335145088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1734016087.123925:0:7685:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 980042304 pending 0 free 3922788352 avail 3690799104 00000100:00100000:1.0:1734016087.123986:0:7685:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335145088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016087.123994:0:7685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1734016087.124266:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335145088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1734016087.126303:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.129890:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.134217:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.139110:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.139190:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.144348:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333245696 00000100:00100000:0.0:1734016087.144360:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333245696 00000100:00100000:0.0:1734016087.144413:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9873 00000100:00100000:0.0:1734016087.144422:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333245696:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016087.144797:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9786552 -> 9786552 00002000:00010000:0.0:1734016087.145834:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016087 -> 1734016087 00002000:00010000:0.0:1734016087.145837:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016087 -> 1734016087 00002000:00010000:0.0:1734016087.145839:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016087 -> 1734016087 00002000:00010000:0.0:1734016087.145840:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1744 -> 1824 00000100:00100000:0.0:1734016087.146229:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333245696:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1806us (1989us total) trans 4294969066 rc 0/0 00000100:00100000:0.0:1734016087.146240:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9873 00000100:00100000:1.0:1734016087.150681:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.150762:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333245824 00000100:00100000:0.0:1734016087.150774:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333245824 00000100:00100000:0.0:1734016087.151267:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9874 00000100:00100000:0.0:1734016087.151278:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333245824:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016087.151597:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9786552 -> 9786552 00002000:00010000:0.0:1734016087.151601:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016087 -> 1734016087 00002000:00010000:0.0:1734016087.151603:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016087 -> 1734016087 00002000:00010000:0.0:1734016087.151605:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016087 -> 1734016087 00002000:00010000:0.0:1734016087.152742:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1824 -> 1928 00000100:00100000:0.0:1734016087.152900:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333245824:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1618us (2227us total) trans 4294969067 rc 0/0 00000100:00100000:0.0:1734016087.152916:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9874 00000100:00100000:0.0:1734016087.163381:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.182301:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.196112:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.199572:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016087.209698:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969068 is committed 00000001:00080000:0.0:1734016087.209723:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969065 is committed 00000100:00100000:0.0:1734016087.213606:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.220041:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016087.221150:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016057 00000100:00100000:0.0:1734016087.234411:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.256095:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.264597:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.278389:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.293946:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.302742:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.314239:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.322119:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.362272:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.362347:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.463546:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.471051:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.477393:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.480319:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.484480:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.487881:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.491092:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.491582:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333249280 00000100:00100000:1.0:1734016087.491598:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333249280 00000100:00100000:1.0:1734016087.491687:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9884 00000100:00100000:1.0:1734016087.491699:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333249280:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016087.491731:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016087.491772:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc2711334f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3f4a expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016087.491922:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335147264:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016087.492082:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00002000:00010000:1.0:1734016087.494155:0:7683:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016087 -> 1734016088 00000100:00100000:1.0:1734016087.494208:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335147264:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016087.494266:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc2711334f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3f4a expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016087.494289:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc2711334f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3f4a expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016087.494325:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016087.494414:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333249280:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2716us (3348us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016087.494429:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9884 00000100:00100000:0.0:1734016087.497272:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.497494:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333249408 00000100:00100000:1.0:1734016087.497512:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333249408 00000100:00100000:1.0:1734016087.497646:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9885 00000100:00100000:1.0:1734016087.497656:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333249408:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016087.497693:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016087.497724:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27113356 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3f51 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016087.497993:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335147392:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016087.498160:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016087.501592:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335147392:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016087.501676:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27113356 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3f51 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016087.501701:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27113356 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3f51 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016087.501791:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016087.502172:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333249408:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4514us (4914us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016087.502187:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9885 00000100:00100000:0.0:1734016087.506175:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.506656:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333249536 00000100:00100000:1.0:1734016087.506673:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333249536 00000100:00100000:0.0:1734016087.513230:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.514026:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9887 00000100:00100000:1.0:1734016087.514040:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333249664:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016087.514074:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016087.514109:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27113364 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3f5f expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016087.514161:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc2711333a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->2355199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3f3c expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016087.514171:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016087.514174:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016087.514177:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27113364 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3f5f expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016087.514221:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc2711333a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->2355199) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3f3c expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016087.514235:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc2711333a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->2355199) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3f3c expref: 7 pid: 7682 timeout: 454 lvb_type: 0 00000100:00100000:1.0:1734016087.514257:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335147648:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016087.514357:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016087.516467:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016087.517118:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc2711333a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2330624->2355199) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3f3c expref: 8 pid: 7682 timeout: 454 lvb_type: 0 00000100:00100000:1.0:1734016087.517147:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335147648:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016087.517186:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27113364 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3f5f expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016087.517199:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016087.517235:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333249664:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3199us (4026us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016087.517246:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9887 00000100:00100000:0.0:1734016087.520479:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.533164:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.541388:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.541507:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333250304 00000100:00100000:1.0:1734016087.541518:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333250304 00000100:00100000:1.0:1734016087.541582:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9888 00000100:00100000:1.0:1734016087.541591:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333250304:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016087.543427:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969071 is committed 00000001:00080000:0.0:1734016087.543457:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969070 is committed 00000100:00100000:1.0:1734016087.543747:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333250304:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2149us (2367us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016087.543759:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9888 00000100:00100000:0.0:1734016087.547489:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.548781:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333250432 00000100:00100000:1.0:1734016087.548822:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333250432 00000100:00100000:1.0:1734016087.549438:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9889 00000100:00100000:1.0:1734016087.549452:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333250432:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016087.550272:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 6573186 -> 6573186 00002000:00010000:1.0:1734016087.550278:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016087 -> 1734016088 00002000:00010000:1.0:1734016087.550280:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016087 -> 1734016087 00002000:00010000:1.0:1734016087.550283:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016088 -> 1734016087 00002000:00010000:1.0:1734016087.550285:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1864 -> 1928 00000100:00100000:1.0:1734016087.550423:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333250432:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 970us (2963us total) trans 4294969072 rc 0/0 00000100:00100000:1.0:1734016087.550453:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9889 00000100:00100000:0.0:1734016087.557082:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.557625:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333250560 00000100:00100000:1.0:1734016087.557643:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333250560 00000100:00100000:1.0:1734016087.557732:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9890 00000100:00100000:1.0:1734016087.557741:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333250560:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016087.557775:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016087.557860:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc2711336b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3f66 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016087.557971:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335147904:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016087.558083:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00002000:00010000:1.0:1734016087.567985:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016087 -> 1734016088 00002000:00010000:1.0:1734016087.568008:0:7683:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016087 -> 1734016088 00000100:00100000:1.0:1734016087.568051:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335147904:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016087.568113:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc2711336b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3f66 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016087.568135:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc2711336b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3f66 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016087.568184:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d8c0, rc 0) 00000100:00100000:1.0:1734016087.568283:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333250560:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10541us (11225us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016087.568295:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9890 00000100:00100000:0.0:1734016087.579917:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.580580:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333250688 00000100:00100000:1.0:1734016087.580596:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333250688 00000100:00100000:1.0:1734016087.580700:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9891 00000100:00100000:1.0:1734016087.580711:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333250688:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016087.580752:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016087.580790:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113372 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e3f6d expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016087.580955:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335148032:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016087.581078:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016087.586630:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.593560:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.603002:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.608248:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.632732:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.639032:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.645487:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.652631:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.657625:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.663897:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.676089:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.684086:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.692641:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.698120:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.717929:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.718026:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.774093:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.783276:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.783403:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333253376 00000100:00100000:1.0:1734016087.783416:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333253376 00000100:00100000:1.0:1734016087.783518:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1901 00000100:00100000:1.0:1734016087.783528:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:9668:x1818247333253376:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:1.0:1734016087.783721:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:9668:x1818247333253376:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 195us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016087.783733:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1901 00000100:00100000:0.0:1734016087.787006:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:1.0:1734016087.792509:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969076 is committed 00000001:00080000:1.0:1734016087.792555:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969074 is committed 00000100:00100000:1.0:1734016087.797972:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.818262:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016087.821388:0:13914:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271133b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8306688->8359935] (req 8306688->8359935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016087.821397:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271133b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8306688->8359935] (req 8306688->8359935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016087.827978:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 6573186 -> 8359936 00002000:00010000:0.0:1734016087.827988:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 2008 -> 2112 00010000:00010000:0.0:1734016087.828010:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271133b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8306688->8359935] (req 8306688->8359935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016087.828024:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271133b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8306688->8359935] (req 8306688->8359935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016087.828034:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271133b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8306688->8359935] (req 8306688->8359935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016087.828045:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd200 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016087.828053:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271133b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8306688->8359935] (req 8306688->8359935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016087.828064:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271133b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8306688->8359935] (req 8306688->8359935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016087.828096:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271133b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8306688->8359935] (req 8306688->8359935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016087.828102:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271133b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8306688->8359935] (req 8306688->8359935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016087.828293:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333253760:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 28933us (30329us total) trans 4294969077 rc 0/0 00000100:00100000:0.0:1734016087.828308:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7634 00000100:00100000:0.0:1734016087.835207:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.843298:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.845628:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.854343:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.856117:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.856709:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2595 00000100:00100000:1.0:1734016087.856717:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b42c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333254528:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016087.856727:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016087.856753:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271133b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3fa5 expref: 7 pid: 7683 timeout: 454 lvb_type: 1 00010000:00010000:1.0:1734016087.856766:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271133b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3fa5 expref: 7 pid: 7683 timeout: 454 lvb_type: 1 00010000:00010000:1.0:1734016087.856848:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271133b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3fa5 expref: 7 pid: 7683 timeout: 454 lvb_type: 1 00010000:00010000:1.0:1734016087.856875:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016087.856899:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b42c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333254528:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 183us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016087.856907:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2595 00000100:00100000:0.0:1734016087.864051:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016087.864971:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333254784 00000100:00100000:1.0:1734016087.864985:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333254784 00002000:00100000:1.0:1734016087.865048:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1916928->8359935) req@ffff88012db08e00 x1818247333254784/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:48/0 lens 504/0 e 0 to 0 dl 1734016098 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016087.865059:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db08e00 with x1818247333254784 ext(1916928->8359935) 00002000:00010000:1.0:1734016087.865066:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db08e00 00000100:00100000:1.0:1734016087.865098:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7635 00000100:00100000:1.0:1734016087.865106:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333254784:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016087.894462:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.897978:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.901234:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.904010:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.907189:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.910245:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.913905:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.917293:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.922502:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.930479:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.938776:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.947007:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.954343:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.961007:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.967620:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.972652:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.980297:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.990529:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016087.999762:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00002000:00010000:0.0:1734016088.013474:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9086312 -> 10481664 00002000:00010000:0.0:1734016088.013480:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 2304 -> 2312 00010000:00010000:0.0:1734016088.013502:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271133f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10477568->10481663] (req 10477568->10481663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.013517:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271133f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10477568->10481663] (req 10477568->10481663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.013528:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271133f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10477568->10481663] (req 10477568->10481663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.013534:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbdf80 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016088.013539:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271133f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10477568->10481663] (req 10477568->10481663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.013549:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271133f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10477568->10481663] (req 10477568->10481663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.013574:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271133f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10477568->10481663] (req 10477568->10481663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.013586:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271133f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10477568->10481663] (req 10477568->10481663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016088.015570:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333258240:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 24707us (25025us total) trans 4294969080 rc 0/0 00000100:00100000:0.0:1734016088.015598:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7645 00000100:00100000:0.0:1734016088.020643:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.026314:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333258752 00000100:00100000:0.0:1734016088.026328:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333258752 00000100:00100000:0.0:1734016088.026448:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7646 00000100:00100000:0.0:1734016088.026459:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333258752:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:0.0:1734016088.026552:0:13914:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27113405 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.026578:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016088.026581:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016088.026587:0:13914:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27113405 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1683456->1691647] (req 1683456->1691647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.026608:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27113405 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1683456->1691647] (req 1683456->1691647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.026786:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27113405 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1683456->1691647] (req 1683456->1691647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.026795:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27113405 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1683456->1691647] (req 1683456->1691647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.026880:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27113405 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1683456->1691647] (req 1683456->1691647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.026887:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a75818c0 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016088.026891:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27113405 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1683456->1691647] (req 1683456->1691647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.026898:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27113405 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1683456->1691647] (req 1683456->1691647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.026917:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27113405 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1683456->1691647] (req 1683456->1691647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.026922:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27113405 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1683456->1691647] (req 1683456->1691647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016088.027016:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333258752:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 558us (815us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1734016088.027024:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7646 00000100:00100000:0.0:1734016088.034001:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.050857:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016088.060635:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969081 is committed 00000100:00100000:0.0:1734016088.065502:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016088.066527:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016058 00000100:00100000:0.0:1734016088.072357:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016088.073770:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016058 00000100:00100000:0.0:1734016088.079064:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.084749:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.091167:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.096556:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.105756:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.108767:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.117676:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.121887:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.122112:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333260672 00000100:00100000:1.0:1734016088.122128:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333260672 00000100:00100000:1.0:1734016088.122220:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1904 00000100:00100000:1.0:1734016088.122230:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+15:9668:x1818247333260672:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016088.122633:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27113444 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016088.122660:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711342f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ff9 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.122669:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27113444 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016088.122732:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711342f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ff9 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.122749:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711342f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ff9 expref: 19 pid: 6478 timeout: 455 lvb_type: 0 00000100:00100000:1.0:1734016088.122765:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335151488:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016088.122916:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016088.125914:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335151488:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016088.125956:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27113444 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016088.126664:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016088.127747:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27113444 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016088.127755:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27113444 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:1.0:1734016088.128485:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968530 00000004:00010000:1.0:1734016088.128547:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075653100 reply state ffff880075209000 transno 4294968531 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27113444 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:1.0:1734016088.128555:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016088.128664:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333260672:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 6435us (6802us total) trans 4294968531 rc 0/0 00000100:00100000:1.0:1734016088.128672:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1904 00000020:00080000:1.0:1734016088.128677:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016088.132900:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.147066:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.147248:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333261056 00000100:00100000:1.0:1734016088.147265:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333261056 00000100:00100000:1.0:1734016088.147555:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1905 00000100:00100000:1.0:1734016088.147565:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:9668:x1818247333261056:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016088.147599:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016088.147634:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc2711344b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e400e expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.147781:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27113452 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016088.147824:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27113452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016088.147840:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27113452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:1.0:1734016088.147874:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 352397 00000004:00200000:1.0:1734016088.147878:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016088.147898:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27113452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016088.147928:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc2711344b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e400e expref: 21 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.147950:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27113452 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e400e expref: 20 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.147959:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016088.147961:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016088.147966:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016088.148018:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:9668:x1818247333261056:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 454us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016088.148026:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1905 00000100:00100000:0.0:1734016088.151488:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.159491:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.170770:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333261568 00000100:00100000:0.0:1734016088.170789:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333261568 00000100:00100000:0.0:1734016088.170949:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7650 00000100:00100000:0.0:1734016088.170961:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333261568:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:0.0:1734016088.171020:0:14005:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27113467 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.171053:0:14005:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27113421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ff2 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.171063:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016088.171066:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016088.171070:0:14005:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27113467 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7135232->7151615] (req 7135232->7151615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.171122:0:14005:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27113421 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ff2 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.171147:0:14005:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27113421 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e3ff2 expref: 8 pid: 7683 timeout: 455 lvb_type: 0 00000100:00100000:0.0:1734016088.171166:0:14005:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14005:1818247335151872:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016088.171283:0:14005:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016088.178259:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016088.185882:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969084 is committed 00000001:00080000:0.0:1734016088.185940:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969083 is committed 00000100:00100000:0.0:1734016088.190050:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.194032:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.208532:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.208615:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.305095:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.305224:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333262592 00000100:00100000:1.0:1734016088.305239:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333262592 00000100:00100000:1.0:1734016088.305382:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9922 00000100:00100000:1.0:1734016088.305390:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333262592:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016088.305429:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016088.305457:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27113483 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4031 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.305495:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016088.305497:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016088.305508:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27113483 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4031 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016088.305530:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27113483 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4031 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016088.305553:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016088.306489:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333262592:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1093us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016088.306499:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9922 00000100:00100000:0.0:1734016088.309359:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.309515:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333262848 00000100:00100000:1.0:1734016088.309530:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333262848 00000100:00100000:1.0:1734016088.309608:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1907 00000100:00100000:1.0:1734016088.309618:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333262848:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016088.309701:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016088.309743:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27113475 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4023 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.309776:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016088.309781:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016088.310083:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc2711348a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016088.310100:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27113452 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e400e expref: 19 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.310107:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc2711348a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016088.310148:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27113452 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e400e expref: 19 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.310163:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27113452 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e400e expref: 19 pid: 6479 timeout: 455 lvb_type: 0 00000100:00100000:1.0:1734016088.310177:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335152000:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016088.310768:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016088.314869:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335152000:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016088.314913:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc2711348a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016088.315120:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016088.316033:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc2711348a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016088.316041:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc2711348a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:0.0:1734016088.316196:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968532 00000004:00010000:0.0:1734016088.316259:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075fc5500 reply state ffff88007520b000 transno 4294968533 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc2711348a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016088.316267:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016088.318194:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333262848:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 8564us (8839us total) trans 4294968533 rc 0/0 00000100:00100000:0.0:1734016088.318210:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1907 00000020:00080000:0.0:1734016088.318220:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016088.320922:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.321122:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333263104 00000100:00100000:1.0:1734016088.321135:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333263104 00000100:00100000:1.0:1734016088.321843:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9923 00000100:00100000:1.0:1734016088.321853:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333263104:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016088.321877:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016088.321899:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27113491 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4038 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.321944:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711347c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e402a expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016088.321953:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27113483 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4031 expref: 5 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016088.321960:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016088.321962:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016088.321966:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27113491 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4038 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.322010:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27113483 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4031 expref: 5 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016088.322024:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27113483 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4031 expref: 5 pid: 7682 timeout: 455 lvb_type: 1 00000100:00100000:1.0:1734016088.322044:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335152128:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016088.322150:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711347c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e402a expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016088.322158:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711347c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e402a expref: 8 pid: 7683 timeout: 455 lvb_type: 1 00000100:00100000:1.0:1734016088.322166:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335152256:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016088.322184:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016088.327937:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335152128:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016088.327959:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335152256:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016088.328016:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27113491 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4038 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.328044:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016088.328127:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333263104:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6273us (7212us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016088.328142:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9923 00000100:00100000:0.0:1734016088.330355:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.343653:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.351993:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.374884:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.378225:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.378283:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333263744 00000100:00100000:1.0:1734016088.378294:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333263744 00000100:00100000:1.0:1734016088.378351:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9924 00000100:00100000:1.0:1734016088.378360:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333263744:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016088.378389:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016088.378412:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271134a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4046 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016088.378496:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335152512:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016088.378570:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016088.389795:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.406573:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.413487:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.431122:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.453430:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.464317:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.469033:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.470951:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333265152 00000100:00100000:1.0:1734016088.470968:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333265152 00002000:00100000:1.0:1734016088.471024:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1601536->1605631) req@ffff8800849b5f80 x1818247333265152/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:49/0 lens 488/0 e 0 to 0 dl 1734016099 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016088.471040:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b5f80 with x1818247333265152 ext(1601536->1605631) 00002000:00010000:1.0:1734016088.471047:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b5f80 00000100:00100000:1.0:1734016088.471392:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7655 00000100:00100000:1.0:1734016088.471400:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333265152:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016088.471691:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333265152:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 290us (2674us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016088.471699:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7655 00002000:00100000:1.0:1734016088.471706:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1601536->1605631) req@ffff8800849b5f80 x1818247333265152/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:49/0 lens 488/4536 e 0 to 0 dl 1734016099 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016088.471714:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b5f80 with x1818247333265152 ext(1601536->1605631) 00002000:00010000:1.0:1734016088.471717:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b5f80 00000100:00100000:0.0:1734016088.476538:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.477008:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333265408 00000100:00100000:1.0:1734016088.477028:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333265408 00002000:00100000:1.0:1734016088.477127:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1568768->1634303) req@ffff8800849b7b80 x1818247333265408/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:49/0 lens 504/0 e 0 to 0 dl 1734016099 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016088.477143:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b7b80 with x1818247333265408 ext(1568768->1634303) 00002000:00010000:1.0:1734016088.477152:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b7b80 00000100:00100000:1.0:1734016088.477293:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7656 00000100:00100000:1.0:1734016088.477304:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333265408:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016088.483331:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333265408:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 6000us (6788us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1734016088.483355:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7656 00002000:00100000:1.0:1734016088.483377:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1568768->1634303) req@ffff8800849b7b80 x1818247333265408/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:49/0 lens 504/440 e 0 to 0 dl 1734016099 ref 1 fl Complete:/200/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016088.483391:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b7b80 with x1818247333265408 ext(1568768->1634303) 00002000:00010000:1.0:1734016088.483398:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b7b80 00000100:00100000:0.0:1734016088.485532:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.485661:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333265664 00000100:00100000:1.0:1734016088.485675:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333265664 00002000:00100000:1.0:1734016088.485742:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1536000->1568767) req@ffff8800849b7800 x1818247333265664/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:49/0 lens 488/0 e 0 to 0 dl 1734016099 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016088.485754:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b7800 with x1818247333265664 ext(1536000->1568767) 00002000:00010000:1.0:1734016088.485760:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b7800 00000100:00100000:1.0:1734016088.485844:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7657 00000100:00100000:1.0:1734016088.485853:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333265664:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016088.488249:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333265664:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 2378us (2716us total) trans 0 rc 32768/32768 00000100:00100000:1.0:1734016088.488269:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7657 00002000:00100000:1.0:1734016088.488290:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1536000->1568767) req@ffff8800849b7800 x1818247333265664/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:49/0 lens 488/440 e 0 to 0 dl 1734016099 ref 1 fl Complete:/200/0 rc 32768/32768 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016088.488303:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b7800 with x1818247333265664 ext(1536000->1568767) 00002000:00010000:1.0:1734016088.488309:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b7800 00000100:00100000:0.0:1734016088.492707:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.492863:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333265920 00000100:00100000:1.0:1734016088.492876:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333265920 00000100:00100000:1.0:1734016088.493258:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7658 00000100:00100000:1.0:1734016088.493268:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333265920:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:1.0:1734016088.493337:0:7687:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271134e5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.493360:0:7687:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27113491 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4038 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.493368:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016088.493371:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016088.493375:0:7687:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271134e5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [638976->651263] (req 638976->651263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.493411:0:7687:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27113491 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4038 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.493443:0:7687:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27113491 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4038 expref: 8 pid: 7682 timeout: 455 lvb_type: 0 00000100:00100000:1.0:1734016088.493458:0:7687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335153024:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016088.493544:0:7687:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016088.497089:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016088.498112:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27113491 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4038 expref: 9 pid: 7682 timeout: 455 lvb_type: 0 00000100:00100000:1.0:1734016088.498769:0:7687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335153024:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016088.498825:0:7687:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271134e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [638976->651263] (req 638976->651263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.498837:0:7687:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271134e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [638976->651263] (req 638976->651263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.498844:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271134e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [638976->651263] (req 638976->651263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.498988:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271134e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [638976->651263] (req 638976->651263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.498999:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271134e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [638976->651263] (req 638976->651263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.499007:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271134e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [638976->651263] (req 638976->651263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.499016:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499eac0 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016088.499021:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271134e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [638976->651263] (req 638976->651263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.499032:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271134e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [638976->651263] (req 638976->651263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.499048:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271134e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [638976->651263] (req 638976->651263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.499055:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271134e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [638976->651263] (req 638976->651263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016088.499108:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333265920:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 5841us (6414us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1734016088.499117:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7658 00000100:00100000:0.0:1734016088.507007:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.523542:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.535846:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333266560 00000100:00100000:0.0:1734016088.535862:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333266560 00010000:00010000:0.0:1734016088.535929:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271134c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4054 expref: 22 pid: 6479 timeout: 455 lvb_type: 0 00000100:00100000:0.0:1734016088.535989:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2606 00000100:00100000:0.0:1734016088.536003:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+22:1981:x1818247333266560:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016088.536034:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016088.536045:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271134c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4054 expref: 22 pid: 6479 timeout: 455 lvb_type: 0 00010000:00010000:0.0:1734016088.536064:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271134c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4054 expref: 22 pid: 6479 timeout: 455 lvb_type: 0 00010000:00010000:0.0:1734016088.536105:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271134c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4054 expref: 22 pid: 6479 timeout: 455 lvb_type: 0 00010000:00010000:0.0:1734016088.536146:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016088.536153:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271134f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016088.536168:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271134f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016088.536186:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271134f3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016088.538209:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016088.540028:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+21:1981:x1818247333266560:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4020us (4365us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016088.540042:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2606 00000100:00100000:1.0:1734016088.543204:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.557879:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.557956:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333266816 00000100:00100000:0.0:1734016088.557972:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333266816 00010000:00010000:0.0:1734016088.558031:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271134ec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4069 expref: 8 pid: 7682 timeout: 455 lvb_type: 1 00000100:00100000:0.0:1734016088.558593:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2607 00000100:00100000:0.0:1734016088.558605:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333266816:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016088.558637:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016088.558679:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271134ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4069 expref: 8 pid: 7682 timeout: 455 lvb_type: 1 00010000:00010000:0.0:1734016088.558697:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271134ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4069 expref: 8 pid: 7682 timeout: 455 lvb_type: 1 00010000:00010000:0.0:1734016088.558740:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271134ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4069 expref: 8 pid: 7682 timeout: 455 lvb_type: 1 00010000:00010000:0.0:1734016088.558772:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016088.558774:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016088.558782:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271134fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4070 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.558794:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271134fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4070 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.558878:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271134fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4070 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016088.558896:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335153408:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016088.558963:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016088.561828:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.562397:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333266944 00000100:00100000:1.0:1734016088.562407:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333266944 00002000:00010000:1.0:1734016088.562462:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (5994803->18446744073709551615) 00002000:00100000:1.0:1734016088.562468:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b6a00 with x1818247333266944 ext(5994803->18446744073709551615) 00002000:00010000:1.0:1734016088.562484:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b6a00. 00000100:00100000:1.0:1734016088.562509:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7659 00000100:00100000:1.0:1734016088.562516:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333266944:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016088.562855:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 2229258 -> 5994803 00002000:00010000:1.0:1734016088.562862:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016088 -> 1734016089 00002000:00010000:1.0:1734016088.562864:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016088 -> 1734016088 00002000:00010000:1.0:1734016088.562867:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016088 -> 1734016089 00002000:00010000:1.0:1734016088.562880:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 432 -> 432 00000100:00100000:1.0:1734016088.562923:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333266944:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 407us (1144us total) trans 4294969086 rc 0/0 00000100:00100000:1.0:1734016088.562931:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7659 00002000:00010000:1.0:1734016088.562934:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (5994803->18446744073709551615) 00002000:00100000:1.0:1734016088.562936:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b6a00 with x1818247333266944 ext(5994803->18446744073709551615) 00002000:00010000:1.0:1734016088.562940:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b6a00. 00000100:00100000:0.0:1734016088.569751:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.580005:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.590477:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.609586:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.622605:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.629139:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.638451:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.639824:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333268096 00000100:00100000:1.0:1734016088.639839:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333268096 00002000:00100000:1.0:1734016088.639899:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5320704->5324799) req@ffff88012e257480 x1818247333268096/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:49/0 lens 488/0 e 0 to 0 dl 1734016099 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016088.639910:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e257480 with x1818247333268096 ext(5320704->5324799) 00002000:00010000:1.0:1734016088.639917:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e257480 00000100:00100000:1.0:1734016088.639958:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7661 00000100:00100000:1.0:1734016088.639968:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333268096:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016088.640234:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333268096:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 267us (1801us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016088.640244:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7661 00002000:00100000:1.0:1734016088.640250:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5320704->5324799) req@ffff88012e257480 x1818247333268096/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:49/0 lens 488/4536 e 0 to 0 dl 1734016099 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016088.640258:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e257480 with x1818247333268096 ext(5320704->5324799) 00002000:00010000:1.0:1734016088.640261:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e257480 00000100:00100000:0.0:1734016088.648346:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.654354:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.669948:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.670208:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333268736 00000100:00100000:1.0:1734016088.670222:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333268736 00000100:00100000:1.0:1734016088.670311:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1912 00000100:00100000:1.0:1734016088.670322:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+21:9668:x1818247333268736:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016088.670380:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016088.670423:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc2711351d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e408c expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.670580:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27113524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016088.670603:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27113524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016088.670618:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27113524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:1.0:1734016088.670658:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 5994803 00000004:00200000:1.0:1734016088.670664:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016088.670691:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27113524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016088.670716:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc2711351d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e408c expref: 23 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.670752:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27113524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e408c expref: 22 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.670764:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016088.670767:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016088.670774:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016088.670870:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+22:9668:x1818247333268736:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 550us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016088.670877:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1912 00000100:00100000:1.0:1734016088.678925:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.684492:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.691368:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.698138:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.702475:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.712008:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.715209:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1914 00000100:00100000:1.0:1734016088.715231:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+23:9668:x1818247333269632:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016088.715280:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016088.715320:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27113539 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e409a expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.715474:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27113540 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016088.715490:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27113540 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016088.715504:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27113540 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:1.0:1734016088.715534:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 9495242 00000004:00200000:1.0:1734016088.715538:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016088.715559:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27113540 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016088.715582:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27113539 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e409a expref: 25 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.715627:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27113540 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e409a expref: 24 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.715640:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016088.715643:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016088.715647:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016088.715735:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+24:9668:x1818247333269632:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 508us (3756us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016088.715743:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1914 00000100:00100000:0.0:1734016088.724795:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333269760 00000100:00100000:0.0:1734016088.724918:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333269760 00000100:00100000:1.0:1734016088.727922:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9934 00000100:00100000:1.0:1734016088.727937:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333269760:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016088.727975:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016088.728010:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113547 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e40a1 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.728063:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113532 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4093 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.728073:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016088.728076:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016088.728080:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113547 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7372800->7385087] (req 7372800->7385087) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40a1 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.728130:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113532 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4093 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.728146:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113532 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4093 expref: 8 pid: 7683 timeout: 455 lvb_type: 0 00000100:00100000:1.0:1734016088.728166:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335154304:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016088.728300:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:0.0:1734016088.735783:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.736170:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335154304:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016088.736212:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113547 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7372800->7385087] (req 7372800->7385087) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40a1 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.736242:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016088.736314:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:9668:x1818247333269760:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8379us (12171us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016088.736326:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9934 00000100:00100000:0.0:1734016088.742327:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.742733:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333270016 00000100:00100000:1.0:1734016088.742744:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333270016 00000100:00100000:1.0:1734016088.742831:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9935 00000100:00100000:1.0:1734016088.742838:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333270016:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016088.743208:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9495242 -> 9495242 00002000:00010000:1.0:1734016088.743211:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016089 -> 1734016089 00002000:00010000:1.0:1734016088.743214:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016088 -> 1734016088 00002000:00010000:1.0:1734016088.743216:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016089 -> 1734016089 00002000:00010000:1.0:1734016088.743217:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 528 -> 528 00000100:00100000:1.0:1734016088.744210:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333270016:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1363us (1875us total) trans 4294969089 rc 0/0 00000100:00100000:1.0:1734016088.744222:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9935 00000100:00100000:0.0:1734016088.747306:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333270144 00000100:00100000:0.0:1734016088.747324:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333270144 00000100:00100000:0.0:1734016088.747437:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1915 00000100:00100000:0.0:1734016088.747447:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:9668:x1818247333270144:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016088.747494:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016088.747537:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc2711354e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e40a8 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.747706:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27113555 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016088.747728:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27113555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016088.747742:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27113555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:0.0:1734016088.747782:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 9495242 00000004:00200000:0.0:1734016088.747789:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016088.747884:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27113555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016088.747922:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc2711354e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40a8 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.747955:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27113555 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40a8 expref: 22 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.747967:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016088.747971:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016088.747977:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:0.0:1734016088.748050:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:9668:x1818247333270144:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 603us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016088.748059:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1915 00000100:00100000:0.0:1734016088.769435:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.769630:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333270400 00000100:00100000:1.0:1734016088.769652:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333270400 00000100:00100000:1.0:1734016088.769744:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1916 00000100:00100000:1.0:1734016088.769754:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:9668:x1818247333270400:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016088.769906:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016088.769961:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27113555 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40a8 expref: 22 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.769997:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016088.770003:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016088.772157:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d8c0/0x5e3a3adc2711355c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016088.772194:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27113540 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e409a expref: 23 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.772204:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d8c0/0x5e3a3adc2711355c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016088.772266:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27113540 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e409a expref: 23 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.772289:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27113540 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e409a expref: 23 pid: 6478 timeout: 455 lvb_type: 0 00000100:00100000:1.0:1734016088.772311:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335154560:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016088.772406:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016088.778746:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335154560:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016088.778865:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d8c0/0x5e3a3adc2711355c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016088.781972:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.788706:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2612 00000100:00100000:1.0:1734016088.788743:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075887b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+24:1981:x1818247333270528:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016088.792831:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016088.792896:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27113540 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e409a expref: 24 pid: 6478 timeout: 455 lvb_type: 0 00010000:00010000:1.0:1734016088.792928:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27113540 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e409a expref: 24 pid: 6478 timeout: 455 lvb_type: 0 00010000:00010000:1.0:1734016088.792973:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27113540 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e409a expref: 24 pid: 6478 timeout: 455 lvb_type: 0 00010000:00010000:1.0:1734016088.793025:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016088.793034:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d8c0/0x5e3a3adc2711355c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016088.793045:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d8c0/0x5e3a3adc2711355c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016088.793052:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d8c0/0x5e3a3adc2711355c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016088.793102:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016088.793208:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075887b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+23:1981:x1818247333270528:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4474us (11264us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016088.793222:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2612 00010000:00010000:0.0:1734016088.793659:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d8c0/0x5e3a3adc2711355c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016088.793672:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d8c0/0x5e3a3adc2711355c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:0.0:1734016088.793905:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968540 00000004:00010000:0.0:1734016088.793996:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075884000 reply state ffff88007bf5c000 transno 4294968541 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d8c0/0x5e3a3adc2711355c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016088.794008:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016088.794163:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:9668:x1818247333270400:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 24409us (24753us total) trans 4294968541 rc 0/0 00000100:00100000:0.0:1734016088.794171:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1916 00000020:00080000:0.0:1734016088.794179:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016088.800009:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.800066:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333270656 00000100:00100000:0.0:1734016088.800079:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333270656 00002000:00010000:0.0:1734016088.800140:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6445651->18446744073709551615) 00002000:00100000:0.0:1734016088.800146:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075608380 with x1818247333270656 ext(6445651->18446744073709551615) 00002000:00010000:0.0:1734016088.800161:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075608380. 00000100:00100000:0.0:1734016088.800204:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7665 00000100:00100000:0.0:1734016088.800213:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333270656:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016088.800618:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9495242 -> 6445651 00002000:00010000:0.0:1734016088.800624:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016089 -> 1734016089 00002000:00010000:0.0:1734016088.800626:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016088 -> 1734016088 00002000:00010000:0.0:1734016088.800628:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016089 -> 1734016089 00002000:00010000:0.0:1734016088.800630:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 528 -> 528 00000100:00100000:0.0:1734016088.800711:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333270656:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 497us (710us total) trans 4294969090 rc 0/0 00000100:00100000:0.0:1734016088.800722:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7665 00002000:00010000:0.0:1734016088.800725:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6445651->18446744073709551615) 00002000:00100000:0.0:1734016088.800727:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075608380 with x1818247333270656 ext(6445651->18446744073709551615) 00002000:00010000:0.0:1734016088.800730:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075608380. 00000100:00100000:1.0:1734016088.808697:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.808843:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333270784 00000100:00100000:0.0:1734016088.808856:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333270784 00000100:00100000:0.0:1734016088.822602:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.825016:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333270912 00000100:00100000:1.0:1734016088.825051:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333270912 00000100:00100000:1.0:1734016088.825168:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9936 00000100:00100000:1.0:1734016088.825179:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333270912:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016088.825223:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016088.825259:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27113571 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e40b6 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.825312:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113547 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7372800->7385087) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40a1 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.825323:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016088.825326:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016088.825329:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27113571 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5951488->5959679] (req 5951488->5959679) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40b6 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.825387:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113547 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7372800->7385087) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40a1 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.825402:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113547 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7372800->7385087) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40a1 expref: 9 pid: 7683 timeout: 455 lvb_type: 0 00000100:00100000:1.0:1734016088.825423:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335154688:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016088.825547:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016088.829203:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.829466:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335154688:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016088.829761:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27113571 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5951488->5959679] (req 5951488->5959679) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40b6 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.829787:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016088.829789:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016088.829849:0:7683:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27113571 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5951488->5959679) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40b6 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.829859:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27113571 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5951488->5959679) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40b6 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.829903:0:7683:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27113571 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5951488->5959679) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40b6 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016088.829917:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335154816:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016088.830037:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016088.832512:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335154816:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016088.832556:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016088.832639:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:9668:x1818247333270912:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7459us (10057us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016088.832653:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9936 00000100:00100000:1.0:1734016088.836061:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333271168 00000100:00100000:1.0:1734016088.836073:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333271168 00000100:00100000:1.0:1734016088.836129:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9937 00000100:00100000:1.0:1734016088.836138:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333271168:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016088.836430:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 6445651 -> 6445651 00002000:00010000:1.0:1734016088.836435:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016089 -> 1734016089 00002000:00010000:1.0:1734016088.836437:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016088 -> 1734016088 00002000:00010000:1.0:1734016088.836440:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016089 -> 1734016089 00002000:00010000:1.0:1734016088.836442:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 528 -> 528 00000100:00100000:1.0:1734016088.836527:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333271168:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 390us (668us total) trans 4294969091 rc 0/0 00000100:00100000:1.0:1734016088.836535:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9937 00000100:00100000:0.0:1734016088.838551:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.839183:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333271296 00000100:00100000:1.0:1734016088.839196:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333271296 00000100:00100000:1.0:1734016088.839474:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1918 00000100:00100000:1.0:1734016088.839486:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+23:9668:x1818247333271296:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016088.839519:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016088.839547:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d680/0x5e3a3adc27113578 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e40bd expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.839676:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711357f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016088.839693:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711357f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016088.839706:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711357f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:1.0:1734016088.839737:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 6445651 00000004:00200000:1.0:1734016088.839743:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016088.839769:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711357f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016088.839829:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d680/0x5e3a3adc27113578 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40bd expref: 25 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.839850:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711357f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40bd expref: 24 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.839859:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016088.839862:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016088.839865:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016088.839944:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+24:9668:x1818247333271296:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 459us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016088.839951:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1918 00000100:00100000:0.0:1734016088.847107:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.859417:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.869827:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.892576:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333271808 00000100:00100000:1.0:1734016088.892610:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333271808 00000100:00100000:1.0:1734016088.892746:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9940 00000100:00100000:1.0:1734016088.892763:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333271808:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016088.892891:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016088.892934:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc2711358d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e40cb expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016088.893076:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335155200:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016088.893207:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016088.906712:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335155200:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016088.906779:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc2711358d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40cb expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016088.906824:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc2711358d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40cb expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016088.906860:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f180, rc 0) 00000100:00100000:1.0:1734016088.906966:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333271808:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 14204us (19306us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016088.906978:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9940 00000100:00100000:0.0:1734016088.909781:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.909875:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333271936 00000100:00100000:1.0:1734016088.909889:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333271936 00000100:00100000:1.0:1734016088.909970:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9941 00000100:00100000:1.0:1734016088.909983:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:9668:x1818247333271936:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016088.910019:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016088.910050:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27113594 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e40d2 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.910103:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27113586 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1007615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40c4 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.910114:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016088.910119:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016088.910123:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27113594 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3432448->3436543] (req 3432448->3436543) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40d2 expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.910166:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27113586 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1007615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40c4 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.910181:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27113586 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1007615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40c4 expref: 10 pid: 7682 timeout: 456 lvb_type: 0 00000100:00100000:1.0:1734016088.910196:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335155328:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016088.910281:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016088.914350:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.914612:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335155328:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016088.915014:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27113594 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3432448->3436543] (req 3432448->3436543) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40d2 expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.915051:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016088.915785:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:9668:x1818247333271936:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5802us (6021us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016088.915795:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9941 00000100:00100000:0.0:1734016088.918347:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.918380:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333272320 00000100:00100000:0.0:1734016088.918389:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333272320 00002000:00100000:0.0:1734016088.918452:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3432448->3436543) req@ffff88007560ad80 x1818247333272320/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:49/0 lens 488/0 e 0 to 0 dl 1734016099 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016088.918465:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560ad80 with x1818247333272320 ext(3432448->3436543) 00002000:00010000:0.0:1734016088.918471:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560ad80 00000100:00100000:0.0:1734016088.919857:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7666 00000100:00100000:0.0:1734016088.919870:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333272320:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016088.920231:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333272320:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 361us (1883us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016088.920241:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7666 00002000:00100000:0.0:1734016088.920250:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3432448->3436543) req@ffff88007560ad80 x1818247333272320/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:49/0 lens 488/4536 e 0 to 0 dl 1734016099 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016088.920259:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560ad80 with x1818247333272320 ext(3432448->3436543) 00002000:00010000:0.0:1734016088.920264:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560ad80 00000100:00100000:0.0:1734016088.930282:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.931230:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333272448 00000100:00100000:1.0:1734016088.931249:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333272448 00000100:00100000:1.0:1734016088.931343:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9942 00000100:00100000:1.0:1734016088.931356:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333272448:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016088.931388:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016088.931425:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc2711359b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e40d9 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016088.931464:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016088.931466:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016088.931478:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc2711359b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40d9 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016088.931499:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc2711359b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40d9 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016088.931513:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016088.931585:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333272448:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 232us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016088.931598:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9942 00000100:00100000:0.0:1734016088.936236:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.946207:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.946779:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.952236:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016088.956298:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016088.960983:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333273088 00000100:00100000:1.0:1734016088.961012:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333273088 00000100:00100000:1.0:1734016088.961111:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9945 00000100:00100000:1.0:1734016088.961121:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333273088:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016088.961567:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 6445651 -> 6445651 00002000:00010000:1.0:1734016088.961572:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016089 -> 1734016089 00002000:00010000:1.0:1734016088.961575:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016088 -> 1734016088 00002000:00010000:1.0:1734016088.961578:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016089 -> 1734016089 00002000:00010000:1.0:1734016088.961582:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 528 -> 528 00000100:00100000:1.0:1734016088.961723:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333273088:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 602us (5437us total) trans 4294969094 rc 0/0 00000100:00100000:1.0:1734016088.961732:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9945 00000100:00100000:0.0:1734016088.971155:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333273344 00000100:00100000:0.0:1734016088.971174:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333273344 00000100:00100000:0.0:1734016088.971265:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1919 00000100:00100000:0.0:1734016088.971274:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+24:9668:x1818247333273344:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016088.971380:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016088.971447:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711357f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40bd expref: 24 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.971493:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016088.971500:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016088.971772:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc271135a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016088.971794:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711356a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40af expref: 23 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.971839:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc271135a9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016088.971883:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711356a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40af expref: 23 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016088.971896:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711356a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40af expref: 23 pid: 6479 timeout: 456 lvb_type: 0 00000100:00100000:0.0:1734016088.971909:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758af100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335155968:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016088.971992:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016088.981480:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016088.988485:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc271135a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016088.988507:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc271135a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016088.988516:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc271135a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016088.988523:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7580480 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016088.988528:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc271135a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016088.988536:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc271135a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016088.988560:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016088.988563:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016088.988568:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc271135a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016088.988573:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc271135a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016089.006990:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.029681:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016089.030838:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016059 00000100:00100000:1.0:1734016089.031536:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2619 00000100:00100000:1.0:1734016089.031549:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333274112:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016089.031570:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016089.031600:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271135a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 253952->299007) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40e0 expref: 13 pid: 7682 timeout: 456 lvb_type: 0 00010000:00010000:1.0:1734016089.031615:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271135a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 253952->299007) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40e0 expref: 13 pid: 7682 timeout: 456 lvb_type: 0 00010000:00010000:1.0:1734016089.031649:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271135a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 253952->299007) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40e0 expref: 13 pid: 7682 timeout: 456 lvb_type: 0 00010000:00010000:1.0:1734016089.031700:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016089.031703:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016089.031709:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271135be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8052736->8069119] (req 8052736->8069119) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.031721:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271135be lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8052736->8069119] (req 8052736->8069119) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.031766:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016089.031861:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333274112:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 313us (2192us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016089.031868:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2619 00000001:00080000:0.0:1734016089.043501:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969096 is committed 00000001:00080000:0.0:1734016089.043529:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969095 is committed 00000100:00100000:0.0:1734016089.049064:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:1.0:1734016089.051135:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016059 00000100:00100000:0.0:1734016089.065383:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.071062:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.079931:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.084398:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016089.084535:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333274880 00000100:00100000:1.0:1734016089.084555:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333274880 00000100:00100000:1.0:1734016089.084651:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9949 00000100:00100000:1.0:1734016089.084666:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333274880:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016089.084704:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016089.084737:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271135e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4103 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016089.084889:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335156480:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016089.085011:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016089.101625:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335156480:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016089.101660:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271135e1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4103 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016089.101680:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271135e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4103 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016089.101707:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016089.101764:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333274880:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 17102us (17393us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016089.101776:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9949 00000100:00100000:0.0:1734016089.103927:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016089.104045:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333275008 00000100:00100000:1.0:1734016089.104060:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333275008 00000100:00100000:1.0:1734016089.104140:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9950 00000100:00100000:1.0:1734016089.104150:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333275008:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016089.104181:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016089.104217:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271135e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e410a expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016089.104309:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335156608:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016089.104415:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016089.106265:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335156608:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016089.106311:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271135e8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e410a expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016089.106325:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271135e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e410a expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016089.106357:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016089.106420:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333275008:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2272us (2510us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016089.106429:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9950 00000100:00100000:1.0:1734016089.108931:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333275136 00000100:00100000:1.0:1734016089.108943:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333275136 00000100:00100000:1.0:1734016089.108994:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9951 00000100:00100000:1.0:1734016089.109002:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333275136:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016089.109026:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016089.109047:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271135ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4111 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016089.109114:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335156736:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016089.109177:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016089.112413:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335156736:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016089.112465:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271135ef lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4111 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016089.112485:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271135ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4111 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016089.112500:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016089.112569:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333275136:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3566us (3741us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016089.112585:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9951 00000100:00100000:0.0:1734016089.114371:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016089.114715:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333275264 00000100:00100000:1.0:1734016089.114731:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333275264 00000100:00100000:1.0:1734016089.114844:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9952 00000100:00100000:1.0:1734016089.114854:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333275264:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016089.114890:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016089.114937:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc271135f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4118 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016089.115016:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335156864:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016089.115086:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016089.123610:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335156864:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016089.123682:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc271135f6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4118 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016089.123706:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc271135f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4118 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016089.123745:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016089.124440:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333275264:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9584us (10084us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016089.124453:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9952 00000100:00100000:0.0:1734016089.130762:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016089.131485:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333275392 00000100:00100000:1.0:1734016089.131503:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333275392 00000100:00100000:1.0:1734016089.134121:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9953 00000100:00100000:1.0:1734016089.134158:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333275392:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016089.134214:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016089.134257:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc271135fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e411f expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016089.134398:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335156992:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016089.134588:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016089.138023:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335156992:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016089.138078:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc271135fd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e411f expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016089.138097:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc271135fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e411f expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016089.138119:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016089.138203:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333275392:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4055us (7456us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016089.138214:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9953 00000100:00100000:1.0:1734016089.145208:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333275520 00000100:00100000:1.0:1734016089.145222:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333275520 00000100:00100000:1.0:1734016089.145299:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9954 00000100:00100000:1.0:1734016089.145308:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333275520:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016089.145334:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016089.145365:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27113604 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4126 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.145422:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc271135da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7409664->7475199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40fc expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.145432:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016089.145434:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016089.145439:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27113604 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1875968->1880063] (req 1875968->1880063) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4126 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.145480:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc271135da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7409664->7475199) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40fc expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.145490:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc271135da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7409664->7475199) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40fc expref: 6 pid: 7682 timeout: 456 lvb_type: 0 00000100:00100000:1.0:1734016089.145503:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335157120:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016089.145583:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016089.151841:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335157120:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016089.151899:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27113604 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1875968->1880063] (req 1875968->1880063) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4126 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.151928:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016089.152020:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333275520:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6712us (7073us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016089.152035:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9954 00000100:00100000:0.0:1734016089.153904:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016089.157016:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2621 00000100:00100000:1.0:1734016089.157033:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333275648:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016089.157064:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016089.157094:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc271135da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7409664->7475199) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40fc expref: 7 pid: 7682 timeout: 456 lvb_type: 0 00010000:00010000:1.0:1734016089.157113:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc271135da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7409664->7475199) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40fc expref: 7 pid: 7682 timeout: 456 lvb_type: 0 00010000:00010000:1.0:1734016089.157144:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc271135da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7409664->7475199) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40fc expref: 7 pid: 7682 timeout: 456 lvb_type: 0 00010000:00010000:1.0:1734016089.157184:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016089.157186:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016089.157194:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27113604 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->1880063) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4126 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.157203:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27113604 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->1880063) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4126 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.157248:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27113604 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->1880063) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4126 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016089.157261:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335157248:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016089.157360:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016089.164486:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016089.169732:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335157248:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016089.169789:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016089.170014:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333275648:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 12982us (16124us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016089.170034:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2621 00000100:00100000:0.0:1734016089.187914:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.192064:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.207315:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.227718:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.242310:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333276800:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 6704us (14583us total) trans 4294969098 rc 0/0 00000100:00100000:0.0:1734016089.242338:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7673 00002000:00100000:0.0:1734016089.242363:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1835008->1880063) req@ffff8800756ed880 x1818247333276800/t4294969098(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:50/0 lens 488/448 e 0 to 0 dl 1734016100 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016089.242376:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ed880 with x1818247333276800 ext(1835008->1880063) 00002000:00010000:0.0:1734016089.242382:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ed880 00000100:00100000:0.0:1734016089.246497:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.257698:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016089.261341:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333277056 00000100:00100000:1.0:1734016089.261358:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333277056 00000100:00100000:1.0:1734016089.261453:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9955 00000100:00100000:1.0:1734016089.261462:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333277056:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016089.275078:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969098 is committed 00000001:00080000:0.0:1734016089.275101:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969097 is committed 00000100:00100000:1.0:1734016089.275322:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333277056:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 13852us (17628us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016089.275337:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9955 00000100:00100000:0.0:1734016089.277693:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016089.277796:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333277184 00000100:00100000:1.0:1734016089.277847:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333277184 00000100:00100000:1.0:1734016089.277898:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9956 00000100:00100000:1.0:1734016089.277907:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333277184:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016089.277927:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016089.277951:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711360b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e412d expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016089.278021:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335157376:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016089.278088:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00002000:00010000:1.0:1734016089.280626:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016088 -> 1734016089 00002000:00010000:1.0:1734016089.280642:0:7683:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 560 -> 648 00000100:00100000:1.0:1734016089.280673:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335157376:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016089.280725:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711360b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e412d expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016089.280750:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711360b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e412d expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016089.280767:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016089.284732:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333277184:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6787us (7011us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016089.284759:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9956 00000100:00100000:0.0:1734016089.294341:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016089.294481:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333277312 00000100:00100000:1.0:1734016089.294494:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333277312 00000100:00100000:1.0:1734016089.294612:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9957 00000100:00100000:1.0:1734016089.294622:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333277312:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016089.294655:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016089.294687:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27113612 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4134 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016089.294754:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335157504:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016089.295228:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016089.296764:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335157504:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016089.296830:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27113612 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4134 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016089.296844:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27113612 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4134 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016089.296939:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016089.297141:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333277312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2517us (2810us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016089.297151:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9957 00000100:00100000:0.0:1734016089.299782:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016089.301211:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333277440 00000100:00100000:1.0:1734016089.301235:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333277440 00000100:00100000:1.0:1734016089.301418:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9958 00000100:00100000:1.0:1734016089.301429:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333277440:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016089.301461:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016089.301494:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27113619 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e413b expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.301541:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27113604 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->1880063) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4126 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.301551:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016089.301554:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016089.301557:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27113619 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1585152->1654783] (req 1585152->1654783) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e413b expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.301603:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27113604 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->1880063) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4126 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.301617:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27113604 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->1880063) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4126 expref: 6 pid: 7683 timeout: 456 lvb_type: 0 00000100:00100000:1.0:1734016089.301638:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335157632:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016089.301987:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016089.311367:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016089.312310:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335157632:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016089.312349:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27113619 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1585152->1654783] (req 1585152->1654783) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e413b expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.312371:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016089.312444:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333277440:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11015us (12676us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016089.312454:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9958 00000100:00100000:0.0:1734016089.328791:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016089.328895:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333277696 00000100:00100000:1.0:1734016089.328904:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333277696 00000100:00100000:1.0:1734016089.328953:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9959 00000100:00100000:1.0:1734016089.328960:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333277696:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016089.329351:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8069120 -> 8069120 00002000:00010000:1.0:1734016089.329354:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016089 -> 1734016089 00002000:00010000:1.0:1734016089.329356:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016089 -> 1734016088 00002000:00010000:1.0:1734016089.329358:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016089 -> 1734016089 00002000:00010000:1.0:1734016089.329360:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 648 -> 648 00000100:00100000:1.0:1734016089.329431:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333277696:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 470us (643us total) trans 4294969099 rc 0/0 00000100:00100000:1.0:1734016089.329437:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9959 00000100:00100000:0.0:1734016089.333654:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.345361:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.352389:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.355919:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.358927:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.364006:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.367968:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.372552:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.375915:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.381785:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.385195:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.389192:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.393539:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.400036:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.404878:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.410068:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.414878:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.421360:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.427616:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016089.427968:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333281792 00000100:00100000:1.0:1734016089.427980:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333281792 00000100:00100000:1.0:1734016089.428047:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9964 00000100:00100000:1.0:1734016089.428056:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333281792:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016089.428082:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016089.428109:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27113643 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e415e expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.428137:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016089.428140:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016089.428152:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27113643 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e415e expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016089.428173:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27113643 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e415e expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016089.428186:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016089.428246:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333281792:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 190us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016089.428254:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9964 00000100:00100000:0.0:1734016089.430727:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.451998:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.459715:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.566597:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016089.581256:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27113651 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5754880->5816319] (req 5754880->5816319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016089.581273:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27113651 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5754880->5816319] (req 5754880->5816319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016089.581285:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27113651 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5754880->5816319] (req 5754880->5816319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016089.581291:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcfc0 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016089.581294:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27113651 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5754880->5816319] (req 5754880->5816319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016089.581300:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27113651 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5754880->5816319] (req 5754880->5816319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016089.581317:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27113651 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5754880->5816319] (req 5754880->5816319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016089.581321:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27113651 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5754880->5816319] (req 5754880->5816319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016089.581454:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333282816:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 14235us (14863us total) trans 0 rc 61440/61440 00000100:00100000:0.0:1734016089.581466:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7690 00000100:00100000:0.0:1734016089.585287:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.601099:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.623037:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.676224:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.676288:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016089.678653:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7692 00000100:00100000:1.0:1734016089.678664:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333283712:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016089.792312:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333283712:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 113639us (116013us total) trans 0 rc 3874816/3874816 00000100:00100000:1.0:1734016089.792325:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7692 00002000:00100000:1.0:1734016089.792334:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8069119) req@ffff880073bbc700 x1818247333283712/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:50/0 lens 504/440 e 0 to 0 dl 1734016100 ref 1 fl Complete:/200/0 rc 3874816/3874816 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016089.792348:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbc700 with x1818247333283712 ext(4190208->8069119) 00002000:00010000:1.0:1734016089.792354:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbc700 00000100:00100000:0.0:1734016089.805556:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016089.805779:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333283840 00000100:00100000:1.0:1734016089.805788:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333283840 00002000:00100000:1.0:1734016089.805869:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7323648->7335935) req@ffff880073bbe300 x1818247333283840/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:50/0 lens 12776/0 e 0 to 0 dl 1734016100 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016089.805879:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbe300 with x1818247333283840 ext(7323648->7335935) 00002000:00010000:1.0:1734016089.805884:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbe300 00000100:00100000:1.0:1734016089.805920:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7693 00000100:00100000:1.0:1734016089.805926:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333283840:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016089.811917:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333283840:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 5979us (6359us total) trans 4294969100 rc 0/0 00000100:00100000:1.0:1734016089.811930:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7693 00002000:00100000:1.0:1734016089.811943:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7323648->7335935) req@ffff880073bbe300 x1818247333283840/t4294969100(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:50/0 lens 12776/448 e 0 to 0 dl 1734016100 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016089.811953:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbe300 with x1818247333283840 ext(7323648->7335935) 00002000:00010000:1.0:1734016089.811960:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbe300 00000100:00100000:0.0:1734016089.817226:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016089.821383:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333283968 00000100:00100000:1.0:1734016089.821406:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333283968 00000100:00100000:1.0:1734016089.821478:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1923 00000100:00100000:1.0:1734016089.821485:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:9668:x1818247333283968:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:1.0:1734016089.821634:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:9668:x1818247333283968:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 148us (4418us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016089.821643:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1923 00000100:00100000:0.0:1734016089.830212:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016089.848303:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969100 is committed 00000100:00100000:0.0:1734016089.859689:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.867097:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.886713:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.896219:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.918304:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.958230:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016089.965404:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016089.965557:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333285120 00000100:00100000:1.0:1734016089.965568:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333285120 00000100:00100000:1.0:1734016089.965640:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7694 00000100:00100000:1.0:1734016089.965646:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333285120:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:1.0:1734016089.965682:0:13914:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711367b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.965697:0:13914:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113666 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->3497983) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4173 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.965704:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016089.965706:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016089.965708:0:13914:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711367b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2486272->2535423] (req 2486272->2535423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.965737:0:13914:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113666 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->3497983) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4173 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.965747:0:13914:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113666 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->3497983) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4173 expref: 8 pid: 7682 timeout: 457 lvb_type: 0 00000100:00100000:1.0:1734016089.965764:0:13914:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335159424:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016089.968203:0:13914:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016089.970478:0:13914:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335159424:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016089.970508:0:13914:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711367b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2486272->2535423] (req 2486272->2535423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016089.970691:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016089.971324:0:13914:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711367b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2486272->2535423] (req 2486272->2535423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.971331:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711367b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2486272->2535423] (req 2486272->2535423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.980478:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711367b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2486272->2535423] (req 2486272->2535423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.980492:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711367b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2486272->2535423] (req 2486272->2535423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.980499:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711367b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2486272->2535423] (req 2486272->2535423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.980505:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499cb40 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016089.980509:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711367b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2486272->2535423] (req 2486272->2535423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.980517:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711367b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2486272->2535423] (req 2486272->2535423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.980530:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711367b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2486272->2535423] (req 2486272->2535423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016089.980535:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711367b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2486272->2535423] (req 2486272->2535423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016089.980633:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333285120:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 14982us (15246us total) trans 0 rc 49152/49152 00000100:00100000:1.0:1734016089.980642:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7694 00000100:00100000:0.0:1734016089.997450:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333285376 00000100:00100000:0.0:1734016089.997459:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333285376 00000100:00100000:0.0:1734016089.997510:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9972 00000100:00100000:0.0:1734016089.997518:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333285376:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016089.997539:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016089.997557:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27113682 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4188 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016089.997584:0:7682:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 8069120, mtime: 0x675afc5a, atime: 0x675afc58, ctime: 0x675afc59, blocks: 0x2e0 00010000:00010000:0.0:1734016089.997604:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016089.997606:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016089.997613:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27113682 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4188 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016089.997627:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27113682 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4188 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016089.997637:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:0.0:1734016089.997711:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333285376:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 192us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016089.997717:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9972 00000100:00100000:0.0:1734016090.005590:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:1.0:1734016090.006427:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016060 00000100:00100000:1.0:1734016090.010346:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016090.010399:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333285760 00000100:00100000:1.0:1734016090.010409:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333285760 00010000:00010000:1.0:1734016090.010450:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271135cc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40ee expref: 24 pid: 6479 timeout: 457 lvb_type: 0 00000100:00100000:1.0:1734016090.010478:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2628 00000100:00100000:1.0:1734016090.010484:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:1982:x1818247333285760:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016090.010498:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016090.010505:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271135cc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40ee expref: 24 pid: 6479 timeout: 457 lvb_type: 0 00010000:00010000:1.0:1734016090.010515:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271135cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e40ee expref: 24 pid: 6479 timeout: 457 lvb_type: 0 00010000:00010000:1.0:1734016090.010534:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016090.010539:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27113689 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016090.010546:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27113689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016090.010552:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27113689 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016090.010570:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016090.010609:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:1982:x1818247333285760:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 125us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016090.010615:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2628 00000100:00100000:0.0:1734016090.015945:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.017363:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9973 00000100:00100000:0.0:1734016090.017372:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333285888:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016090.017400:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016090.017418:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27113690 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e418f expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016090.017461:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27113682 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4188 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016090.017468:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016090.017469:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016090.017472:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27113690 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e418f expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016090.017506:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27113682 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4188 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016090.017517:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27113682 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4188 expref: 9 pid: 7682 timeout: 457 lvb_type: 1 00000100:00100000:0.0:1734016090.017532:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335159680:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016090.017609:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016090.020191:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016090.020294:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333286016 00000100:00100000:1.0:1734016090.020305:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333286016 00010000:00010000:1.0:1734016090.020347:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27113682 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4188 expref: 10 pid: 7682 timeout: 457 lvb_type: 1 00000100:00100000:1.0:1734016090.020379:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2629 00000100:00100000:1.0:1734016090.020386:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333286016:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016090.020413:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016090.020440:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27113682 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4188 expref: 10 pid: 7682 timeout: 457 lvb_type: 1 00010000:00010000:1.0:1734016090.020454:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27113682 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4188 expref: 10 pid: 7682 timeout: 457 lvb_type: 1 00010000:00010000:1.0:1734016090.020479:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016090.020481:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016090.020487:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27113690 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e418f expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016090.020495:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27113690 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e418f expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016090.020533:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27113690 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e418f expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016090.020550:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335159808:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016090.020612:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016090.022035:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335159808:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016090.022050:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016090.022329:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333286016:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1941us (2145us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016090.022337:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2629 00000100:00100000:0.0:1734016090.029961:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016090.030056:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333286144 00000100:00100000:1.0:1734016090.030065:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333286144 00002000:00010000:1.0:1734016090.030102:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (9619075->18446744073709551615) 00002000:00100000:1.0:1734016090.030106:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345f480 with x1818247333286144 ext(9619075->18446744073709551615) 00002000:00010000:1.0:1734016090.030119:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345f480. 00000100:00100000:1.0:1734016090.030148:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7695 00000100:00100000:1.0:1734016090.030154:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333286144:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016090.030347:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8069120 -> 9619075 00002000:00010000:1.0:1734016090.030350:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016090 -> 1734016090 00002000:00010000:1.0:1734016090.030352:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016088 -> 1734016088 00002000:00010000:1.0:1734016090.030354:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016089 -> 1734016090 00002000:00010000:1.0:1734016090.030355:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 736 -> 736 00000100:00100000:1.0:1734016090.030404:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333286144:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 249us (450us total) trans 4294969102 rc 0/0 00000100:00100000:1.0:1734016090.030410:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7695 00002000:00010000:1.0:1734016090.030412:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (9619075->18446744073709551615) 00002000:00100000:1.0:1734016090.030415:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345f480 with x1818247333286144 ext(9619075->18446744073709551615) 00002000:00010000:1.0:1734016090.030418:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345f480. 00000100:00100000:0.0:1734016090.053288:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.053730:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.054300:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7696 00000100:00100000:0.0:1734016090.054309:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333286400:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016090.058610:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.188616:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.195225:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333287040:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 5758us (6610us total) trans 4294969103 rc 0/0 00000100:00100000:0.0:1734016090.195238:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7699 00002000:00100000:0.0:1734016090.195248:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (9572352->9619074) req@ffff880075447b80 x1818247333287040/t4294969103(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:51/0 lens 488/448 e 0 to 0 dl 1734016101 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016090.195257:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075447b80 with x1818247333287040 ext(9572352->9619074) 00002000:00010000:0.0:1734016090.195263:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075447b80 00000100:00100000:0.0:1734016090.201358:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.208910:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:1.0:1734016090.214014:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969103 is committed 00000100:00100000:0.0:1734016090.221394:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.240985:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.258946:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016090.259019:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333287808 00000100:00100000:1.0:1734016090.259031:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333287808 00010000:00010000:1.0:1734016090.259075:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711369e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4196 expref: 28 pid: 6479 timeout: 457 lvb_type: 0 00000100:00100000:1.0:1734016090.259130:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2630 00000100:00100000:1.0:1734016090.259136:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5226c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+28:1981:x1818247333287808:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016090.259152:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016090.259160:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711369e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4196 expref: 28 pid: 6479 timeout: 457 lvb_type: 0 00010000:00010000:1.0:1734016090.259172:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711369e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4196 expref: 28 pid: 6479 timeout: 457 lvb_type: 0 00010000:00010000:1.0:1734016090.259194:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711369e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4196 expref: 28 pid: 6479 timeout: 457 lvb_type: 0 00010000:00010000:1.0:1734016090.259229:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016090.259233:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271136a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016090.259242:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271136a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016090.259249:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271136a5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016090.259289:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016090.259340:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5226c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+27:1981:x1818247333287808:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 204us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016090.259347:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2630 00010000:00010000:0.0:1734016090.265469:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271136a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016090.265482:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271136a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016090.265488:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271136a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016090.265495:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd440 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016090.265500:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271136a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016090.265506:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271136a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016090.265523:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016090.265525:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016090.265529:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271136a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016090.265533:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271136a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00080000:1.0:1734016090.266796:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016060 00000100:00100000:0.0:1734016090.290886:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.324280:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.335059:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.357098:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.369987:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.392542:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016090.403641:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.407832:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.420689:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016090.421172:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333289600 00000100:00100000:1.0:1734016090.421184:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333289600 00000100:00100000:1.0:1734016090.421246:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1930 00000100:00100000:1.0:1734016090.421255:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+28:9668:x1818247333289600:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016090.421319:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016090.421352:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc271136ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e41a4 expref: 28 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016090.421390:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016090.421395:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016090.421594:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271136f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016090.421611:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc271136e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e41c0 expref: 25 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016090.421618:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271136f2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016090.421663:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc271136e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e41c0 expref: 25 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016090.421676:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc271136e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e41c0 expref: 25 pid: 6479 timeout: 457 lvb_type: 0 00000100:00100000:1.0:1734016090.421692:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335160832:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016090.421779:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016090.425315:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335160832:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016090.425346:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271136f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016090.425402:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016090.426399:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271136f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016090.426406:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271136f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:1.0:1734016090.426538:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968548 00000004:00010000:1.0:1734016090.426599:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075444380 reply state ffff88007bf5a000 transno 4294968549 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271136f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:1.0:1734016090.426608:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016090.426714:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+30:9668:x1818247333289600:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 5459us (6040us total) trans 4294968549 rc 0/0 00000100:00100000:1.0:1734016090.426722:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1930 00000020:00080000:1.0:1734016090.426725:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1734016090.431523:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.435512:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335160960:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016090.435553:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271136f9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e41ce expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016090.435573:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:0.0:1734016090.435638:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333289856:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3908us (4118us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016090.435646:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9980 00000100:00100000:0.0:1734016090.436318:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016090.436485:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333289984 00000100:00100000:1.0:1734016090.436493:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333289984 00010000:00010000:1.0:1734016090.436522:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271136eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e41c7 expref: 7 pid: 7682 timeout: 457 lvb_type: 1 00000100:00100000:1.0:1734016090.436560:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2634 00000100:00100000:1.0:1734016090.436566:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333289984:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016090.436579:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016090.436601:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271136eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e41c7 expref: 7 pid: 7682 timeout: 457 lvb_type: 1 00010000:00010000:1.0:1734016090.436612:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271136eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e41c7 expref: 7 pid: 7682 timeout: 457 lvb_type: 1 00010000:00010000:1.0:1734016090.436635:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271136eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e41c7 expref: 7 pid: 7682 timeout: 457 lvb_type: 1 00010000:00010000:1.0:1734016090.436660:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016090.436661:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016090.436667:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271136f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e41ce expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016090.436676:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271136f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e41ce expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016090.436712:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271136f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e41ce expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016090.436724:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335161088:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016090.436787:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016090.440001:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335161088:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016090.440030:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016090.440080:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333289984:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3512us (3762us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016090.440091:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2634 00000100:00100000:0.0:1734016090.441764:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.459916:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.459980:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016090.460064:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333290368 00000100:00100000:1.0:1734016090.460075:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333290368 00002000:00100000:1.0:1734016090.460128:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->7188479) req@ffff8800739e0700 x1818247333290368/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:51/0 lens 504/0 e 0 to 0 dl 1734016101 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016090.460138:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800739e0700 with x1818247333290368 ext(0->7188479) 00002000:00010000:1.0:1734016090.460143:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800739e0700 00000100:00100000:1.0:1734016090.460176:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333290624 00000100:00100000:1.0:1734016090.460179:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333290624 00002000:00100000:1.0:1734016090.460190:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (4190208->7184383) req@ffff8800739e0a80 x1818247333290624/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:51/0 lens 488/0 e 0 to 0 dl 1734016101 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016090.460196:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800739e0a80 with x1818247333290624 ext(4190208->7184383) 00002000:00010000:1.0:1734016090.460199:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800739e0a80 00000100:00100000:1.0:1734016090.460215:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7703 00000100:00100000:1.0:1734016090.460222:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333290368:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016090.560795:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.574849:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016090.575033:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333290880 00000100:00100000:1.0:1734016090.575044:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333290880 00000100:00100000:1.0:1734016090.575117:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1931 00000100:00100000:1.0:1734016090.575127:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+29:9668:x1818247333290880:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:1.0:1734016090.575292:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+29:9668:x1818247333290880:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 167us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016090.575299:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1931 00000100:00100000:0.0:1734016090.579249:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016090.581085:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969106 is committed 00000001:00080000:0.0:1734016090.581120:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969104 is committed 00000100:00100000:0.0:1734016090.584692:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.593447:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.606763:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.613497:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335161344:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016090.613545:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27113715 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e41e3 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016090.613562:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27113715 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e41e3 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016090.613824:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:0.0:1734016090.613892:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333291392:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5269us (7143us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016090.613902:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9983 00000100:00100000:0.0:1734016090.620436:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.642338:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016090.644521:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969107 is committed 00000100:00100000:0.0:1734016090.648332:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.663613:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.681645:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.692655:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016090.707453:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.749503:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016090.751238:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333292416 00000100:00100000:1.0:1734016090.751259:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333292416 00010000:00010000:1.0:1734016090.751313:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271136f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e41ce expref: 7 pid: 7683 timeout: 457 lvb_type: 0 00000100:00100000:1.0:1734016090.751386:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2635 00000100:00100000:1.0:1734016090.751395:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333292416:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016090.751420:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016090.751450:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271136f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e41ce expref: 7 pid: 7683 timeout: 457 lvb_type: 0 00010000:00010000:1.0:1734016090.751466:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271136f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e41ce expref: 7 pid: 7683 timeout: 457 lvb_type: 0 00010000:00010000:1.0:1734016090.751494:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271136f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e41ce expref: 7 pid: 7683 timeout: 457 lvb_type: 0 00010000:00010000:1.0:1734016090.751520:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016090.751523:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016090.751530:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711373f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2519039) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4206 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016090.751539:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711373f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2519039) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4206 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016090.751579:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711373f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2519039) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4206 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016090.751595:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335161984:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016090.751682:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016090.761530:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016090.761651:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335161984:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016090.761681:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016090.761735:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333292416:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 10340us (12242us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016090.761747:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2635 00000100:00100000:0.0:1734016090.770590:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.777220:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.788337:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.800705:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.805449:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.830160:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.833927:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.845114:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.869181:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.885137:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.888246:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.893186:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.898462:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.914123:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.946946:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.963590:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.963691:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016090.976286:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.981933:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.988727:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016090.995009:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.004769:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:1.0:1734016091.006132:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016061 00000100:00100000:0.0:1734016091.009330:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:1.0:1734016091.010214:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016061 00000100:00100000:0.0:1734016091.015286:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.021087:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.027003:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.027080:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016091.027134:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333297920 00000100:00100000:1.0:1734016091.027151:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333297920 00000100:00100000:1.0:1734016091.027221:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 142 00000100:00100000:1.0:1734016091.027229:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333297920:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1734016091.027326:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333297920:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 97us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016091.027333:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 142 00000100:00080000:0.0:1734016091.027563:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016061 00000100:00080000:0.0:1734016091.027568:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016061 00000100:00100000:0.0:1734016091.033640:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.065153:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.073591:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.174001:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333298688 00000100:00100000:0.0:1734016091.174011:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333298688 00000100:00100000:0.0:1734016091.174065:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1936 00000100:00100000:0.0:1734016091.174072:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:9668:x1818247333298688:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016091.174098:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016091.174117:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc2711378c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e423e expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016091.174205:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113793 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016091.174219:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016091.174228:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:0.0:1734016091.174248:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 7294520 00000004:00200000:0.0:1734016091.174252:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016091.174267:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016091.174286:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc2711378c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e423e expref: 16 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016091.174314:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e423e expref: 15 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016091.174321:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016091.174324:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016091.174326:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75818c0, rc 0) 00000100:00100000:0.0:1734016091.174401:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+15:9668:x1818247333298688:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 298us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016091.174408:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1936 00000100:00100000:0.0:1734016091.177730:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016091.177827:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333298944 00000100:00100000:1.0:1734016091.177834:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333298944 00000100:00100000:1.0:1734016091.177862:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1937 00000100:00100000:1.0:1734016091.177868:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+15:9668:x1818247333298944:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016091.177908:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016091.177929:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113793 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e423e expref: 15 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.177959:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016091.177962:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016091.178119:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc2711379a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016091.178131:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27113777 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4229 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.178138:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc2711379a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016091.178168:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27113777 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4229 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.178179:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27113777 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4229 expref: 11 pid: 6479 timeout: 458 lvb_type: 0 00000100:00100000:1.0:1734016091.178193:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335163136:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016091.178262:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016091.183220:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016091.183682:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27113777 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4229 expref: 11 pid: 6479 timeout: 458 lvb_type: 0 00000100:00100000:1.0:1734016091.183694:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335163136:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016091.183712:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc2711379a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016091.183720:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc2711379a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016091.183725:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc2711379a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:1.0:1734016091.183828:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968552 00000004:00010000:1.0:1734016091.183867:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012db08700 reply state ffff88007bf5b000 transno 4294968553 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc2711379a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:1.0:1734016091.184450:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016091.184522:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+17:9668:x1818247333298944:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 6653us (6797us total) trans 4294968553 rc 0/0 00000100:00100000:1.0:1734016091.184528:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1937 00000020:00080000:1.0:1734016091.184532:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016091.186552:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016091.194060:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333299328 00000100:00100000:1.0:1734016091.194070:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333299328 00000100:00100000:1.0:1734016091.194122:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1938 00000100:00100000:1.0:1734016091.194129:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:9668:x1818247333299328:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016091.194151:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016091.194173:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271137a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4245 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.194282:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc271137a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016091.194295:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc271137a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016091.194307:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc271137a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:1.0:1734016091.194327:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 9200859 00000004:00200000:1.0:1734016091.194331:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016091.194346:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc271137a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016091.194391:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271137a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4245 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.194409:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc271137a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4245 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.194417:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016091.194420:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016091.194423:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016091.194486:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:9668:x1818247333299328:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 357us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016091.194493:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1938 00000100:00100000:0.0:1734016091.197732:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.215773:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.230940:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.251993:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016091.252085:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333300352 00000100:00100000:1.0:1734016091.252092:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333300352 00000100:00100000:1.0:1734016091.252750:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1940 00000100:00100000:1.0:1734016091.252758:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:9668:x1818247333300352:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016091.252877:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016091.252905:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc271137a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4245 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.252933:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016091.252937:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016091.253098:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f180/0x5e3a3adc271137d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016091.253110:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271137c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e425a expref: 16 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.253116:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f180/0x5e3a3adc271137d9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016091.253151:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271137c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e425a expref: 16 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.253164:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271137c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e425a expref: 16 pid: 6479 timeout: 458 lvb_type: 0 00000100:00100000:1.0:1734016091.253178:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335163776:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016091.253235:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016091.258117:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335163776:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016091.258150:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f180/0x5e3a3adc271137d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016091.259786:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f180/0x5e3a3adc271137d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016091.259794:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f180/0x5e3a3adc271137d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:1.0:1734016091.259916:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968554 00000004:00010000:1.0:1734016091.259960:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075143100 reply state ffff88012d4fd000 transno 4294968555 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f180/0x5e3a3adc271137d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:1.0:1734016091.259966:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016091.260037:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333300352:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 7280us (8049us total) trans 4294968555 rc 0/0 00000100:00100000:1.0:1734016091.260044:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1940 00000020:00080000:1.0:1734016091.260048:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016091.289258:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.307700:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333300864 00000100:00100000:0.0:1734016091.307722:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333300864 00002000:00010000:0.0:1734016091.307773:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6919835->18446744073709551615) 00002000:00100000:0.0:1734016091.307779:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad7800 with x1818247333300864 ext(6919835->18446744073709551615) 00002000:00010000:0.0:1734016091.307795:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad7800. 00000100:00100000:0.0:1734016091.307871:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7725 00000100:00100000:0.0:1734016091.307880:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333300864:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016091.308490:0:14005:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9200859 -> 6919835 00002000:00010000:0.0:1734016091.308493:0:14005:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016091 -> 1734016091 00002000:00010000:0.0:1734016091.308495:0:14005:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016091 -> 1734016088 00002000:00010000:0.0:1734016091.308497:0:14005:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016091 -> 1734016091 00002000:00010000:0.0:1734016091.308499:0:14005:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 832 -> 736 00000100:00100000:0.0:1734016091.308570:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333300864:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 691us (4036us total) trans 4294969112 rc 0/0 00000100:00100000:0.0:1734016091.308577:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7725 00002000:00010000:0.0:1734016091.308579:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6919835->18446744073709551615) 00002000:00100000:0.0:1734016091.308582:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad7800 with x1818247333300864 ext(6919835->18446744073709551615) 00002000:00010000:0.0:1734016091.308585:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad7800. 00000100:00100000:1.0:1734016091.314773:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.316647:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00002000:00010000:0.0:1734016091.321947:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016088 -> 1734016091 00000100:00100000:0.0:1734016091.321977:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335164160:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016091.322012:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271137f5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e427d expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016091.322027:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271137f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e427d expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016091.322051:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:0.0:1734016091.322101:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333301120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5336us (5457us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016091.322110:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10002 00000100:00100000:0.0:1734016091.335327:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016091.369281:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969113 is committed 00000001:00080000:0.0:1734016091.369307:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969112 is committed 00000100:00100000:0.0:1734016091.371888:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016091.389926:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.434489:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.453988:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.460528:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016091.470583:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.470649:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333303552 00000100:00100000:0.0:1734016091.470660:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333303552 00002000:00100000:0.0:1734016091.470707:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6811648->6815743) req@ffff8801369f1f80 x1818247333303552/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:52/0 lens 488/0 e 0 to 0 dl 1734016102 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016091.470719:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1f80 with x1818247333303552 ext(6811648->6815743) 00002000:00010000:0.0:1734016091.470726:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f1f80 00000100:00100000:0.0:1734016091.470901:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7733 00000100:00100000:0.0:1734016091.470910:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333303552:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016091.471090:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333303552:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 180us (513us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016091.471096:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7733 00002000:00100000:0.0:1734016091.471102:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6811648->6815743) req@ffff8801369f1f80 x1818247333303552/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:52/0 lens 488/4536 e 0 to 0 dl 1734016102 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016091.471109:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1f80 with x1818247333303552 ext(6811648->6815743) 00002000:00010000:0.0:1734016091.471112:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f1f80 00000100:00100000:0.0:1734016091.489069:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.494498:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.498382:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333304576 00000100:00100000:0.0:1734016091.498392:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333304576 00002000:00100000:0.0:1734016091.498434:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6795264->6799359) req@ffff880073ad5180 x1818247333304576/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:52/0 lens 488/0 e 0 to 0 dl 1734016102 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016091.498444:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5180 with x1818247333304576 ext(6795264->6799359) 00002000:00010000:0.0:1734016091.498449:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5180 00000100:00100000:0.0:1734016091.498482:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7737 00000100:00100000:0.0:1734016091.498488:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333304576:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016091.498661:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333304576:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 172us (372us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016091.498667:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7737 00002000:00100000:0.0:1734016091.498673:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6795264->6799359) req@ffff880073ad5180 x1818247333304576/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:52/0 lens 488/4536 e 0 to 0 dl 1734016102 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016091.498680:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5180 with x1818247333304576 ext(6795264->6799359) 00002000:00010000:0.0:1734016091.498683:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5180 00000100:00100000:0.0:1734016091.506951:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.510196:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.517742:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333305344 00000100:00100000:0.0:1734016091.517753:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333305344 00000100:00100000:1.0:1734016091.518487:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7740 00000100:00100000:1.0:1734016091.518497:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333305344:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:1.0:1734016091.518546:0:14005:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27113811 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.518563:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016091.518566:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016091.518572:0:14005:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27113811 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4042752->4046847] (req 4042752->4046847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.518587:0:14005:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27113811 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4042752->4046847] (req 4042752->4046847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.518719:0:14005:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27113811 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4042752->4046847] (req 4042752->4046847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.518727:0:14005:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27113811 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4042752->4046847] (req 4042752->4046847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.518735:0:14005:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27113811 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4042752->4046847] (req 4042752->4046847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.518741:0:14005:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499d200 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016091.518745:0:14005:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27113811 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4042752->4046847] (req 4042752->4046847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.518753:0:14005:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27113811 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4042752->4046847] (req 4042752->4046847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.518774:0:14005:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27113811 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4042752->4046847] (req 4042752->4046847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.518780:0:14005:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27113811 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4042752->4046847] (req 4042752->4046847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016091.518880:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333305344:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 383us (2134us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016091.518889:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7740 00000100:00100000:0.0:1734016091.527153:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.541583:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.550877:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016091.558965:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016091.565715:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.565969:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333306240 00000100:00100000:0.0:1734016091.565978:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333306240 00000100:00100000:0.0:1734016091.566030:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10006 00000100:00100000:0.0:1734016091.566037:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333306240:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016091.566058:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016091.566079:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc2711382d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4299 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016091.566110:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711380a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e428b expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016091.566122:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27113818 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4292 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016091.566128:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016091.566130:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016091.566133:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc2711382d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4299 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016091.566162:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27113818 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4292 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016091.566174:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27113818 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4292 expref: 7 pid: 7684 timeout: 458 lvb_type: 1 00000100:00100000:0.0:1734016091.566186:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335164672:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016091.566245:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711380a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e428b expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016091.566253:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711380a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e428b expref: 6 pid: 7684 timeout: 458 lvb_type: 1 00000100:00100000:0.0:1734016091.566259:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335164800:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016091.566274:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee780 going to sleep for 11 seconds 00000100:00100000:0.0:1734016091.571037:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335164672:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016091.571051:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335164800:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016091.571085:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc2711382d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4299 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016091.571107:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:0.0:1734016091.571175:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333306240:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5136us (5470us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016091.571185:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10006 00000100:00100000:0.0:1734016091.571926:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.571959:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.579863:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.598156:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.598201:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.598243:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.598276:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333306880 00000100:00100000:0.0:1734016091.598286:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333306880 00002000:00100000:0.0:1734016091.598332:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->10297343) req@ffff88007bd2b100 x1818247333306880/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:52/0 lens 504/0 e 0 to 0 dl 1734016102 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016091.598341:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd2b100 with x1818247333306880 ext(0->10297343) 00002000:00010000:0.0:1734016091.598346:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd2b100 00000100:00100000:0.0:1734016091.598397:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333307136 00000100:00100000:0.0:1734016091.598400:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333307136 00002000:00100000:0.0:1734016091.598410:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8384512->10293247) req@ffff88007bd28380 x1818247333307136/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:52/0 lens 488/0 e 0 to 0 dl 1734016102 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016091.598422:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd28380 with x1818247333307136 ext(8384512->10293247) 00002000:00010000:0.0:1734016091.598425:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd28380 00000100:00100000:0.0:1734016091.598433:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333307008 00000100:00100000:0.0:1734016091.598435:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333307008 00002000:00100000:0.0:1734016091.598443:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8384511) req@ffff88007bd2b800 x1818247333307008/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:52/0 lens 488/0 e 0 to 0 dl 1734016102 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016091.598448:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd2b800 with x1818247333307008 ext(4190208->8384511) 00002000:00010000:0.0:1734016091.598450:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd2b800 00000100:00100000:0.0:1734016091.598459:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7743 00000100:00100000:0.0:1734016091.598465:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333306880:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016091.607792:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7745 00000100:00100000:0.0:1734016091.607828:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333307008:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016091.682516:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333306880:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 84037us (84359us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016091.682531:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7743 00002000:00100000:1.0:1734016091.682546:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->10297343) req@ffff88007bd2b100 x1818247333306880/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:52/0 lens 504/440 e 0 to 0 dl 1734016102 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016091.682555:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd2b100 with x1818247333306880 ext(0->10297343) 00002000:00010000:1.0:1734016091.682563:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd2b100 00000100:00100000:1.0:1734016091.700356:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333307008:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 92517us (102095us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016091.700385:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7745 00002000:00100000:1.0:1734016091.700399:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8384511) req@ffff88007bd2b800 x1818247333307008/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:52/0 lens 488/440 e 0 to 0 dl 1734016102 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016091.700410:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd2b800 with x1818247333307008 ext(4190208->8384511) 00002000:00010000:1.0:1734016091.700418:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd2b800 00000100:00100000:0.0:1734016091.742104:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016091.744664:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333307392 00000100:00100000:1.0:1734016091.744689:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333307392 00002000:00100000:1.0:1734016091.744761:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (10248192->10297177) req@ffff88007bd29c00 x1818247333307392/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:52/0 lens 488/0 e 0 to 0 dl 1734016102 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016091.744774:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd29c00 with x1818247333307392 ext(10248192->10297177) 00002000:00010000:1.0:1734016091.744781:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd29c00 00000100:00100000:1.0:1734016091.745294:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7746 00000100:00100000:1.0:1734016091.745303:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333307392:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016091.757609:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333307392:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 12294us (15506us total) trans 4294969115 rc 0/0 00000100:00100000:1.0:1734016091.757624:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7746 00002000:00100000:1.0:1734016091.757638:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (10248192->10297177) req@ffff88007bd29c00 x1818247333307392/t4294969115(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:52/0 lens 488/448 e 0 to 0 dl 1734016102 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016091.757647:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd29c00 with x1818247333307392 ext(10248192->10297177) 00002000:00010000:1.0:1734016091.757653:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd29c00 00000100:00100000:0.0:1734016091.761968:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.765176:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016091.770626:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969115 is committed 00000100:00100000:0.0:1734016091.777976:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333307776 00000100:00100000:0.0:1734016091.777991:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333307776 00000100:00100000:1.0:1734016091.779278:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1944 00000100:00100000:1.0:1734016091.779290:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:9668:x1818247333307776:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016091.779320:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016091.779347:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d680/0x5e3a3adc27113834 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e42a0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.779474:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc2711383b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016091.779489:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc2711383b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016091.779502:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc2711383b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:1.0:1734016091.779532:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 10297178 00000004:00200000:1.0:1734016091.779537:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016091.779557:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc2711383b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016091.779584:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d680/0x5e3a3adc27113834 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42a0 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.779761:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc2711383b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42a0 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.779771:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016091.779774:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016091.779779:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016091.779884:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333307776:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 594us (3420us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016091.779892:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1944 00000100:00100000:0.0:1734016091.785172:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.796609:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016091.796715:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333308160 00000100:00100000:1.0:1734016091.796726:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333308160 00000100:00100000:1.0:1734016091.796785:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1945 00000100:00100000:1.0:1734016091.796792:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+16:9668:x1818247333308160:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016091.797061:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d8c0/0x5e3a3adc27113842 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016091.797078:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc2711383b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42a0 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.797089:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d8c0/0x5e3a3adc27113842 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016091.797120:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc2711383b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42a0 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016091.797131:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc2711383b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42a0 expref: 15 pid: 6478 timeout: 458 lvb_type: 0 00000100:00100000:1.0:1734016091.797145:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335165056:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016091.797206:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016091.799036:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335165056:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016091.799060:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d8c0/0x5e3a3adc27113842 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016091.800399:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016091.800970:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d8c0/0x5e3a3adc27113842 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016091.800976:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d8c0/0x5e3a3adc27113842 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:1.0:1734016091.801062:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968558 00000004:00010000:1.0:1734016091.801100:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007bd28a80 reply state ffff88012d4ff000 transno 4294968559 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d8c0/0x5e3a3adc27113842 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:1.0:1734016091.801106:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016091.801165:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+19:9668:x1818247333308160:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 4373us (4568us total) trans 4294968559 rc 0/0 00000100:00100000:1.0:1734016091.801170:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1945 00000020:00080000:1.0:1734016091.801174:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016091.805323:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.805347:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333308416 00000100:00100000:0.0:1734016091.805355:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333308416 00000100:00100000:0.0:1734016091.805397:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10009 00000100:00100000:0.0:1734016091.805407:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333308416:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016091.805426:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016091.805441:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113849 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e42a7 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016091.805467:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc2711382d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4299 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016091.805474:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016091.805476:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016091.805479:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113849 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42a7 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016091.805506:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc2711382d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4299 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016091.805517:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc2711382d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4299 expref: 6 pid: 7682 timeout: 458 lvb_type: 0 00000100:00100000:0.0:1734016091.805529:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335165184:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016091.806000:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee780 going to sleep for 11 seconds 00000100:00100000:0.0:1734016091.809153:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335165184:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016091.809186:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113849 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42a7 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016091.809204:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016091.809260:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333308416:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3854us (3939us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016091.809271:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10009 00000100:00100000:0.0:1734016091.844087:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016091.856330:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333308672 00000100:00100000:1.0:1734016091.856347:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333308672 00002000:00010000:1.0:1734016091.856421:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (1547852->18446744073709551615) 00002000:00100000:1.0:1734016091.856428:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3c700 with x1818247333308672 ext(1547852->18446744073709551615) 00002000:00010000:1.0:1734016091.856450:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3c700. 00000100:00100000:1.0:1734016091.856493:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7747 00000100:00100000:1.0:1734016091.856506:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333308672:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:0.0:1734016091.858645:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335165312:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016091.858676:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016091.858747:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333308544:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 8385us (14683us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016091.858760:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2647 00002000:00010000:0.0:1734016091.866394:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10297178 -> 1547852 00002000:00010000:0.0:1734016091.866402:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016092 -> 1734016092 00002000:00010000:0.0:1734016091.866405:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016091 -> 1734016091 00002000:00010000:0.0:1734016091.866406:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016092 -> 1734016092 00002000:00010000:0.0:1734016091.866408:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 944 -> 432 00000100:00100000:0.0:1734016091.866506:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333308672:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 9995us (10460us total) trans 4294969117 rc 0/0 00000100:00100000:0.0:1734016091.866516:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7747 00002000:00010000:0.0:1734016091.866523:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (1547852->18446744073709551615) 00002000:00100000:0.0:1734016091.866527:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3c700 with x1818247333308672 ext(1547852->18446744073709551615) 00002000:00010000:0.0:1734016091.866534:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3c700. 00000100:00100000:0.0:1734016091.868582:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.868646:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333308800 00000100:00100000:0.0:1734016091.868658:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333308800 00000100:00100000:0.0:1734016091.869925:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1946 00000100:00100000:0.0:1734016091.869937:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:9668:x1818247333308800:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016091.869971:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016091.870004:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27113850 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e42ae expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016091.870169:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27113857 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016091.870191:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27113857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016091.870211:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27113857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:0.0:1734016091.870241:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 1547852 00000004:00200000:0.0:1734016091.870246:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016091.870274:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27113857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016091.870300:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27113850 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42ae expref: 17 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016091.870321:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27113857 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42ae expref: 16 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016091.870331:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016091.870334:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016091.870337:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:0.0:1734016091.870426:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333308800:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 489us (1857us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016091.870433:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1946 00000100:00100000:0.0:1734016091.872370:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.872413:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333308928 00000100:00100000:0.0:1734016091.872423:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333308928 00000100:00100000:0.0:1734016091.872486:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10010 00000100:00100000:0.0:1734016091.872497:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333308928:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016091.872529:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016091.872550:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc2711385e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e42b5 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016091.872626:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335165440:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016091.872680:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee780 going to sleep for 11 seconds 00000100:00100000:0.0:1734016091.886078:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.900511:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.906410:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016091.909737:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969118 is committed 00000001:00080000:0.0:1734016091.909770:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969117 is committed 00000100:00100000:0.0:1734016091.913307:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016091.917094:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.925599:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.932007:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016091.942725:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.958188:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.983556:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016091.988864:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016091.989208:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333310848 00000100:00100000:0.0:1734016091.989216:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333310848 00010000:00010000:0.0:1734016091.989245:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113881 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42ca expref: 8 pid: 7682 timeout: 459 lvb_type: 1 00000100:00100000:0.0:1734016091.989269:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2649 00000100:00100000:0.0:1734016091.989276:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333310848:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016091.989289:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016091.989311:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113881 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42ca expref: 8 pid: 7682 timeout: 459 lvb_type: 1 00010000:00010000:0.0:1734016091.989324:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113881 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42ca expref: 8 pid: 7682 timeout: 459 lvb_type: 1 00010000:00010000:0.0:1734016091.989349:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113881 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42ca expref: 8 pid: 7682 timeout: 459 lvb_type: 1 00010000:00010000:0.0:1734016091.989394:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016091.989413:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333310848:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 138us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016091.989420:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2649 00000100:00100000:0.0:1734016091.993600:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.000503:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.005114:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016092.005863:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016062 00000100:00100000:0.0:1734016092.011275:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.016923:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.022276:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.025879:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.031198:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.037609:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.038235:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333312000 00000100:00100000:1.0:1734016092.038253:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333312000 00000100:00100000:1.0:1734016092.038308:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10021 00000100:00100000:1.0:1734016092.038319:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333312000:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016092.038344:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016092.038377:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271138c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e42fb expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016092.038453:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335166848:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016092.038551:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f240 going to sleep for 11 seconds 00002000:00010000:1.0:1734016092.041552:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016091 -> 1734016092 00000100:00100000:1.0:1734016092.041598:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013040b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335166848:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016092.041649:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271138c0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42fb expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016092.041678:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271138c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42fb expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016092.042414:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016092.042507:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333312000:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4188us (4913us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016092.042518:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10021 00000100:00100000:0.0:1734016092.045240:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.049148:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.049745:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333312384 00000100:00100000:0.0:1734016092.049756:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333312384 00010000:00010000:0.0:1734016092.049797:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271138b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9580544->9641983) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42f4 expref: 7 pid: 7684 timeout: 459 lvb_type: 0 00000100:00100000:0.0:1734016092.050273:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2652 00000100:00100000:0.0:1734016092.050281:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333312384:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016092.050299:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016092.050325:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271138b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 9580544->9641983) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42f4 expref: 7 pid: 7684 timeout: 459 lvb_type: 0 00010000:00010000:0.0:1734016092.050339:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271138b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 9580544->9641983) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42f4 expref: 7 pid: 7684 timeout: 459 lvb_type: 0 00010000:00010000:0.0:1734016092.050377:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271138b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 9580544->9641983) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42f4 expref: 7 pid: 7684 timeout: 459 lvb_type: 0 00010000:00010000:0.0:1734016092.050405:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016092.050408:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016092.050412:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271138c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [892928->933887] (req 892928->933887) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.050422:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271138c7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [892928->933887] (req 892928->933887) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.050451:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016092.050495:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333312384:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 215us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016092.050502:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2652 00010000:00010000:0.0:1734016092.054171:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271138c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [892928->933887] (req 892928->933887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.054204:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271138c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [892928->933887] (req 892928->933887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.054216:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271138c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [892928->933887] (req 892928->933887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.054227:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df7cc0 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016092.054233:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271138c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [892928->933887] (req 892928->933887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.054245:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271138c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [892928->933887] (req 892928->933887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.054275:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271138c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [892928->933887] (req 892928->933887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.054282:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271138c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [892928->933887] (req 892928->933887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016092.054739:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333312256:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 9073us (9500us total) trans 0 rc 40960/40960 00000100:00100000:0.0:1734016092.054753:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7752 00000100:00100000:0.0:1734016092.057681:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.057858:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333312512 00000100:00100000:1.0:1734016092.057871:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333312512 00000100:00100000:1.0:1734016092.057934:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10022 00000100:00100000:1.0:1734016092.057945:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333312512:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016092.057977:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016092.058009:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271138ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4302 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016092.058039:0:7682:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 1547852, mtime: 0x675afc5c, atime: 0x675afc5b, ctime: 0x675afc5c, blocks: 0x208 00010000:00010000:1.0:1734016092.058069:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016092.058072:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016092.058081:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271138ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4302 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016092.058099:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271138ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4302 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016092.058115:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016092.058198:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333312512:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 254us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016092.058206:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10022 00000100:00100000:0.0:1734016092.060797:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.065639:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.066866:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333312768 00000100:00100000:1.0:1734016092.066890:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333312768 00010000:00010000:1.0:1734016092.066935:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271138ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4302 expref: 8 pid: 7682 timeout: 459 lvb_type: 1 00000100:00100000:1.0:1734016092.066975:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2653 00000100:00100000:1.0:1734016092.066985:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333312768:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016092.067007:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016092.067035:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271138ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4302 expref: 8 pid: 7682 timeout: 459 lvb_type: 1 00010000:00010000:1.0:1734016092.067050:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271138ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4302 expref: 8 pid: 7682 timeout: 459 lvb_type: 1 00010000:00010000:1.0:1734016092.067083:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271138ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4302 expref: 8 pid: 7682 timeout: 459 lvb_type: 1 00010000:00010000:1.0:1734016092.067122:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016092.067125:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016092.067132:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271138d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->2658303) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4309 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016092.067143:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271138d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->2658303) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4309 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016092.067192:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271138d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->2658303) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4309 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016092.067209:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335167232:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016092.067295:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016092.070125:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.070262:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013040b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335167232:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016092.070288:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016092.070340:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333312768:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3355us (4716us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016092.070364:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2653 00000100:00100000:1.0:1734016092.075125:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333313024 00000100:00100000:1.0:1734016092.075136:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333313024 00000100:00100000:1.0:1734016092.075249:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10025 00000100:00100000:1.0:1734016092.075259:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333313024:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016092.075286:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016092.075310:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc271138dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4310 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016092.075389:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335167360:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016092.075741:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f9c0 going to sleep for 11 seconds 00002000:00010000:1.0:1734016092.077655:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016091 -> 1734016092 00000100:00100000:1.0:1734016092.077694:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013040b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335167360:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016092.077743:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc271138dc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4310 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016092.077767:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc271138dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4310 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016092.077990:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016092.078057:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333313024:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2798us (3671us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016092.078068:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10025 00000100:00100000:0.0:1734016092.084127:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.084616:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333313152 00000100:00100000:1.0:1734016092.084620:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333313152 00000100:00100000:1.0:1734016092.084650:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10026 00000100:00100000:1.0:1734016092.084656:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333313152:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016092.084676:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016092.084704:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271138e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4317 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016092.084775:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335168256:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016092.084880:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f9c0 going to sleep for 11 seconds 00000100:00080000:0.0:1734016092.085666:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016062 00000100:00080000:0.0:1734016092.085672:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016062 00000100:00080000:0.0:1734016092.085673:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016062 00000100:00100000:0.0:1734016092.085692:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335167872:0@lo:400:kworker.0 00000100:00100000:0.0:1734016092.085720:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016092.085748:0:3503:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1734016092.085755:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3503:1818247335168000:0@lo:400:kworker.0 00000100:00100000:0.0:1734016092.085774:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016092.086492:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335167872 00000100:00100000:1.0:1734016092.086498:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335167872 00000100:00100000:1.0:1734016092.086549:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1734016092.086555:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335167872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016092.086607:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335167872:12345-0@lo:400:kworker.0 Request processed in 52us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016092.086614:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:0.0:1734016092.086729:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016062 00000100:00100000:0.0:1734016092.086757:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335167872:0@lo:400:kworker.0 00000100:00080000:0.0:1734016092.087633:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016062 00000100:00100000:1.0:1734016092.088456:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3503:1818247335168000:0@lo:400:kworker.0 00000100:00100000:1.0:1734016092.090309:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013040bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335168256:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016092.090375:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271138e3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4317 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016092.090398:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271138e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4317 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016092.090442:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016092.090536:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333313152:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5875us (6409us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016092.090550:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10026 00000100:00100000:0.0:1734016092.097220:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.102259:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.102452:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333313536 00000100:00100000:1.0:1734016092.102467:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333313536 00010000:00010000:1.0:1734016092.102525:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271138d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4309 expref: 9 pid: 7684 timeout: 459 lvb_type: 0 00000100:00100000:1.0:1734016092.102568:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2654 00000100:00100000:1.0:1734016092.102577:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333313536:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016092.102600:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016092.102631:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271138d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2625536->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4309 expref: 9 pid: 7684 timeout: 459 lvb_type: 0 00010000:00010000:1.0:1734016092.102648:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271138d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2625536->2658303) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4309 expref: 9 pid: 7684 timeout: 459 lvb_type: 0 00010000:00010000:1.0:1734016092.102682:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271138d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2625536->2658303) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4309 expref: 9 pid: 7684 timeout: 459 lvb_type: 0 00010000:00010000:1.0:1734016092.102727:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016092.102730:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016092.102735:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271138ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5197824->5222399] (req 5197824->5222399) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016092.102745:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271138ea lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5197824->5222399] (req 5197824->5222399) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016092.102786:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016092.102887:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333313536:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 310us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016092.102896:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2654 00000001:00080000:0.0:1734016092.108626:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969122 is committed 00000001:00080000:0.0:1734016092.108658:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969119 is committed 00000100:00100000:0.0:1734016092.114473:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.114658:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333313664 00000100:00100000:1.0:1734016092.114673:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333313664 00000100:00100000:1.0:1734016092.114752:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10027 00000100:00100000:1.0:1734016092.114762:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333313664:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016092.114792:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016092.114854:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc271138f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e431e expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016092.114883:0:7682:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 5222400, mtime: 0x675afc5c, atime: 0x675afc5b, ctime: 0x675afc5c, blocks: 0x278 00010000:00010000:1.0:1734016092.114910:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016092.114913:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016092.114922:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc271138f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e431e expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016092.114941:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc271138f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e431e expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016092.114956:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016092.115027:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333313664:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 266us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016092.115034:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10027 00000100:00100000:0.0:1734016092.126052:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.141544:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335168512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1734016092.141640:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016092.141709:0:7685:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335168512 00000100:00100000:1.0:1734016092.141721:0:7685:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335168512 00000100:00100000:1.0:1734016092.141776:0:7685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1734016092.141783:0:7685:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335168512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1734016092.141843:0:7685:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 980042304 pending 0 free 3923456000 avail 3691843584 00000100:00100000:1.0:1734016092.141878:0:7685:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335168512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016092.141885:0:7685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1734016092.141927:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335168512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1734016092.166730:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333313920:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 40149us (40684us total) trans 0 rc 3678208/3678208 00000100:00100000:0.0:1734016092.166744:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7754 00002000:00100000:0.0:1734016092.166757:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1396736->5222399) req@ffff8800755b6300 x1818247333313920/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 504/440 e 0 to 0 dl 1734016103 ref 1 fl Complete:/200/0 rc 3678208/3678208 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016092.166766:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b6300 with x1818247333313920 ext(1396736->5222399) 00002000:00010000:0.0:1734016092.166773:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b6300 00000100:00100000:1.0:1734016092.173399:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.173560:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333314176 00000100:00100000:0.0:1734016092.173572:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333314176 00002000:00100000:0.0:1734016092.173631:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1392640->1396735) req@ffff880130409180 x1818247333314176/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/0 e 0 to 0 dl 1734016103 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016092.173643:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880130409180 with x1818247333314176 ext(1392640->1396735) 00002000:00010000:0.0:1734016092.173651:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130409180 00000100:00100000:0.0:1734016092.173687:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7755 00000100:00100000:0.0:1734016092.173694:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333314176:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016092.173943:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333314176:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 247us (560us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016092.173953:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7755 00002000:00100000:0.0:1734016092.173960:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1392640->1396735) req@ffff880130409180 x1818247333314176/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/4536 e 0 to 0 dl 1734016103 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016092.173968:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880130409180 with x1818247333314176 ext(1392640->1396735) 00002000:00010000:0.0:1734016092.173972:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130409180 00000100:00100000:0.0:1734016092.177824:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.178646:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333314432 00000100:00100000:1.0:1734016092.178660:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333314432 00002000:00100000:1.0:1734016092.178728:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1388544->1392639) req@ffff8800755b7b80 x1818247333314432/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/0 e 0 to 0 dl 1734016103 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.178741:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b7b80 with x1818247333314432 ext(1388544->1392639) 00002000:00010000:1.0:1734016092.178748:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b7b80 00000100:00100000:1.0:1734016092.178780:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7756 00000100:00100000:1.0:1734016092.178788:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333314432:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016092.179033:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333314432:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 243us (1244us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016092.179040:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7756 00002000:00100000:1.0:1734016092.179045:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1388544->1392639) req@ffff8800755b7b80 x1818247333314432/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/4536 e 0 to 0 dl 1734016103 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.179052:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b7b80 with x1818247333314432 ext(1388544->1392639) 00002000:00010000:1.0:1734016092.179054:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b7b80 00000100:00100000:0.0:1734016092.181058:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.184306:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333314944 00000100:00100000:1.0:1734016092.184316:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333314944 00002000:00100000:1.0:1734016092.184365:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1380352->1384447) req@ffff880075650e00 x1818247333314944/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/0 e 0 to 0 dl 1734016103 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.184373:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075650e00 with x1818247333314944 ext(1380352->1384447) 00002000:00010000:1.0:1734016092.184379:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075650e00 00000100:00100000:1.0:1734016092.184439:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7758 00000100:00100000:1.0:1734016092.184447:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333314944:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016092.185263:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333314944:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 813us (1053us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016092.185272:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7758 00002000:00100000:1.0:1734016092.185282:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1380352->1384447) req@ffff880075650e00 x1818247333314944/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/4536 e 0 to 0 dl 1734016103 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.185288:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075650e00 with x1818247333314944 ext(1380352->1384447) 00002000:00010000:1.0:1734016092.185292:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075650e00 00000100:00100000:0.0:1734016092.188177:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.188430:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333315200 00000100:00100000:1.0:1734016092.188440:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333315200 00002000:00100000:1.0:1734016092.188485:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1376256->1380351) req@ffff8800755b6680 x1818247333315200/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/0 e 0 to 0 dl 1734016103 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.188495:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b6680 with x1818247333315200 ext(1376256->1380351) 00002000:00010000:1.0:1734016092.188501:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b6680 00000100:00100000:1.0:1734016092.188626:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7759 00000100:00100000:1.0:1734016092.188634:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333315200:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016092.189890:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333315200:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1252us (1721us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016092.189899:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7759 00002000:00100000:1.0:1734016092.189907:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1376256->1380351) req@ffff8800755b6680 x1818247333315200/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/4536 e 0 to 0 dl 1734016103 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.189915:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b6680 with x1818247333315200 ext(1376256->1380351) 00002000:00010000:1.0:1734016092.189919:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b6680 00000100:00100000:0.0:1734016092.192045:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.192175:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333315456 00000100:00100000:1.0:1734016092.192190:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333315456 00002000:00100000:1.0:1734016092.192240:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1372160->1376255) req@ffff8800755b6d80 x1818247333315456/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/0 e 0 to 0 dl 1734016103 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.192249:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b6d80 with x1818247333315456 ext(1372160->1376255) 00002000:00010000:1.0:1734016092.192254:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b6d80 00000100:00100000:1.0:1734016092.192292:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7760 00000100:00100000:1.0:1734016092.192298:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333315456:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016092.192482:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333315456:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 182us (443us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016092.192488:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7760 00002000:00100000:1.0:1734016092.192494:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1372160->1376255) req@ffff8800755b6d80 x1818247333315456/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/4536 e 0 to 0 dl 1734016103 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.192500:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b6d80 with x1818247333315456 ext(1372160->1376255) 00002000:00010000:1.0:1734016092.192503:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b6d80 00000100:00100000:1.0:1734016092.194112:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333315712 00000100:00100000:1.0:1734016092.194121:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333315712 00002000:00100000:1.0:1734016092.194150:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1368064->1372159) req@ffff880073ad7b80 x1818247333315712/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/0 e 0 to 0 dl 1734016103 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.194156:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad7b80 with x1818247333315712 ext(1368064->1372159) 00002000:00010000:1.0:1734016092.194161:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad7b80 00000100:00100000:1.0:1734016092.194186:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7761 00000100:00100000:1.0:1734016092.194191:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333315712:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016092.194325:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333315712:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 129us (258us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016092.194332:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7761 00002000:00100000:1.0:1734016092.194337:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1368064->1372159) req@ffff880073ad7b80 x1818247333315712/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/4536 e 0 to 0 dl 1734016103 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.194344:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad7b80 with x1818247333315712 ext(1368064->1372159) 00002000:00010000:1.0:1734016092.194346:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad7b80 00000100:00100000:0.0:1734016092.195681:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.195774:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333315968 00000100:00100000:1.0:1734016092.195782:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333315968 00002000:00100000:1.0:1734016092.195859:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1363968->1368063) req@ffff8800755b4380 x1818247333315968/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/0 e 0 to 0 dl 1734016103 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.195867:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4380 with x1818247333315968 ext(1363968->1368063) 00002000:00010000:1.0:1734016092.195872:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4380 00000100:00100000:1.0:1734016092.195903:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7762 00000100:00100000:1.0:1734016092.195909:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333315968:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016092.196138:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333315968:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 228us (466us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016092.196145:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7762 00002000:00100000:1.0:1734016092.196150:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1363968->1368063) req@ffff8800755b4380 x1818247333315968/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/4536 e 0 to 0 dl 1734016103 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.196157:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4380 with x1818247333315968 ext(1363968->1368063) 00002000:00010000:1.0:1734016092.196160:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4380 00000100:00100000:0.0:1734016092.199110:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.199228:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333316224 00000100:00100000:1.0:1734016092.199240:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333316224 00002000:00100000:1.0:1734016092.199297:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1359872->1363967) req@ffff8800755b4700 x1818247333316224/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/0 e 0 to 0 dl 1734016103 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.199308:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4700 with x1818247333316224 ext(1359872->1363967) 00002000:00010000:1.0:1734016092.199313:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4700 00000100:00100000:1.0:1734016092.199369:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7763 00000100:00100000:1.0:1734016092.199376:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333316224:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016092.199565:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333316224:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 189us (470us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016092.199578:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7763 00002000:00100000:1.0:1734016092.199583:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1359872->1363967) req@ffff8800755b4700 x1818247333316224/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/4536 e 0 to 0 dl 1734016103 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.199589:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4700 with x1818247333316224 ext(1359872->1363967) 00002000:00010000:1.0:1734016092.199591:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4700 00000100:00100000:0.0:1734016092.215911:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.216035:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333316608 00000100:00100000:1.0:1734016092.216047:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333316608 00002000:00100000:1.0:1734016092.216102:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff8800755b4e00 x1818247333316608/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:53/0 lens 488/0 e 0 to 0 dl 1734016103 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.216114:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4e00 with x1818247333316608 ext(0->4194303) 00002000:00010000:1.0:1734016092.216120:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4e00 00000100:00100000:1.0:1734016092.216588:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333316864 00000100:00100000:1.0:1734016092.216592:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333316864 00002000:00100000:1.0:1734016092.216605:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (4194304->5222399) req@ffff880073ad5500 x1818247333316864/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:53/0 lens 488/0 e 0 to 0 dl 1734016103 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.216612:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5500 with x1818247333316864 ext(4194304->5222399) 00002000:00010000:1.0:1734016092.216615:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5500 00000100:00100000:1.0:1734016092.216637:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7765 00000100:00100000:1.0:1734016092.216641:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333316864:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016092.230129:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333316864:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 13464us (13551us total) trans 0 rc 1028096/1028096 00000100:00100000:1.0:1734016092.230145:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7765 00002000:00100000:1.0:1734016092.230163:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (4194304->5222399) req@ffff880073ad5500 x1818247333316864/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:53/0 lens 488/440 e 0 to 0 dl 1734016103 ref 1 fl Complete:/200/0 rc 1028096/1028096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.230181:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5500 with x1818247333316864 ext(4194304->5222399) 00002000:00010000:1.0:1734016092.230190:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5500 00000100:00100000:0.0:1734016092.299766:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.315370:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335168640:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016092.315388:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335168768:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016092.315444:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271138ff lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2027520->2043903] (req 2027520->2043903) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e432c expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.315481:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:0.0:1734016092.315553:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333316992:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 13508us (15814us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016092.315566:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10029 00000100:00100000:1.0:1734016092.315687:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333317120 00000100:00100000:1.0:1734016092.315697:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333317120 00010000:00010000:1.0:1734016092.315733:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc271138f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e431e expref: 6 pid: 7682 timeout: 459 lvb_type: 1 00000100:00100000:1.0:1734016092.315777:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2655 00000100:00100000:1.0:1734016092.315785:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e719c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333317120:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016092.315835:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016092.315869:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc271138f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e431e expref: 6 pid: 7682 timeout: 459 lvb_type: 1 00010000:00010000:1.0:1734016092.315883:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc271138f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e431e expref: 6 pid: 7682 timeout: 459 lvb_type: 1 00010000:00010000:1.0:1734016092.315921:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc271138f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e431e expref: 6 pid: 7682 timeout: 459 lvb_type: 1 00010000:00010000:1.0:1734016092.316577:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016092.316609:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e719c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333317120:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 824us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016092.316616:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2655 00000100:00100000:0.0:1734016092.321317:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.321950:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333317248 00000100:00100000:1.0:1734016092.321963:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333317248 00010000:00010000:1.0:1734016092.322009:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271138f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4325 expref: 8 pid: 7684 timeout: 459 lvb_type: 1 00000100:00100000:1.0:1734016092.322050:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2656 00000100:00100000:1.0:1734016092.322059:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333317248:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016092.322083:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016092.322118:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271138f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4325 expref: 8 pid: 7684 timeout: 459 lvb_type: 1 00010000:00010000:1.0:1734016092.322137:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271138f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4325 expref: 8 pid: 7684 timeout: 459 lvb_type: 1 00010000:00010000:1.0:1734016092.322168:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271138f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4325 expref: 8 pid: 7684 timeout: 459 lvb_type: 1 00010000:00010000:1.0:1734016092.323322:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016092.323331:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016092.323346:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271138ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2043903) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e432c expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016092.323369:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271138ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2043903) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e432c expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016092.323428:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271138ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2043903) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e432c expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016092.323445:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130409880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335168896:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016092.327831:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016092.329918:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130409880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335168896:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016092.329963:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016092.330048:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333317248:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7986us (8741us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016092.330063:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2656 00000100:00100000:0.0:1734016092.333188:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333317376 00000100:00100000:0.0:1734016092.333207:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333317376 00000100:00100000:0.0:1734016092.333314:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10030 00000100:00100000:0.0:1734016092.333327:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333317376:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016092.333868:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 5222400 -> 5222400 00002000:00010000:0.0:1734016092.333873:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016092 -> 1734016092 00002000:00010000:0.0:1734016092.333876:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016091 -> 1734016091 00002000:00010000:0.0:1734016092.333878:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016092 -> 1734016092 00002000:00010000:0.0:1734016092.333880:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 632 -> 664 00000100:00100000:1.0:1734016092.334035:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333317376:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 708us (2171us total) trans 4294969123 rc 0/0 00000100:00100000:1.0:1734016092.334047:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10030 00000100:00100000:0.0:1734016092.339509:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.340551:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333317504 00000100:00100000:1.0:1734016092.340564:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333317504 00000100:00100000:1.0:1734016092.340634:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10031 00000100:00100000:1.0:1734016092.340646:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333317504:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016092.340679:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016092.340707:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27113906 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4333 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016092.340786:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130409880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335169024:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016092.341005:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00002000:00010000:1.0:1734016092.343726:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016091 -> 1734016092 00000100:00100000:1.0:1734016092.343776:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130409880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335169024:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016092.343858:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27113906 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4333 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016092.343880:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27113906 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4333 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016092.343909:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499eac0, rc 0) 00000100:00100000:1.0:1734016092.343978:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333317504:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3334us (4484us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016092.343990:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10031 00000100:00100000:0.0:1734016092.346283:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.346411:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333317632 00000100:00100000:1.0:1734016092.346424:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333317632 00000100:00100000:1.0:1734016092.346490:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10032 00000100:00100000:1.0:1734016092.346498:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333317632:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016092.346521:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016092.346549:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711390d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e433a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016092.346626:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130409880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335169152:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016092.346716:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016092.348221:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130409880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335169152:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016092.348249:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711390d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e433a expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016092.348261:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711390d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e433a expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016092.348273:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016092.348311:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333317632:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1813us (2044us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016092.348325:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10032 00000100:00100000:0.0:1734016092.351132:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333317888 00000100:00100000:0.0:1734016092.351147:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333317888 00000100:00100000:0.0:1734016092.351255:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7766 00000100:00100000:0.0:1734016092.351269:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333317888:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:0.0:1734016092.351388:0:7687:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113914 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.351412:0:7687:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271138ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2043903) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e432c expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.351424:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016092.351427:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016092.351431:0:7687:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113914 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [675840->684031] (req 675840->684031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.351473:0:7687:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271138ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2043903) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e432c expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.351487:0:7687:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271138ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2043903) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e432c expref: 8 pid: 7684 timeout: 459 lvb_type: 0 00000100:00100000:0.0:1734016092.351502:0:7687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e604700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335169280:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016092.351600:0:7687:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016092.356104:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335169408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1734016092.356189:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016092.356581:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335169408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1734016092.357450:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333318016 00000100:00100000:1.0:1734016092.357454:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333318016 00010000:00010000:1.0:1734016092.357481:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271138ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2043903) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e432c expref: 9 pid: 7684 timeout: 459 lvb_type: 0 00000100:00100000:1.0:1734016092.357990:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2657 00000100:00100000:1.0:1734016092.357998:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333318016:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016092.358017:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016092.358049:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271138ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2043903) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e432c expref: 9 pid: 7684 timeout: 459 lvb_type: 0 00010000:00010000:1.0:1734016092.358064:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271138ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2043903) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e432c expref: 9 pid: 7684 timeout: 459 lvb_type: 0 00010000:00010000:1.0:1734016092.358096:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271138ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2043903) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e432c expref: 9 pid: 7684 timeout: 459 lvb_type: 0 00010000:00010000:1.0:1734016092.358118:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016092.358121:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016092.358126:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113914 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [675840->684031] (req 675840->684031) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016092.358143:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113914 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [675840->684031] (req 675840->684031) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016092.358663:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016092.358744:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333318016:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 744us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016092.358754:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2657 00000100:00100000:0.0:1734016092.362624:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.362709:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333318144 00000100:00100000:1.0:1734016092.362722:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333318144 00000100:00100000:1.0:1734016092.362783:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10033 00000100:00100000:1.0:1734016092.362792:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333318144:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016092.362837:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016092.362864:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711391b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4341 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016092.362892:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 5222400, mtime: 0x675afc5c, atime: 0x675afc5b, ctime: 0x675afc5c, blocks: 0x298 00010000:00010000:1.0:1734016092.362918:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016092.362920:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016092.362929:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711391b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4341 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016092.362946:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711391b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4341 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016092.362957:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016092.363006:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333318144:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 215us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016092.363015:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10033 00000100:00100000:0.0:1734016092.374201:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.374276:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.374544:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333318400 00000100:00100000:1.0:1734016092.374564:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333318400 00002000:00100000:1.0:1734016092.374644:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff88012e604e00 x1818247333318400/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:53/0 lens 488/0 e 0 to 0 dl 1734016103 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.374661:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604e00 with x1818247333318400 ext(0->4194303) 00002000:00010000:1.0:1734016092.374672:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e604e00 00000100:00100000:1.0:1734016092.374731:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333318656 00000100:00100000:1.0:1734016092.374733:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333318656 00002000:00100000:1.0:1734016092.374746:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (4194304->5222399) req@ffff88012e605180 x1818247333318656/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:53/0 lens 488/0 e 0 to 0 dl 1734016103 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.374753:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605180 with x1818247333318656 ext(4194304->5222399) 00002000:00010000:1.0:1734016092.374757:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e605180 00000100:00100000:1.0:1734016092.374773:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7767 00000100:00100000:1.0:1734016092.374782:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333318400:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016092.429372:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333318400:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 54556us (55160us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016092.429393:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7767 00002000:00100000:1.0:1734016092.429414:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff88012e604e00 x1818247333318400/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:53/0 lens 488/440 e 0 to 0 dl 1734016103 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.429428:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604e00 with x1818247333318400 ext(0->4194303) 00002000:00010000:1.0:1734016092.429438:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e604e00 00000100:00100000:0.0:1734016092.437767:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.443659:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333319040 00000100:00100000:0.0:1734016092.443676:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333319040 00000100:00100000:0.0:1734016092.443778:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1948 00000100:00100000:0.0:1734016092.443792:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333319040:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016092.444155:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016092.444220:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27113857 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42ae expref: 16 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.444266:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016092.444274:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016092.444640:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27113929 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016092.444665:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27113896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42d1 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.444673:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27113929 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016092.444739:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27113896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42d1 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.444761:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27113896 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e42d1 expref: 18 pid: 6479 timeout: 459 lvb_type: 0 00000100:00100000:0.0:1734016092.444782:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e605880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335169536:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016092.444943:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eea80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016092.449426:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.449723:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e605880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335169536:192.168.201.16@tcp:104: 00000100:00080000:0.0:1734016092.450465:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016062 00010000:00010000:1.0:1734016092.450562:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27113929 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016092.451632:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27113929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016092.451641:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27113929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:1.0:1734016092.451897:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968560 00000004:00010000:1.0:1734016092.452002:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007bd2a680 reply state ffff880075f75000 transno 4294968561 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27113929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016092.452012:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016092.453077:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:9668:x1818247333319040:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 9287us (9571us total) trans 4294968561 rc 0/0 00000100:00100000:1.0:1734016092.453087:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1948 00000020:00080000:1.0:1734016092.453095:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016092.456755:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.469754:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333319552 00000100:00100000:1.0:1734016092.469770:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333319552 00010000:00010000:1.0:1734016092.469853:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711391b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4341 expref: 8 pid: 7684 timeout: 459 lvb_type: 1 00000100:00100000:1.0:1734016092.469909:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333319424 00000100:00100000:1.0:1734016092.469912:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333319424 00010000:00010000:1.0:1734016092.469926:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27113922 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4348 expref: 7 pid: 7682 timeout: 459 lvb_type: 1 00000100:00100000:1.0:1734016092.469957:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2659 00000100:00100000:1.0:1734016092.469968:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e719c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333319552:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016092.469992:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016092.470024:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711391b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4341 expref: 8 pid: 7684 timeout: 459 lvb_type: 1 00010000:00010000:1.0:1734016092.470039:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711391b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4341 expref: 8 pid: 7684 timeout: 459 lvb_type: 1 00010000:00010000:1.0:1734016092.470074:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711391b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4341 expref: 8 pid: 7684 timeout: 459 lvb_type: 1 00010000:00010000:1.0:1734016092.470105:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016092.470671:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e719c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333319552:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 702us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016092.470682:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2659 00000100:00100000:0.0:1734016092.473270:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.473441:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333319680 00000100:00100000:1.0:1734016092.473456:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333319680 00002000:00010000:1.0:1734016092.473527:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (3646156->18446744073709551615) 00002000:00100000:1.0:1734016092.473535:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605f80 with x1818247333319680 ext(3646156->18446744073709551615) 00002000:00010000:1.0:1734016092.473557:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e605f80. 00000100:00100000:1.0:1734016092.473619:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7769 00000100:00100000:1.0:1734016092.473629:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333319680:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016092.475474:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 5222400 -> 3646156 00002000:00010000:1.0:1734016092.475486:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016092 -> 1734016093 00002000:00010000:1.0:1734016092.475489:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016091 -> 1734016091 00002000:00010000:1.0:1734016092.475491:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016092 -> 1734016093 00002000:00010000:1.0:1734016092.475493:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 664 -> 496 00000100:00100000:1.0:1734016092.475600:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333319680:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1965us (2339us total) trans 4294969124 rc 0/0 00000100:00100000:1.0:1734016092.475618:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7769 00002000:00010000:1.0:1734016092.475624:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (3646156->18446744073709551615) 00002000:00100000:1.0:1734016092.475628:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605f80 with x1818247333319680 ext(3646156->18446744073709551615) 00002000:00010000:1.0:1734016092.475635:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e605f80. 00000100:00100000:0.0:1734016092.478189:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.478471:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333319808 00000100:00100000:1.0:1734016092.478482:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333319808 00000100:00100000:1.0:1734016092.478792:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1949 00000100:00100000:1.0:1734016092.479122:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:9668:x1818247333319808:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016092.479175:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016092.479210:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499eac0/0x5e3a3adc27113937 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4356 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016092.479392:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc2711393e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016092.479413:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc2711393e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016092.479429:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc2711393e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:1.0:1734016092.479468:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 3646156 00000004:00200000:1.0:1734016092.479475:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016092.479500:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc2711393e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016092.479533:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499eac0/0x5e3a3adc27113937 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4356 expref: 19 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016092.479551:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc2711393e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4356 expref: 18 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016092.479561:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016092.479564:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016092.479570:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016092.480251:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:9668:x1818247333319808:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1450us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016092.480260:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1949 00000100:00100000:0.0:1734016092.483501:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.492621:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.497362:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016092.509855:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969126 is committed 00000001:00080000:0.0:1734016092.509880:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969125 is committed 00000100:00100000:0.0:1734016092.518777:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.525225:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.526778:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333320576 00000100:00100000:1.0:1734016092.526860:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333320576 00000100:00100000:1.0:1734016092.526974:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10038 00000100:00100000:1.0:1734016092.526987:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333320576:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016092.527024:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016092.527062:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27113953 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4364 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016092.527118:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711394c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e435d expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016092.527128:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016092.527132:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016092.527137:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27113953 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2314240->2318335] (req 2314240->2318335) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4364 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016092.527200:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711394c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e435d expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016092.527218:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711394c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e435d expref: 7 pid: 7682 timeout: 459 lvb_type: 1 00000100:00100000:1.0:1734016092.527234:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335170176:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016092.527365:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016092.531158:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130408380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335170176:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016092.531206:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27113953 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2314240->2318335] (req 2314240->2318335) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4364 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016092.531236:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016092.531322:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333320576:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4333us (6113us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016092.531339:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10038 00000100:00100000:0.0:1734016092.531903:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.574338:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.577885:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.577989:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333321472 00000100:00100000:1.0:1734016092.578001:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333321472 00002000:00100000:1.0:1734016092.578056:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2306048->2310143) req@ffff88012e605880 x1818247333321472/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/0 e 0 to 0 dl 1734016103 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.578067:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605880 with x1818247333321472 ext(2306048->2310143) 00002000:00010000:1.0:1734016092.578072:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e605880 00000100:00100000:1.0:1734016092.578113:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7773 00000100:00100000:1.0:1734016092.578121:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333321472:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016092.578326:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333321472:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 204us (454us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016092.578333:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7773 00002000:00100000:1.0:1734016092.578338:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2306048->2310143) req@ffff88012e605880 x1818247333321472/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/4536 e 0 to 0 dl 1734016103 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.578364:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605880 with x1818247333321472 ext(2306048->2310143) 00002000:00010000:1.0:1734016092.578367:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e605880 00000100:00100000:0.0:1734016092.583949:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333321728 00000100:00100000:0.0:1734016092.583971:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333321728 00002000:00100000:0.0:1734016092.584079:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2301952->2306047) req@ffff8800a7aad450 x1818247333321728/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/0 e 0 to 0 dl 1734016103 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016092.584100:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7aad450 with x1818247333321728 ext(2301952->2306047) 00002000:00010000:0.0:1734016092.584112:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7aad450 00000100:00100000:0.0:1734016092.584188:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7774 00000100:00100000:0.0:1734016092.584220:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333321728:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016092.585102:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333321728:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 886us (1391us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016092.585115:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7774 00002000:00100000:0.0:1734016092.585122:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2301952->2306047) req@ffff8800a7aad450 x1818247333321728/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 488/4536 e 0 to 0 dl 1734016103 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016092.585135:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7aad450 with x1818247333321728 ext(2301952->2306047) 00002000:00010000:0.0:1734016092.585139:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7aad450 00000100:00100000:0.0:1734016092.595986:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.598434:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333321856 00000100:00100000:1.0:1734016092.598465:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333321856 00002000:00100000:1.0:1734016092.598627:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2301952->2318335) req@ffff88012e605180 x1818247333321856/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 16872/0 e 0 to 0 dl 1734016103 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.598642:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605180 with x1818247333321856 ext(2301952->2318335) 00002000:00010000:1.0:1734016092.598653:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e605180 00000100:00100000:1.0:1734016092.602042:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7775 00000100:00100000:1.0:1734016092.602076:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333321856:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016092.603589:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333321856:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1511us (7621us total) trans 4294969127 rc 0/0 00000100:00100000:1.0:1734016092.603606:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7775 00002000:00100000:1.0:1734016092.603626:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2301952->2318335) req@ffff88012e605180 x1818247333321856/t4294969127(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:53/0 lens 16872/448 e 0 to 0 dl 1734016103 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.603640:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605180 with x1818247333321856 ext(2301952->2318335) 00002000:00010000:1.0:1734016092.603648:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e605180 00000100:00100000:0.0:1734016092.609465:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.611024:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333321984 00000100:00100000:1.0:1734016092.611051:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333321984 00000100:00100000:1.0:1734016092.611151:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1950 00000100:00100000:1.0:1734016092.611163:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:9668:x1818247333321984:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:1.0:1734016092.611445:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:9668:x1818247333321984:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 285us (2009us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016092.611460:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1950 00000100:00100000:1.0:1734016092.618557:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333322112 00000100:00100000:1.0:1734016092.618574:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333322112 00000100:00100000:1.0:1734016092.618652:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10039 00000100:00100000:1.0:1734016092.618661:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333322112:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016092.620582:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969127 is committed 00000100:00100000:1.0:1734016092.621718:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333322112:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 3038us (3954us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016092.621739:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10039 00000100:00100000:0.0:1734016092.632778:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.645525:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.658378:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.658667:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333322624 00000100:00100000:0.0:1734016092.658686:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333322624 00000100:00100000:0.0:1734016092.658782:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10040 00000100:00100000:0.0:1734016092.658793:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333322624:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016092.658861:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016092.658898:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113961 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e436b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.658962:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27113953 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2314240->2318335) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4364 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.658972:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016092.658974:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016092.658979:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113961 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e436b expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.659044:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27113953 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2314240->2318335) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4364 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.659063:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27113953 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2314240->2318335) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4364 expref: 5 pid: 7684 timeout: 459 lvb_type: 0 00000100:00100000:0.0:1734016092.659083:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335170560:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016092.659198:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016092.664507:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335170560:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016092.664576:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113961 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e436b expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.664614:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582d00, rc 0) 00000100:00100000:0.0:1734016092.670536:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333322624:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11694us (12144us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016092.670564:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10040 00000100:00100000:1.0:1734016092.671077:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333322752 00000100:00100000:1.0:1734016092.671097:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333322752 00010000:00010000:1.0:1734016092.671171:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27113953 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2314240->2318335) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4364 expref: 6 pid: 7684 timeout: 459 lvb_type: 0 00000100:00100000:1.0:1734016092.671216:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2664 00000100:00100000:1.0:1734016092.671226:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333322752:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016092.671258:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1734016092.671295:0:6466:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016092 -> 1734016093 00002000:00010000:1.0:1734016092.671302:0:6466:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016092 -> 1734016093 00002000:00010000:1.0:1734016092.671304:0:6466:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 672 -> 704 00010000:00010000:1.0:1734016092.671310:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27113953 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2314240->2318335) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4364 expref: 6 pid: 7684 timeout: 459 lvb_type: 0 00010000:00010000:1.0:1734016092.671333:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27113953 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2314240->2318335) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4364 expref: 6 pid: 7684 timeout: 459 lvb_type: 0 00010000:00010000:1.0:1734016092.671384:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27113953 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2314240->2318335) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4364 expref: 6 pid: 7684 timeout: 459 lvb_type: 0 00010000:00010000:1.0:1734016092.671419:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016092.671423:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016092.671433:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e436b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016092.671447:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113961 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e436b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016092.671518:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113961 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e436b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016092.671536:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335170688:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016092.671656:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016092.678696:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.679648:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333322880 00000100:00100000:0.0:1734016092.679660:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333322880 00002000:00010000:0.0:1734016092.679708:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (9299545->18446744073709551615) 00002000:00100000:0.0:1734016092.679713:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88013040b480 with x1818247333322880 ext(9299545->18446744073709551615) 00002000:00010000:0.0:1734016092.679729:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013040b480. 00000100:00100000:0.0:1734016092.679752:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7776 00000100:00100000:0.0:1734016092.679760:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333322880:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016092.680158:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 6381568 -> 9299545 00002000:00010000:0.0:1734016092.680166:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016093 -> 1734016093 00002000:00010000:0.0:1734016092.680169:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016091 -> 1734016091 00002000:00010000:0.0:1734016092.680172:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016093 -> 1734016093 00002000:00010000:0.0:1734016092.680173:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 704 -> 704 00000100:00100000:0.0:1734016092.680207:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333322880:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 449us (1536us total) trans 4294969128 rc 0/0 00000100:00100000:0.0:1734016092.680215:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7776 00002000:00010000:0.0:1734016092.680218:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (9299545->18446744073709551615) 00002000:00100000:0.0:1734016092.680221:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88013040b480 with x1818247333322880 ext(9299545->18446744073709551615) 00002000:00010000:0.0:1734016092.680225:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013040b480. 00000100:00100000:0.0:1734016092.694274:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.710110:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.720253:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.735160:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.795923:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.801073:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.804117:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016092.806627:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969129 is committed 00000100:00100000:0.0:1734016092.809794:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.815322:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.819025:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.823467:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.831587:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.834562:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.838312:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10048 00000100:00100000:1.0:1734016092.838323:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333324800:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016092.838638:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9299545 -> 9299545 00002000:00010000:1.0:1734016092.838642:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016093 -> 1734016093 00002000:00010000:1.0:1734016092.838644:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016093 -> 1734016091 00002000:00010000:1.0:1734016092.838647:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016093 -> 1734016092 00002000:00010000:1.0:1734016092.838649:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 760 -> 872 00000100:00100000:1.0:1734016092.838732:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333324800:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 409us (4181us total) trans 4294969130 rc 0/0 00000100:00100000:1.0:1734016092.838739:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10048 00000100:00100000:0.0:1734016092.841647:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.849355:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016092.850202:0:7704:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271139ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016092.850208:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271139ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:0.0:1734016092.850321:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968564 00000004:00010000:0.0:1734016092.850386:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880073946300 reply state ffff880073914000 transno 4294968565 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271139ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016092.850394:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016092.851330:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:9668:x1818247333325056:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 9022us (9691us total) trans 4294968565 rc 0/0 00000100:00100000:0.0:1734016092.851338:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1955 00000020:00080000:0.0:1734016092.851352:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1734016092.858431:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271139ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016092.858442:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271139ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016092.858449:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271139ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016092.858459:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbdf80 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016092.858463:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271139ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016092.858470:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271139ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016092.858489:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016092.858492:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016092.858497:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271139ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016092.858502:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271139ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016092.860924:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.861008:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333325440 00000100:00100000:1.0:1734016092.861018:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333325440 00000100:00100000:1.0:1734016092.861063:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1956 00000100:00100000:1.0:1734016092.861072:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333325440:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016092.861094:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016092.861112:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc271139b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e43aa expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016092.861210:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271139bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016092.861224:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271139bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016092.861235:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271139bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:1.0:1734016092.861263:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 6875117 00000004:00200000:1.0:1734016092.861267:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016092.861285:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271139bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016092.861308:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc271139b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e43aa expref: 22 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016092.861327:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271139bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e43aa expref: 21 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016092.861340:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016092.861352:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016092.861355:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016092.861412:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+21:9668:x1818247333325440:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 340us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016092.861419:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1956 00000100:00100000:0.0:1734016092.864690:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.872911:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.878864:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.884501:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.888706:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.894178:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.895195:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333326336 00000100:00100000:1.0:1734016092.895208:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333326336 00002000:00100000:1.0:1734016092.895257:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3461120->3465215) req@ffff880075e50000 x1818247333326336/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:53/0 lens 488/0 e 0 to 0 dl 1734016103 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.895269:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50000 with x1818247333326336 ext(3461120->3465215) 00002000:00010000:1.0:1734016092.895275:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e50000 00000100:00100000:1.0:1734016092.895307:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7780 00000100:00100000:1.0:1734016092.895313:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333326336:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016092.895488:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333326336:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 174us (1314us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016092.895494:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7780 00002000:00100000:1.0:1734016092.895500:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3461120->3465215) req@ffff880075e50000 x1818247333326336/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:53/0 lens 488/4536 e 0 to 0 dl 1734016103 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.895506:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50000 with x1818247333326336 ext(3461120->3465215) 00002000:00010000:1.0:1734016092.895509:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e50000 00000100:00100000:0.0:1734016092.899016:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.901957:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.902042:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333326848 00000100:00100000:1.0:1734016092.902055:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333326848 00002000:00100000:1.0:1734016092.902104:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3452928->3457023) req@ffff880075e52680 x1818247333326848/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:53/0 lens 488/0 e 0 to 0 dl 1734016103 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.902115:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e52680 with x1818247333326848 ext(3452928->3457023) 00002000:00010000:1.0:1734016092.902122:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e52680 00000100:00100000:1.0:1734016092.902157:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7782 00000100:00100000:1.0:1734016092.902163:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333326848:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016092.902356:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333326848:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 191us (411us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016092.902364:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7782 00002000:00100000:1.0:1734016092.902370:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3452928->3457023) req@ffff880075e52680 x1818247333326848/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:53/0 lens 488/4536 e 0 to 0 dl 1734016103 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016092.902377:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e52680 with x1818247333326848 ext(3452928->3457023) 00002000:00010000:1.0:1734016092.902380:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e52680 00000100:00100000:0.0:1734016092.905235:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.908727:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.912874:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.916228:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.919356:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.919456:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333328128 00000100:00100000:0.0:1734016092.919467:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333328128 00002000:00100000:0.0:1734016092.919514:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3432448->3436543) req@ffff88013040a680 x1818247333328128/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:53/0 lens 488/0 e 0 to 0 dl 1734016103 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016092.919526:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88013040a680 with x1818247333328128 ext(3432448->3436543) 00002000:00010000:0.0:1734016092.919531:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013040a680 00000100:00100000:0.0:1734016092.919568:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7787 00000100:00100000:0.0:1734016092.919575:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333328128:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016092.919783:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333328128:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 207us (450us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016092.919791:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7787 00002000:00100000:0.0:1734016092.919797:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3432448->3436543) req@ffff88013040a680 x1818247333328128/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:53/0 lens 488/4536 e 0 to 0 dl 1734016103 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016092.919833:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88013040a680 with x1818247333328128 ext(3432448->3436543) 00002000:00010000:0.0:1734016092.919836:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013040a680 00000100:00100000:1.0:1734016092.923229:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.926623:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.929956:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.935006:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.938748:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.942641:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.945957:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.946033:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333329792 00000100:00100000:0.0:1734016092.946044:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333329792 00000100:00100000:0.0:1734016092.946090:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1957 00000100:00100000:0.0:1734016092.946097:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:9668:x1818247333329792:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016092.946127:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016092.946152:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc271139df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e43cd expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.946256:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc271139e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016092.946275:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc271139e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016092.946288:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc271139e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016092.946316:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 6875117 00000004:00200000:0.0:1734016092.946319:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016092.946335:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc271139e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016092.946368:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc271139df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e43cd expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.946401:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc271139e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e43cd expref: 20 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016092.946409:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016092.946412:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016092.946414:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:0.0:1734016092.946468:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:9668:x1818247333329792:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 371us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016092.946473:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1957 00000100:00100000:1.0:1734016092.948993:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.952762:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016092.967871:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.975531:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.975565:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.975591:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333330688 00000100:00100000:0.0:1734016092.975601:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333330688 00010000:00010000:0.0:1734016092.975637:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271139d8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3461120->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e43c6 expref: 8 pid: 7684 timeout: 460 lvb_type: 0 00000100:00100000:0.0:1734016092.975667:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333330560 00000100:00100000:0.0:1734016092.975669:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333330560 00010000:00010000:0.0:1734016092.975678:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271139ed lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e43d4 expref: 8 pid: 7684 timeout: 460 lvb_type: 1 00000100:00100000:0.0:1734016092.975693:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2668 00000100:00100000:0.0:1734016092.975699:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333330688:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016092.975712:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016092.975735:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271139d8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3461120->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e43c6 expref: 8 pid: 7684 timeout: 460 lvb_type: 0 00010000:00010000:0.0:1734016092.975745:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271139d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3461120->3465215) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e43c6 expref: 8 pid: 7684 timeout: 460 lvb_type: 0 00010000:00010000:0.0:1734016092.975772:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016092.977288:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333330688:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1587us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016092.977296:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2668 00000001:00080000:0.0:1734016092.984719:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969132 is committed 00000001:00080000:0.0:1734016092.984736:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969131 is committed 00000100:00100000:1.0:1734016092.988855:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016092.994414:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.004747:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016093.006354:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016063 00002000:00010000:0.0:1734016093.013775:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 952 -> 1032 00010000:00010000:0.0:1734016093.013793:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27113a09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2379776->2420735] (req 2379776->2420735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016093.013900:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27113a09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2379776->2420735] (req 2379776->2420735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016093.013908:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27113a09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2379776->2420735] (req 2379776->2420735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016093.013915:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df7180 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016093.013919:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27113a09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2379776->2420735] (req 2379776->2420735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016093.013928:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27113a09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2379776->2420735] (req 2379776->2420735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016093.013948:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27113a09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2379776->2420735] (req 2379776->2420735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016093.013954:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27113a09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2379776->2420735] (req 2379776->2420735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016093.014074:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333331072:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 19399us (19666us total) trans 4294969133 rc 0/0 00000100:00100000:0.0:1734016093.014086:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7796 00000100:00100000:1.0:1734016093.021772:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.029092:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.034883:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.081653:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.081710:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016093.081796:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333331840 00000100:00100000:1.0:1734016093.081821:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333331840 00002000:00100000:1.0:1734016093.081866:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff88007493ad80 x1818247333331840/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:54/0 lens 488/0 e 0 to 0 dl 1734016104 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.081882:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007493ad80 with x1818247333331840 ext(0->4194303) 00002000:00010000:1.0:1734016093.081888:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007493ad80 00000100:00100000:1.0:1734016093.081904:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333332096 00000100:00100000:1.0:1734016093.081905:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333332096 00002000:00100000:1.0:1734016093.081913:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (4194304->6877183) req@ffff880074939880 x1818247333332096/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:54/0 lens 488/0 e 0 to 0 dl 1734016104 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.081919:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074939880 with x1818247333332096 ext(4194304->6877183) 00002000:00010000:1.0:1734016093.081921:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074939880 00000100:00100000:1.0:1734016093.081945:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7797 00000100:00100000:1.0:1734016093.081951:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333331840:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016093.175646:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333331840:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 93678us (93988us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016093.175663:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7797 00002000:00100000:1.0:1734016093.175678:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff88007493ad80 x1818247333331840/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:54/0 lens 488/440 e 0 to 0 dl 1734016104 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.175689:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007493ad80 with x1818247333331840 ext(0->4194303) 00002000:00010000:1.0:1734016093.175696:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007493ad80 00000100:00100000:0.0:1734016093.185677:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016093.185876:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333332224 00000100:00100000:1.0:1734016093.185890:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333332224 00002000:00100000:1.0:1734016093.185941:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (53248->102399) req@ffff880074939500 x1818247333332224/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:54/0 lens 488/0 e 0 to 0 dl 1734016104 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.185953:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074939500 with x1818247333332224 ext(53248->102399) 00002000:00010000:1.0:1734016093.185960:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074939500 00000100:00100000:1.0:1734016093.186003:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7799 00000100:00100000:1.0:1734016093.186011:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333332224:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016093.190623:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333332224:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4596us (4942us total) trans 4294969136 rc 0/0 00000100:00100000:1.0:1734016093.190637:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7799 00002000:00100000:1.0:1734016093.190652:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (53248->102399) req@ffff880074939500 x1818247333332224/t4294969136(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:54/0 lens 488/448 e 0 to 0 dl 1734016104 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.190663:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074939500 with x1818247333332224 ext(53248->102399) 00002000:00010000:1.0:1734016093.190669:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074939500 00000100:00100000:0.0:1734016093.193073:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333332352 00000100:00100000:0.0:1734016093.193084:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333332352 00000100:00100000:0.0:1734016093.193145:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10057 00000100:00100000:0.0:1734016093.193153:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333332352:12345-192.168.201.16@tcp:16:fsx.0 00000100:00100000:0.0:1734016093.195018:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333332352:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 1863us (2314us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016093.195028:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10057 00000100:00100000:0.0:1734016093.197373:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.202188:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333332608 00000100:00100000:0.0:1734016093.202198:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333332608 00000100:00100000:0.0:1734016093.202531:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10059 00000100:00100000:0.0:1734016093.202540:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333332608:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016093.202559:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016093.202579:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113a25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e43f7 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016093.202646:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335173248:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016093.202708:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eea80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016093.208743:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333332736 00000100:00100000:0.0:1734016093.208752:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333332736 00000100:00100000:0.0:1734016093.210594:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335173376:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016093.210627:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27113a2c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e43fe expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016093.210637:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27113a2c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e43fe expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016093.210739:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7a80, rc 0) 00000100:00100000:0.0:1734016093.211049:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333332736:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2022us (2473us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016093.211057:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10060 00000100:00100000:0.0:1734016093.213881:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.217070:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335173504:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016093.217113:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27113a33 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4405 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016093.217127:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27113a33 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4405 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016093.217139:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:0.0:1734016093.217189:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333332864:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2815us (3321us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016093.217197:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10061 00000100:00100000:0.0:1734016093.219135:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.230645:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333333120 00000100:00100000:0.0:1734016093.230657:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333333120 00010000:00010000:0.0:1734016093.230686:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113a17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->102399) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e43e9 expref: 7 pid: 7682 timeout: 460 lvb_type: 0 00000100:00100000:0.0:1734016093.230720:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2672 00000100:00100000:0.0:1734016093.230725:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5227450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333333120:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016093.230744:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016093.230766:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113a17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 98304->102399) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e43e9 expref: 7 pid: 7682 timeout: 460 lvb_type: 0 00010000:00010000:0.0:1734016093.230777:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113a17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 98304->102399) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e43e9 expref: 7 pid: 7682 timeout: 460 lvb_type: 0 00010000:00010000:0.0:1734016093.230916:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113a17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 98304->102399) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e43e9 expref: 7 pid: 7682 timeout: 460 lvb_type: 0 00010000:00010000:0.0:1734016093.230944:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016093.230947:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016093.230955:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27113a3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3219456->3276799) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e440c expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016093.230963:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27113a3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3219456->3276799) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e440c expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016093.230995:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27113a3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3219456->3276799) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e440c expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016093.231009:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335173760:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016093.231051:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016093.233923:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.237096:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.248123:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016093.248262:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333333760 00000100:00100000:1.0:1734016093.248273:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333333760 00002000:00100000:1.0:1734016093.248318:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5623808->6877183) req@ffff880074938e00 x1818247333333760/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:54/0 lens 504/0 e 0 to 0 dl 1734016104 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.248328:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074938e00 with x1818247333333760 ext(5623808->6877183) 00002000:00010000:1.0:1734016093.248346:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074938e00 00000100:00100000:1.0:1734016093.248380:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7800 00000100:00100000:1.0:1734016093.248388:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333333760:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016093.254895:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333333760:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 6492us (6772us total) trans 0 rc 499712/499712 00000100:00100000:1.0:1734016093.254909:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7800 00002000:00100000:1.0:1734016093.254924:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5623808->6877183) req@ffff880074938e00 x1818247333333760/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:54/0 lens 504/440 e 0 to 0 dl 1734016104 ref 1 fl Complete:/200/0 rc 499712/499712 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.254932:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074938e00 with x1818247333333760 ext(5623808->6877183) 00002000:00010000:1.0:1734016093.254938:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074938e00 00000100:00100000:0.0:1734016093.258222:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016093.258347:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333334016 00000100:00100000:1.0:1734016093.258358:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333334016 00002000:00100000:1.0:1734016093.258407:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5619712->5623807) req@ffff880074938380 x1818247333334016/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:54/0 lens 488/0 e 0 to 0 dl 1734016104 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.258418:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074938380 with x1818247333334016 ext(5619712->5623807) 00002000:00010000:1.0:1734016093.258424:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074938380 00000100:00100000:1.0:1734016093.258624:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7801 00000100:00100000:1.0:1734016093.258632:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333334016:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016093.259244:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333334016:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 611us (1034us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016093.259252:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7801 00002000:00100000:1.0:1734016093.259258:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5619712->5623807) req@ffff880074938380 x1818247333334016/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:54/0 lens 488/4536 e 0 to 0 dl 1734016104 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.259265:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074938380 with x1818247333334016 ext(5619712->5623807) 00002000:00010000:1.0:1734016093.259268:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074938380 00000100:00100000:0.0:1734016093.262586:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016093.262965:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333334272 00000100:00100000:1.0:1734016093.262978:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333334272 00002000:00100000:1.0:1734016093.263030:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5615616->5619711) req@ffff88007493aa00 x1818247333334272/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:54/0 lens 488/0 e 0 to 0 dl 1734016104 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.263041:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007493aa00 with x1818247333334272 ext(5615616->5619711) 00002000:00010000:1.0:1734016093.263047:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007493aa00 00000100:00100000:1.0:1734016093.263638:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7802 00000100:00100000:1.0:1734016093.263648:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333334272:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016093.263973:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333334272:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 325us (1398us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016093.263983:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7802 00002000:00100000:1.0:1734016093.263991:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5615616->5619711) req@ffff88007493aa00 x1818247333334272/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:54/0 lens 488/4536 e 0 to 0 dl 1734016104 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.263999:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007493aa00 with x1818247333334272 ext(5615616->5619711) 00002000:00010000:1.0:1734016093.264002:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007493aa00 00000100:00100000:1.0:1734016093.268941:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7803 00000100:00100000:1.0:1734016093.268950:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333334528:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016093.269519:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333334528:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 568us (1249us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016093.269526:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7803 00002000:00100000:1.0:1734016093.269533:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5611520->5615615) req@ffff88012e719500 x1818247333334528/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:54/0 lens 488/4536 e 0 to 0 dl 1734016104 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.269540:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e719500 with x1818247333334528 ext(5611520->5615615) 00002000:00010000:1.0:1734016093.269543:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e719500 00000100:00100000:0.0:1734016093.276137:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016093.276332:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333334784 00000100:00100000:1.0:1734016093.276351:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333334784 00002000:00100000:1.0:1734016093.276399:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5607424->5611519) req@ffff88007493b800 x1818247333334784/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:54/0 lens 488/0 e 0 to 0 dl 1734016104 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.276409:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007493b800 with x1818247333334784 ext(5607424->5611519) 00002000:00010000:1.0:1734016093.276415:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007493b800 00000100:00100000:1.0:1734016093.276452:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7804 00000100:00100000:1.0:1734016093.276458:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333334784:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016093.276652:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333334784:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 193us (530us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016093.276661:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7804 00002000:00100000:1.0:1734016093.276668:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5607424->5611519) req@ffff88007493b800 x1818247333334784/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:54/0 lens 488/4536 e 0 to 0 dl 1734016104 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.276676:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007493b800 with x1818247333334784 ext(5607424->5611519) 00002000:00010000:1.0:1734016093.276679:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007493b800 00000100:00100000:0.0:1734016093.286341:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.298751:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.306073:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.309471:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016093.313151:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333336064 00000100:00100000:1.0:1734016093.313168:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333336064 00002000:00100000:1.0:1734016093.313223:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5586944->5591039) req@ffff880075140380 x1818247333336064/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:54/0 lens 488/0 e 0 to 0 dl 1734016104 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.313234:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075140380 with x1818247333336064 ext(5586944->5591039) 00002000:00010000:1.0:1734016093.313239:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075140380 00000100:00100000:1.0:1734016093.313278:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7809 00000100:00100000:1.0:1734016093.313285:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333336064:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016093.313478:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333336064:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 192us (4015us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016093.313486:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7809 00002000:00100000:1.0:1734016093.313492:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5586944->5591039) req@ffff880075140380 x1818247333336064/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:54/0 lens 488/4536 e 0 to 0 dl 1734016104 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.313499:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075140380 with x1818247333336064 ext(5586944->5591039) 00002000:00010000:1.0:1734016093.313501:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075140380 00000100:00100000:0.0:1734016093.324037:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.332686:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016093.344050:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333337088 00000100:00100000:1.0:1734016093.344063:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333337088 00002000:00100000:1.0:1734016093.344134:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5570560->5574655) req@ffff88012e718e00 x1818247333337088/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:54/0 lens 488/0 e 0 to 0 dl 1734016104 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.344153:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e718e00 with x1818247333337088 ext(5570560->5574655) 00002000:00010000:1.0:1734016093.344160:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e718e00 00000100:00100000:1.0:1734016093.344195:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7813 00000100:00100000:1.0:1734016093.344203:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333337088:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016093.344485:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333337088:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 279us (737us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016093.344496:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7813 00002000:00100000:1.0:1734016093.344502:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5570560->5574655) req@ffff88012e718e00 x1818247333337088/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:54/0 lens 488/4536 e 0 to 0 dl 1734016104 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.344510:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e718e00 with x1818247333337088 ext(5570560->5574655) 00002000:00010000:1.0:1734016093.344513:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e718e00 00000100:00100000:0.0:1734016093.348194:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.356187:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.370015:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.397062:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.405481:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.414343:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.428880:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.443011:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016093.452788:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.466876:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016093.478069:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.487965:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.496081:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.503279:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016093.503469:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333339136 00000100:00100000:1.0:1734016093.503479:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333339136 00002000:00100000:1.0:1734016093.503527:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2211840->2215935) req@ffff8800a78cc700 x1818247333339136/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:54/0 lens 4584/0 e 0 to 0 dl 1734016104 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.503538:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cc700 with x1818247333339136 ext(2211840->2215935) 00002000:00010000:1.0:1734016093.503544:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cc700 00000100:00100000:1.0:1734016093.503576:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7816 00000100:00100000:1.0:1734016093.503583:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333339136:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016093.505291:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333339136:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1696us (2010us total) trans 4294969141 rc 0/0 00000100:00100000:1.0:1734016093.505305:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7816 00002000:00100000:1.0:1734016093.505316:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2211840->2215935) req@ffff8800a78cc700 x1818247333339136/t4294969141(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:54/0 lens 4584/448 e 0 to 0 dl 1734016104 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016093.505324:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cc700 with x1818247333339136 ext(2211840->2215935) 00002000:00010000:1.0:1734016093.505328:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cc700 00000100:00100000:1.0:1734016093.508198:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016093.509211:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016063 00000100:00100000:0.0:1734016093.512426:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.525242:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016093.537420:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.546682:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016093.547648:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333340032 00000100:00100000:1.0:1734016093.547665:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333340032 00000100:00100000:1.0:1734016093.549384:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7817 00000100:00100000:1.0:1734016093.549404:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333340032:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:1.0:1734016093.549472:0:7687:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113a8e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.549501:0:7687:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27113a79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->2215935) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4444 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.549508:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016093.549510:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016093.549513:0:7687:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113a8e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1826816->1888255] (req 1826816->1888255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.549549:0:7687:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27113a79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->2215935) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4444 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.549565:0:7687:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27113a79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->2215935) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4444 expref: 7 pid: 7682 timeout: 460 lvb_type: 0 00000100:00100000:1.0:1734016093.549581:0:7687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335175424:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016093.550685:0:7687:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016093.566222:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016093.567060:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27113a79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->2215935) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4444 expref: 7 pid: 7682 timeout: 460 lvb_type: 0 00000100:00100000:1.0:1734016093.567093:0:7687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335175424:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016093.567121:0:7687:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113a8e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1826816->1888255] (req 1826816->1888255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.567132:0:7687:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113a8e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1826816->1888255] (req 1826816->1888255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.567138:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113a8e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1826816->1888255] (req 1826816->1888255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.570143:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113a8e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1826816->1888255] (req 1826816->1888255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.570161:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113a8e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1826816->1888255] (req 1826816->1888255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.570168:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113a8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1826816->1888255] (req 1826816->1888255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.570175:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499db00 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016093.570180:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113a8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1826816->1888255] (req 1826816->1888255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.570191:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113a8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1826816->1888255] (req 1826816->1888255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.570211:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113a8e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1826816->1888255] (req 1826816->1888255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.570216:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113a8e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1826816->1888255] (req 1826816->1888255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016093.570310:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333340032:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 20904us (23640us total) trans 0 rc 61440/61440 00000100:00100000:1.0:1734016093.570322:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7817 00000100:00100000:0.0:1734016093.574194:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.583266:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.589581:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016093.592628:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27113a9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016093.592640:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27113a9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016093.592645:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27113a9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016093.592650:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcb40 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016093.592653:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27113a9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016093.592659:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27113a9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016093.592672:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016093.592674:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016093.592678:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27113a9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016093.592682:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27113a9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016093.593216:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016093.593274:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333340800 00000100:00100000:1.0:1734016093.593282:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333340800 00000100:00100000:1.0:1734016093.593325:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10079 00000100:00100000:1.0:1734016093.593341:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333340800:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016093.593357:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016093.593369:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27113aa3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4460 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.593392:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27113a95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4459 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016093.593398:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016093.593400:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016093.593403:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27113aa3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4460 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.593432:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27113a95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4459 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016093.593442:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27113a95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4459 expref: 6 pid: 7682 timeout: 460 lvb_type: 1 00000100:00100000:1.0:1734016093.593454:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335175680:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016093.593511:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016093.599094:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335175680:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016093.599129:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27113aa3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4460 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.599147:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d8c0, rc 0) 00000100:00100000:1.0:1734016093.599198:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333340800:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5854us (5984us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016093.599209:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10079 00000100:00100000:0.0:1734016093.605494:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016093.642701:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333341056 00000100:00100000:1.0:1734016093.642714:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333341056 00002000:00010000:1.0:1734016093.642749:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (8100218->18446744073709551615) 00002000:00100000:1.0:1734016093.642754:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71b100 with x1818247333341056 ext(8100218->18446744073709551615) 00002000:00010000:1.0:1734016093.642764:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e71b100. 00000100:00100000:1.0:1734016093.642823:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7818 00000100:00100000:1.0:1734016093.642830:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333341056:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016093.643019:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 6875117 -> 8100218 00002000:00010000:1.0:1734016093.643022:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016094 -> 1734016094 00002000:00010000:1.0:1734016093.643024:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016093 -> 1734016093 00002000:00010000:1.0:1734016093.643026:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016094 -> 1734016094 00002000:00010000:1.0:1734016093.643028:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1136 -> 1136 00000100:00100000:1.0:1734016093.643097:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333341056:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 266us (2180us total) trans 4294969143 rc 0/0 00000100:00100000:1.0:1734016093.643104:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7818 00002000:00010000:1.0:1734016093.643108:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (8100218->18446744073709551615) 00002000:00100000:1.0:1734016093.643110:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71b100 with x1818247333341056 ext(8100218->18446744073709551615) 00002000:00010000:1.0:1734016093.643113:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e71b100. 00000100:00100000:0.0:1734016093.648134:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.694989:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.704071:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333341440:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 8864us (9079us total) trans 4294969144 rc 0/0 00000100:00100000:0.0:1734016093.704083:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7820 00002000:00100000:0.0:1734016093.704095:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8060928->8100217) req@ffff88007bd2b800 x1818247333341440/t4294969144(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:54/0 lens 488/448 e 0 to 0 dl 1734016104 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016093.704107:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd2b800 with x1818247333341440 ext(8060928->8100217) 00002000:00010000:0.0:1734016093.704113:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd2b800 00000100:00100000:1.0:1734016093.719932:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333341696 00000100:00100000:1.0:1734016093.719945:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333341696 00000100:00100000:1.0:1734016093.719999:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10080 00000100:00100000:1.0:1734016093.720006:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333341696:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016093.732897:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969144 is committed 00000001:00080000:0.0:1734016093.732919:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969142 is committed 00000100:00100000:1.0:1734016093.733132:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333341696:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 13119us (14895us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016093.733143:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10080 00000100:00100000:0.0:1734016093.744617:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016093.744746:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333341824 00000100:00100000:1.0:1734016093.744757:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333341824 00000100:00100000:1.0:1734016093.744851:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1961 00000100:00100000:1.0:1734016093.744859:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:9668:x1818247333341824:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016093.744879:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016093.744897:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d680/0x5e3a3adc27113aaa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4467 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.744987:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27113ab1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016093.745001:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27113ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016093.745013:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27113ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:1.0:1734016093.745045:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 8100218 00000004:00200000:1.0:1734016093.745050:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016093.745068:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27113ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016093.745091:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d680/0x5e3a3adc27113aaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4467 expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.745130:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27113ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4467 expref: 20 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.745139:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016093.745142:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016093.745146:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016093.745200:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:9668:x1818247333341824:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 341us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016093.745209:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1961 00000100:00100000:1.0:1734016093.764451:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333341952 00000100:00100000:1.0:1734016093.764459:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333341952 00000100:00100000:1.0:1734016093.764512:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10081 00000100:00100000:1.0:1734016093.764519:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333341952:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016093.764538:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016093.764553:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27113ab8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e446e expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016093.764606:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335175936:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016093.764672:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016093.778954:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016093.805558:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.805655:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333342336 00000100:00100000:0.0:1734016093.805672:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333342336 00000100:00100000:0.0:1734016093.805774:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7821 00000100:00100000:0.0:1734016093.805782:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333342336:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:0.0:1734016093.805870:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113ac6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016093.805892:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27113aa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4460 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016093.805899:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016093.805901:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016093.805904:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113ac6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4546560->4591615] (req 4546560->4591615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016093.805943:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27113aa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4460 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016093.805958:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27113aa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4460 expref: 7 pid: 7684 timeout: 460 lvb_type: 0 00000100:00100000:0.0:1734016093.805979:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335176192:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016093.807437:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eec00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016093.818724:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016093.819281:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27113aa3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4460 expref: 7 pid: 7684 timeout: 460 lvb_type: 0 00000100:00100000:1.0:1734016093.819310:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335176192:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016093.819344:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113ac6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4546560->4591615] (req 4546560->4591615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.819354:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113ac6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4546560->4591615] (req 4546560->4591615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.819360:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113ac6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4546560->4591615] (req 4546560->4591615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.901191:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113ac6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4546560->4591615] (req 4546560->4591615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.901209:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113ac6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4546560->4591615] (req 4546560->4591615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.901217:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113ac6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4546560->4591615] (req 4546560->4591615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.901226:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581200 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016093.901230:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113ac6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4546560->4591615] (req 4546560->4591615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.901237:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113ac6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4546560->4591615] (req 4546560->4591615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.901257:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113ac6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4546560->4591615] (req 4546560->4591615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016093.901264:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113ac6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4546560->4591615] (req 4546560->4591615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016093.901421:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333342336:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 95631us (95864us total) trans 0 rc 45056/45056 00000100:00100000:1.0:1734016093.901433:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7821 00000100:00100000:0.0:1734016093.930681:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.936578:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.989429:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016093.989491:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016094.112940:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016094.114718:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016064 00000100:00100000:0.0:1734016094.133146:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016094.152594:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969145 is committed 00000100:00100000:0.0:1734016094.164627:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016094.171349:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016094.174795:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016094.179480:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969146 is committed 00000100:00100000:1.0:1734016094.183763:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016094.189899:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016094.200130:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016094.204526:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016094.211944:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016094.224238:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e607800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335176832:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016094.224282:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27113b05 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e449f expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.224298:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27113b05 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e449f expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.224313:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:0.0:1734016094.224371:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88009024f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333344768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6519us (12438us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016094.224384:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10088 00000100:00100000:1.0:1734016094.229778:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016094.230195:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333344896 00000100:00100000:0.0:1734016094.230205:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333344896 00000100:00100000:0.0:1734016094.230329:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10089 00000100:00100000:0.0:1734016094.230336:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333344896:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016094.230358:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016094.230378:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27113b0c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e44a6 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.230408:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27113afe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2047999) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4498 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.230414:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016094.230416:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016094.230419:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27113b0c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5767168->5787647] (req 5767168->5787647) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44a6 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.230448:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27113afe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2047999) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4498 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.230457:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27113afe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2047999) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4498 expref: 6 pid: 7682 timeout: 461 lvb_type: 0 00000100:00100000:0.0:1734016094.230468:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335176960:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016094.231843:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eef00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016094.235195:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335176960:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016094.235227:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27113b0c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5767168->5787647] (req 5767168->5787647) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44a6 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016094.235249:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582f40, rc 0) 00000100:00100000:1.0:1734016094.235368:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333344896:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5030us (5604us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016094.235377:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10089 00000100:00100000:1.0:1734016094.248960:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333345152 00000100:00100000:1.0:1734016094.248967:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333345152 00000100:00100000:1.0:1734016094.249007:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10090 00000100:00100000:1.0:1734016094.249012:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333345152:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016094.249182:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9355264 -> 9355264 00002000:00010000:1.0:1734016094.249185:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016094 -> 1734016094 00002000:00010000:1.0:1734016094.249187:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016094 -> 1734016094 00002000:00010000:1.0:1734016094.249189:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016094 -> 1734016094 00002000:00010000:1.0:1734016094.249190:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1376 -> 1416 00000100:00100000:1.0:1734016094.249211:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333345152:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 198us (684us total) trans 4294969148 rc 0/0 00000100:00100000:1.0:1734016094.249215:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10090 00000100:00100000:0.0:1734016094.266903:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333345280 00000100:00100000:0.0:1734016094.266922:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333345280 00000100:00100000:0.0:1734016094.266984:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10091 00000100:00100000:0.0:1734016094.266991:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333345280:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016094.267266:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9355264 -> 9355264 00002000:00010000:0.0:1734016094.267269:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016094 -> 1734016094 00002000:00010000:0.0:1734016094.267271:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016094 -> 1734016094 00002000:00010000:0.0:1734016094.267274:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016094 -> 1734016094 00002000:00010000:0.0:1734016094.267276:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1416 -> 1416 00000100:00100000:0.0:1734016094.267387:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333345280:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 395us (4445us total) trans 4294969149 rc 0/0 00000100:00100000:0.0:1734016094.267395:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10091 00000100:00100000:0.0:1734016094.287774:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016094.297338:0:7687:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27113b13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.297347:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27113b13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016094.305613:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1416 -> 1424 00010000:00010000:0.0:1734016094.305632:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27113b13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.305643:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27113b13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.305651:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27113b13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.305662:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df7cc0 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016094.305666:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27113b13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.305674:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27113b13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.305694:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27113b13 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.305700:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27113b13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016094.311176:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333345536:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 37044us (37231us total) trans 4294969150 rc 0/0 00000100:00100000:0.0:1734016094.311194:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7826 00000100:00100000:0.0:1734016094.320492:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016094.332084:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333345792 00000100:00100000:1.0:1734016094.332099:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333345792 00000100:00100000:1.0:1734016094.332153:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10092 00000100:00100000:1.0:1734016094.332161:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333345792:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016094.332181:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016094.332202:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27113b1a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e44ad expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016094.332224:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 9355264, mtime: 0x675afc5e, atime: 0x675afc5e, ctime: 0x675afc5e, blocks: 0x590 00010000:00010000:1.0:1734016094.332243:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016094.332245:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016094.332253:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27113b1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44ad expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016094.332265:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27113b1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44ad expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016094.332276:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f180, rc 0) 00000100:00100000:1.0:1734016094.332363:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333345792:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 201us (11879us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016094.332369:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10092 00000100:00100000:0.0:1734016094.348782:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333345920 00000100:00100000:0.0:1734016094.348791:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333345920 00000100:00100000:1.0:1734016094.349476:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10093 00000100:00100000:1.0:1734016094.349484:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333345920:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016094.349503:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016094.349518:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27113b21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e44b4 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016094.349537:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016094.349539:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016094.349545:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27113b21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44b4 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016094.349557:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27113b21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44b4 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016094.349566:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016094.349618:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333345920:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 135us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016094.349624:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10093 00000100:00100000:1.0:1734016094.370159:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333346176 00000100:00100000:1.0:1734016094.370167:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333346176 00002000:00100000:1.0:1734016094.370208:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff8800750c2a00 x1818247333346176/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:55/0 lens 488/0 e 0 to 0 dl 1734016105 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016094.370217:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c2a00 with x1818247333346176 ext(0->4194303) 00002000:00010000:1.0:1734016094.370222:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c2a00 00000100:00100000:1.0:1734016094.370249:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333346432 00000100:00100000:1.0:1734016094.370251:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333346432 00002000:00100000:1.0:1734016094.370261:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (4194304->8388607) req@ffff8800750c1c00 x1818247333346432/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:55/0 lens 488/0 e 0 to 0 dl 1734016105 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016094.370266:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c1c00 with x1818247333346432 ext(4194304->8388607) 00002000:00010000:1.0:1734016094.370268:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c1c00 00000100:00100000:1.0:1734016094.370284:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333346560 00000100:00100000:1.0:1734016094.370286:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333346560 00002000:00100000:1.0:1734016094.370296:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8388608->9355263) req@ffff8800750c1880 x1818247333346560/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:55/0 lens 488/0 e 0 to 0 dl 1734016105 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016094.370303:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c1880 with x1818247333346560 ext(8388608->9355263) 00002000:00010000:1.0:1734016094.370305:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c1880 00000100:00100000:1.0:1734016094.370313:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7827 00000100:00100000:1.0:1734016094.370326:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333346176:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016094.426066:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333346560:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 49529us (55984us total) trans 0 rc 966656/966656 00000100:00100000:0.0:1734016094.426076:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7829 00002000:00100000:0.0:1734016094.426086:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (8388608->9355263) req@ffff8800750c1880 x1818247333346560/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:55/0 lens 488/440 e 0 to 0 dl 1734016105 ref 1 fl Complete:/200/0 rc 966656/966656 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016094.426095:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c1880 with x1818247333346560 ext(8388608->9355263) 00002000:00010000:0.0:1734016094.426101:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c1880 00000100:00100000:0.0:1734016094.457921:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333346432:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 84504us (87877us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1734016094.457932:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7828 00002000:00100000:0.0:1734016094.457946:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (4194304->8388607) req@ffff8800750c1c00 x1818247333346432/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:55/0 lens 488/440 e 0 to 0 dl 1734016105 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016094.457956:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c1c00 with x1818247333346432 ext(4194304->8388607) 00002000:00010000:0.0:1734016094.457963:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c1c00 00000100:00100000:0.0:1734016094.491056:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333346816 00000100:00100000:0.0:1734016094.491065:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333346816 00000100:00100000:0.0:1734016094.491162:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10094 00000100:00100000:0.0:1734016094.491169:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333346816:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016094.491185:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016094.491201:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27113b28 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e44bb expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.491228:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27113b1a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44ad expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.491235:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27113b21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44b4 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.491240:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016094.491241:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016094.491245:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27113b28 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2957312->2990079] (req 2957312->2990079) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44bb expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.491273:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27113b21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44b4 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.491284:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27113b21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44b4 expref: 7 pid: 7682 timeout: 461 lvb_type: 1 00000100:00100000:0.0:1734016094.491296:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335177344:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016094.491366:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27113b1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44ad expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.491374:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27113b1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44ad expref: 6 pid: 7684 timeout: 461 lvb_type: 1 00000100:00100000:0.0:1734016094.491381:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335177472:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016094.491394:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee780 going to sleep for 11 seconds 00000100:00100000:0.0:1734016094.494632:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335177344:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016094.499924:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335177472:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016094.499952:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27113b28 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2957312->2990079] (req 2957312->2990079) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44bb expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.499966:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581d40, rc 0) 00000100:00100000:0.0:1734016094.500006:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333346816:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8836us (9381us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016094.500014:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10094 00000100:00100000:0.0:1734016094.501160:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333346944 00000100:00100000:0.0:1734016094.501166:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333346944 00010000:00010000:0.0:1734016094.501187:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27113b1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44ad expref: 7 pid: 7684 timeout: 461 lvb_type: 1 00000100:00100000:0.0:1734016094.501252:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2685 00000100:00100000:0.0:1734016094.501257:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333346944:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016094.501267:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016094.501287:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27113b1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44ad expref: 7 pid: 7684 timeout: 461 lvb_type: 1 00010000:00010000:0.0:1734016094.501294:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27113b1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44ad expref: 7 pid: 7684 timeout: 461 lvb_type: 1 00010000:00010000:0.0:1734016094.501310:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27113b1a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44ad expref: 7 pid: 7684 timeout: 461 lvb_type: 1 00010000:00010000:0.0:1734016094.501341:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016094.501766:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333346944:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 507us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016094.501772:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2685 00000100:00100000:0.0:1734016094.512564:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333347072 00000100:00100000:0.0:1734016094.512572:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333347072 00010000:00010000:0.0:1734016094.512600:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27113b21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44b4 expref: 7 pid: 7682 timeout: 461 lvb_type: 1 00000100:00100000:0.0:1734016094.512637:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2686 00000100:00100000:0.0:1734016094.512643:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333347072:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016094.512656:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016094.512674:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27113b21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44b4 expref: 7 pid: 7682 timeout: 461 lvb_type: 1 00010000:00010000:0.0:1734016094.512684:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27113b21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44b4 expref: 7 pid: 7682 timeout: 461 lvb_type: 1 00010000:00010000:0.0:1734016094.512703:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27113b21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44b4 expref: 7 pid: 7682 timeout: 461 lvb_type: 1 00010000:00010000:0.0:1734016094.512728:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016094.512730:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016094.512735:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27113b28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->2990079) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44bb expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.512742:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27113b28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->2990079) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44bb expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.512773:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27113b28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->2990079) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44bb expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016094.512785:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335177600:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016094.512871:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee780 going to sleep for 11 seconds 00000100:00100000:0.0:1734016094.517414:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335177600:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016094.517439:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016094.517496:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333347072:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4851us (4998us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016094.517506:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2686 00000100:00100000:0.0:1734016094.517752:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333347200 00000100:00100000:0.0:1734016094.517758:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333347200 00000100:00100000:0.0:1734016094.517793:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10095 00000100:00100000:0.0:1734016094.517797:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333347200:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016094.518150:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9355264 -> 9355264 00002000:00010000:0.0:1734016094.518153:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016094 -> 1734016094 00002000:00010000:0.0:1734016094.518155:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016094 -> 1734016094 00002000:00010000:0.0:1734016094.518157:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016094 -> 1734016094 00002000:00010000:0.0:1734016094.518158:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1424 -> 1376 00000100:00100000:0.0:1734016094.518187:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333347200:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 389us (541us total) trans 4294969151 rc 0/0 00000100:00100000:0.0:1734016094.518193:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10095 00000100:00100000:1.0:1734016094.530708:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333347328 00000100:00100000:1.0:1734016094.530719:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333347328 00000100:00100000:1.0:1734016094.530791:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10096 00000100:00100000:1.0:1734016094.530822:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333347328:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016094.530843:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016094.530862:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27113b2f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e44c2 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016094.530922:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335177728:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016094.531143:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f480 going to sleep for 11 seconds 00002000:00010000:1.0:1734016094.537834:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016094 -> 1734016095 00000100:00100000:1.0:1734016094.537863:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335177728:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016094.537900:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27113b2f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44c2 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016094.537914:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27113b2f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44c2 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016094.537945:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016094.537999:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333347328:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7199us (7432us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016094.538007:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10096 00000100:00100000:1.0:1734016094.542742:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333347456 00000100:00100000:1.0:1734016094.542753:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333347456 00000100:00100000:1.0:1734016094.542819:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10097 00000100:00100000:1.0:1734016094.542826:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333347456:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016094.542848:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016094.542867:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27113b36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e44c9 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016094.542936:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335177856:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016094.543016:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f480 going to sleep for 11 seconds 00000100:00100000:1.0:1734016094.545765:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335177856:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016094.545835:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27113b36 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44c9 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016094.545849:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27113b36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44c9 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016094.545874:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:0.0:1734016094.546001:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333347456:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3172us (3557us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016094.546011:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10097 00000100:00100000:0.0:1734016094.556210:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333347584 00000100:00100000:0.0:1734016094.556217:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333347584 00000100:00100000:0.0:1734016094.556255:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10098 00000100:00100000:0.0:1734016094.556260:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333347584:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016094.556275:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016094.556289:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27113b3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e44d0 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016094.556344:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335177984:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016094.556403:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016094.559013:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335177984:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016094.559046:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27113b3d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44d0 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.559058:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27113b3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44d0 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.559084:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580900, rc 0) 00000100:00100000:0.0:1734016094.559135:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333347584:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2874us (2993us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016094.559142:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10098 00000100:00100000:0.0:1734016094.572930:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333347712 00000100:00100000:0.0:1734016094.572942:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333347712 00000100:00100000:0.0:1734016094.573001:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10099 00000100:00100000:0.0:1734016094.573009:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333347712:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016094.573027:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016094.573046:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27113b44 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e44d7 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.573076:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27113b28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->2990079) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44bb expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.573083:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016094.573084:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016094.573087:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27113b44 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3858432->3928063] (req 3858432->3928063) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44d7 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.573121:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27113b28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->2990079) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44bb expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.573131:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27113b28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->2990079) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44bb expref: 6 pid: 7684 timeout: 461 lvb_type: 0 00000100:00100000:0.0:1734016094.573148:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335178112:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016094.573219:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016094.579441:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335178112:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016094.579469:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27113b44 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3858432->3928063] (req 3858432->3928063) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44d7 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.579486:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580900, rc 0) 00000100:00100000:0.0:1734016094.579544:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333347712:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6535us (6757us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016094.579552:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10099 00000100:00100000:1.0:1734016094.579646:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333347840 00000100:00100000:1.0:1734016094.579652:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333347840 00010000:00010000:1.0:1734016094.579676:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27113b28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->2990079) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44bb expref: 7 pid: 7684 timeout: 461 lvb_type: 0 00000100:00100000:1.0:1734016094.579696:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2687 00000100:00100000:1.0:1734016094.579702:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333347840:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016094.579713:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016094.579732:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27113b28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2957312->2990079) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44bb expref: 7 pid: 7684 timeout: 461 lvb_type: 0 00010000:00010000:1.0:1734016094.579742:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27113b28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2957312->2990079) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44bb expref: 7 pid: 7684 timeout: 461 lvb_type: 0 00010000:00010000:1.0:1734016094.579765:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27113b28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2957312->2990079) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44bb expref: 7 pid: 7684 timeout: 461 lvb_type: 0 00010000:00010000:1.0:1734016094.579790:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016094.579792:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016094.579798:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27113b44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->3928063) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44d7 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016094.579824:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27113b44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->3928063) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44d7 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016094.579854:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27113b44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->3928063) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44d7 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016094.579869:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335178240:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016094.579899:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f480 going to sleep for 11 seconds 00000100:00100000:1.0:1734016094.584297:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335178240:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016094.584330:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016094.584393:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333347840:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4688us (5062us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016094.584404:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2687 00000100:00100000:0.0:1734016094.584483:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333347968 00000100:00100000:0.0:1734016094.584490:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333347968 00000100:00100000:0.0:1734016094.584537:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10100 00000100:00100000:0.0:1734016094.584543:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333347968:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016094.584776:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9355264 -> 9355264 00002000:00010000:0.0:1734016094.584779:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016094 -> 1734016094 00002000:00010000:0.0:1734016094.584781:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016094 -> 1734016094 00002000:00010000:0.0:1734016094.584783:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016095 -> 1734016094 00002000:00010000:0.0:1734016094.584785:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1376 -> 1512 00000100:00100000:0.0:1734016094.584835:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333347968:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 292us (654us total) trans 4294969152 rc 0/0 00000100:00100000:0.0:1734016094.584845:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10100 00000100:00100000:0.0:1734016094.588498:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333348096 00000100:00100000:0.0:1734016094.588507:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333348096 00000100:00100000:0.0:1734016094.589151:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10101 00000100:00100000:0.0:1734016094.589158:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333348096:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016094.589176:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016094.589192:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27113b4b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e44de expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016094.589244:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335178368:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016094.589307:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eeb40 going to sleep for 11 seconds 00002000:00010000:0.0:1734016094.592566:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016094 -> 1734016095 00000100:00100000:0.0:1734016094.592599:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335178368:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016094.592642:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27113b4b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44de expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.592657:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27113b4b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44de expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.592686:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582f40, rc 0) 00000100:00100000:0.0:1734016094.592756:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333348096:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3596us (4338us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016094.592768:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10101 00000100:00100000:0.0:1734016094.596419:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333348224 00000100:00100000:0.0:1734016094.596428:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333348224 00000100:00100000:0.0:1734016094.596574:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10102 00000100:00100000:0.0:1734016094.596581:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333348224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016094.596598:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016094.596613:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113b52 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e44e5 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016094.596667:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335178496:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016094.596726:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016094.600469:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335178496:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016094.600509:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113b52 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44e5 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.600523:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113b52 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44e5 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.600548:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581200, rc 0) 00000100:00100000:0.0:1734016094.600613:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333348224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4031us (4260us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016094.600622:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10102 00000100:00100000:0.0:1734016094.606061:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333348352 00000100:00100000:0.0:1734016094.606070:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333348352 00000100:00100000:0.0:1734016094.606123:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10103 00000100:00100000:0.0:1734016094.606129:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333348352:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016094.606338:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9355264 -> 9355264 00002000:00010000:0.0:1734016094.606341:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016094 -> 1734016094 00002000:00010000:0.0:1734016094.606343:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016094 -> 1734016094 00002000:00010000:0.0:1734016094.606346:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016095 -> 1734016094 00002000:00010000:0.0:1734016094.606347:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1512 -> 1592 00000100:00100000:0.0:1734016094.606410:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333348352:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 280us (430us total) trans 4294969153 rc 0/0 00000100:00100000:0.0:1734016094.606416:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10103 00000100:00100000:0.0:1734016094.610883:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333348480 00000100:00100000:0.0:1734016094.610891:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333348480 00000100:00100000:0.0:1734016094.610935:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10104 00000100:00100000:0.0:1734016094.610942:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333348480:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016094.610958:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016094.610972:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27113b59 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e44ec expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016094.611019:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335178624:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016094.611087:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eeb40 going to sleep for 11 seconds 00002000:00010000:0.0:1734016094.613404:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016094 -> 1734016095 00000100:00100000:0.0:1734016094.613433:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335178624:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016094.613468:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27113b59 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44ec expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.613481:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27113b59 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44ec expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.613502:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:0.0:1734016094.613560:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333348480:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2617us (2765us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016094.613572:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10104 00000100:00100000:0.0:1734016094.618285:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333348608 00000100:00100000:0.0:1734016094.618294:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333348608 00000100:00100000:0.0:1734016094.618363:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10105 00000100:00100000:0.0:1734016094.618371:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333348608:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016094.618391:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016094.618413:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27113b60 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e44f3 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016094.618473:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335178752:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016094.618553:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016094.622394:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335178752:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016094.622429:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27113b60 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44f3 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.622443:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27113b60 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44f3 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.622465:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00000100:00100000:0.0:1734016094.622521:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333348608:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4148us (4349us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016094.622529:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10105 00000100:00100000:0.0:1734016094.626263:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333348864 00000100:00100000:0.0:1734016094.626271:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333348864 00000100:00100000:0.0:1734016094.629982:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7830 00000100:00100000:0.0:1734016094.629998:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333348864:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:0.0:1734016094.630071:0:13914:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113b67 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.630090:0:13914:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27113b44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->3928063) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44d7 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.630098:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016094.630100:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016094.630103:0:13914:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113b67 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [9191424->9199615] (req 9191424->9199615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.630136:0:13914:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27113b44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->3928063) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44d7 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.630148:0:13914:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27113b44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->3928063) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44d7 expref: 9 pid: 7682 timeout: 461 lvb_type: 0 00000100:00100000:0.0:1734016094.630162:0:13914:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335178880:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016094.630246:0:13914:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016094.633490:0:13914:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335178880:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016094.633521:0:13914:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113b67 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [9191424->9199615] (req 9191424->9199615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016094.635198:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333348992 00000100:00100000:1.0:1734016094.635208:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333348992 00010000:00010000:1.0:1734016094.635239:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27113b44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->3928063) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44d7 expref: 10 pid: 7682 timeout: 461 lvb_type: 0 00000100:00100000:1.0:1734016094.635278:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2688 00000100:00100000:1.0:1734016094.635284:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333348992:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016094.635295:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016094.635325:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27113b44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->3928063) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44d7 expref: 10 pid: 7682 timeout: 461 lvb_type: 0 00010000:00010000:1.0:1734016094.635335:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27113b44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->3928063) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44d7 expref: 10 pid: 7682 timeout: 461 lvb_type: 0 00010000:00010000:1.0:1734016094.635353:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27113b44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->3928063) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44d7 expref: 10 pid: 7682 timeout: 461 lvb_type: 0 00010000:00010000:1.0:1734016094.636223:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016094.636225:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016094.636229:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113b67 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [9191424->9199615] (req 9191424->9199615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016094.636239:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113b67 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [9191424->9199615] (req 9191424->9199615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016094.636350:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016094.636409:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333348992:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1123us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016094.636417:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2688 00010000:00010000:0.0:1734016094.636817:0:13914:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113b67 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9191424->9199615] (req 9191424->9199615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.636830:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113b67 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9191424->9199615] (req 9191424->9199615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.637238:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113b67 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9191424->9199615] (req 9191424->9199615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.637245:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113b67 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9191424->9199615] (req 9191424->9199615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.637250:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113b67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9191424->9199615] (req 9191424->9199615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.637255:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7582d00 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016094.637257:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113b67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9191424->9199615] (req 9191424->9199615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.637263:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113b67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9191424->9199615] (req 9191424->9199615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.637275:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113b67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9191424->9199615] (req 9191424->9199615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.637281:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27113b67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9191424->9199615] (req 9191424->9199615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016094.637359:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333348864:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 7363us (11215us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1734016094.637368:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7830 00000100:00100000:0.0:1734016094.641224:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333349120 00000100:00100000:0.0:1734016094.641233:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333349120 00000100:00100000:0.0:1734016094.641556:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10106 00000100:00100000:0.0:1734016094.641563:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333349120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016094.641581:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016094.641598:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27113b6e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e44fa expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016094.641619:0:7682:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 9355264, mtime: 0x675afc5e, atime: 0x675afc5e, ctime: 0x675afc5e, blocks: 0x638 00010000:00010000:0.0:1734016094.641640:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016094.641643:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016094.641652:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27113b6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44fa expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.641665:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27113b6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44fa expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.641674:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:0.0:1734016094.641734:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333349120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 170us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016094.641739:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10106 00000100:00100000:0.0:1734016094.647971:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333349376 00000100:00100000:0.0:1734016094.647979:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333349376 00000100:00100000:0.0:1734016094.648026:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10108 00000100:00100000:0.0:1734016094.648032:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333349376:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016094.648051:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016094.648068:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27113b7c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4508 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.648093:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27113b6e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44fa expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.648101:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113b75 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4501 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.648107:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016094.648109:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016094.648113:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27113b7c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3858432->3903487] (req 3858432->3903487) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4508 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.648141:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113b75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4501 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.648152:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113b75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4501 expref: 8 pid: 7684 timeout: 461 lvb_type: 1 00000100:00100000:0.0:1734016094.648165:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335179008:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016094.648237:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27113b6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44fa expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.648246:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27113b6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44fa expref: 8 pid: 7682 timeout: 461 lvb_type: 1 00000100:00100000:0.0:1734016094.648257:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335179136:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016094.648273:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016094.651979:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335179008:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016094.651992:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335179136:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016094.652020:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27113b7c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3858432->3903487] (req 3858432->3903487) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4508 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.652034:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:0.0:1734016094.652089:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:9668:x1818247333349376:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4057us (4190us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016094.652096:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10108 00000100:00100000:0.0:1734016094.652736:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016094.652839:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016094.652856:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333349504 00000100:00100000:0.0:1734016094.652862:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333349504 00010000:00010000:0.0:1734016094.652894:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113b75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4501 expref: 8 pid: 7684 timeout: 461 lvb_type: 1 00000100:00100000:0.0:1734016094.652914:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333349632 00000100:00100000:0.0:1734016094.652917:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333349632 00010000:00010000:0.0:1734016094.652924:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27113b6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44fa expref: 9 pid: 7682 timeout: 461 lvb_type: 1 00000100:00100000:0.0:1734016094.652936:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2689 00000100:00100000:0.0:1734016094.652942:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333349504:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016094.652953:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016094.652973:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113b75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4501 expref: 8 pid: 7684 timeout: 461 lvb_type: 1 00010000:00010000:0.0:1734016094.652981:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113b75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4501 expref: 8 pid: 7684 timeout: 461 lvb_type: 1 00010000:00010000:0.0:1734016094.653003:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113b75 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4501 expref: 8 pid: 7684 timeout: 461 lvb_type: 1 00010000:00010000:0.0:1734016094.653036:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016094.653061:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333349504:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 118us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016094.653067:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2689 00000100:00100000:0.0:1734016094.653078:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2690 00000100:00100000:0.0:1734016094.653081:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333349632:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016094.653087:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016094.653093:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27113b6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44fa expref: 9 pid: 7682 timeout: 461 lvb_type: 1 00010000:00010000:0.0:1734016094.653101:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27113b6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44fa expref: 9 pid: 7682 timeout: 461 lvb_type: 1 00010000:00010000:0.0:1734016094.653113:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27113b6e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e44fa expref: 9 pid: 7682 timeout: 461 lvb_type: 1 00010000:00010000:0.0:1734016094.653127:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016094.653129:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016094.653134:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27113b7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->3903487) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4508 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.653142:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27113b7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->3903487) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4508 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.653167:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27113b7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->3903487) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4508 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016094.653181:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335179264:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016094.653210:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016094.656853:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335179264:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016094.656879:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016094.656938:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333349632:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3853us (4097us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016094.656948:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2690 00000100:00100000:0.0:1734016094.661867:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333349760 00000100:00100000:0.0:1734016094.661876:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333349760 00000100:00100000:0.0:1734016094.661926:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10109 00000100:00100000:0.0:1734016094.661932:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333349760:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016094.662060:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9355264 -> 9355264 00002000:00010000:0.0:1734016094.662062:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016094 -> 1734016094 00002000:00010000:0.0:1734016094.662064:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016094 -> 1734016094 00002000:00010000:0.0:1734016094.662066:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016094 -> 1734016094 00002000:00010000:0.0:1734016094.662068:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1592 -> 1592 00000100:00100000:0.0:1734016094.662565:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333349760:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 630us (1289us total) trans 4294969154 rc 0/0 00000100:00100000:0.0:1734016094.662573:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10109 00000100:00100000:0.0:1734016094.667628:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333349888 00000100:00100000:0.0:1734016094.667638:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333349888 00000100:00100000:0.0:1734016094.667683:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10110 00000100:00100000:0.0:1734016094.667690:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333349888:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016094.667707:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016094.667725:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113b83 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e450f expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016094.667782:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335179392:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016094.667984:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00002000:00010000:0.0:1734016094.670796:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016094 -> 1734016095 00000100:00100000:0.0:1734016094.670905:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335179392:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016094.670937:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113b83 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e450f expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.670952:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113b83 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e450f expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.671018:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:0.0:1734016094.671079:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333349888:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3388us (3529us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016094.671091:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10110 00000100:00100000:0.0:1734016094.673905:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333350016 00000100:00100000:0.0:1734016094.673914:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333350016 00000100:00100000:0.0:1734016094.673958:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10111 00000100:00100000:0.0:1734016094.673965:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333350016:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016094.673982:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016094.673998:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113b8a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4516 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016094.674049:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335179520:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016094.674108:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016094.676345:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335179520:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016094.676382:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113b8a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4516 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.676395:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113b8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4516 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.676406:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016094.676461:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333350016:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2493us (2750us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016094.676468:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10111 00000100:00100000:0.0:1734016094.680243:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333350144 00000100:00100000:0.0:1734016094.680253:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333350144 00000100:00100000:0.0:1734016094.680849:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10112 00000100:00100000:0.0:1734016094.680857:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333350144:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016094.681083:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9355264 -> 9355264 00002000:00010000:0.0:1734016094.681086:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016094 -> 1734016094 00002000:00010000:0.0:1734016094.681088:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016094 -> 1734016094 00002000:00010000:0.0:1734016094.681090:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016095 -> 1734016094 00002000:00010000:0.0:1734016094.681091:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1592 -> 1688 00000100:00100000:0.0:1734016094.681152:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333350144:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 294us (1020us total) trans 4294969155 rc 0/0 00000100:00100000:0.0:1734016094.681158:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10112 00000100:00100000:0.0:1734016094.749230:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333350784 00000100:00100000:0.0:1734016094.749241:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333350784 00010000:00010000:0.0:1734016094.749278:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27113b7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4508 expref: 9 pid: 7682 timeout: 461 lvb_type: 0 00000100:00100000:0.0:1734016094.749333:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2691 00000100:00100000:0.0:1734016094.749341:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333350784:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016094.749361:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016094.749385:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27113b7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4508 expref: 9 pid: 7682 timeout: 461 lvb_type: 0 00010000:00010000:0.0:1734016094.749398:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27113b7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->3903487) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4508 expref: 9 pid: 7682 timeout: 461 lvb_type: 0 00010000:00010000:0.0:1734016094.749424:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27113b7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->3903487) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4508 expref: 9 pid: 7682 timeout: 461 lvb_type: 0 00010000:00010000:0.0:1734016094.749461:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016094.749464:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016094.749473:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27113ba6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1449984->1454079) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4532 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.749484:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27113ba6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1449984->1454079) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4532 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016094.749526:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27113ba6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1449984->1454079) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4532 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016094.749551:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335180160:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016094.749612:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016094.752861:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335180160:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016094.752883:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016094.752923:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333350784:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3580us (3779us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016094.752932:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2691 00000100:00100000:0.0:1734016094.800403:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333351040 00000100:00100000:0.0:1734016094.800413:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333351040 00002000:00100000:0.0:1734016094.800455:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff880075444a80 x1818247333351040/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:55/0 lens 488/0 e 0 to 0 dl 1734016105 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016094.800465:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075444a80 with x1818247333351040 ext(0->4194303) 00002000:00010000:0.0:1734016094.800470:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075444a80 00000100:00100000:0.0:1734016094.800489:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7831 00000100:00100000:0.0:1734016094.800494:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333351296:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016094.801331:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7833 00000100:00100000:1.0:1734016094.801343:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333351552:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016094.825277:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247333351552:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 23921us (24852us total) trans 0 rc 966656/966656 00000100:00100000:1.0:1734016094.825292:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7833 00002000:00100000:1.0:1734016094.825306:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (8388608->9355263) req@ffff8800739e0a80 x1818247333351552/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:55/0 lens 488/440 e 0 to 0 dl 1734016105 ref 1 fl Complete:/200/0 rc 966656/966656 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016094.825326:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800739e0a80 with x1818247333351552 ext(8388608->9355263) 00002000:00010000:1.0:1734016094.825332:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800739e0a80 00000100:00100000:1.0:1734016094.894264:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333351296:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 93759us (93886us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016094.894278:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7831 00002000:00100000:1.0:1734016094.894293:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (4194304->8388607) req@ffff8800739e0380 x1818247333351296/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:55/0 lens 488/440 e 0 to 0 dl 1734016105 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016094.894305:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800739e0380 with x1818247333351296 ext(4194304->8388607) 00002000:00010000:1.0:1734016094.894323:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800739e0380 00000100:00100000:0.0:1734016094.945709:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016094.947338:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7834 00000100:00100000:1.0:1734016094.947346:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333351680:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016094.950937:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333351680:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 3580us (5233us total) trans 4294969156 rc 0/0 00000100:00100000:0.0:1734016094.950949:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7834 00002000:00100000:0.0:1734016094.950961:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1429504->1454079) req@ffff88007bd3c700 x1818247333351680/t4294969156(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:55/0 lens 488/448 e 0 to 0 dl 1734016105 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016094.950969:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3c700 with x1818247333351680 ext(1429504->1454079) 00002000:00010000:0.0:1734016094.950974:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3c700 00000100:00100000:0.0:1734016094.953148:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016094.977500:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333351936 00000100:00100000:0.0:1734016094.977510:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333351936 00000100:00100000:0.0:1734016094.977563:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10118 00000100:00100000:0.0:1734016094.977570:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333351936:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016094.977591:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016094.977611:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113bad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4539 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016094.977674:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335180288:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016094.981494:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00002000:00010000:0.0:1734016094.990316:0:7684:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime: 1734016094 -> 1734016095 00002000:00010000:0.0:1734016094.990326:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016094 -> 1734016095 00002000:00010000:0.0:1734016094.990329:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 1688 -> 1736 00000100:00100000:0.0:1734016094.990360:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335180288:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016094.990407:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113bad lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4539 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.990424:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113bad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4539 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.990453:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016094.990525:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333351936:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12954us (13105us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016094.990535:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10118 00000100:00100000:1.0:1734016094.993839:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016094.994022:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333352064 00000100:00100000:0.0:1734016094.994033:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333352064 00000100:00100000:0.0:1734016094.994083:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10119 00000100:00100000:0.0:1734016094.994090:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333352064:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016094.994111:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016094.994131:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113bb4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4540 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016094.994190:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335180416:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016094.995491:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016094.997260:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335180416:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016094.997295:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113bb4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4540 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.997318:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113bb4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4540 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016094.998819:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:0.0:1734016094.998896:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333352064:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4803us (5106us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016094.998905:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10119 00000100:00100000:1.0:1734016095.004580:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.004665:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333352192 00000100:00100000:0.0:1734016095.004675:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333352192 00000100:00100000:0.0:1734016095.004733:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10120 00000100:00100000:0.0:1734016095.004744:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333352192:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016095.004767:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016095.004791:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113bbb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4547 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016095.004986:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335180544:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016095.005068:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016095.006994:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335180544:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016095.007025:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113bbb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4547 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.007036:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113bbb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4547 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.007046:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016095.007088:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333352192:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2349us (2519us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016095.007098:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10120 00000100:00100000:0.0:1734016095.010175:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333352320 00000100:00100000:0.0:1734016095.010183:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333352320 00000100:00100000:0.0:1734016095.010223:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10121 00000100:00100000:0.0:1734016095.010229:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333352320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016095.010246:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016095.010261:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113bc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e454e expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016095.010323:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335180672:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016095.010389:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016095.012679:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335180672:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016095.012730:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113bc2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e454e expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.012748:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113bc2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e454e expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.012892:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:0.0:1734016095.013048:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333352320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2816us (2957us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016095.013059:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10121 00000100:00100000:1.0:1734016095.018923:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016095.019787:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016065 00000100:00100000:0.0:1734016095.026613:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800739e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335180800:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016095.026637:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27113bc9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016095.026967:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333352704 00000100:00100000:1.0:1734016095.026973:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333352704 00010000:00010000:1.0:1734016095.027003:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27113ab1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4467 expref: 20 pid: 13956 timeout: 462 lvb_type: 0 00000100:00100000:1.0:1734016095.027032:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2692 00000100:00100000:1.0:1734016095.027037:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:1982:x1818247333352704:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016095.027047:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016095.027052:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27113ab1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4467 expref: 20 pid: 13956 timeout: 462 lvb_type: 0 00010000:00010000:1.0:1734016095.027060:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27113ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4467 expref: 20 pid: 13956 timeout: 462 lvb_type: 0 00010000:00010000:1.0:1734016095.027076:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27113ab1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4467 expref: 20 pid: 13956 timeout: 462 lvb_type: 0 00010000:00010000:1.0:1734016095.027096:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016095.027100:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27113bc9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016095.027107:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27113bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016095.027113:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27113bc9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016095.027126:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016095.027157:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:1982:x1818247333352704:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 119us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016095.027162:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2692 00000100:00080000:0.0:1734016095.027260:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016065 00010000:00010000:0.0:1734016095.027267:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27113bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016095.027272:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27113bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:0.0:1734016095.027356:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968568 00000004:00010000:0.0:1734016095.027393:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880073bbe680 reply state ffff8800756f0000 transno 4294968569 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27113bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016095.027398:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016095.027453:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+25:9668:x1818247333352576:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 7878us (8542us total) trans 4294968569 rc 0/0 00000100:00100000:0.0:1734016095.027459:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1963 00000020:00080000:0.0:1734016095.027462:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1734016095.037182:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27113bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016095.037197:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27113bc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016095.037207:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27113bc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016095.037212:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df7cc0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:1.0:1734016095.037215:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27113bc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016095.037220:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27113bc9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016095.037232:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016095.037234:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1734016095.037237:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27113bc9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016095.037241:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27113bc9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016095.039449:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.039540:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333352832 00000100:00100000:0.0:1734016095.039550:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333352832 00002000:00010000:0.0:1734016095.039607:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (5568683->18446744073709551615) 00002000:00100000:0.0:1734016095.039611:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbea00 with x1818247333352832 ext(5568683->18446744073709551615) 00002000:00010000:0.0:1734016095.039621:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbea00. 00000100:00100000:0.0:1734016095.039652:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7835 00000100:00100000:0.0:1734016095.039659:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333352832:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016095.042296:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9355264 -> 5568683 00002000:00010000:0.0:1734016095.042315:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016095 -> 1734016095 00002000:00010000:0.0:1734016095.042318:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016095 -> 1734016094 00002000:00010000:0.0:1734016095.042320:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016095 -> 1734016095 00002000:00010000:0.0:1734016095.042322:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1736 -> 1312 00000100:00100000:0.0:1734016095.042402:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333352832:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 2738us (2963us total) trans 4294969157 rc 0/0 00000100:00100000:0.0:1734016095.042413:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7835 00002000:00010000:0.0:1734016095.042419:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (5568683->18446744073709551615) 00002000:00100000:0.0:1734016095.042422:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbea00 with x1818247333352832 ext(5568683->18446744073709551615) 00002000:00010000:0.0:1734016095.042428:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbea00. 00000100:00100000:0.0:1734016095.052015:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333352960 00000100:00100000:0.0:1734016095.052024:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333352960 00000100:00100000:0.0:1734016095.052074:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1964 00000100:00100000:0.0:1734016095.052081:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:9668:x1818247333352960:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016095.052104:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016095.052122:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27113bd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4555 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.052195:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27113bd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016095.052207:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27113bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016095.052214:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27113bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016095.052234:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 5568683 00000004:00200000:0.0:1734016095.052236:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016095.052249:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27113bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016095.052267:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27113bd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4555 expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.054391:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27113bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4555 expref: 20 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.054404:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016095.054407:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016095.054410:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016095.054477:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:9668:x1818247333352960:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2395us (3162us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.054484:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1964 00000100:00100000:0.0:1734016095.059049:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.067087:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.075024:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.080464:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.085896:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.092985:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.098381:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.104915:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.127357:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.136569:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.143777:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.143886:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333354624 00000100:00100000:0.0:1734016095.143893:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333354624 00002000:00100000:0.0:1734016095.143938:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2940928->2945023) req@ffff88007345f480 x1818247333354624/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/0 e 0 to 0 dl 1734016106 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016095.143948:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345f480 with x1818247333354624 ext(2940928->2945023) 00002000:00010000:0.0:1734016095.143954:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345f480 00000100:00100000:0.0:1734016095.144634:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7837 00000100:00100000:0.0:1734016095.144641:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333354624:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016095.144761:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333354624:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 120us (994us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016095.144771:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7837 00002000:00100000:0.0:1734016095.144776:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2940928->2945023) req@ffff88007345f480 x1818247333354624/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/4536 e 0 to 0 dl 1734016106 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016095.144783:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345f480 with x1818247333354624 ext(2940928->2945023) 00002000:00010000:0.0:1734016095.144786:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345f480 00000100:00100000:1.0:1734016095.148418:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.156023:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.166098:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333355136 00000100:00100000:0.0:1734016095.166116:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333355136 00002000:00100000:0.0:1734016095.166177:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2932736->2936831) req@ffff88007345d180 x1818247333355136/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/0 e 0 to 0 dl 1734016106 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016095.166190:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345d180 with x1818247333355136 ext(2932736->2936831) 00002000:00010000:0.0:1734016095.166196:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345d180 00000100:00100000:0.0:1734016095.166245:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7839 00000100:00100000:0.0:1734016095.166254:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333355136:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016095.166496:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333355136:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 243us (10487us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016095.166505:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7839 00002000:00100000:0.0:1734016095.166512:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2932736->2936831) req@ffff88007345d180 x1818247333355136/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/4536 e 0 to 0 dl 1734016106 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016095.166519:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345d180 with x1818247333355136 ext(2932736->2936831) 00002000:00010000:0.0:1734016095.166522:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345d180 00000100:00100000:1.0:1734016095.171969:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.179224:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.185140:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.185300:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333355904 00000100:00100000:0.0:1734016095.185316:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333355904 00002000:00100000:0.0:1734016095.185350:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2920448->2924543) req@ffff88007345ca80 x1818247333355904/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/0 e 0 to 0 dl 1734016106 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016095.185364:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345ca80 with x1818247333355904 ext(2920448->2924543) 00002000:00010000:0.0:1734016095.185372:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345ca80 00000100:00100000:0.0:1734016095.185402:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7842 00000100:00100000:0.0:1734016095.185408:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333355904:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016095.185549:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333355904:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 140us (417us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016095.185555:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7842 00002000:00100000:0.0:1734016095.185560:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2920448->2924543) req@ffff88007345ca80 x1818247333355904/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/4536 e 0 to 0 dl 1734016106 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016095.185566:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345ca80 with x1818247333355904 ext(2920448->2924543) 00002000:00010000:0.0:1734016095.185568:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345ca80 00000100:00100000:1.0:1734016095.192281:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.196707:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.196762:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333356416 00000100:00100000:0.0:1734016095.196771:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333356416 00002000:00100000:0.0:1734016095.196838:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2912256->2916351) req@ffff88012e254700 x1818247333356416/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/0 e 0 to 0 dl 1734016106 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016095.196847:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e254700 with x1818247333356416 ext(2912256->2916351) 00002000:00010000:0.0:1734016095.196852:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e254700 00000100:00100000:0.0:1734016095.196876:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7844 00000100:00100000:0.0:1734016095.196880:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333356416:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016095.197025:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333356416:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 143us (325us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016095.197031:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7844 00002000:00100000:0.0:1734016095.197037:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2912256->2916351) req@ffff88012e254700 x1818247333356416/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/4536 e 0 to 0 dl 1734016106 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016095.197045:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e254700 with x1818247333356416 ext(2912256->2916351) 00002000:00010000:0.0:1734016095.197047:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e254700 00000100:00100000:1.0:1734016095.202548:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.217022:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.217103:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333356928 00000100:00100000:0.0:1734016095.217114:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333356928 00002000:00100000:0.0:1734016095.217160:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2904064->2908159) req@ffff88012e257800 x1818247333356928/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/0 e 0 to 0 dl 1734016106 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016095.217170:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e257800 with x1818247333356928 ext(2904064->2908159) 00002000:00010000:0.0:1734016095.217175:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e257800 00000100:00100000:0.0:1734016095.217210:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7846 00000100:00100000:0.0:1734016095.217216:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333356928:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016095.217397:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333356928:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 180us (386us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016095.217404:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7846 00002000:00100000:0.0:1734016095.217410:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2904064->2908159) req@ffff88012e257800 x1818247333356928/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/4536 e 0 to 0 dl 1734016106 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016095.217417:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e257800 with x1818247333356928 ext(2904064->2908159) 00002000:00010000:0.0:1734016095.217420:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e257800 00000100:00100000:1.0:1734016095.220605:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.220669:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333357056 00000100:00100000:0.0:1734016095.220677:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333357056 00000100:00100000:0.0:1734016095.220721:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1965 00000100:00100000:0.0:1734016095.220726:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+24:9668:x1818247333357056:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016095.220749:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016095.220767:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27113c16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4594 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.220861:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113c1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016095.220871:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016095.220880:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016095.220899:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 5568683 00000004:00200000:0.0:1734016095.220902:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016095.220912:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016095.220933:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27113c16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4594 expref: 26 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.220951:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113c1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4594 expref: 25 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.220958:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016095.220960:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016095.220963:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75818c0, rc 0) 00000100:00100000:0.0:1734016095.221004:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+25:9668:x1818247333357056:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 277us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.221008:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1965 00000100:00100000:0.0:1734016095.225372:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.228820:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.228924:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333357312 00000100:00100000:1.0:1734016095.228933:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333357312 00000100:00100000:1.0:1734016095.228982:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10131 00000100:00100000:1.0:1734016095.228988:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333357312:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016095.229004:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016095.229020:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27113c2b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e45a2 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016095.229045:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113c0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->2949119) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e458d expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016095.229053:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27113c24 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e459b expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016095.229058:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016095.229059:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016095.229062:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27113c2b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45a2 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016095.229091:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27113c24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e459b expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016095.229100:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27113c24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e459b expref: 7 pid: 7684 timeout: 462 lvb_type: 1 00000100:00100000:1.0:1734016095.229117:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e255180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335182080:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016095.236069:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016095.238690:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113c0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->2949119) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e458d expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016095.238706:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113c0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->2949119) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e458d expref: 7 pid: 7684 timeout: 462 lvb_type: 0 00000100:00100000:1.0:1734016095.238723:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e257100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335182208:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016095.239332:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f480 going to sleep for 11 seconds 00010000:00010000:1.0:1734016095.239359:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27113c24 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e459b expref: 7 pid: 7684 timeout: 462 lvb_type: 1 00000100:00100000:1.0:1734016095.241276:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e255180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335182080:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016095.243538:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e257100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335182208:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016095.243572:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27113c2b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45a2 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.243587:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:0.0:1734016095.243628:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333357312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 14638us (14838us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.243636:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10131 00000100:00100000:0.0:1734016095.246661:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.260496:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.266560:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.269296:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.273063:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.276090:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.280875:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.289372:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.289456:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333359360 00000100:00100000:0.0:1734016095.289466:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333359360 00000100:00100000:0.0:1734016095.289686:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10132 00000100:00100000:0.0:1734016095.289693:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88009024f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333359360:12345-192.168.201.16@tcp:16:fsx.0 00000100:00100000:0.0:1734016095.291455:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88009024f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333359360:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 1758us (2089us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.291464:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10132 00000100:00100000:0.0:1734016095.299497:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00002000:00010000:0.0:1734016095.305240:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016094 -> 1734016095 00000100:00100000:0.0:1734016095.305271:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e607800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335182464:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016095.305316:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27113c32 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45a9 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.305336:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27113c32 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45a9 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.305367:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:0.0:1734016095.305437:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333359488:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5657us (5948us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016095.305447:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10133 00000100:00100000:1.0:1734016095.308877:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.308944:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333359616 00000100:00100000:0.0:1734016095.308954:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333359616 00000100:00100000:0.0:1734016095.309004:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10134 00000100:00100000:0.0:1734016095.309012:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333359616:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016095.309031:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016095.309048:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27113c39 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e45b0 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016095.309111:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335182592:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016095.309174:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016095.311889:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013040a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335182592:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016095.311923:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27113c39 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45b0 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.311936:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27113c39 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45b0 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.311962:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581b00, rc 0) 00000100:00100000:0.0:1734016095.312016:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333359616:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3005us (3149us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016095.312024:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10134 00000100:00100000:0.0:1734016095.318657:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333359744 00000100:00100000:0.0:1734016095.318666:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333359744 00000100:00100000:1.0:1734016095.348901:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.354407:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333360384 00000100:00100000:0.0:1734016095.354412:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333360384 00010000:00010000:0.0:1734016095.354438:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27113c2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45a2 expref: 7 pid: 7682 timeout: 462 lvb_type: 0 00000100:00100000:0.0:1734016095.354468:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2696 00000100:00100000:0.0:1734016095.354473:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333360384:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016095.354487:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016095.354508:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27113c2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45a2 expref: 7 pid: 7682 timeout: 462 lvb_type: 0 00010000:00010000:0.0:1734016095.354518:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27113c2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45a2 expref: 7 pid: 7682 timeout: 462 lvb_type: 0 00010000:00010000:0.0:1734016095.354543:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27113c2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45a2 expref: 7 pid: 7682 timeout: 462 lvb_type: 0 00010000:00010000:0.0:1734016095.354558:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016095.354560:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016095.354565:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27113c55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5398528->5431295) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45cc expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.354574:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27113c55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5398528->5431295) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45cc expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.354608:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27113c55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5398528->5431295) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45cc expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016095.354622:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335183232:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016095.354663:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016095.359772:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013040a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335183232:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016095.359844:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016095.360707:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333360384:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6227us (6922us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.360719:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2696 00000100:00100000:1.0:1734016095.361322:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.378893:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.378965:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333360768 00000100:00100000:0.0:1734016095.378974:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333360768 00010000:00010000:0.0:1734016095.379009:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27113c55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5398528->5431295) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45cc expref: 8 pid: 7684 timeout: 462 lvb_type: 0 00000100:00100000:0.0:1734016095.379050:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2697 00000100:00100000:0.0:1734016095.379056:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333360768:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016095.379070:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016095.379089:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27113c55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5398528->5431295) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45cc expref: 8 pid: 7684 timeout: 462 lvb_type: 0 00010000:00010000:0.0:1734016095.379106:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27113c55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5398528->5431295) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45cc expref: 8 pid: 7684 timeout: 462 lvb_type: 0 00010000:00010000:0.0:1734016095.379128:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27113c55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5398528->5431295) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45cc expref: 8 pid: 7684 timeout: 462 lvb_type: 0 00010000:00010000:0.0:1734016095.379158:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016095.379160:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016095.379166:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113c5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 585728->589823) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45d3 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.379174:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113c5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 585728->589823) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45d3 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.379209:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113c5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 585728->589823) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45d3 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016095.379224:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335183488:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016095.379280:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016095.383144:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013040a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335183488:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016095.383163:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016095.383209:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333360768:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4153us (4324us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.383218:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2697 00000100:00100000:0.0:1734016095.394872:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.410665:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.423534:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.437844:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.438292:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333361536 00000100:00100000:1.0:1734016095.438338:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333361536 00010000:00010000:1.0:1734016095.438378:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113c5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 585728->589823) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45d3 expref: 8 pid: 7684 timeout: 462 lvb_type: 0 00000100:00100000:1.0:1734016095.438414:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2698 00000100:00100000:1.0:1734016095.438421:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333361536:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016095.438433:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016095.438455:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113c5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 585728->589823) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45d3 expref: 8 pid: 7684 timeout: 462 lvb_type: 0 00010000:00010000:1.0:1734016095.438467:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113c5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 585728->589823) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45d3 expref: 8 pid: 7684 timeout: 462 lvb_type: 0 00010000:00010000:1.0:1734016095.438490:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113c5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 585728->589823) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45d3 expref: 8 pid: 7684 timeout: 462 lvb_type: 0 00010000:00010000:1.0:1734016095.438517:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016095.438519:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016095.438525:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27113c78 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1392639) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45ef expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016095.438534:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27113c78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1392639) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45ef expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016095.438577:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27113c78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1392639) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45ef expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016095.438591:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e255180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335184128:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016095.438669:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f180 going to sleep for 11 seconds 00000100:00100000:1.0:1734016095.441433:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e255180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335184128:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016095.441454:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016095.441490:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333361536:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3068us (3656us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016095.441499:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2698 00000100:00100000:0.0:1734016095.446082:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.454473:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.463485:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.468662:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.468710:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.468915:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333362176 00000100:00100000:0.0:1734016095.468922:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333362176 00010000:00010000:0.0:1734016095.468951:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27113c7f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45f6 expref: 10 pid: 7682 timeout: 462 lvb_type: 1 00000100:00100000:0.0:1734016095.468973:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333362304 00000100:00100000:0.0:1734016095.468975:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333362304 00010000:00010000:0.0:1734016095.468983:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27113c78 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1388544->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45ef expref: 8 pid: 7682 timeout: 462 lvb_type: 0 00000100:00100000:0.0:1734016095.468996:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2699 00000100:00100000:0.0:1734016095.469002:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e255180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333362176:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016095.469014:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016095.469033:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27113c7f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45f6 expref: 10 pid: 7682 timeout: 462 lvb_type: 1 00010000:00010000:0.0:1734016095.469042:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27113c7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45f6 expref: 10 pid: 7682 timeout: 462 lvb_type: 1 00010000:00010000:0.0:1734016095.469060:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016095.469101:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e255180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333362176:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 99us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.469106:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2699 00000100:00100000:0.0:1734016095.469119:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2700 00000100:00100000:0.0:1734016095.469123:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333362304:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016095.469128:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016095.469134:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27113c78 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1388544->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45ef expref: 8 pid: 7682 timeout: 462 lvb_type: 0 00010000:00010000:0.0:1734016095.469141:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27113c78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1388544->1392639) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45ef expref: 8 pid: 7682 timeout: 462 lvb_type: 0 00010000:00010000:0.0:1734016095.469150:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016095.469152:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016095.469157:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113c86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5263360->5267455) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45fd expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.469164:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113c86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5263360->5267455) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45fd expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.469193:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113c86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5263360->5267455) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45fd expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016095.469206:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335184512:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016095.469237:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016095.475752:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.475845:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335184512:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016095.475866:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016095.475922:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333362304:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6796us (7210us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.475932:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2700 00000100:00100000:1.0:1734016095.483621:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.490722:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.494585:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.498546:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.502512:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.506717:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.511715:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.517442:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.522336:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.527441:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.533572:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.539151:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.547921:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.556489:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.562605:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.562920:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333366016 00000100:00100000:1.0:1734016095.562926:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333366016 00010000:00010000:1.0:1734016095.562955:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113c1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4594 expref: 25 pid: 13956 timeout: 462 lvb_type: 0 00000100:00100000:1.0:1734016095.562977:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2701 00000100:00100000:1.0:1734016095.562983:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+25:1982:x1818247333366016:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016095.562994:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016095.562999:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113c1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4594 expref: 25 pid: 13956 timeout: 462 lvb_type: 0 00010000:00010000:1.0:1734016095.563008:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113c1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4594 expref: 25 pid: 13956 timeout: 462 lvb_type: 0 00010000:00010000:1.0:1734016095.563024:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113c1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4594 expref: 25 pid: 13956 timeout: 462 lvb_type: 0 00010000:00010000:1.0:1734016095.563040:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016095.563044:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27113c8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016095.563051:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27113c8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016095.563056:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27113c8d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016095.563069:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016095.563103:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+24:1982:x1818247333366016:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 118us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016095.563108:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2701 00010000:00010000:0.0:1734016095.563997:0:7704:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27113c8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016095.564008:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27113c8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:0.0:1734016095.564100:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968570 00000004:00010000:0.0:1734016095.564149:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800752a7100 reply state ffff8800735d1000 transno 4294968571 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27113c8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016095.564156:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016095.564241:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:9668:x1818247333365888:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 7516us (7757us total) trans 4294968571 rc 0/0 00000100:00100000:0.0:1734016095.564249:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1966 00000020:00080000:0.0:1734016095.564254:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1734016095.566727:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27113c8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016095.566738:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27113c8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016095.566744:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27113c8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016095.566749:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4900 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016095.566753:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27113c8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016095.566762:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27113c8d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016095.566775:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016095.566777:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016095.566780:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27113c8d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016095.566785:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27113c8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00000100:00100000:1.0:1734016095.572380:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.584112:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333366528 00000100:00100000:0.0:1734016095.584119:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333366528 00002000:00100000:0.0:1734016095.584156:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9547776->9608084) req@ffff88012e606680 x1818247333366528/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/0 e 0 to 0 dl 1734016106 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016095.584164:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e606680 with x1818247333366528 ext(9547776->9608084) 00002000:00010000:0.0:1734016095.584169:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e606680 00000100:00100000:0.0:1734016095.584382:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7870 00000100:00100000:0.0:1734016095.584389:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333366528:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016095.588892:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333366528:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4493us (4925us total) trans 4294969164 rc 0/0 00000100:00100000:0.0:1734016095.588904:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7870 00002000:00100000:0.0:1734016095.588915:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9547776->9608084) req@ffff88012e606680 x1818247333366528/t4294969164(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/448 e 0 to 0 dl 1734016106 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016095.588924:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e606680 with x1818247333366528 ext(9547776->9608084) 00002000:00010000:0.0:1734016095.588929:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e606680 00000100:00100000:1.0:1734016095.591450:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.592071:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333366656 00000100:00100000:0.0:1734016095.592083:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333366656 00000100:00100000:0.0:1734016095.592144:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1967 00000100:00100000:0.0:1734016095.592152:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:9668:x1818247333366656:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:0.0:1734016095.592306:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:9668:x1818247333366656:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 143us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.592313:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1967 00000100:00100000:0.0:1734016095.594925:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333366784 00000100:00100000:0.0:1734016095.594939:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333366784 00000100:00100000:0.0:1734016095.594993:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10150 00000100:00100000:0.0:1734016095.595003:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333366784:12345-192.168.201.16@tcp:16:fsx.0 00000100:00100000:0.0:1734016095.597631:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333366784:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2626us (2835us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.597641:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10150 00000100:00100000:0.0:1734016095.606877:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333367040 00000100:00100000:0.0:1734016095.606885:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333367040 00000100:00100000:0.0:1734016095.606936:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10151 00000100:00100000:0.0:1734016095.606944:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333367040:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016095.606962:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016095.606981:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27113ca2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e460b expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016095.607042:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e255180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335184768:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016095.607113:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00002000:00010000:0.0:1734016095.609556:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016095 -> 1734016096 00002000:00010000:0.0:1734016095.609566:0:7682:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 1544 -> 1664 00000100:00100000:0.0:1734016095.609596:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e255180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335184768:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016095.609638:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27113ca2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e460b expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.609654:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27113ca2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e460b expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.610093:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75818c0, rc 0) 00000100:00100000:0.0:1734016095.610157:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333367040:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3211us (3374us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016095.610166:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10151 00000100:00100000:0.0:1734016095.613941:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333367168 00000100:00100000:0.0:1734016095.613949:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333367168 00000100:00100000:0.0:1734016095.613990:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10152 00000100:00100000:0.0:1734016095.613995:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333367168:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016095.614008:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016095.614023:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113ca9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4612 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.614049:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113c86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5263360->5267455) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45fd expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.614054:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016095.614056:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016095.614059:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113ca9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2076672->2080767] (req 2076672->2080767) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4612 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.614086:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113c86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5263360->5267455) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45fd expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.614096:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113c86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5263360->5267455) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45fd expref: 5 pid: 7682 timeout: 462 lvb_type: 0 00000100:00100000:0.0:1734016095.614106:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e255180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335184896:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016095.614159:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016095.618413:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e255180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335184896:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016095.618445:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113ca9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2076672->2080767] (req 2076672->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4612 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.618460:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016095.618525:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333367168:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4528us (4683us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.618534:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10152 00000100:00100000:0.0:1734016095.620281:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333367296 00000100:00100000:0.0:1734016095.620290:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333367296 00010000:00010000:0.0:1734016095.620332:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113c86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5263360->5267455) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45fd expref: 6 pid: 7682 timeout: 462 lvb_type: 0 00000100:00100000:0.0:1734016095.620364:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2702 00000100:00100000:0.0:1734016095.620369:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333367296:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016095.620380:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016095.620401:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113c86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5263360->5267455) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45fd expref: 6 pid: 7682 timeout: 462 lvb_type: 0 00010000:00010000:0.0:1734016095.620411:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113c86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5263360->5267455) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45fd expref: 6 pid: 7682 timeout: 462 lvb_type: 0 00010000:00010000:0.0:1734016095.620428:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27113c86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5263360->5267455) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e45fd expref: 6 pid: 7682 timeout: 462 lvb_type: 0 00010000:00010000:0.0:1734016095.620451:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016095.620453:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016095.620458:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113ca9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4612 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.620465:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113ca9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4612 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.620493:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113ca9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4612 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016095.620506:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e255180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335185024:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016095.620550:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016095.627028:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e255180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335185024:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016095.627050:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016095.627105:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333367296:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6733us (6900us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.627116:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2702 00000100:00100000:1.0:1734016095.627769:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333367552 00000100:00100000:1.0:1734016095.627778:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333367552 00002000:00100000:1.0:1734016095.627844:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2076672->9609215) req@ffff8800739e3480 x1818247333367552/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:56/0 lens 504/0 e 0 to 0 dl 1734016106 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.627855:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800739e3480 with x1818247333367552 ext(2076672->9609215) 00002000:00010000:1.0:1734016095.627861:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800739e3480 00000100:00100000:1.0:1734016095.627880:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7871 00000100:00100000:1.0:1734016095.627887:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333367552:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016095.632254:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333367552:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 4359us (5327us total) trans 0 rc 258048/258048 00000100:00100000:1.0:1734016095.632265:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7871 00002000:00100000:1.0:1734016095.632276:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2076672->9609215) req@ffff8800739e3480 x1818247333367552/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:56/0 lens 504/440 e 0 to 0 dl 1734016106 ref 1 fl Complete:/200/0 rc 258048/258048 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.632285:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800739e3480 with x1818247333367552 ext(2076672->9609215) 00002000:00010000:1.0:1734016095.632291:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800739e3480 00000100:00100000:0.0:1734016095.637239:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.637362:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333367808 00000100:00100000:1.0:1734016095.637374:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333367808 00002000:00100000:1.0:1734016095.637421:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2072576->2076671) req@ffff88012e255180 x1818247333367808/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:56/0 lens 488/0 e 0 to 0 dl 1734016106 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.637432:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e255180 with x1818247333367808 ext(2072576->2076671) 00002000:00010000:1.0:1734016095.637438:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e255180 00000100:00100000:1.0:1734016095.637644:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7872 00000100:00100000:1.0:1734016095.637652:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333367808:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016095.637875:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333367808:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 222us (647us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016095.637883:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7872 00002000:00100000:1.0:1734016095.637890:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2072576->2076671) req@ffff88012e255180 x1818247333367808/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:56/0 lens 488/4536 e 0 to 0 dl 1734016106 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.637897:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e255180 with x1818247333367808 ext(2072576->2076671) 00002000:00010000:1.0:1734016095.637901:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e255180 00000100:00100000:1.0:1734016095.649146:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333368320 00000100:00100000:1.0:1734016095.649156:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333368320 00002000:00100000:1.0:1734016095.649198:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2064384->2068479) req@ffff88012e606d80 x1818247333368320/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:56/0 lens 488/0 e 0 to 0 dl 1734016106 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.649207:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e606d80 with x1818247333368320 ext(2064384->2068479) 00002000:00010000:1.0:1734016095.649212:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e606d80 00000100:00100000:1.0:1734016095.649244:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7874 00000100:00100000:1.0:1734016095.649250:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333368320:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016095.649408:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333368320:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 158us (428us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016095.649415:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7874 00002000:00100000:1.0:1734016095.649420:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2064384->2068479) req@ffff88012e606d80 x1818247333368320/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:56/0 lens 488/4536 e 0 to 0 dl 1734016106 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.649427:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e606d80 with x1818247333368320 ext(2064384->2068479) 00002000:00010000:1.0:1734016095.649430:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e606d80 00000100:00100000:0.0:1734016095.653025:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.653969:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7875 00000100:00100000:1.0:1734016095.653981:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333368576:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016095.654227:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333368576:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 247us (1210us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016095.654234:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7875 00002000:00100000:1.0:1734016095.654240:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2060288->2064383) req@ffff880073bbd880 x1818247333368576/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:56/0 lens 488/4536 e 0 to 0 dl 1734016106 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.654248:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbd880 with x1818247333368576 ext(2060288->2064383) 00002000:00010000:1.0:1734016095.654253:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbd880 00000100:00100000:0.0:1734016095.669864:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.673842:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333369600 00000100:00100000:1.0:1734016095.673853:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333369600 00002000:00100000:1.0:1734016095.673905:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2043904->2047999) req@ffff8801369f2a00 x1818247333369600/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:56/0 lens 488/0 e 0 to 0 dl 1734016106 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.673916:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f2a00 with x1818247333369600 ext(2043904->2047999) 00002000:00010000:1.0:1734016095.673922:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f2a00 00000100:00100000:1.0:1734016095.673968:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7879 00000100:00100000:1.0:1734016095.673976:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333369600:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016095.674200:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333369600:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 223us (500us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016095.674208:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7879 00002000:00100000:1.0:1734016095.674213:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2043904->2047999) req@ffff8801369f2a00 x1818247333369600/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:56/0 lens 488/4536 e 0 to 0 dl 1734016106 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.674220:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f2a00 with x1818247333369600 ext(2043904->2047999) 00002000:00010000:1.0:1734016095.674223:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f2a00 00000100:00100000:0.0:1734016095.682088:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.682305:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333370112 00000100:00100000:1.0:1734016095.682315:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333370112 00002000:00100000:1.0:1734016095.682365:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2035712->2039807) req@ffff880073bbfb80 x1818247333370112/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:56/0 lens 488/0 e 0 to 0 dl 1734016106 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.682375:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbfb80 with x1818247333370112 ext(2035712->2039807) 00002000:00010000:1.0:1734016095.682381:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbfb80 00000100:00100000:1.0:1734016095.682422:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7881 00000100:00100000:1.0:1734016095.682429:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333370112:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016095.682651:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333370112:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 221us (573us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016095.682659:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7881 00002000:00100000:1.0:1734016095.682665:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2035712->2039807) req@ffff880073bbfb80 x1818247333370112/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:56/0 lens 488/4536 e 0 to 0 dl 1734016106 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.682672:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbfb80 with x1818247333370112 ext(2035712->2039807) 00002000:00010000:1.0:1734016095.682674:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbfb80 00000100:00100000:0.0:1734016095.694218:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333370496 00000100:00100000:0.0:1734016095.694226:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333370496 00000100:00100000:0.0:1734016095.694266:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10153 00000100:00100000:0.0:1734016095.694272:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333370496:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016095.694288:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016095.694313:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27113cb0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4619 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.694338:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016095.694340:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016095.694348:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27113cb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4619 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.694363:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27113cb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4619 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.694375:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:0.0:1734016095.694444:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333370496:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 170us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.694450:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10153 00000100:00100000:0.0:1734016095.697161:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.703886:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333370752 00000100:00100000:0.0:1734016095.703895:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333370752 00010000:00010000:0.0:1734016095.703927:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27113cb0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4619 expref: 7 pid: 7682 timeout: 462 lvb_type: 1 00000100:00100000:0.0:1734016095.703958:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333370880 00000100:00100000:0.0:1734016095.703960:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333370880 00010000:00010000:0.0:1734016095.703971:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113ca9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4612 expref: 7 pid: 7682 timeout: 462 lvb_type: 0 00000100:00100000:0.0:1734016095.703988:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2703 00000100:00100000:0.0:1734016095.703994:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333370752:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016095.704005:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016095.704024:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27113cb0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4619 expref: 7 pid: 7682 timeout: 462 lvb_type: 1 00010000:00010000:0.0:1734016095.704035:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27113cb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4619 expref: 7 pid: 7682 timeout: 462 lvb_type: 1 00010000:00010000:0.0:1734016095.704057:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27113cb0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4619 expref: 7 pid: 7682 timeout: 462 lvb_type: 1 00010000:00010000:0.0:1734016095.704076:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016095.704132:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333370752:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 137us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.704139:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2703 00000100:00100000:0.0:1734016095.704154:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2704 00000100:00100000:0.0:1734016095.704158:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333370880:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016095.704166:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016095.704173:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113ca9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4612 expref: 7 pid: 7682 timeout: 462 lvb_type: 0 00010000:00010000:0.0:1734016095.704182:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113ca9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2080767) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4612 expref: 7 pid: 7682 timeout: 462 lvb_type: 0 00010000:00010000:0.0:1734016095.704193:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27113ca9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2080767) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4612 expref: 7 pid: 7682 timeout: 462 lvb_type: 0 00010000:00010000:0.0:1734016095.704201:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016095.704202:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016095.704208:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113cb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->1839103) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4620 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.704216:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113cb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->1839103) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4620 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.704249:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113cb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->1839103) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4620 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016095.704267:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335185408:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016095.704319:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016095.710495:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335185408:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016095.710518:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016095.711159:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333370880:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6996us (7367us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.711171:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2704 00000100:00100000:0.0:1734016095.711942:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333371008 00000100:00100000:0.0:1734016095.711949:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333371008 00000100:00100000:0.0:1734016095.711978:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10155 00000100:00100000:0.0:1734016095.711983:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333371008:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016095.712208:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9608085 -> 9608085 00002000:00010000:0.0:1734016095.712211:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016096 -> 1734016096 00002000:00010000:0.0:1734016095.712213:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016096 -> 1734016095 00002000:00010000:0.0:1734016095.712215:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016096 -> 1734016096 00002000:00010000:0.0:1734016095.712217:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1664 -> 1664 00000100:00100000:0.0:1734016095.712265:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333371008:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 280us (506us total) trans 4294969165 rc 0/0 00000100:00100000:0.0:1734016095.712270:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10155 00000100:00100000:1.0:1734016095.729522:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333371776 00000100:00100000:1.0:1734016095.729536:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333371776 00002000:00100000:1.0:1734016095.729585:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6279168->6283263) req@ffff880075fc7100 x1818247333371776/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/0 e 0 to 0 dl 1734016106 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.729596:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7100 with x1818247333371776 ext(6279168->6283263) 00002000:00010000:1.0:1734016095.729602:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc7100 00000100:00100000:1.0:1734016095.729674:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7885 00000100:00100000:1.0:1734016095.729681:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333371776:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016095.729894:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333371776:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 213us (1165us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016095.729901:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7885 00002000:00100000:1.0:1734016095.729906:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6279168->6283263) req@ffff880075fc7100 x1818247333371776/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/4536 e 0 to 0 dl 1734016106 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.729912:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7100 with x1818247333371776 ext(6279168->6283263) 00002000:00010000:1.0:1734016095.729914:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc7100 00000100:00100000:1.0:1734016095.739913:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333372288 00000100:00100000:1.0:1734016095.739928:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333372288 00002000:00100000:1.0:1734016095.739989:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6270976->6275071) req@ffff880075fc6a00 x1818247333372288/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/0 e 0 to 0 dl 1734016106 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.740000:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc6a00 with x1818247333372288 ext(6270976->6275071) 00002000:00010000:1.0:1734016095.740006:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc6a00 00000100:00100000:1.0:1734016095.740609:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7887 00000100:00100000:1.0:1734016095.740616:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333372288:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016095.740848:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333372288:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 231us (1515us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016095.740855:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7887 00002000:00100000:1.0:1734016095.740860:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6270976->6275071) req@ffff880075fc6a00 x1818247333372288/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/4536 e 0 to 0 dl 1734016106 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.740868:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc6a00 with x1818247333372288 ext(6270976->6275071) 00002000:00010000:1.0:1734016095.740871:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc6a00 00000100:00100000:1.0:1734016095.756966:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333372800 00000100:00100000:1.0:1734016095.756977:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333372800 00002000:00100000:1.0:1734016095.757033:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6262784->6266879) req@ffff880075fc4a80 x1818247333372800/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/0 e 0 to 0 dl 1734016106 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.757044:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc4a80 with x1818247333372800 ext(6262784->6266879) 00002000:00010000:1.0:1734016095.757049:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc4a80 00000100:00100000:1.0:1734016095.757426:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7889 00000100:00100000:1.0:1734016095.757431:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333372800:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016095.758334:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333372800:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 899us (1485us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016095.758345:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7889 00002000:00100000:1.0:1734016095.758351:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6262784->6266879) req@ffff880075fc4a80 x1818247333372800/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/4536 e 0 to 0 dl 1734016106 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.758359:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc4a80 with x1818247333372800 ext(6262784->6266879) 00002000:00010000:1.0:1734016095.758363:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc4a80 00000100:00100000:1.0:1734016095.768492:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333372928 00000100:00100000:1.0:1734016095.768501:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333372928 00002000:00100000:1.0:1734016095.768539:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6262784->6291455) req@ffff880075fc7b80 x1818247333372928/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/0 e 0 to 0 dl 1734016106 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.768548:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7b80 with x1818247333372928 ext(6262784->6291455) 00002000:00010000:1.0:1734016095.768552:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc7b80 00000100:00100000:1.0:1734016095.768634:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7890 00000100:00100000:1.0:1734016095.768641:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333372928:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016095.773744:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333372928:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 5082us (5332us total) trans 4294969166 rc 0/0 00000100:00100000:0.0:1734016095.773763:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7890 00002000:00100000:0.0:1734016095.773781:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6262784->6291455) req@ffff880075fc7b80 x1818247333372928/t4294969166(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/448 e 0 to 0 dl 1734016106 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016095.773791:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7b80 with x1818247333372928 ext(6262784->6291455) 00002000:00010000:0.0:1734016095.773824:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc7b80 00000100:00100000:0.0:1734016095.788905:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333373184 00000100:00100000:0.0:1734016095.788918:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333373184 00000100:00100000:0.0:1734016095.788982:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1969 00000100:00100000:0.0:1734016095.788990:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+24:9668:x1818247333373184:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016095.789016:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016095.789039:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27113cbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4627 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.789142:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27113cc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016095.789157:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27113cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016095.789167:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27113cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016095.789194:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 9608085 00000004:00200000:0.0:1734016095.789198:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016095.789212:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27113cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016095.789232:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27113cbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4627 expref: 26 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.789263:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27113cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4627 expref: 25 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.789272:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016095.789274:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016095.789276:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016095.789344:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+25:9668:x1818247333373184:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 354us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.789350:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1969 00000100:00100000:0.0:1734016095.817409:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333373696 00000100:00100000:0.0:1734016095.817417:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333373696 00000100:00100000:0.0:1734016095.817481:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7891 00000100:00100000:0.0:1734016095.817488:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333373696:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:0.0:1734016095.817529:0:13914:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113cda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.817545:0:13914:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113cb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->1839103) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4620 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.817552:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016095.817554:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016095.817557:0:13914:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113cda lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2154496->2195455] (req 2154496->2195455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.817592:0:13914:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113cb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->1839103) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4620 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.817603:0:13914:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113cb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->1839103) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4620 expref: 6 pid: 7684 timeout: 462 lvb_type: 0 00000100:00100000:0.0:1734016095.817619:0:13914:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335185792:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016095.817685:0:13914:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016095.825793:0:13914:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335185792:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016095.825837:0:13914:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113cda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2154496->2195455] (req 2154496->2195455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016095.825898:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333373824 00000100:00100000:1.0:1734016095.825903:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333373824 00010000:00010000:1.0:1734016095.825928:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113cb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4620 expref: 7 pid: 7684 timeout: 462 lvb_type: 0 00000100:00100000:1.0:1734016095.825960:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2705 00000100:00100000:1.0:1734016095.825964:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333373824:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016095.825975:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016095.825995:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113cb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1794048->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4620 expref: 7 pid: 7684 timeout: 462 lvb_type: 0 00010000:00010000:1.0:1734016095.826009:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113cb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1794048->1839103) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4620 expref: 7 pid: 7684 timeout: 462 lvb_type: 0 00010000:00010000:1.0:1734016095.826026:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27113cb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1794048->1839103) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4620 expref: 7 pid: 7684 timeout: 462 lvb_type: 0 00010000:00010000:1.0:1734016095.826041:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016095.826043:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016095.826046:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113cda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2154496->2195455] (req 2154496->2195455) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016095.826053:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113cda lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2154496->2195455] (req 2154496->2195455) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016095.826071:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016095.826125:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333373824:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 159us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016095.826132:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2705 00010000:00010000:0.0:1734016095.826319:0:13914:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113cda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2154496->2195455] (req 2154496->2195455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.826326:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113cda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2154496->2195455] (req 2154496->2195455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016095.840977:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1720 -> 1800 00010000:00010000:1.0:1734016095.840995:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113cda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2154496->2195455] (req 2154496->2195455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016095.841005:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113cda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2154496->2195455] (req 2154496->2195455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016095.841012:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113cda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2154496->2195455] (req 2154496->2195455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016095.841022:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7580480 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016095.841026:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113cda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2154496->2195455] (req 2154496->2195455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016095.841032:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113cda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2154496->2195455] (req 2154496->2195455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016095.841045:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113cda lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2154496->2195455] (req 2154496->2195455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016095.841050:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113cda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2154496->2195455] (req 2154496->2195455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016095.841207:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333373696:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 23714us (23969us total) trans 4294969167 rc 0/0 00000100:00100000:1.0:1734016095.841216:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7891 00000100:00100000:1.0:1734016095.854131:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333374208 00000100:00100000:1.0:1734016095.854142:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333374208 00000100:00100000:1.0:1734016095.854192:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1970 00000100:00100000:1.0:1734016095.854201:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+25:9668:x1818247333374208:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016095.854251:0:7704:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016095.854275:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27113cc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4627 expref: 25 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016095.854441:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016095.854446:0:7704:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016095.854617:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27113ce8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016095.854637:0:7704:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27113c9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4604 expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016095.854645:0:7704:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27113ce8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016095.854847:0:7704:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27113c9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4604 expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016095.854859:0:7704:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27113c9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4604 expref: 21 pid: 13956 timeout: 462 lvb_type: 0 00000100:00100000:1.0:1734016095.854875:0:7704:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800752a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335185920:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016095.855059:0:7704:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016095.858218:0:7704:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800752a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335185920:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016095.858261:0:7704:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27113ce8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016095.861927:0:7704:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27113ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016095.861935:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27113ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:0.0:1734016095.862018:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968572 00000004:00010000:0.0:1734016095.862060:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8801369f2d80 reply state ffff88007bc4b000 transno 4294968573 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27113ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016095.862068:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016095.865740:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+27:9668:x1818247333374208:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 11538us (12084us total) trans 4294968573 rc 0/0 00000100:00100000:0.0:1734016095.865747:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1970 00000020:00080000:0.0:1734016095.865752:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016095.870156:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333374464 00000100:00100000:0.0:1734016095.870165:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333374464 00000100:00100000:0.0:1734016095.870215:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10160 00000100:00100000:0.0:1734016095.870222:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333374464:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016095.870241:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016095.870255:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113cef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4643 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.870284:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27113ce1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e463c expref: 5 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.870300:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016095.870302:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016095.870306:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113cef lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4643 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.870337:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27113ce1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e463c expref: 5 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.870347:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27113ce1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e463c expref: 5 pid: 7682 timeout: 463 lvb_type: 1 00000100:00100000:0.0:1734016095.870361:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335186048:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016095.870431:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eeb40 going to sleep for 11 seconds 00010000:00010000:1.0:1734016095.870522:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27113ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016095.870530:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27113ce8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016095.870536:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27113ce8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016095.870541:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499e880 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:1.0:1734016095.870544:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27113ce8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016095.870550:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27113ce8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016095.870564:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016095.870567:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1734016095.870570:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27113ce8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016095.870574:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27113ce8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016095.874884:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335186048:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016095.874918:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113cef lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4643 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.874933:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:0.0:1734016095.874980:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333374464:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4758us (4888us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.874989:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10160 00000100:00100000:1.0:1734016095.879441:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333374720 00000100:00100000:1.0:1734016095.879448:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333374720 00002000:00010000:1.0:1734016095.879481:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (9106781->18446744073709551615) 00002000:00100000:1.0:1734016095.879485:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad180 with x1818247333374720 ext(9106781->18446744073709551615) 00002000:00010000:1.0:1734016095.879496:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ad180. 00000100:00100000:1.0:1734016095.879528:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7892 00000100:00100000:1.0:1734016095.879534:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333374720:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016095.879964:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9608085 -> 9106781 00002000:00010000:1.0:1734016095.879968:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016096 -> 1734016096 00002000:00010000:1.0:1734016095.879970:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016096 -> 1734016096 00002000:00010000:1.0:1734016095.879972:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016096 -> 1734016096 00002000:00010000:1.0:1734016095.879974:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1800 -> 1680 00000100:00100000:1.0:1734016095.880026:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333374720:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 491us (671us total) trans 4294969168 rc 0/0 00000100:00100000:1.0:1734016095.880032:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7892 00002000:00010000:1.0:1734016095.880035:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (9106781->18446744073709551615) 00002000:00100000:1.0:1734016095.880037:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad180 with x1818247333374720 ext(9106781->18446744073709551615) 00002000:00010000:1.0:1734016095.880040:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ad180. 00000100:00100000:0.0:1734016095.881580:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335186176:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016095.881602:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016095.881639:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333374592:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6498us (6962us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.881646:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2707 00000100:00100000:0.0:1734016095.886649:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333374848 00000100:00100000:0.0:1734016095.886658:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333374848 00000100:00100000:0.0:1734016095.887700:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1971 00000100:00100000:0.0:1734016095.887709:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:9668:x1818247333374848:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016095.887734:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016095.887755:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27113cf6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e464a expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.887855:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113cfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016095.887867:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016095.887876:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:0.0:1734016095.887900:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 9106781 00000004:00200000:0.0:1734016095.887903:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016095.887915:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016095.887935:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27113cf6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e464a expref: 23 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.887953:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27113cfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e464a expref: 22 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.887959:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016095.887962:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016095.887964:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75818c0, rc 0) 00000100:00100000:0.0:1734016095.888039:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:9668:x1818247333374848:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 330us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.888049:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1971 00000100:00100000:0.0:1734016095.891219:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333374976 00000100:00100000:0.0:1734016095.891227:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333374976 00000100:00100000:0.0:1734016095.891256:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10161 00000100:00100000:0.0:1734016095.891262:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333374976:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016095.891277:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016095.891299:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27113d04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4651 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016095.891350:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335186304:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016095.891414:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eef00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016095.893362:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335186304:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016095.893390:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27113d04 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4651 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.893401:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27113d04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4651 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.893411:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581b00, rc 0) 00000100:00100000:0.0:1734016095.893908:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333374976:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2644us (2810us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016095.893917:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10161 00000100:00100000:0.0:1734016095.898103:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333375104 00000100:00100000:0.0:1734016095.898115:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333375104 00000100:00100000:0.0:1734016095.898165:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10162 00000100:00100000:0.0:1734016095.898172:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333375104:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016095.898194:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016095.898213:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27113d0b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4658 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016095.898280:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335186432:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016095.898368:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eef00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016095.902192:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335186432:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016095.902231:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27113d0b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4658 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.902244:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27113d0b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4658 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.902260:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581b00, rc 0) 00000100:00100000:0.0:1734016095.902324:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333375104:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4151us (4550us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016095.902332:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10162 00000100:00100000:0.0:1734016095.906558:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333375232 00000100:00100000:0.0:1734016095.906565:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333375232 00000100:00100000:0.0:1734016095.906893:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1972 00000100:00100000:0.0:1734016095.906901:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+26:9668:x1818247333375232:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016095.906922:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016095.906938:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27113d12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e465f expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.907018:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27113d19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016095.907031:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27113d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016095.907043:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27113d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:0.0:1734016095.907072:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 9106781 00000004:00200000:0.0:1734016095.907075:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016095.907088:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27113d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016095.907111:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27113d12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e465f expref: 28 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.907151:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27113d19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e465f expref: 27 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.907157:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016095.907159:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016095.907162:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581680, rc 0) 00000100:00100000:0.0:1734016095.908168:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+27:9668:x1818247333375232:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1265us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.908175:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1972 00000100:00100000:0.0:1734016095.912230:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333375360 00000100:00100000:0.0:1734016095.912240:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333375360 00000100:00100000:0.0:1734016095.912308:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10163 00000100:00100000:0.0:1734016095.912316:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333375360:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016095.912339:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016095.912359:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113d20 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4666 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016095.912420:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335186560:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016095.912498:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016095.919672:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.926721:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.936223:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.940911:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.941002:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333376128 00000100:00100000:1.0:1734016095.941011:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333376128 00002000:00100000:1.0:1734016095.941047:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8003584->8007679) req@ffff8800739e2a00 x1818247333376128/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/0 e 0 to 0 dl 1734016106 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.941055:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800739e2a00 with x1818247333376128 ext(8003584->8007679) 00002000:00010000:1.0:1734016095.941060:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800739e2a00 00000100:00100000:1.0:1734016095.941089:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7894 00000100:00100000:1.0:1734016095.941095:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333376128:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016095.941250:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333376128:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 154us (348us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016095.941257:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7894 00002000:00100000:1.0:1734016095.941262:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8003584->8007679) req@ffff8800739e2a00 x1818247333376128/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/4536 e 0 to 0 dl 1734016106 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016095.941268:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800739e2a00 with x1818247333376128 ext(8003584->8007679) 00002000:00010000:1.0:1734016095.941270:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800739e2a00 00000100:00100000:0.0:1734016095.945518:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.949049:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.953577:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.953619:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.965797:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333376896 00000100:00100000:0.0:1734016095.965888:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333376896 00000100:00100000:0.0:1734016095.965959:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10166 00000100:00100000:0.0:1734016095.965966:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333376896:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016095.965982:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016095.965999:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113d3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e467b expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016095.966019:0:7682:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 9106781, mtime: 0x675afc60, atime: 0x675afc60, ctime: 0x675afc60, blocks: 0x6f0 00010000:00010000:0.0:1734016095.966036:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016095.966038:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016095.966046:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113d3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e467b expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.966065:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113d3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e467b expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016095.966074:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:0.0:1734016095.966128:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333376896:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 162us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016095.966134:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10166 00000100:00100000:0.0:1734016095.971380:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.977727:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333377152 00000100:00100000:0.0:1734016095.977734:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333377152 00010000:00010000:0.0:1734016095.977761:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113d3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e467b expref: 7 pid: 7682 timeout: 463 lvb_type: 1 00000100:00100000:0.0:1734016095.977792:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2711 00000100:00100000:0.0:1734016095.977798:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333377152:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016095.977824:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016095.977842:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113d3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e467b expref: 7 pid: 7682 timeout: 463 lvb_type: 1 00010000:00010000:0.0:1734016095.977853:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113d3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e467b expref: 7 pid: 7682 timeout: 463 lvb_type: 1 00010000:00010000:0.0:1734016095.977885:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27113d3c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e467b expref: 7 pid: 7682 timeout: 463 lvb_type: 1 00010000:00010000:0.0:1734016095.977913:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016095.977915:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016095.977920:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27113d43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1105919) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4682 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.977929:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27113d43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1105919) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4682 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016095.977958:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27113d43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1105919) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4682 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016095.977973:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073944700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335187328:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016095.978025:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eec00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016095.981792:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.989025:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016095.994079:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016095.999698:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333378048 00000100:00100000:0.0:1734016095.999710:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333378048 00002000:00100000:0.0:1734016095.999752:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (8060928->8065023) req@ffff8800749ae680 x1818247333378048/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:56/0 lens 488/0 e 0 to 0 dl 1734016106 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016095.999760:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ae680 with x1818247333378048 ext(8060928->8065023) 00002000:00010000:0.0:1734016095.999766:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ae680 00000100:00100000:1.0:1734016096.004974:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016096.005670:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016066 00000100:00100000:1.0:1734016096.009042:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.013070:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333378816 00000100:00100000:0.0:1734016096.013082:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333378816 00002000:00100000:0.0:1734016096.013129:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8048640->8052735) req@ffff8800749adc00 x1818247333378816/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:57/0 lens 488/0 e 0 to 0 dl 1734016107 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016096.013144:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749adc00 with x1818247333378816 ext(8048640->8052735) 00002000:00010000:0.0:1734016096.013150:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749adc00 00000100:00100000:0.0:1734016096.013187:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7901 00000100:00100000:0.0:1734016096.013194:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333378816:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016096.013391:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333378816:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 197us (1031us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016096.013399:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7901 00002000:00100000:0.0:1734016096.013405:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8048640->8052735) req@ffff8800749adc00 x1818247333378816/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:57/0 lens 488/4536 e 0 to 0 dl 1734016107 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016096.013412:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749adc00 with x1818247333378816 ext(8048640->8052735) 00002000:00010000:0.0:1734016096.013414:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749adc00 00000100:00100000:1.0:1734016096.016789:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.020264:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.024105:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333379584 00000100:00100000:0.0:1734016096.024113:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333379584 00002000:00100000:0.0:1734016096.024154:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8036352->8040447) req@ffff8800749aca80 x1818247333379584/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:57/0 lens 488/0 e 0 to 0 dl 1734016107 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016096.024164:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749aca80 with x1818247333379584 ext(8036352->8040447) 00002000:00010000:0.0:1734016096.024169:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749aca80 00000100:00100000:0.0:1734016096.024198:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7904 00000100:00100000:0.0:1734016096.024204:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333379584:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016096.024377:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333379584:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 172us (359us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016096.024384:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7904 00002000:00100000:0.0:1734016096.024389:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8036352->8040447) req@ffff8800749aca80 x1818247333379584/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:57/0 lens 488/4536 e 0 to 0 dl 1734016107 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016096.024397:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749aca80 with x1818247333379584 ext(8036352->8040447) 00002000:00010000:0.0:1734016096.024399:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749aca80 00000100:00100000:1.0:1734016096.027224:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.032150:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.032191:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.032229:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.032365:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333380352 00000100:00100000:0.0:1734016096.032368:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333380352 00002000:00100000:0.0:1734016096.032396:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8028160->8032255) req@ffff8800758af480 x1818247333380352/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:57/0 lens 488/0 e 0 to 0 dl 1734016107 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016096.032405:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758af480 with x1818247333380352 ext(8028160->8032255) 00002000:00010000:0.0:1734016096.032409:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758af480 00000100:00100000:0.0:1734016096.032424:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7906 00000100:00100000:0.0:1734016096.032429:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333380352:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016096.032563:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333380352:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 133us (333us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016096.032569:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7906 00002000:00100000:0.0:1734016096.032573:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8028160->8032255) req@ffff8800758af480 x1818247333380352/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:57/0 lens 488/4536 e 0 to 0 dl 1734016107 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016096.032579:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758af480 with x1818247333380352 ext(8028160->8032255) 00002000:00010000:0.0:1734016096.032581:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758af480 00000100:00080000:0.0:1734016096.033857:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016066 00000100:00080000:0.0:1734016096.034541:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016066 00000100:00100000:1.0:1734016096.037868:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333380480 00000100:00100000:1.0:1734016096.037876:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333380480 00000100:00100000:1.0:1734016096.037922:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10169 00000100:00100000:1.0:1734016096.037929:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333380480:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016096.037946:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016096.037960:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27113d4a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4689 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016096.038012:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335187456:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016096.038065:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016096.043175:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.051702:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.061493:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.071379:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.071458:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333381120 00000100:00100000:0.0:1734016096.071468:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333381120 00000100:00100000:0.0:1734016096.071523:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7907 00000100:00100000:0.0:1734016096.071530:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333381120:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:0.0:1734016096.071563:0:14005:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113d66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016096.071579:0:14005:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27113d43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1105919) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4682 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016096.071585:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016096.071587:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016096.071589:0:14005:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113d66 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6336512->6369279] (req 6336512->6369279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016096.071617:0:14005:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27113d43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1105919) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4682 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016096.071626:0:14005:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27113d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1105919) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4682 expref: 7 pid: 7684 timeout: 463 lvb_type: 0 00000100:00100000:0.0:1734016096.071638:0:14005:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14005:1818247335187968:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016096.071693:0:14005:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee180 going to sleep for 11 seconds 00000100:00100000:1.0:1734016096.077565:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016096.078364:0:14005:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113d66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6336512->6369279] (req 6336512->6369279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016096.078371:0:14005:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113d66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6336512->6369279] (req 6336512->6369279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016096.089284:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.090384:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10173 00000100:00100000:0.0:1734016096.090393:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333381376:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016096.090413:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016096.090431:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113d6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e46a5 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016096.090453:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 9106781, mtime: 0x675afc60, atime: 0x675afc60, ctime: 0x675afc60, blocks: 0x730 00010000:00010000:0.0:1734016096.090469:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016096.090471:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016096.090479:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113d6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46a5 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016096.090492:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113d6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46a5 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016096.090503:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:0.0:1734016096.090642:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333381376:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 249us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016096.090650:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10173 00000100:00100000:1.0:1734016096.094202:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.094298:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333381504 00000100:00100000:0.0:1734016096.094306:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333381504 00000100:00100000:0.0:1734016096.094838:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10174 00000100:00100000:0.0:1734016096.094845:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333381504:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016096.094860:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016096.094874:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27113d74 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e46ac expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016096.094894:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016096.094896:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016096.094903:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27113d74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46ac expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016096.094913:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27113d74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46ac expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016096.094922:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:0.0:1734016096.094961:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333381504:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 117us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016096.094966:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10174 00000100:00100000:1.0:1734016096.101667:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.119467:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.127576:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.130320:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.130525:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333382144 00000100:00100000:0.0:1734016096.130529:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333382144 00010000:00010000:0.0:1734016096.130540:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27113d74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46ac expref: 6 pid: 7684 timeout: 463 lvb_type: 1 00000100:00100000:0.0:1734016096.130560:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2714 00000100:00100000:0.0:1734016096.130564:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333382144:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016096.130572:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016096.130580:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27113d74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46ac expref: 6 pid: 7684 timeout: 463 lvb_type: 1 00010000:00010000:0.0:1734016096.130588:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27113d74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46ac expref: 6 pid: 7684 timeout: 463 lvb_type: 1 00010000:00010000:0.0:1734016096.130598:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27113d74 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46ac expref: 6 pid: 7684 timeout: 463 lvb_type: 1 00010000:00010000:0.0:1734016096.130614:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016096.130616:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016096.130621:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27113d82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4935680->4972543) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46b3 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016096.130628:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27113d82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4935680->4972543) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46b3 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016096.130654:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27113d82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4935680->4972543) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46b3 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016096.130666:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335188352:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016096.130698:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016096.135753:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.139954:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.144519:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016096.149217:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969173 is committed 00000100:00100000:0.0:1734016096.153102:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333382784 00000100:00100000:0.0:1734016096.153111:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333382784 00000100:00100000:0.0:1734016096.153155:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10177 00000100:00100000:0.0:1734016096.153162:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333382784:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016096.153177:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016096.153194:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113d90 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e46ba expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016096.153214:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 9106781, mtime: 0x675afc60, atime: 0x675afc60, ctime: 0x675afc60, blocks: 0x758 00010000:00010000:0.0:1734016096.153233:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016096.153235:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016096.153241:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113d90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46ba expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016096.153252:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113d90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46ba expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016096.153260:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:0.0:1734016096.153315:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333382784:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 153us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016096.153321:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10177 00000100:00100000:0.0:1734016096.155719:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.159645:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.159729:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333383040 00000100:00100000:0.0:1734016096.159740:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333383040 00000100:00100000:0.0:1734016096.159852:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10179 00000100:00100000:0.0:1734016096.159860:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333383040:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016096.159879:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016096.159897:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27113d9e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e46c8 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016096.159924:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113d90 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46ba expref: 5 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016096.159931:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27113d97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46c1 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016096.159941:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016096.159943:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016096.159946:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27113d9e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5955584->5959679] (req 5955584->5959679) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46c8 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016096.159976:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27113d97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46c1 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016096.159988:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27113d97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46c1 expref: 8 pid: 7682 timeout: 463 lvb_type: 1 00000100:00100000:0.0:1734016096.160002:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335188608:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016096.160072:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113d90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46ba expref: 5 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016096.160080:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27113d90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46ba expref: 5 pid: 7684 timeout: 463 lvb_type: 1 00000100:00100000:0.0:1734016096.160089:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335188736:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016096.160105:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016096.163645:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335188608:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016096.163656:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335188736:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016096.163682:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27113d9e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5955584->5959679] (req 5955584->5959679) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46c8 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016096.163703:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:0.0:1734016096.164351:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333383040:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4488us (4715us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016096.164359:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10179 00000100:00100000:1.0:1734016096.165449:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.165493:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.170956:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.176543:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.180957:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.186153:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.191681:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.196027:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.199175:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:1.0:1734016096.200995:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969174 is committed 00000100:00100000:1.0:1734016096.205187:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.213677:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.220911:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.227730:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.240112:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.244941:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.248001:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.258142:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.266477:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.270588:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016096.270655:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27113dcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016096.270666:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27113dcf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016096.270672:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27113dcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016096.270680:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd200 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016096.270684:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27113dcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016096.270693:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27113dcf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016096.270709:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016096.270712:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016096.270716:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27113dcf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016096.270723:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27113dcf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016096.281243:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.281676:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.289508:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.295304:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.299619:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.307592:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.315208:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.315302:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333387392 00000100:00100000:0.0:1734016096.315310:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333387392 00000100:00100000:0.0:1734016096.315536:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1976 00000100:00100000:0.0:1734016096.315543:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:9668:x1818247333387392:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016096.315589:0:7704:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016096.315612:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27113de4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e46f2 expref: 12 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016096.315640:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016096.315644:0:7704:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016096.315770:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27113df9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016096.315780:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27113df9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016096.315786:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27113df9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:0.0:1734016096.316060:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968576 00000004:00010000:0.0:1734016096.316078:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075df1180 reply state ffff8801309f6000 transno 4294968577 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27113df9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016096.316084:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016096.316269:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333387392:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 726us (1071us total) trans 4294968577 rc 0/0 00000100:00100000:0.0:1734016096.316275:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1976 00000020:00080000:0.0:1734016096.316279:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1734016096.319047:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27113df9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016096.319059:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27113df9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016096.319066:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27113df9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016096.319071:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581440 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:1.0:1734016096.319076:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27113df9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016096.319082:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27113df9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016096.319097:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016096.319099:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1734016096.319103:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27113df9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016096.319107:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27113df9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016096.319634:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.324029:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.331239:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.336787:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.337031:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333387904 00000100:00100000:0.0:1734016096.337040:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333387904 00000100:00100000:0.0:1734016096.337894:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1977 00000100:00100000:0.0:1734016096.337904:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:9668:x1818247333387904:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016096.337927:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016096.337945:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27113e07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e470e expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016096.338023:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27113e0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016096.338036:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27113e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016096.338044:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27113e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:0.0:1734016096.338065:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 3896659 00000004:00200000:0.0:1734016096.338067:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016096.338080:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27113e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016096.338098:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27113e07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e470e expref: 15 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016096.339125:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27113e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e470e expref: 14 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016096.339135:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016096.339138:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016096.339140:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582d00, rc 0) 00000100:00100000:0.0:1734016096.339206:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333387904:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1302us (2428us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016096.339213:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1977 00000100:00100000:0.0:1734016096.344822:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333388160 00000100:00100000:0.0:1734016096.344831:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333388160 00000100:00100000:0.0:1734016096.344870:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1978 00000100:00100000:0.0:1734016096.344875:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333388160:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016096.344916:0:7704:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016096.344937:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27113e0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e470e expref: 14 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016096.344961:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016096.344964:0:7704:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016096.345084:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27113e15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016096.345095:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27113e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016096.345102:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27113e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:0.0:1734016096.345129:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968578 00000004:00010000:0.0:1734016096.345145:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007bd3f480 reply state ffff880075f72000 transno 4294968579 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27113e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016096.345153:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016096.345217:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333388160:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 341us (494us total) trans 4294968579 rc 0/0 00000100:00100000:0.0:1734016096.345223:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1978 00000020:00080000:0.0:1734016096.345226:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1734016096.351374:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27113e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016096.351389:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27113e15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016096.351396:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27113e15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016096.351402:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a75821c0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016096.351405:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27113e15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016096.351412:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27113e15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016096.351429:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016096.351432:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016096.351436:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27113e15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016096.351440:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27113e15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016096.354156:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333388288 00000100:00100000:0.0:1734016096.354166:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333388288 00002000:00010000:0.0:1734016096.354194:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (8324451->18446744073709551615) 00002000:00100000:0.0:1734016096.354199:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3ed80 with x1818247333388288 ext(8324451->18446744073709551615) 00002000:00010000:0.0:1734016096.354207:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3ed80. 00000100:00100000:0.0:1734016096.354831:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7919 00000100:00100000:0.0:1734016096.354840:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333388288:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016096.355038:0:14005:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 3896659 -> 8324451 00002000:00010000:0.0:1734016096.355041:0:14005:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016096 -> 1734016096 00002000:00010000:0.0:1734016096.355043:0:14005:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016096 -> 1734016096 00002000:00010000:0.0:1734016096.355044:0:14005:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016096 -> 1734016096 00002000:00010000:0.0:1734016096.355046:0:14005:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1336 -> 1336 00000100:00100000:0.0:1734016096.355113:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333388288:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 272us (1340us total) trans 4294969177 rc 0/0 00000100:00100000:0.0:1734016096.355121:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7919 00002000:00010000:0.0:1734016096.355124:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (8324451->18446744073709551615) 00002000:00100000:0.0:1734016096.355127:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3ed80 with x1818247333388288 ext(8324451->18446744073709551615) 00002000:00010000:0.0:1734016096.355132:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3ed80. 00000100:00100000:1.0:1734016096.359321:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.364384:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.373742:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.397911:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.397963:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.498534:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.508645:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333389440 00000100:00100000:0.0:1734016096.508658:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333389440 00000100:00100000:0.0:1734016096.508891:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10192 00000100:00100000:0.0:1734016096.508898:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333389440:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016096.508922:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016096.508944:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27113e3f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4731 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016096.509017:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335190784:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016096.509720:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016096.512441:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335190784:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016096.512498:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27113e3f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4731 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016096.512516:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27113e3f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4731 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016096.512544:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580900, rc 0) 00000100:00100000:0.0:1734016096.512610:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333389440:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3710us (4194us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016096.512621:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10192 00000100:00100000:0.0:1734016096.516123:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.525139:0:13914:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335190912:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016096.525181:0:13914:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27113e46 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6885376->6909951] (req 6885376->6909951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016096.533947:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016096.536178:0:13914:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27113e46 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6885376->6909951] (req 6885376->6909951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016096.536188:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27113e46 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6885376->6909951] (req 6885376->6909951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016096.547758:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333389952 00000100:00100000:0.0:1734016096.547767:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333389952 00000100:00100000:0.0:1734016096.548110:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10193 00000100:00100000:0.0:1734016096.548117:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333389952:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016096.548135:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016096.548151:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27113e4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4738 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016096.548169:0:7682:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 8324451, mtime: 0x675afc60, atime: 0x675afc60, ctime: 0x675afc60, blocks: 0x538 00010000:00010000:0.0:1734016096.548189:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016096.548191:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016096.548198:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27113e4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4738 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016096.548212:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27113e4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4738 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016096.548221:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00000100:00100000:0.0:1734016096.548292:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333389952:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 174us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016096.548297:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10193 00000100:00100000:1.0:1734016096.552086:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333390080 00000100:00100000:1.0:1734016096.552098:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333390080 00000100:00100000:1.0:1734016096.552341:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10194 00000100:00100000:1.0:1734016096.552349:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333390080:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016096.552370:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016096.552394:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27113e54 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e473f expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016096.552425:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27113e4d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4738 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016096.552433:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016096.552435:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016096.552438:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27113e54 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6213632->6262783] (req 6213632->6262783) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e473f expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016096.552474:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27113e4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4738 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016096.552488:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27113e4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4738 expref: 9 pid: 7682 timeout: 463 lvb_type: 1 00000100:00100000:1.0:1734016096.552503:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075df3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335191040:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016096.552775:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016096.557541:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075df3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335191040:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016096.557580:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27113e54 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6213632->6262783] (req 6213632->6262783) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e473f expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016096.557598:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016096.557675:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:9668:x1818247333390080:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5323us (6102us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016096.557684:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10194 00000100:00100000:1.0:1734016096.565110:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.594934:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.622591:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.622942:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10201 00000100:00100000:1.0:1734016096.622949:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333391232:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016096.622968:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016096.622985:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27113e8c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4770 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016096.623011:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27113e54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6213632->6262783) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e473f expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016096.623017:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016096.623019:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016096.623023:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27113e8c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8273920->8278015] (req 8273920->8278015) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4770 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016096.623527:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27113e54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6213632->6262783) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e473f expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016096.623540:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27113e54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6213632->6262783) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e473f expref: 8 pid: 7684 timeout: 463 lvb_type: 0 00000100:00100000:1.0:1734016096.623554:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335191936:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016096.623620:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1734016096.629591:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27113e54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6213632->6262783) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e473f expref: 9 pid: 7684 timeout: 463 lvb_type: 0 00000100:00100000:1.0:1734016096.629612:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335191936:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016096.629635:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27113e8c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8273920->8278015) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4770 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016096.629643:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016096.630106:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:9668:x1818247333391232:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7157us (7524us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016096.630113:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10201 00000100:00100000:0.0:1734016096.672442:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.672507:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.673130:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333391872 00000100:00100000:1.0:1734016096.673136:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333391872 00002000:00100000:1.0:1734016096.673156:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8327167) req@ffff88007487ce00 x1818247333391872/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:57/0 lens 504/0 e 0 to 0 dl 1734016107 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016096.673169:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487ce00 with x1818247333391872 ext(4190208->8327167) 00002000:00010000:1.0:1734016096.673173:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487ce00 00000100:00100000:1.0:1734016096.673195:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7923 00000100:00100000:1.0:1734016096.673204:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333391616:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016096.725564:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333391616:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 52347us (53125us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1734016096.725579:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7923 00002000:00100000:0.0:1734016096.725593:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (0->8278015) req@ffff88007487e680 x1818247333391616/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:57/0 lens 504/440 e 0 to 0 dl 1734016107 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016096.725605:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487e680 with x1818247333391616 ext(0->8278015) 00002000:00010000:0.0:1734016096.725613:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487e680 00000100:00100000:0.0:1734016096.783368:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.786731:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333392256 00000100:00100000:1.0:1734016096.786740:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333392256 00000100:00100000:1.0:1734016096.786983:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10202 00000100:00100000:1.0:1734016096.786990:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333392256:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016096.788339:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969179 is committed 00000001:00080000:0.0:1734016096.788351:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969178 is committed 00000100:00100000:1.0:1734016096.788535:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333392256:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 1542us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016096.788541:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10202 00000100:00100000:1.0:1734016096.792693:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.799239:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.809846:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.833946:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016096.857648:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.891137:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.910349:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.987122:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016096.992245:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.000300:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.017730:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016097.018464:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016067 00000100:00100000:0.0:1734016097.027864:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758ad880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335193088:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016097.027890:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016097.034291:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333393920:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 15857us (16548us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016097.034308:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2728 00000100:00100000:0.0:1734016097.035096:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333394048 00000100:00100000:0.0:1734016097.035103:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333394048 00000100:00100000:0.0:1734016097.035140:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10209 00000100:00100000:0.0:1734016097.035146:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333394048:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016097.035424:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8324451 -> 8324451 00002000:00010000:0.0:1734016097.035428:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016097 -> 1734016097 00002000:00010000:0.0:1734016097.035431:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016097 -> 1734016097 00002000:00010000:0.0:1734016097.035433:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016097 -> 1734016097 00002000:00010000:0.0:1734016097.035434:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1408 -> 1472 00000100:00100000:0.0:1734016097.035479:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333394048:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 333us (738us total) trans 4294969180 rc 0/0 00000100:00100000:0.0:1734016097.035486:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10209 00000100:00100000:0.0:1734016097.077305:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333394560 00000100:00100000:0.0:1734016097.077313:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333394560 00000100:00100000:0.0:1734016097.077381:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1982 00000100:00100000:0.0:1734016097.077388:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333394560:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016097.077437:0:7704:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016097.077460:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27113e62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4746 expref: 16 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016097.077496:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016097.077500:0:7704:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016097.077639:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27113ecb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016097.077651:0:7704:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27113e23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4715 expref: 14 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016097.077658:0:7704:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27113ecb lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016097.077688:0:7704:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27113e23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4715 expref: 14 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016097.077700:0:7704:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27113e23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4715 expref: 14 pid: 13956 timeout: 464 lvb_type: 0 00000100:00100000:0.0:1734016097.077717:0:7704:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075650a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335193472:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016097.077782:0:7704:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:1.0:1734016097.081502:0:7704:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075650a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335193472:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016097.081523:0:7704:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27113ecb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:1.0:1734016097.081546:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333394688 00000100:00100000:1.0:1734016097.081551:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333394688 00010000:00010000:1.0:1734016097.081581:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27113e23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4715 expref: 15 pid: 13956 timeout: 464 lvb_type: 0 00000100:00100000:1.0:1734016097.082004:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2729 00000100:00100000:1.0:1734016097.082012:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+15:1982:x1818247333394688:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016097.082027:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016097.082033:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27113e23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4715 expref: 15 pid: 13956 timeout: 464 lvb_type: 0 00010000:00010000:1.0:1734016097.082044:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27113e23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4715 expref: 15 pid: 13956 timeout: 464 lvb_type: 0 00010000:00010000:1.0:1734016097.082068:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27113e23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4715 expref: 15 pid: 13956 timeout: 464 lvb_type: 0 00010000:00010000:1.0:1734016097.082100:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016097.082104:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27113ecb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016097.082112:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27113ecb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016097.082119:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27113ecb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016097.082304:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016097.082411:0:7704:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27113ecb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016097.082418:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27113ecb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:0.0:1734016097.082488:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968580 00000004:00010000:0.0:1734016097.082523:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012b132a00 reply state ffff8800756f6000 transno 4294968581 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27113ecb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016097.082529:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016097.082609:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333394688:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 596us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016097.082615:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2729 00000100:00100000:0.0:1734016097.083290:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:9668:x1818247333394560:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 5901us (6115us total) trans 4294968581 rc 0/0 00000100:00100000:0.0:1734016097.083296:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1982 00000020:00080000:0.0:1734016097.083300:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1734016097.087843:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27113ecb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016097.087857:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27113ecb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016097.087864:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27113ecb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016097.087870:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7583180 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:1.0:1734016097.088539:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27113ecb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016097.088547:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27113ecb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016097.088560:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016097.088562:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1734016097.088565:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27113ecb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016097.088569:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27113ecb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00000100:00100000:1.0:1734016097.095533:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3506:1818247335193856:0@lo:400:kworker.0 00000100:00100000:1.0:1734016097.095598:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016097.095630:0:3506:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1734016097.095635:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3506:1818247335193728:0@lo:400:kworker.0 00000100:00100000:1.0:1734016097.095652:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016097.095663:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335194240:0@lo:400:kworker.0 00000100:00100000:1.0:1734016097.095682:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016097.095707:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335194240 00000100:00100000:1.0:1734016097.095713:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335194240 00000100:00100000:1.0:1734016097.095752:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1734016097.095759:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335194240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016097.095816:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335194240:12345-0@lo:400:kworker.0 Request processed in 39us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016097.095824:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1734016097.095858:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335194240:0@lo:400:kworker.0 00000100:00100000:1.0:1734016097.095889:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335193856 00000100:00100000:1.0:1734016097.095892:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335193856 00000100:00100000:1.0:1734016097.095913:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335193728 00000100:00100000:1.0:1734016097.095915:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335193728 00000100:00100000:1.0:1734016097.095929:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1734016097.095933:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3506:x1818247335193856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016097.095963:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3506:x1818247335193856:12345-0@lo:400:kworker.0 Request processed in 29us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016097.095967:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1734016097.095974:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1734016097.095977:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3506:x1818247335193728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016097.095994:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3506:x1818247335193728:12345-0@lo:400:kworker.0 Request processed in 16us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016097.095998:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1734016097.096017:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3506:1818247335193728:0@lo:400:kworker.0 00000100:00100000:1.0:1734016097.096024:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3506:1818247335193856:0@lo:400:kworker.0 00000100:00080000:1.0:1734016097.096044:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016067 00000100:00080000:1.0:1734016097.096047:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016067 00000100:00100000:0.0:1734016097.096306:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335193984:0@lo:400:kworker.0 00000100:00100000:0.0:1734016097.096330:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016097.096344:0:3503:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1734016097.096349:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67a75f73-9674-4938-8c12-63813a36f078:3503:1818247335193600:0@lo:400:kworker.0 00000100:00100000:0.0:1734016097.096370:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016097.096379:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3503:1818247335194112:0@lo:400:kworker.0 00000100:00100000:0.0:1734016097.096394:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016097.096459:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335194112 00000100:00100000:1.0:1734016097.096463:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335194112 00000100:00100000:1.0:1734016097.096483:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1734016097.096486:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3503:x1818247335194112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016097.096512:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3503:x1818247335194112:12345-0@lo:400:kworker.0 Request processed in 25us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016097.096517:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1734016097.096531:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335193984 00000100:00100000:1.0:1734016097.096533:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335193984 00000100:00100000:1.0:1734016097.096546:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1734016097.096550:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335193984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016097.096572:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335193984:12345-0@lo:400:kworker.0 Request processed in 21us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016097.096577:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1734016097.096792:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016067 00000100:00080000:0.0:1734016097.096795:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016067 00000100:00080000:0.0:1734016097.096796:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016067 00000100:00100000:0.0:1734016097.096835:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67a75f73-9674-4938-8c12-63813a36f078:3503:1818247335193600:0@lo:400:kworker.0 00000100:00100000:0.0:1734016097.096848:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3503:1818247335194112:0@lo:400:kworker.0 00000100:00100000:0.0:1734016097.096856:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335193984:0@lo:400:kworker.0 00000100:00100000:0.0:1734016097.099733:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.125919:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.134363:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016097.135235:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333395328 00000100:00100000:1.0:1734016097.135245:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333395328 00000100:00100000:1.0:1734016097.135299:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1983 00000100:00100000:1.0:1734016097.135305:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:9668:x1818247333395328:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:1.0:1734016097.135431:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:9668:x1818247333395328:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 125us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016097.135436:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1983 00000100:00100000:0.0:1734016097.137992:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016097.138839:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333395456 00000100:00100000:1.0:1734016097.138851:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333395456 00000100:00100000:1.0:1734016097.139471:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10212 00000100:00100000:1.0:1734016097.139478:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333395456:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016097.140901:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969182 is committed 00000100:00100000:1.0:1734016097.141081:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333395456:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 1599us (3093us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016097.141093:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10212 00000100:00100000:0.0:1734016097.147875:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.151968:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016097.152470:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333395712 00000100:00100000:1.0:1734016097.152480:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333395712 00000100:00100000:1.0:1734016097.152538:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10213 00000100:00100000:1.0:1734016097.152544:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333395712:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016097.152562:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016097.152577:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27113ee0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e47b6 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016097.152638:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335194368:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016097.152707:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00002000:00010000:1.0:1734016097.156974:0:7682:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 1472 -> 1480 00000100:00100000:1.0:1734016097.157005:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335194368:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016097.157036:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27113ee0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e47b6 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.157049:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27113ee0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e47b6 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.157079:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016097.157135:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333395712:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4590us (5172us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016097.157144:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10213 00000100:00100000:1.0:1734016097.157582:0:7685:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335194496 00000100:00100000:1.0:1734016097.157587:0:7685:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335194496 00000100:00100000:1.0:1734016097.157610:0:7685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1734016097.157615:0:7685:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335194496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1734016097.157634:0:7685:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 980042304 pending 0 free 3922817024 avail 3690987520 00000100:00100000:1.0:1734016097.157662:0:7685:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335194496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016097.157667:0:7685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1734016097.165033:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016097.165135:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333395840 00000100:00100000:1.0:1734016097.165143:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333395840 00000100:00100000:1.0:1734016097.165540:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10214 00000100:00100000:1.0:1734016097.165547:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333395840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016097.165566:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016097.165582:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27113ee7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e47bd expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016097.165634:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335194624:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016097.165772:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1734016097.175281:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335194624:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016097.175322:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27113ee7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e47bd expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.175335:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27113ee7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e47bd expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.175370:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016097.175450:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333395840:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9902us (10424us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016097.175459:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10214 00000100:00100000:0.0:1734016097.187775:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.201986:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016097.202675:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333396224 00000100:00100000:1.0:1734016097.202686:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333396224 00000100:00100000:1.0:1734016097.202743:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1985 00000100:00100000:1.0:1734016097.202751:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:9668:x1818247333396224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016097.202772:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016097.202791:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc27113eee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e47c4 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.202918:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27113ef5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016097.202933:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27113ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016097.202944:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27113ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:1.0:1734016097.202970:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 8930466 00000004:00200000:1.0:1734016097.202974:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016097.202992:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27113ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016097.203017:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc27113eee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e47c4 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.203054:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27113ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e47c4 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.203062:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016097.203065:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016097.203067:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016097.203121:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:9668:x1818247333396224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 370us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016097.203128:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1985 00000100:00100000:0.0:1734016097.206068:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016097.206159:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333396352 00000100:00100000:1.0:1734016097.206168:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333396352 00000100:00100000:1.0:1734016097.206225:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10215 00000100:00100000:1.0:1734016097.206232:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333396352:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016097.206254:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016097.206312:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27113efc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e47cb expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.206339:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27113eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1167359) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e479a expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.206345:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016097.206347:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016097.206350:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27113efc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2920448->2957311] (req 2920448->2957311) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e47cb expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.206379:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27113eb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1167359) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e479a expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.206389:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27113eb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1167359) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e479a expref: 5 pid: 7682 timeout: 464 lvb_type: 0 00000100:00100000:1.0:1734016097.206403:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335194752:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016097.206471:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016097.213898:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016097.215538:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27113eb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1118208->1167359) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e479a expref: 6 pid: 7682 timeout: 464 lvb_type: 0 00000100:00100000:1.0:1734016097.215568:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335194752:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016097.215592:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27113efc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2920448->2957311) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e47cb expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.215606:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016097.215648:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333396352:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9414us (9587us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016097.215655:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10215 00000100:00100000:0.0:1734016097.227723:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016097.227866:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333396608 00000100:00100000:1.0:1734016097.227876:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333396608 00000100:00100000:1.0:1734016097.227937:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10216 00000100:00100000:1.0:1734016097.227943:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333396608:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016097.228252:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8930466 -> 8930466 00002000:00010000:1.0:1734016097.228255:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016097 -> 1734016097 00002000:00010000:1.0:1734016097.228257:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016097 -> 1734016097 00002000:00010000:1.0:1734016097.228259:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016097 -> 1734016097 00002000:00010000:1.0:1734016097.228260:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1480 -> 1480 00000100:00100000:1.0:1734016097.228337:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333396608:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 393us (624us total) trans 4294969183 rc 0/0 00000100:00100000:1.0:1734016097.228342:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10216 00000100:00100000:0.0:1734016097.237115:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.256910:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.281714:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333397248 00000100:00100000:0.0:1734016097.281723:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333397248 00002000:00100000:0.0:1734016097.281765:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1900544->1904639) req@ffff8800750c3100 x1818247333397248/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:58/0 lens 488/0 e 0 to 0 dl 1734016108 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016097.281776:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c3100 with x1818247333397248 ext(1900544->1904639) 00002000:00010000:0.0:1734016097.281782:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c3100 00000100:00100000:0.0:1734016097.281840:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7932 00000100:00100000:0.0:1734016097.281847:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333397248:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016097.282013:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333397248:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 165us (382us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016097.282019:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7932 00002000:00100000:0.0:1734016097.282024:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1900544->1904639) req@ffff8800750c3100 x1818247333397248/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:58/0 lens 488/4536 e 0 to 0 dl 1734016108 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016097.282031:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c3100 with x1818247333397248 ext(1900544->1904639) 00002000:00010000:0.0:1734016097.282033:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c3100 00000100:00100000:0.0:1734016097.292016:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333397504 00000100:00100000:0.0:1734016097.292025:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333397504 00002000:00100000:0.0:1734016097.292072:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1896448->1900543) req@ffff8800750c3480 x1818247333397504/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:58/0 lens 488/0 e 0 to 0 dl 1734016108 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016097.292081:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c3480 with x1818247333397504 ext(1896448->1900543) 00002000:00010000:0.0:1734016097.292086:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c3480 00000100:00100000:0.0:1734016097.292118:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7933 00000100:00100000:0.0:1734016097.292125:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333397504:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016097.292307:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333397504:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 181us (363us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016097.292313:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7933 00002000:00100000:0.0:1734016097.292319:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1896448->1900543) req@ffff8800750c3480 x1818247333397504/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:58/0 lens 488/4536 e 0 to 0 dl 1734016108 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016097.292325:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c3480 with x1818247333397504 ext(1896448->1900543) 00002000:00010000:0.0:1734016097.292327:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c3480 00000100:00100000:0.0:1734016097.301760:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.308182:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.313760:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333398272 00000100:00100000:0.0:1734016097.313768:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333398272 00002000:00100000:0.0:1734016097.313958:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1884160->1888255) req@ffff880073ad4700 x1818247333398272/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:58/0 lens 488/0 e 0 to 0 dl 1734016108 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016097.313968:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4700 with x1818247333398272 ext(1884160->1888255) 00002000:00010000:0.0:1734016097.313972:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4700 00000100:00100000:0.0:1734016097.314004:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7936 00000100:00100000:0.0:1734016097.314010:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333398272:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016097.314156:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333398272:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 145us (751us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016097.314162:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7936 00002000:00100000:0.0:1734016097.314166:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1884160->1888255) req@ffff880073ad4700 x1818247333398272/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:58/0 lens 488/4536 e 0 to 0 dl 1734016108 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016097.314173:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4700 with x1818247333398272 ext(1884160->1888255) 00002000:00010000:0.0:1734016097.314175:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4700 00000100:00100000:0.0:1734016097.322087:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.330077:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.341847:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333399040 00000100:00100000:0.0:1734016097.341857:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333399040 00002000:00100000:0.0:1734016097.341901:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1871872->1875967) req@ffff880073ad4380 x1818247333399040/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:58/0 lens 488/0 e 0 to 0 dl 1734016108 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016097.341911:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4380 with x1818247333399040 ext(1871872->1875967) 00002000:00010000:0.0:1734016097.341917:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4380 00000100:00100000:0.0:1734016097.353858:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.359955:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.363655:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335195392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1734016097.363697:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016097.369028:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335195392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1734016097.372636:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016097.374679:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969184 is committed 00000001:00080000:0.0:1734016097.374698:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969183 is committed 00000100:00100000:0.0:1734016097.382069:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.387599:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.402585:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333400064 00000100:00100000:0.0:1734016097.402593:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333400064 00000100:00100000:0.0:1734016097.402646:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1986 00000100:00100000:0.0:1734016097.402652:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+15:9668:x1818247333400064:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016097.402694:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016097.402715:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27113ed9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e47af expref: 15 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016097.402744:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016097.402747:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016097.402903:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27113f1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016097.402915:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27113ef5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e47c4 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016097.402921:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27113f1f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016097.402948:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27113ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e47c4 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016097.402958:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27113ef5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e47c4 expref: 17 pid: 6478 timeout: 464 lvb_type: 0 00000100:00100000:0.0:1734016097.402971:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335195776:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016097.403023:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eea80 going to sleep for 11 seconds 00010000:00010000:1.0:1734016097.415732:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27113f1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016097.415747:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27113f1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016097.415754:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27113f1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016097.415763:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581200 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:1.0:1734016097.415766:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27113f1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016097.415772:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27113f1f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016097.415786:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016097.415789:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1734016097.415792:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27113f1f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016097.415796:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27113f1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016097.417276:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.426173:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.433557:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.442036:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.444891:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.454354:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.465978:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.473654:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016097.477113:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969186 is committed 00000100:00100000:0.0:1734016097.486582:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016097.493706:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.499498:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016097.509608:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969187 is committed 00000100:00100000:0.0:1734016097.517969:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016097.518057:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333401984 00000100:00100000:1.0:1734016097.518066:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333401984 00000100:00100000:1.0:1734016097.518114:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1988 00000100:00100000:1.0:1734016097.518121:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+16:9668:x1818247333401984:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016097.518143:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016097.518160:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27113f5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4811 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.518238:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27113f65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016097.518250:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27113f65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016097.518260:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27113f65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:1.0:1734016097.518293:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 9257391 00000004:00200000:1.0:1734016097.518296:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016097.518310:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27113f65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016097.518332:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27113f5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4811 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.520100:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27113f65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4811 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.520110:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016097.520113:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016097.520116:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016097.520874:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+17:9668:x1818247333401984:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2751us (2911us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016097.520883:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1988 00000100:00100000:0.0:1734016097.524558:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.540447:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.547639:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.552153:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016097.552278:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333402624 00000100:00100000:1.0:1734016097.552288:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333402624 00000100:00100000:1.0:1734016097.552339:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10229 00000100:00100000:1.0:1734016097.552345:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333402624:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016097.552362:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016097.552379:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27113f7a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4826 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016097.552442:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335196928:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016097.552512:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00002000:00010000:1.0:1734016097.557715:0:7682:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime: 1734016097 -> 1734016098 00002000:00010000:1.0:1734016097.557722:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016097 -> 1734016098 00000100:00100000:1.0:1734016097.557744:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335196928:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016097.557773:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27113f7a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4826 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.557786:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27113f7a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4826 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.561193:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016097.563078:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333402624:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10720us (10921us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016097.563089:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10229 00000100:00100000:1.0:1734016097.568090:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333402752 00000100:00100000:1.0:1734016097.568101:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333402752 00000100:00100000:1.0:1734016097.568155:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10230 00000100:00100000:1.0:1734016097.568162:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333402752:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016097.568180:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016097.568197:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27113f81 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e482d expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016097.568255:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335197056:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016097.568335:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1734016097.574448:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335197056:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016097.574482:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27113f81 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e482d expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.574500:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27113f81 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e482d expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.574528:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f180, rc 0) 00000100:00100000:1.0:1734016097.574589:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333402752:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6426us (6608us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016097.574597:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10230 00000100:00100000:0.0:1734016097.578372:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016097.578465:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333402880 00000100:00100000:1.0:1734016097.578472:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333402880 00000100:00100000:1.0:1734016097.578521:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10231 00000100:00100000:1.0:1734016097.578527:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333402880:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016097.578543:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016097.578559:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27113f88 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4834 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016097.578616:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335197184:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016097.578673:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1734016097.580771:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335197184:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016097.580841:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27113f88 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4834 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.580854:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27113f88 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4834 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.580869:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d8c0, rc 0) 00000100:00100000:1.0:1734016097.580920:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333402880:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2391us (2555us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016097.580927:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10231 00000100:00100000:0.0:1734016097.587839:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016097.588308:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333403008 00000100:00100000:1.0:1734016097.588317:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333403008 00000100:00100000:1.0:1734016097.588365:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10232 00000100:00100000:1.0:1734016097.588373:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333403008:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016097.588392:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016097.588410:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27113f8f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e483b expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016097.588469:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335197312:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016097.588639:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1734016097.590690:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335197312:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016097.590727:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27113f8f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e483b expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.590739:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27113f8f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e483b expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.590751:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016097.591124:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333403008:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2748us (3332us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016097.591135:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10232 00000100:00100000:0.0:1734016097.602249:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333403264 00000100:00100000:0.0:1734016097.602258:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333403264 00000100:00100000:0.0:1734016097.602332:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7945 00000100:00100000:0.0:1734016097.602338:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333403264:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:0.0:1734016097.602397:0:14005:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113f96 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016097.602412:0:14005:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113f73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10063872->10092543) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e481f expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016097.602418:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016097.602420:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016097.602423:0:14005:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113f96 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3350528->3366911] (req 3350528->3366911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016097.602452:0:14005:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113f73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10063872->10092543) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e481f expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016097.602462:0:14005:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113f73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10063872->10092543) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e481f expref: 8 pid: 7684 timeout: 464 lvb_type: 0 00000100:00100000:0.0:1734016097.602476:0:14005:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14005:1818247335197440:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016097.602543:0:14005:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016097.612015:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333403392 00000100:00100000:0.0:1734016097.612023:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333403392 00010000:00010000:0.0:1734016097.612055:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113f73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10063872->10092543) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e481f expref: 9 pid: 7684 timeout: 464 lvb_type: 0 00000100:00100000:0.0:1734016097.612463:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2737 00000100:00100000:0.0:1734016097.612470:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333403392:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016097.612485:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016097.612505:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113f73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10063872->10092543) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e481f expref: 9 pid: 7684 timeout: 464 lvb_type: 0 00010000:00010000:0.0:1734016097.612522:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113f73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10063872->10092543) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e481f expref: 9 pid: 7684 timeout: 464 lvb_type: 0 00010000:00010000:0.0:1734016097.612542:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113f73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10063872->10092543) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e481f expref: 9 pid: 7684 timeout: 464 lvb_type: 0 00010000:00010000:0.0:1734016097.612572:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016097.612575:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016097.612580:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113f96 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3350528->3366911] (req 3350528->3366911) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016097.612591:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27113f96 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3350528->3366911] (req 3350528->3366911) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016097.613449:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016097.613899:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333403392:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1428us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016097.613905:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2737 00000100:00100000:1.0:1734016097.619046:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333403520 00000100:00100000:1.0:1734016097.619056:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333403520 00000100:00100000:1.0:1734016097.619107:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10233 00000100:00100000:1.0:1734016097.619114:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333403520:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016097.619132:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016097.619149:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27113f9d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4842 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016097.619169:0:7682:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 10092085, mtime: 0x675afc61, atime: 0x675afc61, ctime: 0x675afc61, blocks: 0x688 00010000:00010000:1.0:1734016097.619186:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016097.619188:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016097.619195:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27113f9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4842 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.619209:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27113f9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4842 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.619218:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016097.619277:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333403520:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 163us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016097.619283:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10233 00000100:00100000:0.0:1734016097.651067:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016097.669323:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016097.670110:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.670549:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333404160 00000100:00100000:0.0:1734016097.670560:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333404160 00002000:00100000:0.0:1734016097.670613:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8388608->10092543) req@ffff8800749e9c00 x1818247333404160/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:58/0 lens 488/0 e 0 to 0 dl 1734016108 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016097.670623:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e9c00 with x1818247333404160 ext(8388608->10092543) 00002000:00010000:0.0:1734016097.670629:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e9c00 00000100:00100000:0.0:1734016097.670660:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333404032 00000100:00100000:0.0:1734016097.670663:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333404032 00002000:00100000:0.0:1734016097.670673:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8388607) req@ffff8800749e9180 x1818247333404032/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:58/0 lens 504/0 e 0 to 0 dl 1734016108 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016097.670685:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e9180 with x1818247333404032 ext(4190208->8388607) 00002000:00010000:0.0:1734016097.670688:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e9180 00000100:00100000:0.0:1734016097.670701:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7947 00000100:00100000:0.0:1734016097.670706:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333404160:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016097.672615:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7948 00000100:00100000:0.0:1734016097.672625:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247333404032:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016097.761460:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333404160:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 90742us (92136us total) trans 0 rc 1703936/1703936 00000100:00100000:0.0:1734016097.761470:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7947 00002000:00100000:0.0:1734016097.761481:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8388608->10092543) req@ffff8800749e9c00 x1818247333404160/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:58/0 lens 488/440 e 0 to 0 dl 1734016108 ref 1 fl Complete:/200/0 rc 1703936/1703936 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016097.761490:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e9c00 with x1818247333404160 ext(8388608->10092543) 00002000:00010000:0.0:1734016097.761495:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e9c00 00000100:00100000:0.0:1734016097.804638:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333404032:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 132001us (134515us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1734016097.804655:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7948 00002000:00100000:0.0:1734016097.804669:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8388607) req@ffff8800749e9180 x1818247333404032/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:58/0 lens 504/440 e 0 to 0 dl 1734016108 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016097.804682:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e9180 with x1818247333404032 ext(4190208->8388607) 00002000:00010000:0.0:1734016097.804691:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e9180 00000100:00100000:1.0:1734016097.860516:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333404544 00000100:00100000:1.0:1734016097.860530:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333404544 00010000:00010000:1.0:1734016097.860576:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27113f9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4842 expref: 9 pid: 7682 timeout: 464 lvb_type: 1 00000100:00100000:1.0:1734016097.860612:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2738 00000100:00100000:1.0:1734016097.860619:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333404544:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016097.860640:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016097.860665:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27113f9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4842 expref: 9 pid: 7682 timeout: 464 lvb_type: 1 00010000:00010000:1.0:1734016097.860678:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27113f9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4842 expref: 9 pid: 7682 timeout: 464 lvb_type: 1 00010000:00010000:1.0:1734016097.860702:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27113f9d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4842 expref: 9 pid: 7682 timeout: 464 lvb_type: 1 00010000:00010000:1.0:1734016097.860735:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016097.860737:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016097.860745:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6160384->6201343) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4849 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.860754:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113fa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6160384->6201343) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4849 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.860790:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113fa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6160384->6201343) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4849 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016097.860839:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749e9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335197696:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016097.861828:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:0.0:1734016097.868478:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749e9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335197696:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016097.868500:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016097.869618:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333404544:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 8993us (9838us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016097.869628:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2738 00000100:00100000:0.0:1734016097.870657:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333404672 00000100:00100000:0.0:1734016097.870671:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333404672 00000100:00100000:0.0:1734016097.870726:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10235 00000100:00100000:0.0:1734016097.870732:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333404672:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016097.871040:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10092085 -> 10092085 00002000:00010000:0.0:1734016097.871044:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016097 -> 1734016097 00002000:00010000:0.0:1734016097.871046:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016097 -> 1734016097 00002000:00010000:0.0:1734016097.871047:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016097 -> 1734016097 00002000:00010000:0.0:1734016097.871049:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1672 -> 1672 00000100:00100000:0.0:1734016097.871125:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333404672:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 392us (1292us total) trans 4294969189 rc 0/0 00000100:00100000:0.0:1734016097.871132:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10235 00000100:00100000:1.0:1734016097.880018:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333404928 00000100:00100000:1.0:1734016097.880026:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333404928 00000100:00100000:0.0:1734016097.886357:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335197824:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016097.886389:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27113fab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016097.889559:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333405056 00000100:00100000:0.0:1734016097.889570:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333405056 00010000:00010000:0.0:1734016097.889603:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27113f65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4811 expref: 17 pid: 6478 timeout: 465 lvb_type: 0 00000100:00100000:0.0:1734016097.889633:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2739 00000100:00100000:0.0:1734016097.889639:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+17:1982:x1818247333405056:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016097.889652:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016097.889658:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27113f65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4811 expref: 17 pid: 6478 timeout: 465 lvb_type: 0 00010000:00010000:0.0:1734016097.889668:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27113f65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4811 expref: 17 pid: 6478 timeout: 465 lvb_type: 0 00010000:00010000:0.0:1734016097.889688:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27113f65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4811 expref: 17 pid: 6478 timeout: 465 lvb_type: 0 00010000:00010000:0.0:1734016097.892435:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016097.892446:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27113fab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016097.892458:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27113fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016097.892464:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27113fab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016097.892499:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016097.892572:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+16:1982:x1818247333405056:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 2930us (3261us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016097.892581:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2739 00010000:00010000:1.0:1734016097.895724:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27113fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016097.895742:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27113fab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016097.895749:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27113fab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016097.895755:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4b40 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:1.0:1734016097.895759:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27113fab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016097.895766:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27113fab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016097.895785:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016097.895788:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1734016097.895792:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27113fab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016097.895797:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27113fab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016097.897477:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333405184 00000100:00100000:1.0:1734016097.897493:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333405184 00000100:00100000:1.0:1734016097.897571:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10236 00000100:00100000:1.0:1734016097.897581:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333405184:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016097.897610:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016097.897640:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27113fb2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4850 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.897676:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6160384->6201343) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4849 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.897683:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016097.897685:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016097.897688:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27113fb2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4850 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.897731:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113fa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6160384->6201343) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4849 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.897743:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113fa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6160384->6201343) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4849 expref: 8 pid: 7684 timeout: 465 lvb_type: 0 00000100:00100000:1.0:1734016097.897759:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335197952:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016097.897861:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016097.902726:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335197952:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016097.902764:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27113fb2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4850 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.902782:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016097.903254:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333405184:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5671us (6118us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016097.903274:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10236 00000100:00100000:0.0:1734016097.905642:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333405312 00000100:00100000:0.0:1734016097.905650:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333405312 00010000:00010000:0.0:1734016097.905677:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113fa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6160384->6201343) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4849 expref: 9 pid: 7684 timeout: 465 lvb_type: 0 00000100:00100000:0.0:1734016097.905751:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2740 00000100:00100000:0.0:1734016097.905758:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333405312:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016097.905771:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016097.905789:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113fa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6160384->6201343) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4849 expref: 9 pid: 7684 timeout: 465 lvb_type: 0 00010000:00010000:0.0:1734016097.905830:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113fa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6160384->6201343) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4849 expref: 9 pid: 7684 timeout: 465 lvb_type: 0 00010000:00010000:0.0:1734016097.905852:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27113fa4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6160384->6201343) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4849 expref: 9 pid: 7684 timeout: 465 lvb_type: 0 00010000:00010000:0.0:1734016097.905947:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016097.905950:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016097.905956:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27113fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4850 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016097.905964:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27113fb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4850 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016097.905998:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27113fb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4850 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016097.906012:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db08a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335198080:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016097.906428:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eef00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016097.911205:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db08a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335198080:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016097.911228:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016097.911296:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333405312:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5536us (5725us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016097.911307:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2740 00000100:00100000:1.0:1734016097.911402:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333405440 00000100:00100000:1.0:1734016097.911408:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333405440 00002000:00010000:1.0:1734016097.911442:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6980177->18446744073709551615) 00002000:00100000:1.0:1734016097.911446:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad7b80 with x1818247333405440 ext(6980177->18446744073709551615) 00002000:00010000:1.0:1734016097.911454:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad7b80. 00000100:00100000:1.0:1734016097.911470:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7949 00000100:00100000:1.0:1734016097.911475:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333405440:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016097.918127:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10092085 -> 6980177 00002000:00010000:0.0:1734016097.918134:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016097 -> 1734016098 00002000:00010000:0.0:1734016097.918136:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016097 -> 1734016097 00002000:00010000:0.0:1734016097.918139:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016097 -> 1734016098 00002000:00010000:0.0:1734016097.918142:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1672 -> 1472 00000100:00100000:0.0:1734016097.918247:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333405440:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 6766us (7145us total) trans 4294969190 rc 0/0 00000100:00100000:0.0:1734016097.918266:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7949 00002000:00010000:0.0:1734016097.918271:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6980177->18446744073709551615) 00002000:00100000:0.0:1734016097.918274:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad7b80 with x1818247333405440 ext(6980177->18446744073709551615) 00002000:00010000:0.0:1734016097.918280:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad7b80. 00000100:00100000:0.0:1734016097.924304:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.928428:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016097.929183:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333405696 00000100:00100000:1.0:1734016097.929194:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333405696 00000100:00100000:1.0:1734016097.929427:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10237 00000100:00100000:1.0:1734016097.929434:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333405696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016097.929452:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016097.929470:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113fc7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e485e expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016097.929524:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335198208:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016097.929885:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016097.933062:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335198208:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016097.933101:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113fc7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e485e expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.933115:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27113fc7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e485e expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.933151:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016097.933202:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333405696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3767us (4782us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016097.933211:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10237 00000100:00100000:0.0:1734016097.937826:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016097.937927:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333405824 00000100:00100000:1.0:1734016097.937938:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333405824 00000100:00100000:1.0:1734016097.937979:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10238 00000100:00100000:1.0:1734016097.937986:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333405824:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016097.938004:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016097.938022:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27113fce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4865 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016097.938077:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335198336:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016097.938144:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016097.940458:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335198336:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016097.940489:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27113fce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4865 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.940501:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27113fce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4865 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.940734:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016097.940917:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333405824:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2931us (3117us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016097.940928:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10238 00000100:00100000:0.0:1734016097.944964:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.951918:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016097.956059:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969191 is committed 00000001:00080000:0.0:1734016097.956085:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969190 is committed 00000100:00100000:0.0:1734016097.961378:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.965306:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016097.965419:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333406464 00000100:00100000:1.0:1734016097.965430:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333406464 00000100:00100000:1.0:1734016097.965475:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10239 00000100:00100000:1.0:1734016097.965482:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333406464:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016097.965501:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016097.965525:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27113fea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4873 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016097.965546:0:7682:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 6980177, mtime: 0x675afc62, atime: 0x675afc61, ctime: 0x675afc62, blocks: 0x5d0 00010000:00010000:1.0:1734016097.965562:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016097.965564:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016097.965572:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27113fea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4873 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.965586:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27113fea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4873 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016097.965595:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016097.965667:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333406464:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 185us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016097.965672:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10239 00000100:00100000:0.0:1734016097.971463:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.977608:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016097.977782:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333406848 00000100:00100000:1.0:1734016097.977790:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333406848 00010000:00010000:1.0:1734016097.977844:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27113fea lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4873 expref: 7 pid: 7682 timeout: 465 lvb_type: 1 00000100:00100000:1.0:1734016097.977884:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2742 00000100:00100000:1.0:1734016097.977889:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333406848:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016097.977901:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016097.977919:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27113fea lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4873 expref: 7 pid: 7682 timeout: 465 lvb_type: 1 00010000:00010000:1.0:1734016097.977929:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27113fea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4873 expref: 7 pid: 7682 timeout: 465 lvb_type: 1 00010000:00010000:1.0:1734016097.977949:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016097.977950:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016097.977954:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5705728->5718015] (req 5705728->5718015) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.977961:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27113ff1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5705728->5718015] (req 5705728->5718015) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016097.977979:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016097.978021:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333406848:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 131us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016097.978026:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2742 00000001:00080000:1.0:1734016097.982535:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969192 is committed 00000100:00100000:0.0:1734016097.987434:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.991956:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016097.997430:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:1.0:1734016098.004348:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969193 is committed 00000100:00100000:0.0:1734016098.007703:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:1.0:1734016098.008182:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016068 00000100:00100000:0.0:1734016098.012288:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.017394:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016098.017490:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333407872 00000100:00100000:1.0:1734016098.017497:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333407872 00010000:00010000:1.0:1734016098.017522:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114006 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4881 expref: 6 pid: 7684 timeout: 465 lvb_type: 1 00000100:00100000:1.0:1734016098.017972:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2744 00000100:00100000:1.0:1734016098.017979:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333407872:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016098.017992:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016098.018010:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114006 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4881 expref: 6 pid: 7684 timeout: 465 lvb_type: 1 00010000:00010000:1.0:1734016098.018021:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114006 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4881 expref: 6 pid: 7684 timeout: 465 lvb_type: 1 00010000:00010000:1.0:1734016098.018040:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114006 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4881 expref: 6 pid: 7684 timeout: 465 lvb_type: 1 00010000:00010000:1.0:1734016098.018067:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016098.018070:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016098.018074:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc2711400d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [102400->131071] (req 102400->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016098.018081:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc2711400d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [102400->131071] (req 102400->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016098.018100:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016098.018143:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333407872:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 164us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016098.018149:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2744 00000001:00080000:1.0:1734016098.023659:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969194 is committed 00000001:00080000:1.0:1734016098.025074:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969195 is committed 00000001:00080000:1.0:1734016098.026782:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969196 is committed 00000100:00100000:0.0:1734016098.031054:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016098.031180:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333408000 00000100:00100000:1.0:1734016098.031190:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333408000 00000100:00100000:1.0:1734016098.031458:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10242 00000100:00100000:1.0:1734016098.031467:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333408000:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016098.031494:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016098.031520:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27114014 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4888 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016098.031546:0:7682:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 6980177, mtime: 0x675afc62, atime: 0x675afc61, ctime: 0x675afc62, blocks: 0x650 00010000:00010000:1.0:1734016098.031567:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016098.031569:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016098.031578:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27114014 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4888 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016098.031596:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27114014 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4888 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016098.031606:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016098.031878:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333408000:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 411us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016098.031884:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10242 00000100:00100000:1.0:1734016098.038021:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016098.044639:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016098.050657:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.050919:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333408512 00000100:00100000:0.0:1734016098.050929:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333408512 00000100:00100000:0.0:1734016098.050997:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10243 00000100:00100000:0.0:1734016098.051006:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333408512:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016098.051026:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016098.051053:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114022 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e488f expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016098.051087:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27114014 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4888 expref: 5 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016098.051096:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016098.051098:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016098.051102:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114022 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e488f expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016098.051136:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27114014 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4888 expref: 5 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016098.051148:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27114014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4888 expref: 5 pid: 7682 timeout: 465 lvb_type: 1 00000100:00100000:0.0:1734016098.051163:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075884380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335199104:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016098.051231:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eef00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016098.056104:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075884380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335199104:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016098.056138:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114022 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e488f expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016098.056155:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582f40, rc 0) 00000100:00100000:0.0:1734016098.056211:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333408512:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5205us (5574us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016098.056218:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10243 00000100:00100000:0.0:1734016098.056598:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333408640 00000100:00100000:0.0:1734016098.056605:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333408640 00010000:00010000:0.0:1734016098.056630:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27114014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4888 expref: 6 pid: 7682 timeout: 465 lvb_type: 1 00000100:00100000:0.0:1734016098.056650:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2746 00000100:00100000:0.0:1734016098.056655:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333408640:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016098.056666:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016098.056690:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27114014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4888 expref: 6 pid: 7682 timeout: 465 lvb_type: 1 00010000:00010000:0.0:1734016098.056700:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27114014 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4888 expref: 6 pid: 7682 timeout: 465 lvb_type: 1 00010000:00010000:0.0:1734016098.056720:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27114014 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4888 expref: 6 pid: 7682 timeout: 465 lvb_type: 1 00010000:00010000:0.0:1734016098.056754:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016098.056756:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016098.056762:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114022 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e488f expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016098.056773:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114022 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e488f expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016098.057650:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114022 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e488f expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016098.057665:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075884380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335199232:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016098.058326:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eef00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016098.061456:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075884380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335199232:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016098.061477:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016098.062724:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333408640:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6061us (6371us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016098.062736:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2746 00000100:00100000:1.0:1734016098.063018:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.067959:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333409024 00000100:00100000:0.0:1734016098.067968:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333409024 00002000:00100000:0.0:1734016098.068011:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8937472->8941567) req@ffff8801369f1500 x1818247333409024/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.068020:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1500 with x1818247333409024 ext(8937472->8941567) 00002000:00010000:0.0:1734016098.068026:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f1500 00000100:00100000:0.0:1734016098.068059:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7955 00000100:00100000:0.0:1734016098.068065:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333409024:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016098.068225:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333409024:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 159us (348us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016098.068232:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7955 00002000:00100000:0.0:1734016098.068237:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8937472->8941567) req@ffff8801369f1500 x1818247333409024/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.068244:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1500 with x1818247333409024 ext(8937472->8941567) 00002000:00010000:0.0:1734016098.068247:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f1500 00000100:00100000:0.0:1734016098.072182:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333409280 00000100:00100000:0.0:1734016098.072190:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333409280 00002000:00100000:0.0:1734016098.072225:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8933376->8937471) req@ffff880073ad5500 x1818247333409280/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.072233:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5500 with x1818247333409280 ext(8933376->8937471) 00002000:00010000:0.0:1734016098.072238:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5500 00000100:00100000:0.0:1734016098.074056:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7956 00000100:00100000:0.0:1734016098.074065:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333409280:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016098.074261:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333409280:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 187us (2207us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016098.074267:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7956 00002000:00100000:0.0:1734016098.074274:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8933376->8937471) req@ffff880073ad5500 x1818247333409280/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.074282:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5500 with x1818247333409280 ext(8933376->8937471) 00002000:00010000:0.0:1734016098.074287:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5500 00000100:00100000:1.0:1734016098.080277:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016098.092330:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.092505:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333410304 00000100:00100000:0.0:1734016098.092513:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333410304 00002000:00100000:0.0:1734016098.092547:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8916992->8921087) req@ffff8800749e9880 x1818247333410304/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.092555:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e9880 with x1818247333410304 ext(8916992->8921087) 00002000:00010000:0.0:1734016098.092561:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e9880 00000100:00100000:0.0:1734016098.097087:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333410560 00000100:00100000:0.0:1734016098.097096:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333410560 00002000:00100000:0.0:1734016098.097132:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8912896->8916991) req@ffff880073ad6d80 x1818247333410560/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.097140:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad6d80 with x1818247333410560 ext(8912896->8916991) 00002000:00010000:0.0:1734016098.097145:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad6d80 00000100:00100000:0.0:1734016098.097205:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7961 00000100:00100000:0.0:1734016098.097211:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333410560:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016098.097770:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333410560:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 556us (759us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016098.097776:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7961 00002000:00100000:0.0:1734016098.097782:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8912896->8916991) req@ffff880073ad6d80 x1818247333410560/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.097789:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad6d80 with x1818247333410560 ext(8912896->8916991) 00002000:00010000:0.0:1734016098.097791:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad6d80 00000100:00100000:0.0:1734016098.105145:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333410816 00000100:00100000:0.0:1734016098.105155:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333410816 00002000:00100000:0.0:1734016098.105214:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8908800->8912895) req@ffff880073ad4a80 x1818247333410816/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.105223:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4a80 with x1818247333410816 ext(8908800->8912895) 00002000:00010000:0.0:1734016098.105231:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4a80 00000100:00100000:0.0:1734016098.105274:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7962 00000100:00100000:0.0:1734016098.105283:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333410816:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016098.105495:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333410816:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 213us (788us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016098.105503:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7962 00002000:00100000:0.0:1734016098.105510:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8908800->8912895) req@ffff880073ad4a80 x1818247333410816/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.105517:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4a80 with x1818247333410816 ext(8908800->8912895) 00002000:00010000:0.0:1734016098.105520:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4a80 00000100:00100000:0.0:1734016098.113347:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.124936:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333411328 00000100:00100000:0.0:1734016098.124955:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333411328 00002000:00100000:0.0:1734016098.125007:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8900608->8904703) req@ffff880073ad4000 x1818247333411328/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.125016:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4000 with x1818247333411328 ext(8900608->8904703) 00002000:00010000:0.0:1734016098.125023:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4000 00000100:00100000:0.0:1734016098.125072:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7964 00000100:00100000:0.0:1734016098.125079:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333411328:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016098.125280:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333411328:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 200us (2803us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016098.125287:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7964 00002000:00100000:0.0:1734016098.125292:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8900608->8904703) req@ffff880073ad4000 x1818247333411328/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.125305:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4000 with x1818247333411328 ext(8900608->8904703) 00002000:00010000:0.0:1734016098.125307:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4000 00000100:00100000:0.0:1734016098.154705:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.164134:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333412096 00000100:00100000:0.0:1734016098.164145:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333412096 00002000:00100000:1.0:1734016098.164650:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8888320->8892415) req@ffff8800755b4a80 x1818247333412096/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.164661:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4a80 with x1818247333412096 ext(8888320->8892415) 00002000:00010000:1.0:1734016098.164668:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4a80 00000100:00100000:1.0:1734016098.164706:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7967 00000100:00100000:1.0:1734016098.164712:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333412096:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016098.164923:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333412096:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 209us (2337us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016098.164929:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7967 00002000:00100000:1.0:1734016098.164934:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8888320->8892415) req@ffff8800755b4a80 x1818247333412096/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.164940:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4a80 with x1818247333412096 ext(8888320->8892415) 00002000:00010000:1.0:1734016098.164943:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4a80 00000100:00100000:1.0:1734016098.175316:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333412352 00000100:00100000:1.0:1734016098.175325:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333412352 00002000:00100000:1.0:1734016098.175365:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8884224->8888319) req@ffff88012b131880 x1818247333412352/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.175375:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b131880 with x1818247333412352 ext(8884224->8888319) 00002000:00010000:1.0:1734016098.175380:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b131880 00000100:00100000:1.0:1734016098.175420:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7968 00000100:00100000:1.0:1734016098.175426:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333412352:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016098.175580:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333412352:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 153us (1281us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016098.175589:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7968 00002000:00100000:1.0:1734016098.175594:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8884224->8888319) req@ffff88012b131880 x1818247333412352/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.175600:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b131880 with x1818247333412352 ext(8884224->8888319) 00002000:00010000:1.0:1734016098.175602:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b131880 00000100:00100000:0.0:1734016098.181558:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016098.199496:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333412864 00000100:00100000:1.0:1734016098.199507:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333412864 00002000:00100000:1.0:1734016098.199555:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8876032->8880127) req@ffff88012b131f80 x1818247333412864/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.199565:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b131f80 with x1818247333412864 ext(8876032->8880127) 00002000:00010000:1.0:1734016098.199572:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b131f80 00000100:00100000:1.0:1734016098.199609:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7970 00000100:00100000:1.0:1734016098.199617:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333412864:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016098.199855:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333412864:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 237us (494us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016098.199863:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7970 00002000:00100000:1.0:1734016098.199869:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8876032->8880127) req@ffff88012b131f80 x1818247333412864/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.199875:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b131f80 with x1818247333412864 ext(8876032->8880127) 00002000:00010000:1.0:1734016098.199877:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b131f80 00000100:00100000:0.0:1734016098.223317:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333412992:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 16268us (17448us total) trans 4294969198 rc 0/0 00000100:00100000:0.0:1734016098.223328:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7971 00002000:00100000:0.0:1734016098.223337:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8876032->8940930) req@ffff88012b131180 x1818247333412992/t4294969198(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/448 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.223344:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b131180 with x1818247333412992 ext(8876032->8940930) 00002000:00010000:0.0:1734016098.223351:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b131180 00000100:00100000:0.0:1734016098.226143:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333413120 00000100:00100000:0.0:1734016098.226151:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333413120 00000100:00100000:0.0:1734016098.226198:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1993 00000100:00100000:0.0:1734016098.226205:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333413120:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:0.0:1734016098.226347:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333413120:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 141us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016098.226355:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1993 00000100:00100000:0.0:1734016098.228788:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333413248 00000100:00100000:0.0:1734016098.228833:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333413248 00000100:00100000:0.0:1734016098.228882:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10244 00000100:00100000:0.0:1734016098.228889:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333413248:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:1.0:1734016098.231309:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969198 is committed 00000100:00100000:0.0:1734016098.231482:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333413248:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2587us (3309us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016098.231492:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10244 00000100:00100000:1.0:1734016098.236375:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.245672:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333413504 00000100:00100000:0.0:1734016098.245681:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333413504 00000100:00100000:0.0:1734016098.245728:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10245 00000100:00100000:0.0:1734016098.245735:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333413504:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016098.245983:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8940931 -> 8940931 00002000:00010000:0.0:1734016098.245987:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016098 -> 1734016098 00002000:00010000:0.0:1734016098.245989:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016097 -> 1734016097 00002000:00010000:0.0:1734016098.245991:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016098 -> 1734016098 00002000:00010000:0.0:1734016098.245994:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1616 -> 1744 00000100:00100000:0.0:1734016098.246056:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333413504:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 320us (451us total) trans 4294969199 rc 0/0 00000100:00100000:0.0:1734016098.246064:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10245 00000100:00100000:0.0:1734016098.248840:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333413632 00000100:00100000:0.0:1734016098.248851:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333413632 00000100:00100000:0.0:1734016098.248898:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1995 00000100:00100000:0.0:1734016098.248905:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:9668:x1818247333413632:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016098.248926:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016098.248948:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27114037 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e489d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016098.249032:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc2711403e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016098.249044:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc2711403e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016098.249054:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc2711403e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:0.0:1734016098.249078:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 8940931 00000004:00200000:0.0:1734016098.249081:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016098.249098:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc2711403e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016098.249120:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27114037 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e489d expref: 21 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016098.249134:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc2711403e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e489d expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016098.249142:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016098.249144:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016098.249147:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581200, rc 0) 00000100:00100000:0.0:1734016098.249204:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:9668:x1818247333413632:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 299us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016098.249209:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1995 00000100:00100000:1.0:1734016098.253482:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00002000:00010000:0.0:1734016098.258201:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016097 -> 1734016098 00000100:00100000:0.0:1734016098.258222:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075df1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335199360:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016098.258249:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27114045 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48a4 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016098.258268:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27114045 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48a4 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016098.259105:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:0.0:1734016098.259518:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333413760:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5877us (6043us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016098.259527:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10246 00000100:00100000:0.0:1734016098.263350:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333413888 00000100:00100000:0.0:1734016098.263359:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333413888 00000100:00100000:0.0:1734016098.263399:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10247 00000100:00100000:0.0:1734016098.263405:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333413888:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016098.263420:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016098.263435:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc2711404c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e48ab expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016098.263481:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075886a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335199488:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016098.263535:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016098.266216:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075886a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335199488:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016098.266245:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc2711404c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48ab expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016098.266271:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc2711404c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48ab expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016098.266571:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581d40, rc 0) 00000100:00100000:0.0:1734016098.266626:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333413888:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3221us (3337us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016098.266637:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10247 00000100:00100000:1.0:1734016098.270103:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333414016 00000100:00100000:1.0:1734016098.270111:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333414016 00000100:00100000:1.0:1734016098.270160:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10248 00000100:00100000:1.0:1734016098.270166:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333414016:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016098.270183:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016098.270199:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114053 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e48b2 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016098.270421:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e607480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335199616:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016098.270500:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f180 going to sleep for 11 seconds 00000100:00100000:1.0:1734016098.279240:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e607480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335199616:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016098.279285:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114053 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48b2 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016098.279299:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114053 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48b2 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016098.280166:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499eac0, rc 0) 00000100:00100000:1.0:1734016098.280632:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333414016:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10462us (10629us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016098.280642:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10248 00000100:00100000:1.0:1734016098.286074:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.290483:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075609880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335199744:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016098.290518:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc2711405a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48b9 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016098.290529:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc2711405a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48b9 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016098.290551:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd440, rc 0) 00000100:00100000:0.0:1734016098.290610:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333414144:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3677us (4551us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016098.290620:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10249 00000100:00100000:0.0:1734016098.295786:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333414272 00000100:00100000:0.0:1734016098.295798:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333414272 00000100:00100000:0.0:1734016098.296069:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10250 00000100:00100000:0.0:1734016098.296077:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333414272:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016098.296096:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016098.296115:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114061 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e48c0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016098.296144:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114022 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e488f expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016098.296150:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016098.296151:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016098.296155:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114061 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [303104->339967] (req 303104->339967) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48c0 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016098.296184:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114022 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e488f expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016098.296194:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114022 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e488f expref: 7 pid: 7682 timeout: 465 lvb_type: 0 00000100:00100000:0.0:1734016098.296205:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075886a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335199872:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016098.296286:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016098.300199:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.300861:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075886a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335199872:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016098.300891:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114061 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [303104->339967] (req 303104->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48c0 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016098.300907:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:0.0:1734016098.300965:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333414272:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4887us (5272us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016098.300973:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10250 00000100:00100000:1.0:1734016098.320917:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333414528 00000100:00100000:1.0:1734016098.320924:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333414528 00000100:00100000:1.0:1734016098.320968:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10251 00000100:00100000:1.0:1734016098.320975:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333414528:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016098.321198:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8940931 -> 8940931 00002000:00010000:1.0:1734016098.321201:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016098 -> 1734016098 00002000:00010000:1.0:1734016098.321203:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016098 -> 1734016097 00002000:00010000:1.0:1734016098.321205:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016098 -> 1734016098 00002000:00010000:1.0:1734016098.321206:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1744 -> 1712 00000100:00100000:1.0:1734016098.321280:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333414528:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 304us (706us total) trans 4294969200 rc 0/0 00000100:00100000:1.0:1734016098.321286:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10251 00000100:00100000:0.0:1734016098.327581:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075df1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335200000:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016098.327603:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016098.327665:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333414400:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 26292us (27472us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016098.327675:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2747 00000100:00100000:1.0:1734016098.335824:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333414784 00000100:00100000:1.0:1734016098.335834:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333414784 00000100:00100000:1.0:1734016098.335870:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10253 00000100:00100000:1.0:1734016098.335877:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333414784:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016098.335892:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016098.335907:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27114068 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e48c7 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016098.335963:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335200128:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016098.336114:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f180 going to sleep for 11 seconds 00002000:00010000:1.0:1734016098.341739:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016097 -> 1734016098 00000100:00100000:1.0:1734016098.341765:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335200128:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016098.341958:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27114068 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48c7 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016098.341974:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27114068 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48c7 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016098.342594:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016098.343098:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333414784:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7218us (7368us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016098.343107:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10253 00000100:00100000:1.0:1734016098.350154:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333414912 00000100:00100000:1.0:1734016098.350163:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333414912 00000100:00100000:1.0:1734016098.350212:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10254 00000100:00100000:1.0:1734016098.350218:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333414912:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016098.350235:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016098.350260:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711406f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e48ce expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016098.350322:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335200256:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016098.352536:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f180 going to sleep for 11 seconds 00000100:00100000:1.0:1734016098.356177:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335200256:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016098.356215:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711406f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48ce expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016098.356228:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711406f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48ce expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016098.356853:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016098.356919:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333414912:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6699us (6883us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016098.356930:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10254 00000100:00100000:0.0:1734016098.361624:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016098.362070:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333415040 00000100:00100000:1.0:1734016098.362078:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333415040 00000100:00100000:1.0:1734016098.362130:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10255 00000100:00100000:1.0:1734016098.362137:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333415040:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016098.362154:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016098.362171:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114076 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e48d5 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016098.362226:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335200384:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016098.362304:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f180 going to sleep for 11 seconds 00000100:00100000:1.0:1734016098.367957:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335200384:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016098.368003:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114076 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48d5 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016098.368018:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114076 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48d5 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016098.368102:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499eac0, rc 0) 00000100:00100000:1.0:1734016098.368184:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333415040:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6044us (6565us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016098.368195:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10255 00000100:00100000:1.0:1734016098.371725:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333415168 00000100:00100000:1.0:1734016098.371733:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333415168 00000100:00100000:1.0:1734016098.372337:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10256 00000100:00100000:1.0:1734016098.372344:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333415168:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016098.372362:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016098.372377:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711407d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e48dc expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016098.372431:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335200512:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016098.372524:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f180 going to sleep for 11 seconds 00000100:00100000:1.0:1734016098.377881:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335200512:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016098.377920:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711407d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48dc expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016098.377935:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711407d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48dc expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016098.378014:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016098.378079:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333415168:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5733us (6433us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016098.378088:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10256 00000100:00100000:1.0:1734016098.381988:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333415296 00000100:00100000:1.0:1734016098.381997:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333415296 00000100:00100000:1.0:1734016098.382040:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10257 00000100:00100000:1.0:1734016098.382046:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333415296:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016098.382066:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016098.382084:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27114084 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e48e3 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016098.382148:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335200640:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016098.382205:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f180 going to sleep for 11 seconds 00000100:00100000:1.0:1734016098.388365:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335200640:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016098.388406:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27114084 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48e3 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016098.388421:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27114084 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48e3 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016098.389171:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016098.389456:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333415296:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7405us (7598us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016098.389467:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10257 00000100:00100000:0.0:1734016098.393721:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016098.394086:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333415424 00000100:00100000:1.0:1734016098.394095:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333415424 00000100:00100000:1.0:1734016098.394345:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10258 00000100:00100000:1.0:1734016098.394352:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333415424:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016098.394369:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016098.394710:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711408b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e48ea expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016098.394767:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335200768:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016098.395418:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f180 going to sleep for 11 seconds 00000100:00100000:1.0:1734016098.398995:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335200768:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016098.399028:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711408b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48ea expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016098.399039:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711408b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48ea expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016098.399208:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016098.399262:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333415424:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4909us (5548us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016098.399270:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10258 00000100:00100000:1.0:1734016098.405832:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333415552 00000100:00100000:1.0:1734016098.405841:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333415552 00000100:00100000:1.0:1734016098.407835:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10259 00000100:00100000:1.0:1734016098.407847:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333415552:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016098.407867:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016098.407886:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27114092 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e48f1 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016098.407915:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114061 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->339967) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48c0 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016098.407922:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016098.407924:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016098.407928:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27114092 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5419008->5464063] (req 5419008->5464063) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48f1 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016098.407961:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114061 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->339967) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48c0 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016098.407974:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114061 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->339967) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48c0 expref: 7 pid: 7684 timeout: 465 lvb_type: 0 00000100:00100000:1.0:1734016098.407989:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335200896:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016098.408077:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f180 going to sleep for 11 seconds 00000100:00100000:0.0:1734016098.412050:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016098.412169:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335200896:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016098.412201:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27114092 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5419008->5464063] (req 5419008->5464063) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48f1 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016098.412217:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016098.412288:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333415552:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4442us (6593us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016098.412296:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10259 00000100:00100000:0.0:1734016098.423596:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016098.423928:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333415808 00000100:00100000:1.0:1734016098.423935:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333415808 00000100:00100000:1.0:1734016098.425268:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10260 00000100:00100000:1.0:1734016098.425277:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333415808:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016098.425485:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8940931 -> 8940931 00002000:00010000:1.0:1734016098.425488:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016098 -> 1734016098 00002000:00010000:1.0:1734016098.425490:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016098 -> 1734016097 00002000:00010000:1.0:1734016098.425492:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016098 -> 1734016098 00002000:00010000:1.0:1734016098.425494:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1784 -> 1784 00000100:00100000:1.0:1734016098.425585:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333415808:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 308us (1989us total) trans 4294969202 rc 0/0 00000100:00100000:1.0:1734016098.425594:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10260 00000100:00100000:0.0:1734016098.434272:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016098.434715:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333415936 00000100:00100000:1.0:1734016098.434726:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333415936 00000100:00100000:1.0:1734016098.435348:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10261 00000100:00100000:1.0:1734016098.435359:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333415936:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016098.435529:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8940931 -> 8940931 00002000:00010000:1.0:1734016098.435532:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016098 -> 1734016098 00002000:00010000:1.0:1734016098.435534:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016097 -> 1734016097 00002000:00010000:1.0:1734016098.435536:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016098 -> 1734016098 00002000:00010000:1.0:1734016098.435537:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1784 -> 1784 00000100:00100000:1.0:1734016098.435842:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333415936:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 482us (1593us total) trans 4294969203 rc 0/0 00000100:00100000:1.0:1734016098.435849:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10261 00000100:00100000:1.0:1734016098.439036:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333416064 00000100:00100000:1.0:1734016098.439043:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333416064 00000100:00100000:1.0:1734016098.439089:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10262 00000100:00100000:1.0:1734016098.439095:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333416064:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016098.439111:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016098.439129:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27114099 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e48f8 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016098.439184:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335201152:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016098.439244:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f180 going to sleep for 11 seconds 00002000:00010000:1.0:1734016098.444935:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016097 -> 1734016098 00002000:00010000:1.0:1734016098.444942:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016098 -> 1734016099 00000100:00100000:1.0:1734016098.444966:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335201152:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016098.445002:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27114099 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48f8 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016098.445016:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27114099 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e48f8 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016098.445044:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:0.0:1734016098.445177:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333416064:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6078us (6231us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016098.445186:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10262 00000100:00100000:0.0:1734016098.449291:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.468057:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333416320 00000100:00100000:0.0:1734016098.468065:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333416320 00000100:00100000:0.0:1734016098.468705:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10264 00000100:00100000:0.0:1734016098.468714:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333416320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016098.468735:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016098.468753:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc271140a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4906 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016098.469622:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075df1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335201408:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016098.472532:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016098.511761:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.520261:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335201664:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016098.520301:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271140b5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4914 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016098.520316:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271140b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4914 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016098.520340:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:0.0:1734016098.521145:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333416576:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6499us (9390us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016098.521153:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10266 00000100:00100000:0.0:1734016098.525322:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.541959:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.548760:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016098.564626:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.577473:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.593596:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.601705:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.608739:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.608768:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333417728 00000100:00100000:0.0:1734016098.608775:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333417728 00002000:00100000:0.0:1734016098.608837:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5148672->8941567) req@ffff880073b9df80 x1818247333417728/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 504/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.608846:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9df80 with x1818247333417728 ext(5148672->8941567) 00002000:00010000:0.0:1734016098.608851:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9df80 00000100:00100000:0.0:1734016098.611722:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7972 00000100:00100000:0.0:1734016098.611733:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333417728:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016098.613659:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333417728:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1919us (4919us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1734016098.613670:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7972 00002000:00100000:0.0:1734016098.613680:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5148672->8941567) req@ffff880073b9df80 x1818247333417728/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 504/440 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.613689:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9df80 with x1818247333417728 ext(5148672->8941567) 00002000:00010000:0.0:1734016098.613693:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9df80 00000100:00100000:0.0:1734016098.620458:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333417984 00000100:00100000:0.0:1734016098.620467:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333417984 00002000:00100000:0.0:1734016098.620506:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5144576->5148671) req@ffff880075609f80 x1818247333417984/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.620517:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609f80 with x1818247333417984 ext(5144576->5148671) 00002000:00010000:0.0:1734016098.620523:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075609f80 00000100:00100000:1.0:1734016098.621698:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7973 00000100:00100000:1.0:1734016098.621706:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333417984:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016098.621911:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333417984:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 203us (1532us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016098.621919:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7973 00002000:00100000:1.0:1734016098.621925:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5144576->5148671) req@ffff880075609f80 x1818247333417984/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.621933:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609f80 with x1818247333417984 ext(5144576->5148671) 00002000:00010000:1.0:1734016098.621939:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075609f80 00000100:00100000:0.0:1734016098.632331:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333418240 00000100:00100000:0.0:1734016098.632342:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333418240 00002000:00100000:0.0:1734016098.632389:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5140480->5144575) req@ffff88007560b480 x1818247333418240/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.632399:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560b480 with x1818247333418240 ext(5140480->5144575) 00002000:00010000:0.0:1734016098.632405:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560b480 00000100:00100000:0.0:1734016098.632443:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7974 00000100:00100000:0.0:1734016098.632450:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333418240:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016098.632613:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333418240:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 161us (532us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016098.632620:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7974 00002000:00100000:0.0:1734016098.632626:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5140480->5144575) req@ffff88007560b480 x1818247333418240/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.632633:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560b480 with x1818247333418240 ext(5140480->5144575) 00002000:00010000:0.0:1734016098.632636:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560b480 00000100:00100000:1.0:1734016098.636838:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333418496 00000100:00100000:1.0:1734016098.636848:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333418496 00002000:00100000:1.0:1734016098.636890:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5136384->5140479) req@ffff88007487f800 x1818247333418496/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.636899:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487f800 with x1818247333418496 ext(5136384->5140479) 00002000:00010000:1.0:1734016098.636904:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487f800 00000100:00100000:1.0:1734016098.636926:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7975 00000100:00100000:1.0:1734016098.636932:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333418496:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016098.637093:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333418496:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 158us (359us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016098.637101:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7975 00002000:00100000:1.0:1734016098.637107:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5136384->5140479) req@ffff88007487f800 x1818247333418496/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.637114:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487f800 with x1818247333418496 ext(5136384->5140479) 00002000:00010000:1.0:1734016098.637117:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487f800 00000100:00100000:0.0:1734016098.643357:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333418752 00000100:00100000:0.0:1734016098.643366:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333418752 00002000:00100000:0.0:1734016098.643406:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5132288->5136383) req@ffff88007560b800 x1818247333418752/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.643423:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560b800 with x1818247333418752 ext(5132288->5136383) 00002000:00010000:0.0:1734016098.643977:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560b800 00000100:00100000:0.0:1734016098.644004:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7976 00000100:00100000:0.0:1734016098.644010:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333418752:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016098.644183:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333418752:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 172us (1389us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016098.644191:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7976 00002000:00100000:0.0:1734016098.644196:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5132288->5136383) req@ffff88007560b800 x1818247333418752/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.644203:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560b800 with x1818247333418752 ext(5132288->5136383) 00002000:00010000:0.0:1734016098.644207:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560b800 00000100:00100000:1.0:1734016098.652073:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333419008 00000100:00100000:1.0:1734016098.652082:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333419008 00002000:00100000:1.0:1734016098.652122:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5128192->5132287) req@ffff880075609180 x1818247333419008/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.652132:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609180 with x1818247333419008 ext(5128192->5132287) 00002000:00010000:1.0:1734016098.652138:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075609180 00000100:00100000:1.0:1734016098.652278:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7977 00000100:00100000:1.0:1734016098.652285:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333419008:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016098.652432:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333419008:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 146us (713us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016098.652439:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7977 00002000:00100000:1.0:1734016098.652444:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5128192->5132287) req@ffff880075609180 x1818247333419008/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.652451:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609180 with x1818247333419008 ext(5128192->5132287) 00002000:00010000:1.0:1734016098.652454:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075609180 00000100:00100000:0.0:1734016098.659289:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333419264 00000100:00100000:0.0:1734016098.659297:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333419264 00002000:00100000:0.0:1734016098.659331:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5124096->5128191) req@ffff88007487f480 x1818247333419264/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.659340:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487f480 with x1818247333419264 ext(5124096->5128191) 00002000:00010000:0.0:1734016098.659345:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487f480 00000100:00100000:0.0:1734016098.659378:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7978 00000100:00100000:0.0:1734016098.659384:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333419264:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016098.659529:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333419264:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 144us (340us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016098.659536:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7978 00002000:00100000:0.0:1734016098.659541:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5124096->5128191) req@ffff88007487f480 x1818247333419264/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.659549:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487f480 with x1818247333419264 ext(5124096->5128191) 00002000:00010000:0.0:1734016098.659551:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487f480 00000100:00100000:1.0:1734016098.663911:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333419520 00000100:00100000:1.0:1734016098.663920:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333419520 00002000:00100000:1.0:1734016098.663957:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5120000->5124095) req@ffff880075608000 x1818247333419520/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.663967:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075608000 with x1818247333419520 ext(5120000->5124095) 00002000:00010000:1.0:1734016098.663971:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075608000 00000100:00100000:1.0:1734016098.663998:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7979 00000100:00100000:1.0:1734016098.664003:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333419520:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016098.664153:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333419520:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 148us (393us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016098.664160:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7979 00002000:00100000:1.0:1734016098.664165:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5120000->5124095) req@ffff880075608000 x1818247333419520/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.664172:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075608000 with x1818247333419520 ext(5120000->5124095) 00002000:00010000:1.0:1734016098.664175:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075608000 00000100:00100000:0.0:1734016098.667773:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333419776 00000100:00100000:0.0:1734016098.667781:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333419776 00002000:00100000:0.0:1734016098.667844:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5115904->5119999) req@ffff88007560a680 x1818247333419776/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.667853:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560a680 with x1818247333419776 ext(5115904->5119999) 00002000:00010000:0.0:1734016098.667858:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560a680 00000100:00100000:0.0:1734016098.667881:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7980 00000100:00100000:0.0:1734016098.667888:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333419776:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016098.668026:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333419776:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 137us (342us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016098.668033:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7980 00002000:00100000:0.0:1734016098.668038:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5115904->5119999) req@ffff88007560a680 x1818247333419776/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.668045:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560a680 with x1818247333419776 ext(5115904->5119999) 00002000:00010000:0.0:1734016098.668048:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560a680 00000100:00100000:1.0:1734016098.673026:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333420032 00000100:00100000:1.0:1734016098.673034:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333420032 00002000:00100000:1.0:1734016098.673072:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7000064->7004159) req@ffff88007487dc00 x1818247333420032/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.673082:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487dc00 with x1818247333420032 ext(7000064->7004159) 00002000:00010000:1.0:1734016098.673088:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487dc00 00000100:00100000:1.0:1734016098.673221:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7981 00000100:00100000:1.0:1734016098.673227:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333420032:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016098.673587:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333420032:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 358us (752us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016098.673597:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7981 00002000:00100000:1.0:1734016098.673603:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7000064->7004159) req@ffff88007487dc00 x1818247333420032/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.673609:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487dc00 with x1818247333420032 ext(7000064->7004159) 00002000:00010000:1.0:1734016098.673612:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487dc00 00000100:00100000:1.0:1734016098.679332:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333420288 00000100:00100000:1.0:1734016098.679341:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333420288 00002000:00100000:1.0:1734016098.679378:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6995968->7000063) req@ffff88007560a300 x1818247333420288/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.679388:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560a300 with x1818247333420288 ext(6995968->7000063) 00002000:00010000:1.0:1734016098.679393:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560a300 00000100:00100000:1.0:1734016098.679548:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7982 00000100:00100000:1.0:1734016098.679554:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333420288:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016098.679697:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333420288:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 142us (510us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016098.679704:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7982 00002000:00100000:1.0:1734016098.679709:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6995968->7000063) req@ffff88007560a300 x1818247333420288/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.679715:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560a300 with x1818247333420288 ext(6995968->7000063) 00002000:00010000:1.0:1734016098.679718:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560a300 00000100:00100000:0.0:1734016098.685639:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333420544 00000100:00100000:0.0:1734016098.685648:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333420544 00002000:00100000:0.0:1734016098.685689:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6991872->6995967) req@ffff880075609500 x1818247333420544/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.685698:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609500 with x1818247333420544 ext(6991872->6995967) 00002000:00010000:0.0:1734016098.685703:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075609500 00000100:00100000:0.0:1734016098.685737:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7983 00000100:00100000:0.0:1734016098.685743:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333420544:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016098.685923:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333420544:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 179us (533us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016098.685931:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7983 00002000:00100000:0.0:1734016098.685936:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6991872->6995967) req@ffff880075609500 x1818247333420544/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.685944:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609500 with x1818247333420544 ext(6991872->6995967) 00002000:00010000:0.0:1734016098.685947:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075609500 00000100:00100000:1.0:1734016098.696256:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333420800 00000100:00100000:1.0:1734016098.696266:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333420800 00002000:00100000:1.0:1734016098.696309:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6987776->6991871) req@ffff88007487f100 x1818247333420800/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.696323:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487f100 with x1818247333420800 ext(6987776->6991871) 00002000:00010000:1.0:1734016098.696329:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487f100 00000100:00100000:1.0:1734016098.696364:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7984 00000100:00100000:1.0:1734016098.696371:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333420800:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016098.697494:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333420800:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1121us (1783us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016098.697502:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7984 00002000:00100000:1.0:1734016098.697509:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6987776->6991871) req@ffff88007487f100 x1818247333420800/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.697516:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487f100 with x1818247333420800 ext(6987776->6991871) 00002000:00010000:1.0:1734016098.697519:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487f100 00000100:00100000:1.0:1734016098.708584:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333421056 00000100:00100000:1.0:1734016098.708593:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333421056 00002000:00100000:1.0:1734016098.708635:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6983680->6987775) req@ffff88007560ad80 x1818247333421056/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.708646:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560ad80 with x1818247333421056 ext(6983680->6987775) 00002000:00010000:1.0:1734016098.708651:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560ad80 00000100:00100000:1.0:1734016098.708678:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7985 00000100:00100000:1.0:1734016098.708684:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333421056:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016098.708886:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333421056:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 201us (491us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016098.708893:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7985 00002000:00100000:1.0:1734016098.708898:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6983680->6987775) req@ffff88007560ad80 x1818247333421056/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.708906:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560ad80 with x1818247333421056 ext(6983680->6987775) 00002000:00010000:1.0:1734016098.708909:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560ad80 00000100:00100000:0.0:1734016098.713433:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333421312 00000100:00100000:0.0:1734016098.713443:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333421312 00002000:00100000:0.0:1734016098.713490:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6979584->6983679) req@ffff88007560b100 x1818247333421312/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.713499:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560b100 with x1818247333421312 ext(6979584->6983679) 00002000:00010000:0.0:1734016098.713504:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560b100 00000100:00100000:0.0:1734016098.713539:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7986 00000100:00100000:0.0:1734016098.713548:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333421312:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016098.714695:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333421312:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1140us (1731us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016098.714705:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7986 00002000:00100000:0.0:1734016098.714716:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6979584->6983679) req@ffff88007560b100 x1818247333421312/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.714724:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560b100 with x1818247333421312 ext(6979584->6983679) 00002000:00010000:0.0:1734016098.714728:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560b100 00000100:00100000:0.0:1734016098.725585:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333421568 00000100:00100000:0.0:1734016098.725599:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333421568 00002000:00100000:0.0:1734016098.725650:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6975488->6979583) req@ffff88007487c380 x1818247333421568/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.725660:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487c380 with x1818247333421568 ext(6975488->6979583) 00002000:00010000:0.0:1734016098.725667:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487c380 00000100:00100000:0.0:1734016098.725709:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7987 00000100:00100000:0.0:1734016098.725716:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333421568:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016098.725967:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333421568:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 251us (861us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016098.725975:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7987 00002000:00100000:0.0:1734016098.725981:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6975488->6979583) req@ffff88007487c380 x1818247333421568/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.725987:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487c380 with x1818247333421568 ext(6975488->6979583) 00002000:00010000:0.0:1734016098.725990:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487c380 00000100:00100000:1.0:1734016098.730053:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333421824 00000100:00100000:1.0:1734016098.730060:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333421824 00002000:00100000:1.0:1734016098.730094:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6971392->6975487) req@ffff880075608700 x1818247333421824/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.730102:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075608700 with x1818247333421824 ext(6971392->6975487) 00002000:00010000:1.0:1734016098.730106:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075608700 00000100:00100000:1.0:1734016098.730122:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7988 00000100:00100000:1.0:1734016098.730127:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333421824:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016098.730537:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333421824:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 408us (564us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016098.730543:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7988 00002000:00100000:1.0:1734016098.730549:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6971392->6975487) req@ffff880075608700 x1818247333421824/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.730555:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075608700 with x1818247333421824 ext(6971392->6975487) 00002000:00010000:1.0:1734016098.730558:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075608700 00000100:00100000:1.0:1734016098.736884:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333422080 00000100:00100000:1.0:1734016098.736894:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333422080 00002000:00100000:1.0:1734016098.736934:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6967296->6971391) req@ffff88007560bb80 x1818247333422080/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.736942:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560bb80 with x1818247333422080 ext(6967296->6971391) 00002000:00010000:1.0:1734016098.736947:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560bb80 00000100:00100000:1.0:1734016098.736967:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7989 00000100:00100000:1.0:1734016098.736972:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333422080:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016098.738472:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333422080:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1487us (1700us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016098.738488:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7989 00002000:00100000:1.0:1734016098.738504:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6967296->6971391) req@ffff88007560bb80 x1818247333422080/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.738512:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560bb80 with x1818247333422080 ext(6967296->6971391) 00002000:00010000:1.0:1734016098.738517:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560bb80 00000100:00100000:1.0:1734016098.754018:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333422336 00000100:00100000:1.0:1734016098.754028:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333422336 00002000:00100000:1.0:1734016098.754079:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6963200->6967295) req@ffff8800755b4380 x1818247333422336/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.754089:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4380 with x1818247333422336 ext(6963200->6967295) 00002000:00010000:1.0:1734016098.754094:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4380 00000100:00100000:1.0:1734016098.754281:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7990 00000100:00100000:1.0:1734016098.754288:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333422336:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016098.754443:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333422336:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 153us (1033us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016098.754449:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7990 00002000:00100000:1.0:1734016098.754455:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6963200->6967295) req@ffff8800755b4380 x1818247333422336/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.754462:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4380 with x1818247333422336 ext(6963200->6967295) 00002000:00010000:1.0:1734016098.754464:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4380 00000100:00100000:0.0:1734016098.760338:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333422592 00000100:00100000:0.0:1734016098.760347:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333422592 00002000:00100000:0.0:1734016098.760394:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6959104->6963199) req@ffff880075608380 x1818247333422592/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.760403:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075608380 with x1818247333422592 ext(6959104->6963199) 00002000:00010000:0.0:1734016098.760408:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075608380 00000100:00100000:0.0:1734016098.760444:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7991 00000100:00100000:0.0:1734016098.760450:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333422592:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016098.760641:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333422592:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 189us (402us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016098.760649:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7991 00002000:00100000:0.0:1734016098.760654:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6959104->6963199) req@ffff880075608380 x1818247333422592/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.760660:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075608380 with x1818247333422592 ext(6959104->6963199) 00002000:00010000:0.0:1734016098.760662:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075608380 00000100:00100000:1.0:1734016098.766825:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333422848 00000100:00100000:1.0:1734016098.766835:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333422848 00002000:00100000:1.0:1734016098.766876:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6955008->6959103) req@ffff880075609880 x1818247333422848/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.766885:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609880 with x1818247333422848 ext(6955008->6959103) 00002000:00010000:1.0:1734016098.766891:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075609880 00000100:00100000:1.0:1734016098.766918:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7992 00000100:00100000:1.0:1734016098.766923:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333422848:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016098.767088:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333422848:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 162us (430us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016098.767095:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7992 00002000:00100000:1.0:1734016098.767099:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6955008->6959103) req@ffff880075609880 x1818247333422848/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.767105:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609880 with x1818247333422848 ext(6955008->6959103) 00002000:00010000:1.0:1734016098.767108:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075609880 00000100:00100000:0.0:1734016098.780045:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333422976 00000100:00100000:0.0:1734016098.780056:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333422976 00000100:00100000:0.0:1734016098.781035:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10273 00000100:00100000:0.0:1734016098.781045:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333422976:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016098.781066:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016098.781086:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc271140df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e493e expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016098.781117:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016098.781119:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016098.781128:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc271140df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e493e expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016098.781145:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc271140df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e493e expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016098.781156:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580900, rc 0) 00000100:00100000:0.0:1734016098.781224:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333422976:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 180us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016098.781231:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10273 00000100:00100000:0.0:1734016098.793753:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333423232 00000100:00100000:0.0:1734016098.793767:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333423232 00002000:00100000:0.0:1734016098.793926:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2846720->2850815) req@ffff8801369f0a80 x1818247333423232/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.793939:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f0a80 with x1818247333423232 ext(2846720->2850815) 00002000:00010000:0.0:1734016098.793949:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f0a80 00000100:00100000:0.0:1734016098.794113:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7993 00000100:00100000:0.0:1734016098.794121:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333423232:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016098.797224:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333423232:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 3087us (3554us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016098.797251:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7993 00002000:00100000:0.0:1734016098.797266:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2846720->2850815) req@ffff8801369f0a80 x1818247333423232/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.797275:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f0a80 with x1818247333423232 ext(2846720->2850815) 00002000:00010000:0.0:1734016098.797282:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f0a80 00000100:00100000:0.0:1734016098.808057:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333423488 00000100:00100000:0.0:1734016098.808065:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333423488 00002000:00100000:0.0:1734016098.808103:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2842624->2846719) req@ffff8800755b5180 x1818247333423488/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.808112:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5180 with x1818247333423488 ext(2842624->2846719) 00002000:00010000:0.0:1734016098.808117:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b5180 00000100:00100000:0.0:1734016098.808146:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7994 00000100:00100000:0.0:1734016098.808152:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333423488:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016098.808307:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333423488:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 154us (510us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016098.808317:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7994 00002000:00100000:0.0:1734016098.808322:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2842624->2846719) req@ffff8800755b5180 x1818247333423488/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.808329:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5180 with x1818247333423488 ext(2842624->2846719) 00002000:00010000:0.0:1734016098.808332:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b5180 00000100:00100000:1.0:1734016098.814318:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333423744 00000100:00100000:1.0:1734016098.814327:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333423744 00002000:00100000:1.0:1734016098.814375:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2838528->2842623) req@ffff8800755b6d80 x1818247333423744/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.814384:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b6d80 with x1818247333423744 ext(2838528->2842623) 00002000:00010000:1.0:1734016098.814389:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b6d80 00000100:00100000:1.0:1734016098.814409:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7995 00000100:00100000:1.0:1734016098.814415:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333423744:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016098.814660:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333423744:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 243us (466us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016098.814668:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7995 00002000:00100000:1.0:1734016098.814674:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2838528->2842623) req@ffff8800755b6d80 x1818247333423744/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.814681:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b6d80 with x1818247333423744 ext(2838528->2842623) 00002000:00010000:1.0:1734016098.814684:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b6d80 00000100:00100000:1.0:1734016098.827266:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333424000 00000100:00100000:1.0:1734016098.827276:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333424000 00002000:00100000:1.0:1734016098.827318:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2834432->2838527) req@ffff8800750d0000 x1818247333424000/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.827329:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d0000 with x1818247333424000 ext(2834432->2838527) 00002000:00010000:1.0:1734016098.827334:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d0000 00000100:00100000:1.0:1734016098.827362:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7996 00000100:00100000:1.0:1734016098.827368:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333424000:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016098.827531:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333424000:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 162us (1804us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016098.827538:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7996 00002000:00100000:1.0:1734016098.827543:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2834432->2838527) req@ffff8800750d0000 x1818247333424000/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.827551:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d0000 with x1818247333424000 ext(2834432->2838527) 00002000:00010000:1.0:1734016098.827554:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d0000 00000100:00100000:0.0:1734016098.834513:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333424256 00000100:00100000:0.0:1734016098.834522:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333424256 00002000:00100000:0.0:1734016098.834561:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2830336->2834431) req@ffff880073ad7800 x1818247333424256/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.834571:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad7800 with x1818247333424256 ext(2830336->2834431) 00002000:00010000:0.0:1734016098.834576:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad7800 00000100:00100000:0.0:1734016098.834733:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7997 00000100:00100000:0.0:1734016098.834742:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333424256:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016098.835322:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333424256:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 579us (891us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016098.835331:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7997 00002000:00100000:0.0:1734016098.835340:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2830336->2834431) req@ffff880073ad7800 x1818247333424256/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.835350:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad7800 with x1818247333424256 ext(2830336->2834431) 00002000:00010000:0.0:1734016098.835353:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad7800 00000100:00100000:0.0:1734016098.843010:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333424512 00000100:00100000:0.0:1734016098.843019:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333424512 00002000:00100000:0.0:1734016098.843059:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2826240->2830335) req@ffff880073ad6680 x1818247333424512/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.843073:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad6680 with x1818247333424512 ext(2826240->2830335) 00002000:00010000:0.0:1734016098.843077:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad6680 00000100:00100000:0.0:1734016098.844148:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7998 00000100:00100000:0.0:1734016098.844155:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333424512:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016098.844342:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333424512:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 185us (1738us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016098.844349:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7998 00002000:00100000:0.0:1734016098.844355:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2826240->2830335) req@ffff880073ad6680 x1818247333424512/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.844362:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad6680 with x1818247333424512 ext(2826240->2830335) 00002000:00010000:0.0:1734016098.844366:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad6680 00000100:00100000:1.0:1734016098.852052:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333424768 00000100:00100000:1.0:1734016098.852061:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333424768 00002000:00100000:1.0:1734016098.852102:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2822144->2826239) req@ffff8800750d2a00 x1818247333424768/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.852117:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d2a00 with x1818247333424768 ext(2822144->2826239) 00002000:00010000:1.0:1734016098.852123:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d2a00 00000100:00100000:1.0:1734016098.852176:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 7999 00000100:00100000:1.0:1734016098.852183:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333424768:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016098.852524:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333424768:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 339us (1888us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016098.852531:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 7999 00002000:00100000:1.0:1734016098.852537:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2822144->2826239) req@ffff8800750d2a00 x1818247333424768/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.852544:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d2a00 with x1818247333424768 ext(2822144->2826239) 00002000:00010000:1.0:1734016098.852547:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d2a00 00000100:00100000:1.0:1734016098.855717:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333425024 00000100:00100000:1.0:1734016098.855726:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333425024 00002000:00100000:1.0:1734016098.855762:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2818048->2822143) req@ffff880073ad5180 x1818247333425024/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.855773:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5180 with x1818247333425024 ext(2818048->2822143) 00002000:00010000:1.0:1734016098.855778:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5180 00000100:00100000:1.0:1734016098.855832:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8000 00000100:00100000:1.0:1734016098.855838:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333425024:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016098.856002:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333425024:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 163us (563us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016098.856010:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8000 00002000:00100000:1.0:1734016098.856016:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2818048->2822143) req@ffff880073ad5180 x1818247333425024/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016098.856023:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5180 with x1818247333425024 ext(2818048->2822143) 00002000:00010000:1.0:1734016098.856026:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5180 00000100:00100000:0.0:1734016098.860597:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333425280 00000100:00100000:0.0:1734016098.860608:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333425280 00002000:00100000:0.0:1734016098.860652:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2813952->2818047) req@ffff8800756ec380 x1818247333425280/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/0 e 0 to 0 dl 1734016109 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.860662:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ec380 with x1818247333425280 ext(2813952->2818047) 00002000:00010000:0.0:1734016098.860667:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ec380 00000100:00100000:0.0:1734016098.860705:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8001 00000100:00100000:0.0:1734016098.860712:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333425280:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016098.860925:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333425280:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 212us (424us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016098.860933:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8001 00002000:00100000:0.0:1734016098.860938:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2813952->2818047) req@ffff8800756ec380 x1818247333425280/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:59/0 lens 488/4536 e 0 to 0 dl 1734016109 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016098.860946:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ec380 with x1818247333425280 ext(2813952->2818047) 00002000:00010000:0.0:1734016098.860948:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ec380 00000100:00100000:0.0:1734016098.867839:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333425408 00000100:00100000:0.0:1734016098.867847:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333425408 00000100:00100000:0.0:1734016098.867896:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10274 00000100:00100000:0.0:1734016098.867903:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:9668:x1818247333425408:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016098.867920:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016098.867936:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271140e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4945 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016098.867962:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271140d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5148672->5152767) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4937 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016098.867970:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc271140df lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e493e expref: 10 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016098.867976:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016098.867978:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016098.867981:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271140e6 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [6311936->6365183] (req 6311936->6365183) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4945 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016098.868007:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc271140df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e493e expref: 10 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016098.868017:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc271140df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e493e expref: 10 pid: 7682 timeout: 466 lvb_type: 1 00000100:00100000:0.0:1734016098.868033:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335202560:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016098.868100:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271140d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5148672->5152767) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4937 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016098.868108:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271140d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5148672->5152767) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4937 expref: 9 pid: 7682 timeout: 466 lvb_type: 0 00000100:00100000:0.0:1734016098.868115:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335202688:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016098.868131:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016098.874160:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335202560:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016098.874172:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335202688:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016098.874199:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271140e6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [6311936->6365183] (req 6311936->6365183) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4945 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016098.874214:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:0.0:1734016098.874270:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:9668:x1818247333425408:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6366us (6525us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016098.874278:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10274 00000100:00100000:1.0:1734016098.874532:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333425536 00000100:00100000:1.0:1734016098.874541:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333425536 00010000:00010000:1.0:1734016098.874567:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc271140df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e493e expref: 11 pid: 7682 timeout: 466 lvb_type: 1 00000100:00100000:1.0:1734016098.874589:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333425664 00000100:00100000:1.0:1734016098.874591:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333425664 00010000:00010000:1.0:1734016098.874599:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271140d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5148672->5152767) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4937 expref: 9 pid: 7682 timeout: 466 lvb_type: 0 00000100:00100000:1.0:1734016098.874624:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2750 00000100:00100000:1.0:1734016098.874630:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333425536:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016098.874643:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016098.874665:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc271140df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e493e expref: 11 pid: 7682 timeout: 466 lvb_type: 1 00010000:00010000:1.0:1734016098.874674:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc271140df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e493e expref: 11 pid: 7682 timeout: 466 lvb_type: 1 00010000:00010000:1.0:1734016098.874698:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc271140df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e493e expref: 11 pid: 7682 timeout: 466 lvb_type: 1 00010000:00010000:1.0:1734016098.874713:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016098.874732:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333425536:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 103us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016098.874739:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2750 00000100:00100000:1.0:1734016098.874751:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2751 00000100:00100000:1.0:1734016098.874755:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333425664:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016098.874762:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016098.874769:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271140d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5148672->5152767) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4937 expref: 9 pid: 7682 timeout: 466 lvb_type: 0 00010000:00010000:1.0:1734016098.874778:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271140d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5148672->5152767) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4937 expref: 9 pid: 7682 timeout: 466 lvb_type: 0 00010000:00010000:1.0:1734016098.874788:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271140d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5148672->5152767) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4937 expref: 9 pid: 7682 timeout: 466 lvb_type: 0 00010000:00010000:1.0:1734016098.874797:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016098.874822:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016098.874827:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271140e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6311936->6365183) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4945 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016098.874835:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271140e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6311936->6365183) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4945 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016098.874861:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271140e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6311936->6365183) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4945 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016098.874872:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335202816:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016098.874899:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f180 going to sleep for 11 seconds 00000100:00100000:0.0:1734016098.881494:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333425792 00000100:00100000:0.0:1734016098.881504:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333425792 00000100:00100000:0.0:1734016098.881557:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10275 00000100:00100000:0.0:1734016098.881564:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333425792:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016098.881849:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8940931 -> 8940931 00002000:00010000:0.0:1734016098.881854:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016098 -> 1734016098 00002000:00010000:0.0:1734016098.881856:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016098 -> 1734016097 00002000:00010000:0.0:1734016098.881858:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016099 -> 1734016098 00002000:00010000:0.0:1734016098.881860:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1736 -> 1736 00000100:00100000:0.0:1734016098.881953:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333425792:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 387us (518us total) trans 4294969205 rc 0/0 00000100:00100000:0.0:1734016098.881960:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10275 00000100:00100000:1.0:1734016098.882346:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335202816:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016098.882366:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016098.882930:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333425664:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 8171us (8480us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016098.882940:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2751 00000100:00100000:0.0:1734016098.891530:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333425920 00000100:00100000:0.0:1734016098.891540:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333425920 00000100:00100000:0.0:1734016098.892175:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10276 00000100:00100000:0.0:1734016098.892182:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333425920:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016098.892198:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016098.892215:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc271140ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e494c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016098.892280:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335202944:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016098.892342:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee240 going to sleep for 11 seconds 00002000:00010000:0.0:1734016098.898851:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016097 -> 1734016099 00002000:00010000:0.0:1734016098.898860:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016098 -> 1734016099 00000100:00100000:0.0:1734016098.898885:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335202944:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016098.898921:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc271140ed lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e494c expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016098.898937:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc271140ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e494c expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016098.899736:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582d00, rc 0) 00000100:00100000:0.0:1734016098.899797:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333425920:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7614us (8410us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016098.899834:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10276 00000100:00100000:1.0:1734016098.905627:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.905733:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333426048 00000100:00100000:0.0:1734016098.905748:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333426048 00000100:00100000:0.0:1734016098.905820:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10277 00000100:00100000:0.0:1734016098.905827:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333426048:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016098.905849:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016098.905867:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc271140f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4953 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016098.905927:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335203072:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016098.906632:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016098.911212:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335203072:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016098.911251:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc271140f4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4953 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016098.911263:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc271140f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4953 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016098.911286:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:0.0:1734016098.911332:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333426048:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5505us (5714us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016098.911344:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10277 00000100:00100000:0.0:1734016098.927657:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016098.928128:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333426432 00000100:00100000:1.0:1734016098.928135:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333426432 00010000:00010000:1.0:1734016098.928161:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc2711403e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e489d expref: 20 pid: 6478 timeout: 466 lvb_type: 0 00000100:00100000:1.0:1734016098.928183:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2752 00000100:00100000:1.0:1734016098.928189:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:1982:x1818247333426432:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016098.928201:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016098.928206:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc2711403e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e489d expref: 20 pid: 6478 timeout: 466 lvb_type: 0 00010000:00010000:1.0:1734016098.928216:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc2711403e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e489d expref: 20 pid: 6478 timeout: 466 lvb_type: 0 00010000:00010000:1.0:1734016098.928235:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc2711403e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e489d expref: 20 pid: 6478 timeout: 466 lvb_type: 0 00010000:00010000:1.0:1734016098.928273:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016098.928277:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc271140fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016098.928286:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc271140fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016098.928292:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc271140fb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016098.928317:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016098.928360:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:1982:x1818247333426432:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 169us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016098.928366:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2752 00000100:00100000:0.0:1734016098.932070:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016098.932148:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc271140fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016098.932159:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc271140fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016098.932166:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc271140fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016098.932172:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df7a80 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:1.0:1734016098.932176:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc271140fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016098.932182:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc271140fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016098.932196:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016098.932198:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1734016098.932201:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc271140fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016098.932206:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc271140fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016098.938456:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016098.938533:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333426688 00000100:00100000:1.0:1734016098.938542:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333426688 00010000:00010000:1.0:1734016098.938573:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271140e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6311936->6365183) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4945 expref: 9 pid: 7682 timeout: 466 lvb_type: 0 00000100:00100000:1.0:1734016098.938609:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2753 00000100:00100000:1.0:1734016098.938615:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333426688:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016098.938627:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016098.938650:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271140e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6311936->6365183) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4945 expref: 9 pid: 7682 timeout: 466 lvb_type: 0 00010000:00010000:1.0:1734016098.938662:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271140e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6311936->6365183) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4945 expref: 9 pid: 7682 timeout: 466 lvb_type: 0 00010000:00010000:1.0:1734016098.938686:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271140e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6311936->6365183) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4945 expref: 9 pid: 7682 timeout: 466 lvb_type: 0 00010000:00010000:1.0:1734016098.938700:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016098.938701:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016098.938706:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114102 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e495a expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016098.938716:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114102 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e495a expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016098.938749:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114102 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e495a expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016098.938763:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335203456:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016098.938861:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f180 going to sleep for 11 seconds 00000100:00100000:0.0:1734016098.947192:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016098.947303:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335203456:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016098.947325:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016098.947365:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333426688:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 8749us (8916us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016098.947373:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2753 00000100:00100000:0.0:1734016098.952542:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.967968:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.979463:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016098.989440:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.010460:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:1.0:1734016099.011634:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016069 00000100:00100000:0.0:1734016099.030307:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.036141:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1984:x1818247333428224:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 5489us (5832us total) trans 4294969207 rc 0/0 00000100:00100000:0.0:1734016099.036153:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8008 00002000:00100000:0.0:1734016099.036165:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (10047488->10064124) req@ffff880075fc7480 x1818247333428224/t4294969207(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:60/0 lens 488/448 e 0 to 0 dl 1734016110 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016099.036173:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7480 with x1818247333428224 ext(10047488->10064124) 00002000:00010000:0.0:1734016099.036179:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc7480 00000100:00100000:0.0:1734016099.043792:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:1.0:1734016099.044389:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016069 00000100:00100000:0.0:1734016099.050900:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333428480 00000100:00100000:0.0:1734016099.050908:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333428480 00000100:00100000:0.0:1734016099.051485:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10279 00000100:00100000:0.0:1734016099.051493:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333428480:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016099.062371:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969207 is committed 00000001:00080000:0.0:1734016099.062392:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969205 is committed 00000100:00100000:1.0:1734016099.082621:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:1.0:1734016099.083178:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016069 00000100:00100000:0.0:1734016099.096275:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016099.113731:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016099.124293:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.124469:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333429120 00000100:00100000:0.0:1734016099.124477:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333429120 00000100:00100000:0.0:1734016099.124537:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8009 00000100:00100000:0.0:1734016099.124543:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333429120:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:0.0:1734016099.124573:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114125 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.124589:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114102 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e495a expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.124594:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016099.124595:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016099.124597:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114125 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6524928->6553599] (req 6524928->6553599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.124624:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114102 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e495a expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.124635:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114102 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e495a expref: 7 pid: 7684 timeout: 466 lvb_type: 0 00000100:00100000:0.0:1734016099.124649:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800739e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335203840:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016099.124702:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016099.127174:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016099.150417:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969208 is committed 00000100:00100000:0.0:1734016099.156054:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333429376 00000100:00100000:0.0:1734016099.156064:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333429376 00000100:00100000:0.0:1734016099.156124:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 1999 00000100:00100000:0.0:1734016099.156133:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333429376:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016099.156154:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016099.156174:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc2711412c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4976 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.156304:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114133 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016099.156317:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016099.156327:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016099.156350:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 10064125 00000004:00200000:0.0:1734016099.156355:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016099.156369:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016099.156388:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc2711412c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4976 expref: 22 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.156418:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4976 expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.156425:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016099.156427:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016099.156430:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:0.0:1734016099.156473:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+21:9668:x1818247333429376:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 340us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016099.156479:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 1999 00000100:00100000:0.0:1734016099.167955:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.174280:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.182170:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.187847:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.200460:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333430144 00000100:00100000:0.0:1734016099.200471:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333430144 00000100:00100000:0.0:1734016099.200544:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8010 00000100:00100000:0.0:1734016099.200551:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333430144:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:0.0:1734016099.200584:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114148 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.200600:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114141 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9965568->9969663) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4984 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.200607:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016099.200609:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016099.200611:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114148 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1843200->1867775] (req 1843200->1867775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.200642:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114141 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9965568->9969663) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4984 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.200653:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114141 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9965568->9969663) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4984 expref: 8 pid: 7684 timeout: 466 lvb_type: 0 00000100:00100000:0.0:1734016099.200666:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800739e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335204224:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016099.200734:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016099.211860:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800739e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335204224:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016099.211889:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114148 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1843200->1867775] (req 1843200->1867775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016099.212615:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114148 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1843200->1867775] (req 1843200->1867775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016099.212624:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114148 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1843200->1867775] (req 1843200->1867775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016099.221149:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114148 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1843200->1867775] (req 1843200->1867775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016099.221177:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114148 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1843200->1867775] (req 1843200->1867775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016099.221185:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1843200->1867775] (req 1843200->1867775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016099.221197:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7580480 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016099.221200:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1843200->1867775] (req 1843200->1867775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016099.221207:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114148 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1843200->1867775] (req 1843200->1867775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016099.221223:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114148 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1843200->1867775] (req 1843200->1867775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016099.221228:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114148 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1843200->1867775] (req 1843200->1867775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016099.221364:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333430144:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 20807us (22633us total) trans 0 rc 24576/24576 00000100:00100000:1.0:1734016099.221375:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8010 00000100:00100000:0.0:1734016099.226135:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333430400 00000100:00100000:0.0:1734016099.226143:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333430400 00000100:00100000:0.0:1734016099.226195:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10285 00000100:00100000:0.0:1734016099.226202:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333430400:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016099.226217:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016099.226247:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc2711414f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e498b expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016099.226271:0:7682:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 10064125, mtime: 0x675afc63, atime: 0x675afc63, ctime: 0x675afc63, blocks: 0x728 00010000:00010000:0.0:1734016099.226288:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016099.226291:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016099.226300:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc2711414f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e498b expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016099.226317:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc2711414f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e498b expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016099.226328:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:0.0:1734016099.226388:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333430400:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 185us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016099.226395:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10285 00000100:00100000:1.0:1734016099.231367:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333430656 00000100:00100000:1.0:1734016099.231377:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333430656 00000100:00100000:1.0:1734016099.231426:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8011 00000100:00100000:1.0:1734016099.231433:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333430656:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:1.0:1734016099.231460:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27114156 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016099.231476:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc2711414f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e498b expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016099.231487:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016099.231489:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016099.231491:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27114156 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8151040->8159231] (req 8151040->8159231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016099.231516:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc2711414f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e498b expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016099.231526:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc2711414f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e498b expref: 8 pid: 7682 timeout: 466 lvb_type: 1 00000100:00100000:1.0:1734016099.231538:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335204352:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016099.234491:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f180 going to sleep for 11 seconds 00000100:00100000:0.0:1734016099.242327:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335204352:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016099.242355:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27114156 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8151040->8159231] (req 8151040->8159231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016099.242475:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333430784 00000100:00100000:1.0:1734016099.242481:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333430784 00010000:00010000:1.0:1734016099.242507:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc2711414f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e498b expref: 9 pid: 7682 timeout: 466 lvb_type: 1 00000100:00100000:1.0:1734016099.242530:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2757 00000100:00100000:1.0:1734016099.242535:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333430784:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016099.242548:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016099.242567:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc2711414f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e498b expref: 9 pid: 7682 timeout: 466 lvb_type: 1 00010000:00010000:1.0:1734016099.242577:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc2711414f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e498b expref: 9 pid: 7682 timeout: 466 lvb_type: 1 00010000:00010000:1.0:1734016099.242601:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc2711414f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e498b expref: 9 pid: 7682 timeout: 466 lvb_type: 1 00010000:00010000:1.0:1734016099.242632:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016099.242635:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016099.242638:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27114156 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8151040->8159231] (req 8151040->8159231) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016099.242646:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27114156 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8151040->8159231] (req 8151040->8159231) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016099.242672:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016099.242724:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333430784:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 177us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016099.242730:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2757 00010000:00010000:0.0:1734016099.242943:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27114156 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8151040->8159231] (req 8151040->8159231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.242951:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27114156 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8151040->8159231] (req 8151040->8159231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016099.249661:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969210 is committed 00000100:00100000:0.0:1734016099.272682:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.277208:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335204480:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016099.277261:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114164 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3026944->3051519] (req 3026944->3051519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016099.278440:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016099.279089:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114164 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3026944->3051519] (req 3026944->3051519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.279096:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114164 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3026944->3051519] (req 3026944->3051519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016099.284703:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969211 is committed 00000100:00100000:0.0:1734016099.287308:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333431424 00000100:00100000:0.0:1734016099.287317:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333431424 00000100:00100000:0.0:1734016099.287377:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10287 00000100:00100000:0.0:1734016099.287383:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333431424:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016099.287401:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016099.287422:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc2711416b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4999 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016099.287443:0:7682:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 10064125, mtime: 0x675afc63, atime: 0x675afc63, ctime: 0x675afc63, blocks: 0x768 00010000:00010000:0.0:1734016099.287460:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016099.287462:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016099.287468:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc2711416b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4999 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016099.287481:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc2711416b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4999 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016099.287491:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581b00, rc 0) 00000100:00100000:0.0:1734016099.287540:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333431424:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 156us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016099.287547:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10287 00000100:00100000:0.0:1734016099.290654:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016099.305914:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016099.308243:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114179 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [536576->577535] (req 536576->577535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.308257:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114179 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [536576->577535] (req 536576->577535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.308265:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114179 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [536576->577535] (req 536576->577535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.308271:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc480 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016099.308274:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114179 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [536576->577535] (req 536576->577535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.308285:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114179 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [536576->577535] (req 536576->577535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.308300:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114179 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [536576->577535] (req 536576->577535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.308307:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114179 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [536576->577535] (req 536576->577535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016099.312319:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333431808:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 6214us (6398us total) trans 0 rc 40960/40960 00000100:00100000:0.0:1734016099.312333:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8013 00000100:00100000:0.0:1734016099.322244:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.335642:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016099.335746:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333432320 00000100:00100000:1.0:1734016099.335754:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333432320 00000100:00100000:1.0:1734016099.340960:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2000 00000100:00100000:1.0:1734016099.340991:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:9668:x1818247333432320:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016099.341062:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016099.341094:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27114110 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4961 expref: 20 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016099.342276:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016099.342282:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016099.342456:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114187 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016099.342475:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114133 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4976 expref: 20 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016099.342481:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114187 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016099.342517:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4976 expref: 20 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016099.342530:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114133 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4976 expref: 20 pid: 13956 timeout: 466 lvb_type: 0 00000100:00100000:1.0:1734016099.342546:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335204608:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016099.343445:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016099.350016:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333432448 00000100:00100000:0.0:1734016099.350023:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333432448 00000100:00100000:1.0:1734016099.350025:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335204608:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016099.350049:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114187 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016099.350052:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114133 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4976 expref: 21 pid: 13956 timeout: 466 lvb_type: 0 00000100:00100000:0.0:1734016099.350076:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2759 00000100:00100000:0.0:1734016099.350081:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+21:1982:x1818247333432448:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016099.350092:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016099.350096:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114133 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4976 expref: 21 pid: 13956 timeout: 466 lvb_type: 0 00010000:00010000:0.0:1734016099.350105:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4976 expref: 21 pid: 13956 timeout: 466 lvb_type: 0 00010000:00010000:0.0:1734016099.350123:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114133 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4976 expref: 21 pid: 13956 timeout: 466 lvb_type: 0 00010000:00010000:0.0:1734016099.350148:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016099.350152:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114187 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016099.350160:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114187 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016099.350166:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114187 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016099.350189:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016099.350224:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+20:1982:x1818247333432448:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 142us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016099.350230:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2759 00010000:00010000:1.0:1734016099.350761:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114187 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016099.350768:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114187 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:1.0:1734016099.353468:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968590 00000004:00010000:1.0:1734016099.353524:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800752a6d80 reply state ffff880075dad000 transno 4294968591 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114187 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:1.0:1734016099.353532:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016099.353968:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:9668:x1818247333432320:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 12986us (18335us total) trans 4294968591 rc 0/0 00000100:00100000:1.0:1734016099.353976:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2000 00000020:00080000:1.0:1734016099.353982:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1734016099.368604:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114187 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016099.368619:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114187 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016099.368624:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114187 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016099.368630:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499f3c0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016099.368633:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114187 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016099.368641:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114187 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016099.368660:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016099.368663:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016099.368666:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114187 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016099.368671:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114187 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016099.371124:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016099.386920:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114172 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e49a0 expref: 6 pid: 7684 timeout: 466 lvb_type: 1 00000100:00100000:0.0:1734016099.386962:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335204736:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016099.386975:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc2711416b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4999 expref: 8 pid: 7682 timeout: 466 lvb_type: 1 00000100:00100000:0.0:1734016099.386983:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335204864:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016099.387016:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711418e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e49a7 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.387027:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:0.0:1734016099.387088:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333432576:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 14013us (15974us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016099.387096:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10289 00000100:00100000:1.0:1734016099.391514:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016099.404461:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.410053:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333433216 00000100:00100000:0.0:1734016099.410063:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333433216 00000100:00100000:0.0:1734016099.410646:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10290 00000100:00100000:0.0:1734016099.410655:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333433216:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016099.410679:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016099.410698:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271141a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e49b5 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016099.410755:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335205120:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016099.410893:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016099.413406:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335205120:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016099.413459:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271141a3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e49b5 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016099.413478:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271141a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e49b5 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016099.413513:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:0.0:1734016099.413584:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333433216:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2927us (3628us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016099.413598:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10290 00000100:00100000:1.0:1734016099.416724:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.416878:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333433344 00000100:00100000:0.0:1734016099.416890:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333433344 00000100:00100000:0.0:1734016099.416949:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10291 00000100:00100000:0.0:1734016099.416961:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333433344:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016099.416988:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016099.417013:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271141aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e49bc expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016099.417087:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335205248:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016099.417159:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016099.421067:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335205248:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016099.421107:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271141aa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e49bc expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016099.421120:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271141aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e49bc expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016099.421145:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016099.421194:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333433344:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4235us (4487us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016099.421202:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10291 00000100:00100000:1.0:1734016099.425661:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016099.459495:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016099.463255:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016099.469122:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8017 00000100:00100000:1.0:1734016099.469133:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333433984:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016099.604906:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016099.611753:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016099.618460:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.618544:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333434368 00000100:00100000:0.0:1734016099.618554:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333434368 00000100:00100000:0.0:1734016099.618606:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10292 00000100:00100000:0.0:1734016099.618612:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333434368:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:1.0:1734016099.620305:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969213 is committed 00000100:00100000:0.0:1734016099.620489:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333434368:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 1872us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016099.620499:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10292 00000100:00100000:0.0:1734016099.624505:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333434496 00000100:00100000:0.0:1734016099.624515:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333434496 00000100:00100000:0.0:1734016099.624562:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10293 00000100:00100000:0.0:1734016099.624569:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333434496:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016099.624587:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016099.624604:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271141bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e49ca expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016099.624658:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335205376:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016099.624727:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00002000:00010000:0.0:1734016099.630712:0:7682:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime: 1734016099 -> 1734016100 00002000:00010000:0.0:1734016099.630719:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016099 -> 1734016100 00002000:00010000:0.0:1734016099.630722:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016099 -> 1734016100 00000100:00100000:0.0:1734016099.630744:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335205376:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016099.630780:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271141bf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e49ca expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016099.630794:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271141bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e49ca expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016099.630853:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016099.630911:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333434496:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6341us (6498us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016099.630920:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10293 00000100:00100000:1.0:1734016099.640577:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.640649:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333434624 00000100:00100000:0.0:1734016099.640657:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333434624 00000100:00100000:0.0:1734016099.640708:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10294 00000100:00100000:0.0:1734016099.640716:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333434624:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016099.640733:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016099.640751:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271141c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e49d1 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016099.640840:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335205504:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016099.640902:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016099.642758:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335205504:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016099.642794:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271141c6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e49d1 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016099.642843:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271141c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e49d1 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016099.642870:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:0.0:1734016099.642923:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333434624:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2207us (2355us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016099.642931:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10294 00000100:00100000:1.0:1734016099.647337:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.647401:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333434752 00000100:00100000:0.0:1734016099.647410:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333434752 00000100:00100000:0.0:1734016099.647456:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10295 00000100:00100000:0.0:1734016099.647462:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333434752:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016099.647478:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016099.647493:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc271141cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e49d8 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016099.647541:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335205632:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016099.647603:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016099.649653:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335205632:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016099.649680:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc271141cd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e49d8 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016099.649691:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc271141cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e49d8 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016099.649719:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581b00, rc 0) 00000100:00100000:0.0:1734016099.649892:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333434752:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2428us (2564us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016099.649900:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10295 00000100:00100000:0.0:1734016099.668389:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333434880 00000100:00100000:0.0:1734016099.668398:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333434880 00000100:00100000:0.0:1734016099.668455:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10296 00000100:00100000:0.0:1734016099.668462:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333434880:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016099.668483:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016099.668501:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc271141d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e49df expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.668529:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711418e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e49a7 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.668536:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016099.668538:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016099.668542:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc271141d4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4354048->4390911] (req 4354048->4390911) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e49df expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.668576:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711418e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e49a7 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.668590:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711418e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e49a7 expref: 5 pid: 7682 timeout: 466 lvb_type: 0 00000100:00100000:0.0:1734016099.668616:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335205760:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016099.668692:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016099.679396:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335205760:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016099.679427:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc271141d4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4354048->4390911] (req 4354048->4390911) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e49df expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016099.679444:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:0.0:1734016099.679501:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333434880:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11037us (11186us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016099.679509:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10296 00000100:00100000:1.0:1734016099.704850:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.711566:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333435136 00000100:00100000:0.0:1734016099.711576:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333435136 00000100:00100000:0.0:1734016099.711626:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10297 00000100:00100000:0.0:1734016099.711633:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333435136:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016099.711832:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7390209 -> 7390209 00002000:00010000:0.0:1734016099.711835:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016100 -> 1734016100 00002000:00010000:0.0:1734016099.711837:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016100 -> 1734016099 00002000:00010000:0.0:1734016099.711839:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016100 -> 1734016099 00002000:00010000:0.0:1734016099.711841:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1712 -> 1784 00000100:00100000:0.0:1734016099.711900:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333435136:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 267us (2141us total) trans 4294969214 rc 0/0 00000100:00100000:0.0:1734016099.711907:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10297 00000100:00100000:1.0:1734016099.717580:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016099.724873:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016099.728946:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016099.748014:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.753597:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016099.761283:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.766563:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.766610:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.800786:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8020 00000100:00100000:0.0:1734016099.800792:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333436544:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016099.874453:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333436544:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 73650us (74169us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1734016099.874465:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8020 00002000:00100000:0.0:1734016099.874477:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->5873663) req@ffff880075143b80 x1818247333436544/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:60/0 lens 504/440 e 0 to 0 dl 1734016110 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016099.874485:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075143b80 with x1818247333436544 ext(0->5873663) 00002000:00010000:0.0:1734016099.874491:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075143b80 00000100:00100000:1.0:1734016099.909580:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.915426:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333436928:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4495us (5841us total) trans 4294969215 rc 0/0 00000100:00100000:0.0:1734016099.915439:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8022 00002000:00100000:0.0:1734016099.915451:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5816320->5873663) req@ffff880075447100 x1818247333436928/t4294969215(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:60/0 lens 488/448 e 0 to 0 dl 1734016110 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016099.915459:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075447100 with x1818247333436928 ext(5816320->5873663) 00002000:00010000:0.0:1734016099.915467:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075447100 00000100:00100000:1.0:1734016099.917722:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:1.0:1734016099.929650:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969215 is committed 00000100:00100000:0.0:1734016099.936169:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.944779:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.951946:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.966796:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016099.993036:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.010295:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.027384:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016100.027478:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711421a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016100.027492:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711421a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016100.027497:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711421a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016100.027503:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcb40 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:1.0:1734016100.027507:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711421a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016100.027513:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711421a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016100.027528:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016100.027531:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1734016100.027534:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711421a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016100.027539:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711421a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00080000:1.0:1734016100.028420:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016070 00000100:00100000:0.0:1734016100.051904:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.060580:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.060693:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333438336 00000100:00100000:1.0:1734016100.060703:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333438336 00002000:00010000:1.0:1734016100.060739:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (4285340->18446744073709551615) 00002000:00100000:1.0:1734016100.060743:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd29500 with x1818247333438336 ext(4285340->18446744073709551615) 00002000:00010000:1.0:1734016100.060754:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd29500. 00000100:00100000:1.0:1734016100.060777:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8023 00000100:00100000:1.0:1734016100.060785:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333438336:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016100.063196:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7390209 -> 4285340 00002000:00010000:1.0:1734016100.063207:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016100 -> 1734016100 00002000:00010000:1.0:1734016100.063210:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016100 -> 1734016099 00002000:00010000:1.0:1734016100.063212:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016100 -> 1734016100 00002000:00010000:1.0:1734016100.063215:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1896 -> 1544 00000100:00100000:1.0:1734016100.063304:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333438336:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 2513us (2731us total) trans 4294969216 rc 0/0 00000100:00100000:1.0:1734016100.063315:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8023 00002000:00010000:1.0:1734016100.063320:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (4285340->18446744073709551615) 00002000:00100000:1.0:1734016100.063323:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd29500 with x1818247333438336 ext(4285340->18446744073709551615) 00002000:00010000:1.0:1734016100.063329:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd29500. 00000100:00100000:0.0:1734016100.071692:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.077408:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.100510:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.131871:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.131905:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333439104 00000100:00100000:0.0:1734016100.131914:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333439104 00000100:00100000:0.0:1734016100.131973:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8024 00000100:00100000:0.0:1734016100.131980:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333439104:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:0.0:1734016100.132016:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114252 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.132031:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114221 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a1e expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.132036:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016100.132038:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016100.132040:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114252 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7794688->7827455] (req 7794688->7827455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.132073:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114221 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a1e expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.132086:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114221 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a1e expref: 7 pid: 7684 timeout: 467 lvb_type: 0 00000100:00100000:0.0:1734016100.132102:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335207808:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016100.132181:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016100.140600:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:1.0:1734016100.146926:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969217 is committed 00000100:00100000:0.0:1734016100.168697:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.178203:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.179780:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333439744 00000100:00100000:0.0:1734016100.179789:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333439744 00010000:00010000:0.0:1734016100.179843:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114259 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a41 expref: 6 pid: 7682 timeout: 467 lvb_type: 1 00000100:00100000:0.0:1734016100.179870:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2769 00000100:00100000:0.0:1734016100.179876:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333439744:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016100.179889:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016100.179911:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114259 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a41 expref: 6 pid: 7682 timeout: 467 lvb_type: 1 00010000:00010000:0.0:1734016100.179923:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114259 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a41 expref: 6 pid: 7682 timeout: 467 lvb_type: 1 00010000:00010000:0.0:1734016100.179943:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114259 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a41 expref: 6 pid: 7682 timeout: 467 lvb_type: 1 00010000:00010000:0.0:1734016100.181484:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016100.181489:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016100.181493:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114260 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [626688->675839] (req 626688->675839) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.181506:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114260 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [626688->675839] (req 626688->675839) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016100.181888:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016100.182142:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333439744:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 2260us (3945us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016100.182153:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2769 00000001:00080000:1.0:1734016100.187823:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969218 is committed 00000100:00100000:0.0:1734016100.192897:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333439872 00000100:00100000:0.0:1734016100.192904:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333439872 00000100:00100000:1.0:1734016100.193018:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10311 00000100:00100000:1.0:1734016100.193025:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333439872:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016100.193044:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016100.193064:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114267 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4a48 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016100.193082:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 7827456, mtime: 0x675afc64, atime: 0x675afc64, ctime: 0x675afc64, blocks: 0x6a8 00010000:00010000:1.0:1734016100.193097:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016100.193100:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016100.193107:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114267 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a48 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016100.193120:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114267 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a48 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016100.193129:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016100.193172:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333439872:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 146us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016100.193178:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10311 00000100:00100000:1.0:1734016100.197035:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.206181:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333440128 00000100:00100000:1.0:1734016100.206189:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333440128 00010000:00010000:1.0:1734016100.206231:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114267 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a48 expref: 7 pid: 7684 timeout: 467 lvb_type: 1 00000100:00100000:1.0:1734016100.206256:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2770 00000100:00100000:1.0:1734016100.206262:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333440128:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016100.206275:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016100.206292:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114267 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a48 expref: 7 pid: 7684 timeout: 467 lvb_type: 1 00010000:00010000:1.0:1734016100.206303:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114267 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a48 expref: 7 pid: 7684 timeout: 467 lvb_type: 1 00010000:00010000:1.0:1734016100.206322:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114267 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a48 expref: 7 pid: 7684 timeout: 467 lvb_type: 1 00010000:00010000:1.0:1734016100.206350:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016100.206352:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016100.206358:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711426e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6967296->6987775) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a4f expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016100.206366:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711426e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6967296->6987775) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a4f expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016100.206395:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711426e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6967296->6987775) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a4f expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016100.206407:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335208192:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016100.206463:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1734016100.211292:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.217891:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.218524:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333440384 00000100:00100000:1.0:1734016100.218533:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333440384 00000100:00100000:1.0:1734016100.218589:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10314 00000100:00100000:1.0:1734016100.218596:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333440384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016100.218614:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016100.218630:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114275 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4a56 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016100.218687:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335208320:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016100.218945:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016100.229316:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333440512 00000100:00100000:0.0:1734016100.229325:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333440512 00000100:00100000:0.0:1734016100.229374:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10315 00000100:00100000:0.0:1734016100.229381:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333440512:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016100.229398:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016100.229412:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711427c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4a5d expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016100.229465:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335208448:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016100.229530:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eef00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016100.231849:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335208448:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016100.231882:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711427c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a5d expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016100.231896:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711427c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a5d expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016100.232096:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581680, rc 0) 00000100:00100000:0.0:1734016100.232155:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333440512:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2772us (2966us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016100.232163:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10315 00000100:00100000:1.0:1734016100.256413:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.257386:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.258592:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8026 00000100:00100000:0.0:1734016100.258599:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333440768:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016100.335063:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333440768:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 76454us (78647us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1734016100.335074:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8026 00002000:00100000:0.0:1734016100.335085:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff880075447b80 x1818247333440768/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:61/0 lens 488/440 e 0 to 0 dl 1734016111 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016100.335094:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075447b80 with x1818247333440768 ext(0->4194303) 00002000:00010000:0.0:1734016100.335099:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075447b80 00000100:00100000:0.0:1734016100.382344:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333441152 00000100:00100000:0.0:1734016100.382353:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333441152 00000100:00100000:0.0:1734016100.382403:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10316 00000100:00100000:0.0:1734016100.382409:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333441152:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016100.382424:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016100.382442:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114283 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4a64 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016100.382704:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335208576:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016100.384400:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eef00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016100.393457:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335208576:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016100.393487:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114283 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a64 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016100.393505:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114283 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a64 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016100.394852:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581680, rc 0) 00000100:00100000:1.0:1734016100.398151:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333441152:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 15730us (15896us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016100.398162:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10316 00000100:00100000:1.0:1734016100.419967:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333441280 00000100:00100000:1.0:1734016100.419975:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333441280 00000100:00100000:1.0:1734016100.420017:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10317 00000100:00100000:1.0:1734016100.420024:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333441280:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016100.420041:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016100.420056:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc2711428a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4a6b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016100.420101:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335208704:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016100.420155:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016100.429486:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335208704:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016100.429522:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc2711428a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a6b expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016100.429539:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc2711428a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a6b expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016100.429567:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f180, rc 0) 00000100:00100000:1.0:1734016100.429621:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333441280:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9596us (9765us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016100.429631:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10317 00000100:00100000:0.0:1734016100.469655:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333441664 00000100:00100000:0.0:1734016100.469665:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333441664 00000100:00100000:0.0:1734016100.470812:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8028 00000100:00100000:0.0:1734016100.470822:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333441664:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:0.0:1734016100.470864:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114298 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.470880:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711426e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6967296->6987775) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a4f expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.470886:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016100.470888:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016100.470890:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114298 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2289664->2318335] (req 2289664->2318335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.470919:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711426e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6967296->6987775) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a4f expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.470931:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711426e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6967296->6987775) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a4f expref: 6 pid: 7682 timeout: 467 lvb_type: 0 00000100:00100000:0.0:1734016100.470945:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335208960:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016100.471030:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eef00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016100.479068:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335208960:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016100.479098:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114298 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2289664->2318335] (req 2289664->2318335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.492210:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114298 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2289664->2318335] (req 2289664->2318335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.492228:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114298 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2289664->2318335] (req 2289664->2318335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.499782:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114298 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2289664->2318335] (req 2289664->2318335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.499943:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114298 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2289664->2318335] (req 2289664->2318335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.499955:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114298 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2289664->2318335] (req 2289664->2318335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.499962:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a75818c0 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016100.499966:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114298 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2289664->2318335] (req 2289664->2318335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.499975:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114298 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2289664->2318335] (req 2289664->2318335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.499992:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114298 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2289664->2318335] (req 2289664->2318335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.499999:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114298 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2289664->2318335] (req 2289664->2318335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016100.503933:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333441664:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 33099us (34498us total) trans 0 rc 28672/28672 00000100:00100000:1.0:1734016100.503948:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8028 00000100:00100000:1.0:1734016100.513973:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333442176 00000100:00100000:1.0:1734016100.513981:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333442176 00000100:00100000:1.0:1734016100.514067:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8029 00000100:00100000:1.0:1734016100.514073:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333442176:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:1.0:1734016100.514108:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271142a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016100.514123:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711429f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a79 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016100.514130:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016100.514132:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016100.514135:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271142a6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2883584->2904063] (req 2883584->2904063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016100.514163:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711429f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a79 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016100.514172:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711429f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a79 expref: 6 pid: 7684 timeout: 467 lvb_type: 1 00000100:00100000:1.0:1734016100.514186:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335209088:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016100.514258:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016100.518033:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335209088:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016100.518056:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271142a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2883584->2904063] (req 2883584->2904063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.520052:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271142a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2883584->2904063] (req 2883584->2904063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.520059:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271142a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2883584->2904063] (req 2883584->2904063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1734016100.525019:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969220 is committed 00000001:00080000:1.0:1734016100.525035:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969219 is committed 00002000:00010000:0.0:1734016100.525130:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016100 -> 1734016101 00002000:00010000:0.0:1734016100.525135:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016100 -> 1734016101 00002000:00010000:0.0:1734016100.525138:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1704 -> 1744 00010000:00010000:0.0:1734016100.525153:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271142a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2883584->2904063] (req 2883584->2904063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.525165:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271142a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2883584->2904063] (req 2883584->2904063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.525172:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271142a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2883584->2904063] (req 2883584->2904063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.525178:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499ef40 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016100.525182:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271142a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2883584->2904063] (req 2883584->2904063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.525188:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271142a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2883584->2904063] (req 2883584->2904063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.525203:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271142a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2883584->2904063] (req 2883584->2904063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.525224:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271142a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2883584->2904063] (req 2883584->2904063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016100.525414:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333442176:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 11334us (11636us total) trans 4294969220 rc 0/0 00000100:00100000:0.0:1734016100.525427:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8029 00000100:00100000:0.0:1734016100.531297:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333442432 00000100:00100000:0.0:1734016100.531305:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333442432 00000100:00100000:0.0:1734016100.531356:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10320 00000100:00100000:0.0:1734016100.531363:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333442432:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016100.531383:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016100.531402:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271142ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4a80 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016100.531425:0:7682:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 7827456, mtime: 0x675afc65, atime: 0x675afc64, ctime: 0x675afc65, blocks: 0x6d0 00010000:00010000:0.0:1734016100.531443:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016100.531445:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016100.531453:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271142ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a80 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016100.531467:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271142ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a80 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016100.531476:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:0.0:1734016100.531530:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333442432:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 168us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016100.531539:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10320 00000100:00100000:0.0:1734016100.544182:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333442688 00000100:00100000:0.0:1734016100.544194:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333442688 00000100:00100000:0.0:1734016100.544784:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10322 00000100:00100000:0.0:1734016100.544792:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333442688:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016100.544859:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016100.544878:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc271142bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4a8e expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.544908:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271142ad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a80 expref: 5 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016100.544915:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271142b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a87 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016100.544920:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016100.544921:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016100.544924:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc271142bb lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [196608->217087] (req 196608->217087) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a8e expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.544956:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271142b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a87 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016100.544968:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271142b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a87 expref: 8 pid: 7684 timeout: 467 lvb_type: 1 00000100:00100000:0.0:1734016100.544983:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335209216:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016100.545071:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271142ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a80 expref: 5 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016100.545079:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271142ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a80 expref: 5 pid: 7682 timeout: 467 lvb_type: 1 00000100:00100000:0.0:1734016100.545087:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335209344:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016100.545105:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eef00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016100.549263:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335209216:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016100.549273:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335209344:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016100.549303:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc271142bb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [196608->217087] (req 196608->217087) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a8e expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.549322:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581200, rc 0) 00000100:00100000:0.0:1734016100.549379:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333442688:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4587us (5292us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016100.549388:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10322 00000100:00100000:1.0:1734016100.552039:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333442944 00000100:00100000:1.0:1734016100.552045:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333442944 00010000:00010000:1.0:1734016100.552068:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271142ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a80 expref: 6 pid: 7682 timeout: 467 lvb_type: 1 00000100:00100000:1.0:1734016100.552468:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2774 00000100:00100000:1.0:1734016100.552474:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075140a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333442944:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016100.552485:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016100.552502:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271142ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a80 expref: 6 pid: 7682 timeout: 467 lvb_type: 1 00010000:00010000:1.0:1734016100.552514:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271142ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a80 expref: 6 pid: 7682 timeout: 467 lvb_type: 1 00010000:00010000:1.0:1734016100.552530:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271142ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a80 expref: 6 pid: 7682 timeout: 467 lvb_type: 1 00010000:00010000:1.0:1734016100.552554:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016100.552556:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016100.552562:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc271142bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 196608->217087) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a8e expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016100.552570:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc271142bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 196608->217087) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a8e expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016100.552608:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc271142bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 196608->217087) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a8e expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016100.552621:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335209472:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016100.552673:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f480 going to sleep for 11 seconds 00000100:00100000:1.0:1734016100.559204:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335209472:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016100.559236:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016100.559292:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075140a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333442944:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6816us (7932us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016100.559303:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2774 00000100:00100000:0.0:1734016100.559387:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.559824:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333443072 00000100:00100000:1.0:1734016100.559830:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333443072 00000100:00100000:1.0:1734016100.560118:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10323 00000100:00100000:1.0:1734016100.560124:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333443072:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016100.560275:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7827456 -> 7827456 00002000:00010000:1.0:1734016100.560278:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016101 -> 1734016101 00002000:00010000:1.0:1734016100.560281:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016100 -> 1734016100 00002000:00010000:1.0:1734016100.560282:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016101 -> 1734016100 00002000:00010000:1.0:1734016100.560285:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1744 -> 1744 00000100:00100000:1.0:1734016100.560673:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333443072:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 546us (1283us total) trans 4294969221 rc 0/0 00000100:00100000:1.0:1734016100.560684:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10323 00000100:00100000:0.0:1734016100.564194:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.564301:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333443200 00000100:00100000:1.0:1734016100.564311:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333443200 00000100:00100000:1.0:1734016100.564682:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10324 00000100:00100000:1.0:1734016100.564690:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333443200:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016100.564755:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016100.564771:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271142c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4a95 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016100.564850:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335209600:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016100.565474:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f480 going to sleep for 11 seconds 00002000:00010000:1.0:1734016100.567615:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016100 -> 1734016101 00002000:00010000:1.0:1734016100.567623:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016100 -> 1734016101 00000100:00100000:1.0:1734016100.567644:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335209600:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016100.567679:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271142c2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a95 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016100.567694:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271142c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a95 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016100.568347:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:0.0:1734016100.568441:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333443200:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3749us (4252us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016100.568450:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10324 00000100:00100000:0.0:1734016100.570660:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.576339:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800739e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335209728:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016100.576379:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc271142c9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a9c expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016100.576395:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc271142c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a9c expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016100.576423:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd440, rc 0) 00000100:00100000:0.0:1734016100.577169:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333443328:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5592us (6516us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016100.577177:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10325 00000100:00100000:0.0:1734016100.581138:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.587912:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.600494:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.609844:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.616064:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.620462:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.620906:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333444224 00000100:00100000:1.0:1734016100.620913:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333444224 00010000:00010000:1.0:1734016100.620947:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc2711422f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a25 expref: 24 pid: 13956 timeout: 467 lvb_type: 0 00000100:00100000:1.0:1734016100.620989:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2775 00000100:00100000:1.0:1734016100.620996:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:1982:x1818247333444224:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016100.621014:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016100.621019:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc2711422f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a25 expref: 24 pid: 13956 timeout: 467 lvb_type: 0 00010000:00010000:1.0:1734016100.621030:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc2711422f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a25 expref: 24 pid: 13956 timeout: 467 lvb_type: 0 00010000:00010000:1.0:1734016100.621055:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc2711422f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4a25 expref: 24 pid: 13956 timeout: 467 lvb_type: 0 00010000:00010000:1.0:1734016100.621075:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016100.621079:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271142ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016100.621089:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271142ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016100.621095:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271142ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016100.621113:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016100.621158:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:1982:x1818247333444224:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 162us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016100.621165:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2775 00000100:00100000:0.0:1734016100.626573:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.626674:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333444352 00000100:00100000:1.0:1734016100.626682:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333444352 00002000:00010000:1.0:1734016100.626713:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (1756085->18446744073709551615) 00002000:00100000:1.0:1734016100.626718:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db0b480 with x1818247333444352 ext(1756085->18446744073709551615) 00002000:00010000:1.0:1734016100.626728:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db0b480. 00000100:00100000:1.0:1734016100.627709:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8030 00000100:00100000:1.0:1734016100.627717:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333444352:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:1.0:1734016100.636590:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.640559:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.649579:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.659367:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.674959:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.683711:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.684250:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333445248 00000100:00100000:0.0:1734016100.684258:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333445248 00000100:00100000:0.0:1734016100.684344:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2009 00000100:00100000:0.0:1734016100.684351:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:9668:x1818247333445248:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016100.684394:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016100.684416:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc271142fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4abf expref: 24 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.684671:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016100.684676:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016100.684825:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc2711431d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016100.684840:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc2711431d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016100.684847:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc2711431d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:0.0:1734016100.684874:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968596 00000004:00010000:0.0:1734016100.684888:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012e71a300 reply state ffff88007351a000 transno 4294968597 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc2711431d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016100.684894:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016100.685308:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+26:9668:x1818247333445248:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 953us (1601us total) trans 4294968597 rc 0/0 00000100:00100000:0.0:1734016100.685314:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2009 00000020:00080000:0.0:1734016100.685318:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1734016100.691112:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.697124:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.702339:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.708069:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.708269:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333445760 00000100:00100000:0.0:1734016100.708276:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333445760 00000100:00100000:0.0:1734016100.708316:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2010 00000100:00100000:0.0:1734016100.708321:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+25:9668:x1818247333445760:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016100.708341:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016100.708356:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc2711432b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4ae9 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.708425:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114332 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016100.708435:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016100.708443:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016100.708465:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 2903860 00000004:00200000:0.0:1734016100.708467:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016100.708477:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016100.708492:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc2711432b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ae9 expref: 27 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.708515:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114332 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ae9 expref: 26 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.708521:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016100.708524:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016100.708526:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582d00, rc 0) 00000100:00100000:0.0:1734016100.708575:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+26:9668:x1818247333445760:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 253us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016100.708580:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2010 00000100:00100000:0.0:1734016100.712963:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.725604:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.725695:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333446144 00000100:00100000:1.0:1734016100.725704:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333446144 00000100:00100000:1.0:1734016100.725824:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10336 00000100:00100000:1.0:1734016100.725833:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333446144:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016100.725852:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016100.730374:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114347 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4af7 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016100.730466:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335211264:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016100.730561:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016100.741063:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333446272 00000100:00100000:0.0:1734016100.741075:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333446272 00000100:00100000:1.0:1734016100.750923:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.754789:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.760617:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.767064:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.773466:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.773816:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333447040 00000100:00100000:0.0:1734016100.773825:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333447040 00002000:00010000:0.0:1734016100.773859:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (4986166->18446744073709551615) 00002000:00100000:0.0:1734016100.773863:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075885f80 with x1818247333447040 ext(4986166->18446744073709551615) 00002000:00010000:0.0:1734016100.773875:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075885f80. 00000100:00100000:0.0:1734016100.774401:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8032 00000100:00100000:0.0:1734016100.774407:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333447040:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016100.774569:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 2903860 -> 4986166 00002000:00010000:0.0:1734016100.774572:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016101 -> 1734016101 00002000:00010000:0.0:1734016100.774574:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016100 -> 1734016100 00002000:00010000:0.0:1734016100.774576:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016101 -> 1734016101 00002000:00010000:0.0:1734016100.774577:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 832 -> 832 00000100:00100000:0.0:1734016100.774596:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333447040:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 189us (1140us total) trans 4294969225 rc 0/0 00000100:00100000:0.0:1734016100.774602:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8032 00002000:00010000:0.0:1734016100.774605:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (4986166->18446744073709551615) 00002000:00100000:0.0:1734016100.774607:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075885f80 with x1818247333447040 ext(4986166->18446744073709551615) 00002000:00010000:0.0:1734016100.774611:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075885f80. 00000100:00100000:0.0:1734016100.778059:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333447168 00000100:00100000:0.0:1734016100.778067:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333447168 00000100:00100000:0.0:1734016100.778109:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2013 00000100:00100000:0.0:1734016100.778116:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+24:9668:x1818247333447168:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016100.778138:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016100.778156:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27114363 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4b0c expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.778242:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc2711436a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016100.778254:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc2711436a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016100.778263:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc2711436a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:0.0:1734016100.778286:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 4986166 00000004:00200000:0.0:1734016100.778290:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016100.778303:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc2711436a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016100.778322:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27114363 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b0c expref: 26 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.778352:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc2711436a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b0c expref: 25 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.778359:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016100.778361:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016100.778364:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00000100:00100000:0.0:1734016100.778407:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+25:9668:x1818247333447168:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 290us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016100.778413:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2013 00000100:00100000:1.0:1734016100.791070:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016100.791120:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.791649:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8033 00000100:00100000:0.0:1734016100.791659:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333447424:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016100.851306:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333447424:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 59640us (60235us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016100.851317:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8033 00002000:00100000:1.0:1734016100.851327:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff8800749ac000 x1818247333447424/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:61/0 lens 488/440 e 0 to 0 dl 1734016111 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016100.851334:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ac000 with x1818247333447424 ext(0->4194303) 00002000:00010000:1.0:1734016100.851340:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ac000 00000100:00100000:1.0:1734016100.866137:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.874367:0:7688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800739e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335211904:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016100.874400:0:7688:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114371 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8552448->8601599] (req 8552448->8601599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016100.880604:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016100.883559:0:7688:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114371 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8552448->8601599] (req 8552448->8601599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.883576:0:7688:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114371 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8552448->8601599] (req 8552448->8601599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1734016100.892376:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969226 is committed 00000001:00080000:1.0:1734016100.892390:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969224 is committed 00000100:00100000:0.0:1734016100.896729:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333448192 00000100:00100000:0.0:1734016100.896740:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333448192 00000100:00100000:0.0:1734016100.896784:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2014 00000100:00100000:0.0:1734016100.896790:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+25:9668:x1818247333448192:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016100.896826:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016100.896845:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27114378 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4b13 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.896927:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc2711437f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016100.896938:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc2711437f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016100.896948:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc2711437f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016100.896969:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 4986166 00000004:00200000:0.0:1734016100.896973:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016100.896986:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc2711437f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016100.897005:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27114378 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b13 expref: 27 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.897023:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc2711437f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b13 expref: 26 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.897029:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016100.897032:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016100.897034:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582f40, rc 0) 00000100:00100000:0.0:1734016100.897078:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+26:9668:x1818247333448192:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 288us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016100.897083:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2014 00000100:00100000:0.0:1734016100.900345:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333448320 00000100:00100000:0.0:1734016100.900356:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333448320 00000100:00100000:0.0:1734016100.900541:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10339 00000100:00100000:0.0:1734016100.900548:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333448320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016100.900571:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016100.900599:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114386 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4b1a expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016100.900620:0:7682:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 8601600, mtime: 0x675afc65, atime: 0x675afc64, ctime: 0x675afc65, blocks: 0x3a0 00010000:00010000:0.0:1734016100.900643:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016100.900645:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016100.900654:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114386 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b1a expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016100.900668:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114386 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b1a expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016100.900677:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581d40, rc 0) 00000100:00100000:0.0:1734016100.900727:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333448320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 180us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016100.900736:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10339 00000100:00100000:0.0:1734016100.904985:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.912229:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333448576 00000100:00100000:0.0:1734016100.912237:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333448576 00010000:00010000:0.0:1734016100.912270:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114386 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b1a expref: 7 pid: 7682 timeout: 468 lvb_type: 1 00000100:00100000:0.0:1734016100.912307:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2780 00000100:00100000:0.0:1734016100.912314:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333448576:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016100.912325:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016100.912344:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114386 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b1a expref: 7 pid: 7682 timeout: 468 lvb_type: 1 00010000:00010000:0.0:1734016100.912355:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114386 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b1a expref: 7 pid: 7682 timeout: 468 lvb_type: 1 00010000:00010000:0.0:1734016100.912374:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114386 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b1a expref: 7 pid: 7682 timeout: 468 lvb_type: 1 00010000:00010000:0.0:1734016100.912398:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016100.912400:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016100.912405:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711438d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6918144->6922239) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b21 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.912412:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711438d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6918144->6922239) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b21 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016100.912447:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711438d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6918144->6922239) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b21 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016100.912462:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335212160:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016100.912525:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016100.918269:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335212160:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016100.918303:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016100.918586:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333448576:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6269us (6857us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016100.918599:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2780 00000100:00100000:0.0:1734016100.919215:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333448832 00000100:00100000:0.0:1734016100.919222:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333448832 00002000:00100000:0.0:1734016100.919260:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (6918144->8601599) req@ffff880075df1f80 x1818247333448832/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:61/0 lens 504/0 e 0 to 0 dl 1734016111 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016100.919270:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075df1f80 with x1818247333448832 ext(6918144->8601599) 00002000:00010000:0.0:1734016100.919275:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075df1f80 00000100:00100000:0.0:1734016100.919307:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8036 00000100:00100000:0.0:1734016100.919313:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333448832:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016100.932706:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333448832:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 13383us (13820us total) trans 0 rc 778240/778240 00000100:00100000:0.0:1734016100.932719:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8036 00002000:00100000:0.0:1734016100.932731:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (6918144->8601599) req@ffff880075df1f80 x1818247333448832/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:61/0 lens 504/440 e 0 to 0 dl 1734016111 ref 1 fl Complete:/200/0 rc 778240/778240 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016100.932746:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075df1f80 with x1818247333448832 ext(6918144->8601599) 00002000:00010000:0.0:1734016100.932752:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075df1f80 00000100:00100000:0.0:1734016100.938662:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.944640:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.949230:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333449216:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 3429us (4586us total) trans 4294969227 rc 0/0 00000100:00100000:0.0:1734016100.949244:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8038 00002000:00100000:0.0:1734016100.949258:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6914048->6922239) req@ffff88012db0a680 x1818247333449216/t4294969227(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:61/0 lens 8680/448 e 0 to 0 dl 1734016111 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016100.949268:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db0a680 with x1818247333449216 ext(6914048->6922239) 00002000:00010000:0.0:1734016100.949274:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db0a680 00000100:00100000:0.0:1734016100.951924:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.955083:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:1.0:1734016100.957086:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969227 is committed 00000100:00100000:0.0:1734016100.963668:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016100.968658:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016100.976502:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016100.976619:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114394 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016100.976629:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016100.976635:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcfc0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016100.976638:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016100.976648:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114394 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016100.976740:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016100.976742:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016100.976746:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114394 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016100.976796:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114394 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:1.0:1734016100.976894:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333449984 00000100:00100000:1.0:1734016100.976903:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333449984 00002000:00010000:1.0:1734016100.976933:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (9963515->18446744073709551615) 00002000:00100000:1.0:1734016100.976938:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749eaa00 with x1818247333449984 ext(9963515->18446744073709551615) 00002000:00010000:1.0:1734016100.976946:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749eaa00. 00000100:00100000:1.0:1734016100.976963:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8039 00000100:00100000:1.0:1734016100.976970:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333449984:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016100.978788:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8601600 -> 9963515 00002000:00010000:1.0:1734016100.978793:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016101 -> 1734016101 00002000:00010000:1.0:1734016100.978809:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016100 -> 1734016100 00002000:00010000:1.0:1734016100.978811:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016101 -> 1734016101 00002000:00010000:1.0:1734016100.978813:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 928 -> 944 00000100:00100000:1.0:1734016100.978875:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333449984:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1902us (2164us total) trans 4294969228 rc 0/0 00000100:00100000:1.0:1734016100.978885:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8039 00002000:00010000:1.0:1734016100.978889:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (9963515->18446744073709551615) 00002000:00100000:1.0:1734016100.978892:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749eaa00 with x1818247333449984 ext(9963515->18446744073709551615) 00002000:00010000:1.0:1734016100.978896:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749eaa00. 00000100:00100000:1.0:1734016100.983457:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333450240 00000100:00100000:1.0:1734016100.983467:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333450240 00002000:00100000:1.0:1734016100.983511:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8601600->9965567) req@ffff8800749e8a80 x1818247333450240/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:61/0 lens 488/0 e 0 to 0 dl 1734016111 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016100.983522:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e8a80 with x1818247333450240 ext(8601600->9965567) 00002000:00010000:1.0:1734016100.983528:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e8a80 00000100:00100000:1.0:1734016100.983549:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8040 00000100:00100000:1.0:1734016100.983555:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333450240:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016101.000573:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333450240:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 17007us (17185us total) trans 0 rc 1363968/1363968 00000100:00100000:1.0:1734016101.000585:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8040 00002000:00100000:1.0:1734016101.000598:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8601600->9965567) req@ffff8800749e8a80 x1818247333450240/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:61/0 lens 488/440 e 0 to 0 dl 1734016111 ref 1 fl Complete:/200/0 rc 1363968/1363968 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.000607:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e8a80 with x1818247333450240 ext(8601600->9965567) 00002000:00010000:1.0:1734016101.000613:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e8a80 00000100:00100000:0.0:1734016101.014199:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.016457:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333450368 00000100:00100000:1.0:1734016101.016470:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333450368 00002000:00100000:1.0:1734016101.016521:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (9949184->9963514) req@ffff8800758af800 x1818247333450368/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 14824/0 e 0 to 0 dl 1734016112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.016532:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758af800 with x1818247333450368 ext(9949184->9963514) 00002000:00010000:1.0:1734016101.016538:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758af800 00000100:00100000:1.0:1734016101.016572:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8041 00000100:00100000:1.0:1734016101.016578:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333450368:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016101.018440:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333450368:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1847us (4235us total) trans 4294969229 rc 0/0 00000100:00100000:1.0:1734016101.018457:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8041 00002000:00100000:1.0:1734016101.018468:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (9949184->9963514) req@ffff8800758af800 x1818247333450368/t4294969229(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 14824/448 e 0 to 0 dl 1734016112 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.018477:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758af800 with x1818247333450368 ext(9949184->9963514) 00002000:00010000:1.0:1734016101.018482:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758af800 00000100:00100000:0.0:1734016101.021712:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:1.0:1734016101.023069:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016071 00000100:00100000:0.0:1734016101.025978:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.028736:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333450624:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 1938us (2760us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016101.028746:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10342 00000100:00100000:0.0:1734016101.031977:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.032193:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333450752 00000100:00100000:1.0:1734016101.032201:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333450752 00000100:00100000:1.0:1734016101.032302:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2018 00000100:00100000:1.0:1734016101.032309:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+24:9668:x1818247333450752:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016101.032327:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016101.032345:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc2711439b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4b28 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.032430:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271143a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016101.032442:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271143a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016101.032452:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271143a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:1.0:1734016101.032475:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 9963515 00000004:00200000:1.0:1734016101.032480:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016101.032495:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271143a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016101.032513:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc2711439b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b28 expref: 26 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.032528:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271143a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b28 expref: 25 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.032535:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016101.032538:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016101.032542:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016101.032602:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+25:9668:x1818247333450752:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 292us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016101.032609:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2018 00000100:00100000:0.0:1734016101.035736:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016101.038348:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016071 00000100:00100000:0.0:1734016101.039699:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.040231:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016101.040748:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016071 00000100:00100000:1.0:1734016101.042759:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333451136 00000100:00100000:1.0:1734016101.042769:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333451136 00000100:00100000:1.0:1734016101.042824:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 148 00000100:00100000:1.0:1734016101.042830:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333451136:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1734016101.042890:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333451136:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 60us (3196us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016101.042899:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 148 00000100:00080000:0.0:1734016101.043351:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016071 00000100:00100000:0.0:1734016101.048944:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.055996:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.056058:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333451520 00000100:00100000:1.0:1734016101.056066:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333451520 00002000:00100000:1.0:1734016101.056102:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1277952->1282047) req@ffff88008719c000 x1818247333451520/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/0 e 0 to 0 dl 1734016112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.056110:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719c000 with x1818247333451520 ext(1277952->1282047) 00002000:00010000:1.0:1734016101.056114:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719c000 00000100:00100000:1.0:1734016101.056140:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8042 00000100:00100000:1.0:1734016101.056145:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333451520:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016101.056282:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333451520:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 136us (293us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016101.056287:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8042 00002000:00100000:1.0:1734016101.056292:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1277952->1282047) req@ffff88008719c000 x1818247333451520/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/4536 e 0 to 0 dl 1734016112 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.056298:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719c000 with x1818247333451520 ext(1277952->1282047) 00002000:00010000:1.0:1734016101.056300:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719c000 00000100:00100000:0.0:1734016101.061529:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.065073:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.065489:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333452032 00000100:00100000:1.0:1734016101.065497:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333452032 00002000:00100000:1.0:1734016101.065526:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1269760->1273855) req@ffff88008719c700 x1818247333452032/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/0 e 0 to 0 dl 1734016112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.065534:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719c700 with x1818247333452032 ext(1269760->1273855) 00002000:00010000:1.0:1734016101.065538:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719c700 00000100:00100000:1.0:1734016101.065734:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8044 00000100:00100000:1.0:1734016101.065739:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333452032:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016101.065879:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333452032:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 139us (812us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016101.065885:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8044 00002000:00100000:1.0:1734016101.065889:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1269760->1273855) req@ffff88008719c700 x1818247333452032/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/4536 e 0 to 0 dl 1734016112 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.065895:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719c700 with x1818247333452032 ext(1269760->1273855) 00002000:00010000:1.0:1734016101.065898:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719c700 00000100:00100000:0.0:1734016101.069745:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.073955:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.074083:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333452544 00000100:00100000:1.0:1734016101.074092:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333452544 00002000:00100000:1.0:1734016101.074124:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1261568->1265663) req@ffff88008719ce00 x1818247333452544/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/0 e 0 to 0 dl 1734016112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.074133:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719ce00 with x1818247333452544 ext(1261568->1265663) 00002000:00010000:1.0:1734016101.074137:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719ce00 00000100:00100000:1.0:1734016101.074166:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8046 00000100:00100000:1.0:1734016101.074171:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333452544:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016101.074310:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333452544:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 138us (363us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016101.074315:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8046 00002000:00100000:1.0:1734016101.074319:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1261568->1265663) req@ffff88008719ce00 x1818247333452544/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/4536 e 0 to 0 dl 1734016112 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.074325:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719ce00 with x1818247333452544 ext(1261568->1265663) 00002000:00010000:1.0:1734016101.074327:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719ce00 00000100:00100000:0.0:1734016101.079099:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.082220:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.082321:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333453056 00000100:00100000:1.0:1734016101.082329:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333453056 00002000:00100000:1.0:1734016101.082361:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1253376->1257471) req@ffff88008719d500 x1818247333453056/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/0 e 0 to 0 dl 1734016112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.082369:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719d500 with x1818247333453056 ext(1253376->1257471) 00002000:00010000:1.0:1734016101.082373:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719d500 00000100:00100000:1.0:1734016101.082401:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8048 00000100:00100000:1.0:1734016101.082405:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333453056:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016101.082527:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333453056:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 121us (324us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016101.082532:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8048 00002000:00100000:1.0:1734016101.082536:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1253376->1257471) req@ffff88008719d500 x1818247333453056/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/4536 e 0 to 0 dl 1734016112 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.082542:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719d500 with x1818247333453056 ext(1253376->1257471) 00002000:00010000:1.0:1734016101.082549:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719d500 00000100:00100000:0.0:1734016101.085501:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.088937:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.089160:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333453568 00000100:00100000:1.0:1734016101.089167:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333453568 00002000:00100000:1.0:1734016101.089198:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1245184->1249279) req@ffff88008719dc00 x1818247333453568/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/0 e 0 to 0 dl 1734016112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.089215:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719dc00 with x1818247333453568 ext(1245184->1249279) 00002000:00010000:1.0:1734016101.089219:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719dc00 00000100:00100000:1.0:1734016101.089245:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8050 00000100:00100000:1.0:1734016101.089251:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333453568:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016101.089401:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333453568:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 149us (471us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016101.089410:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8050 00002000:00100000:1.0:1734016101.089415:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1245184->1249279) req@ffff88008719dc00 x1818247333453568/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/4536 e 0 to 0 dl 1734016112 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.089421:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719dc00 with x1818247333453568 ext(1245184->1249279) 00002000:00010000:1.0:1734016101.089423:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719dc00 00000100:00100000:0.0:1734016101.093092:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.096935:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.097410:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333454080 00000100:00100000:1.0:1734016101.097419:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333454080 00002000:00100000:1.0:1734016101.097457:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1236992->1241087) req@ffff88008719e300 x1818247333454080/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/0 e 0 to 0 dl 1734016112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.097466:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719e300 with x1818247333454080 ext(1236992->1241087) 00002000:00010000:1.0:1734016101.097471:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719e300 00000100:00100000:1.0:1734016101.097499:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8052 00000100:00100000:1.0:1734016101.097503:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333454080:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016101.097882:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333454080:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 378us (956us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016101.097889:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8052 00002000:00100000:1.0:1734016101.097893:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1236992->1241087) req@ffff88008719e300 x1818247333454080/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/4536 e 0 to 0 dl 1734016112 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.097900:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719e300 with x1818247333454080 ext(1236992->1241087) 00002000:00010000:1.0:1734016101.097902:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719e300 00000100:00100000:0.0:1734016101.100899:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.101050:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333454336 00000100:00100000:1.0:1734016101.101057:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333454336 00002000:00100000:1.0:1734016101.101093:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1232896->1236991) req@ffff88008719e680 x1818247333454336/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/0 e 0 to 0 dl 1734016112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.101107:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719e680 with x1818247333454336 ext(1232896->1236991) 00002000:00010000:1.0:1734016101.101112:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719e680 00000100:00100000:1.0:1734016101.101141:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8053 00000100:00100000:1.0:1734016101.101147:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333454336:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016101.101301:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333454336:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 153us (411us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016101.101307:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8053 00002000:00100000:1.0:1734016101.101311:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1232896->1236991) req@ffff88008719e680 x1818247333454336/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/4536 e 0 to 0 dl 1734016112 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.101317:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719e680 with x1818247333454336 ext(1232896->1236991) 00002000:00010000:1.0:1734016101.101319:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719e680 00000100:00100000:0.0:1734016101.105391:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.105916:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8054 00000100:00100000:1.0:1734016101.105922:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333454592:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016101.106197:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333454592:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 274us (813us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016101.106211:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8054 00002000:00100000:1.0:1734016101.106216:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1228800->1232895) req@ffff88008719ea00 x1818247333454592/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/4536 e 0 to 0 dl 1734016112 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.106222:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719ea00 with x1818247333454592 ext(1228800->1232895) 00002000:00010000:1.0:1734016101.106225:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719ea00 00000100:00100000:0.0:1734016101.111054:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.111165:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333454848 00000100:00100000:1.0:1734016101.111174:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333454848 00002000:00100000:1.0:1734016101.111222:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1224704->1228799) req@ffff88008719ed80 x1818247333454848/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/0 e 0 to 0 dl 1734016112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.111230:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719ed80 with x1818247333454848 ext(1224704->1228799) 00002000:00010000:1.0:1734016101.111235:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719ed80 00000100:00100000:1.0:1734016101.111467:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8055 00000100:00100000:1.0:1734016101.111472:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333454848:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016101.111679:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333454848:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 206us (634us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016101.111685:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8055 00002000:00100000:1.0:1734016101.111691:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1224704->1228799) req@ffff88008719ed80 x1818247333454848/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/4536 e 0 to 0 dl 1734016112 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.111697:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719ed80 with x1818247333454848 ext(1224704->1228799) 00002000:00010000:1.0:1734016101.111699:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719ed80 00000100:00100000:0.0:1734016101.115556:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.115646:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333455104 00000100:00100000:1.0:1734016101.115654:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333455104 00002000:00100000:1.0:1734016101.115689:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1220608->1224703) req@ffff88008719f100 x1818247333455104/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/0 e 0 to 0 dl 1734016112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.115698:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719f100 with x1818247333455104 ext(1220608->1224703) 00002000:00010000:1.0:1734016101.115703:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719f100 00000100:00100000:1.0:1734016101.115931:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8056 00000100:00100000:1.0:1734016101.115937:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333455104:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016101.116064:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333455104:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 127us (516us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016101.116070:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8056 00002000:00100000:1.0:1734016101.116076:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1220608->1224703) req@ffff88008719f100 x1818247333455104/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/4536 e 0 to 0 dl 1734016112 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.116082:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719f100 with x1818247333455104 ext(1220608->1224703) 00002000:00010000:1.0:1734016101.116084:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719f100 00000100:00100000:0.0:1734016101.118981:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.127343:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.134022:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.138683:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.142622:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.142833:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333456000 00000100:00100000:1.0:1734016101.142843:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333456000 00002000:00100000:1.0:1734016101.142882:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1212416->1216511) req@ffff880073b48380 x1818247333456000/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/0 e 0 to 0 dl 1734016112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.142891:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48380 with x1818247333456000 ext(1212416->1216511) 00002000:00010000:1.0:1734016101.142897:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b48380 00000100:00100000:1.0:1734016101.142930:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8059 00000100:00100000:1.0:1734016101.142936:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333456000:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016101.143089:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333456000:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 151us (473us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016101.143095:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8059 00002000:00100000:1.0:1734016101.143100:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1212416->1216511) req@ffff880073b48380 x1818247333456000/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/4536 e 0 to 0 dl 1734016112 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.143106:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48380 with x1818247333456000 ext(1212416->1216511) 00002000:00010000:1.0:1734016101.143109:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b48380 00000100:00100000:0.0:1734016101.145776:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.151362:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.158675:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.179444:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.179603:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333456768 00000100:00100000:1.0:1734016101.179611:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333456768 00000100:00100000:1.0:1734016101.179680:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8061 00000100:00100000:1.0:1734016101.179686:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333456768:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:1.0:1734016101.179722:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271143d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.179738:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711438d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6918144->6922239) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b21 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.179745:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016101.179747:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016101.179750:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271143d3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [10063872->10108927] (req 10063872->10108927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.179785:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711438d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6918144->6922239) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b21 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.179795:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711438d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6918144->6922239) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b21 expref: 6 pid: 7684 timeout: 468 lvb_type: 0 00000100:00100000:1.0:1734016101.179840:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749af800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335212928:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016101.179898:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1734016101.193297:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749af800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335212928:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016101.193337:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271143d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [10063872->10108927] (req 10063872->10108927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016101.202555:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016101.205338:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271143d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10063872->10108927] (req 10063872->10108927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.205352:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271143d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10063872->10108927] (req 10063872->10108927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016101.215633:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969231 is committed 00000100:00100000:0.0:1734016101.227197:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.233887:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.234046:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333457408 00000100:00100000:0.0:1734016101.234053:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333457408 00010000:00010000:0.0:1734016101.234077:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271143da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b52 expref: 6 pid: 7684 timeout: 468 lvb_type: 1 00000100:00100000:0.0:1734016101.234098:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2783 00000100:00100000:0.0:1734016101.234103:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333457408:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016101.234114:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016101.234131:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271143da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b52 expref: 6 pid: 7684 timeout: 468 lvb_type: 1 00010000:00010000:0.0:1734016101.234139:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271143da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b52 expref: 6 pid: 7684 timeout: 468 lvb_type: 1 00010000:00010000:0.0:1734016101.234156:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271143da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b52 expref: 6 pid: 7684 timeout: 468 lvb_type: 1 00010000:00010000:0.0:1734016101.234184:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016101.234185:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016101.234189:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271143e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8413184->8445951] (req 8413184->8445951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.234195:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271143e1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8413184->8445951] (req 8413184->8445951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.234219:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016101.234253:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333457408:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 150us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016101.234260:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2783 00000001:00080000:0.0:1734016101.241732:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969232 is committed 00000100:00100000:1.0:1734016101.269859:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.274711:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.277467:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.282996:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.283037:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.283071:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333458048 00000100:00100000:1.0:1734016101.283077:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333458048 00010000:00010000:1.0:1734016101.283109:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271143e8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b59 expref: 6 pid: 7684 timeout: 468 lvb_type: 1 00000100:00100000:1.0:1734016101.283921:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333457920 00000100:00100000:1.0:1734016101.283924:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333457920 00010000:00010000:1.0:1734016101.283936:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271143ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b60 expref: 8 pid: 8216 timeout: 468 lvb_type: 1 00000100:00100000:0.0:1734016101.284099:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2784 00000100:00100000:0.0:1734016101.284106:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b23850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333458048:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016101.284118:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016101.284138:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271143e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b59 expref: 6 pid: 7684 timeout: 468 lvb_type: 1 00010000:00010000:0.0:1734016101.284146:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271143e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b59 expref: 6 pid: 7684 timeout: 468 lvb_type: 1 00010000:00010000:0.0:1734016101.284164:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271143e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b59 expref: 6 pid: 7684 timeout: 468 lvb_type: 1 00010000:00010000:0.0:1734016101.284177:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016101.284193:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b23850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333458048:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 87us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016101.284198:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2784 00000100:00100000:0.0:1734016101.284241:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2785 00000100:00100000:0.0:1734016101.284245:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333457920:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016101.284251:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016101.284257:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271143ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b60 expref: 8 pid: 8216 timeout: 468 lvb_type: 1 00010000:00010000:0.0:1734016101.284268:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271143ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b60 expref: 8 pid: 8216 timeout: 468 lvb_type: 1 00010000:00010000:0.0:1734016101.284278:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271143ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b60 expref: 8 pid: 8216 timeout: 468 lvb_type: 1 00010000:00010000:0.0:1734016101.284285:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016101.284287:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016101.284291:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271143f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b67 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.284297:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271143f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b67 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.284321:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271143f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b67 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016101.284332:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b49500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335213440:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016101.284355:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eec00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016101.303791:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.336185:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.342059:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333458560 00000100:00100000:0.0:1734016101.342077:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333458560 00002000:00100000:0.0:1734016101.342129:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (9183232->10108927) req@ffff8800749ad880 x1818247333458560/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:62/0 lens 488/0 e 0 to 0 dl 1734016112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016101.342141:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad880 with x1818247333458560 ext(9183232->10108927) 00002000:00010000:0.0:1734016101.342148:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ad880 00000100:00100000:1.0:1734016101.344481:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8064 00000100:00100000:1.0:1734016101.344493:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333458560:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016101.378551:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333458560:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 34052us (42368us total) trans 0 rc 925696/925696 00000100:00100000:0.0:1734016101.378562:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8064 00002000:00100000:0.0:1734016101.378571:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (9183232->10108927) req@ffff8800749ad880 x1818247333458560/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:62/0 lens 488/440 e 0 to 0 dl 1734016112 ref 1 fl Complete:/200/0 rc 925696/925696 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016101.378580:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad880 with x1818247333458560 ext(9183232->10108927) 00002000:00010000:0.0:1734016101.378585:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ad880 00000100:00100000:0.0:1734016101.400840:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333458688:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 9854us (10126us total) trans 4294969233 rc 0/0 00000100:00100000:0.0:1734016101.400851:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8065 00002000:00100000:0.0:1734016101.400863:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6447104->6475775) req@ffff88007bd3c000 x1818247333458688/t4294969233(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:62/0 lens 488/448 e 0 to 0 dl 1734016112 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016101.400870:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3c000 with x1818247333458688 ext(6447104->6475775) 00002000:00010000:0.0:1734016101.400875:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3c000 00000100:00100000:1.0:1734016101.408024:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.412859:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333458944 00000100:00100000:0.0:1734016101.412872:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333458944 00000100:00100000:0.0:1734016101.412939:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10352 00000100:00100000:0.0:1734016101.412949:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333458944:12345-192.168.201.16@tcp:16:fsx.0 00000100:00100000:0.0:1734016101.416331:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333458944:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 3379us (3626us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016101.416340:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10352 00000100:00100000:0.0:1734016101.420343:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.420597:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333459200 00000100:00100000:1.0:1734016101.420607:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333459200 00000100:00100000:1.0:1734016101.420658:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2021 00000100:00100000:1.0:1734016101.420663:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+28:9668:x1818247333459200:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016101.420713:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016101.420735:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271143be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b3d expref: 28 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.420762:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016101.420766:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016101.420919:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc271143fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016101.420930:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271143a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b28 expref: 24 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.420940:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc271143fd lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016101.420979:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271143a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b28 expref: 24 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.420988:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271143a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b28 expref: 24 pid: 13956 timeout: 468 lvb_type: 0 00000100:00100000:1.0:1734016101.421001:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075398000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335213568:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016101.421047:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016101.425615:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.428766:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.429433:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333459456 00000100:00100000:1.0:1734016101.429442:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333459456 00000100:00100000:1.0:1734016101.429492:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10353 00000100:00100000:1.0:1734016101.429499:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333459456:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016101.429514:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016101.429528:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114404 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4b6e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.429556:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271143f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b67 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.429562:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016101.429564:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016101.429568:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114404 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b6e expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.429608:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271143f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b67 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.429619:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271143f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b67 expref: 6 pid: 8216 timeout: 468 lvb_type: 0 00000100:00100000:1.0:1734016101.429633:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075398380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335213696:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016101.429692:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:0.0:1734016101.443634:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075398380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335213696:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016101.443672:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114404 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b6e expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.443691:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:0.0:1734016101.443757:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333459456:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 14257us (15000us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016101.443766:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10353 00000100:00100000:0.0:1734016101.444296:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333459584 00000100:00100000:0.0:1734016101.444305:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333459584 00010000:00010000:0.0:1734016101.444331:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271143f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b67 expref: 7 pid: 8216 timeout: 468 lvb_type: 0 00000100:00100000:0.0:1734016101.444357:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2787 00000100:00100000:0.0:1734016101.444361:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333459584:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016101.444373:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1734016101.444388:0:6465:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016101 -> 1734016102 00002000:00010000:0.0:1734016101.444390:0:6465:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016101 -> 1734016102 00002000:00010000:0.0:1734016101.444392:0:6465:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1248 -> 1304 00010000:00010000:0.0:1734016101.444398:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271143f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b67 expref: 7 pid: 8216 timeout: 468 lvb_type: 0 00010000:00010000:0.0:1734016101.444407:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271143f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b67 expref: 7 pid: 8216 timeout: 468 lvb_type: 0 00010000:00010000:0.0:1734016101.444428:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271143f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b67 expref: 7 pid: 8216 timeout: 468 lvb_type: 0 00010000:00010000:0.0:1734016101.444455:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016101.444456:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016101.444462:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114404 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b6e expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.444471:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114404 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b6e expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.444505:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114404 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b6e expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016101.444521:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335213824:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016101.444565:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eea80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016101.446883:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b4b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335213824:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016101.446906:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016101.446949:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333459584:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 2586us (2928us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016101.446959:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2787 00000100:00100000:0.0:1734016101.447877:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333459712 00000100:00100000:0.0:1734016101.447885:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333459712 00002000:00010000:1.0:1734016101.447994:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6075760->18446744073709551615) 00002000:00100000:1.0:1734016101.447999:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15f100 with x1818247333459712 ext(6075760->18446744073709551615) 00002000:00010000:1.0:1734016101.448007:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15f100. 00000100:00100000:1.0:1734016101.448025:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8066 00000100:00100000:1.0:1734016101.448030:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333459712:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016101.450695:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10108928 -> 6075760 00002000:00010000:1.0:1734016101.450704:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016102 -> 1734016102 00002000:00010000:1.0:1734016101.450707:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016101 -> 1734016101 00002000:00010000:1.0:1734016101.450709:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016102 -> 1734016102 00002000:00010000:1.0:1734016101.450711:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1304 -> 952 00000100:00100000:1.0:1734016101.450797:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333459712:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 2762us (3043us total) trans 4294969234 rc 0/0 00000100:00100000:1.0:1734016101.450830:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8066 00002000:00010000:1.0:1734016101.450835:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6075760->18446744073709551615) 00002000:00100000:1.0:1734016101.450838:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15f100 with x1818247333459712 ext(6075760->18446744073709551615) 00002000:00010000:1.0:1734016101.450845:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15f100. 00000100:00100000:0.0:1734016101.464032:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333459840 00000100:00100000:0.0:1734016101.464040:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333459840 00000100:00100000:0.0:1734016101.464081:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2022 00000100:00100000:0.0:1734016101.464088:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:9668:x1818247333459840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016101.464107:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016101.464127:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc2711440b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4b75 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.464209:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27114412 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016101.464219:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27114412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016101.464227:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27114412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016101.464247:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 6075760 00000004:00200000:0.0:1734016101.464250:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016101.464261:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27114412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016101.464279:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc2711440b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b75 expref: 14 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.469139:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27114412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b75 expref: 13 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.469153:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016101.469155:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016101.469158:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582f40, rc 0) 00000100:00100000:0.0:1734016101.469240:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:9668:x1818247333459840:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5150us (5267us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016101.469250:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2022 00000100:00100000:0.0:1734016101.477151:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333459968 00000100:00100000:0.0:1734016101.477159:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333459968 00000100:00100000:0.0:1734016101.477216:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2023 00000100:00100000:0.0:1734016101.477223:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+13:9668:x1818247333459968:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016101.477243:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016101.477261:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27114419 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4b7c expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.477341:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27114420 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016101.477353:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27114420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016101.477362:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27114420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016101.477387:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 6075760 00000004:00200000:0.0:1734016101.477390:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016101.477403:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27114420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016101.477424:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27114419 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b7c expref: 15 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.477455:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27114420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b7c expref: 14 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.477461:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016101.477464:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016101.477466:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:0.0:1734016101.477515:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+14:9668:x1818247333459968:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 291us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016101.477520:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2023 00000100:00100000:0.0:1734016101.482269:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333460096 00000100:00100000:0.0:1734016101.482280:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333460096 00000100:00100000:0.0:1734016101.482330:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10354 00000100:00100000:0.0:1734016101.482337:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88009024dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333460096:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016101.482357:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016101.482375:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114427 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4b83 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016101.482438:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335213952:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016101.482511:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eea80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016101.490419:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88009024dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333460096:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8073us (8236us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016101.490431:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10354 00000100:00100000:0.0:1734016101.502834:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333460224 00000100:00100000:0.0:1734016101.502842:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333460224 00000100:00100000:0.0:1734016101.502884:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10355 00000100:00100000:0.0:1734016101.502890:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333460224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016101.502904:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016101.502919:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711442e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4b8a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016101.502962:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335214080:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016101.503016:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016101.509768:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335214080:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016101.509812:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711442e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b8a expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016101.509829:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711442e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b8a expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016101.510144:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582d00, rc 0) 00000100:00100000:0.0:1734016101.510511:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333460224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7618us (7774us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016101.510520:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10355 00000100:00100000:1.0:1734016101.515998:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.524020:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335214208:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016101.524043:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27114435 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:1.0:1734016101.524566:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333460608 00000100:00100000:1.0:1734016101.524574:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333460608 00010000:00010000:1.0:1734016101.524603:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27114420 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b7c expref: 14 pid: 13956 timeout: 468 lvb_type: 0 00000100:00100000:1.0:1734016101.524635:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2788 00000100:00100000:1.0:1734016101.524640:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333460608:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016101.524651:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016101.524657:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27114420 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b7c expref: 14 pid: 13956 timeout: 468 lvb_type: 0 00010000:00010000:1.0:1734016101.524668:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27114420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b7c expref: 14 pid: 13956 timeout: 468 lvb_type: 0 00010000:00010000:1.0:1734016101.524685:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27114420 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b7c expref: 14 pid: 13956 timeout: 468 lvb_type: 0 00010000:00010000:1.0:1734016101.524707:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016101.524710:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27114435 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016101.524720:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27114435 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016101.524725:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27114435 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016101.524744:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016101.524782:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333460608:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 141us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016101.524787:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2788 00010000:00010000:0.0:1734016101.525123:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27114435 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016101.525129:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27114435 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:0.0:1734016101.525194:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968604 00000004:00010000:0.0:1734016101.525244:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075398700 reply state ffff88007588a000 transno 4294968605 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27114435 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016101.525249:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016101.525321:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:9668:x1818247333460480:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 9061us (9337us total) trans 4294968605 rc 0/0 00000100:00100000:0.0:1734016101.525327:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2024 00000020:00080000:0.0:1734016101.525330:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1734016101.529739:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.537710:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.549559:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.554210:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.558012:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333462016 00000100:00100000:0.0:1734016101.558020:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333462016 00002000:00100000:0.0:1734016101.558058:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (9359360->9363455) req@ffff880073b9f100 x1818247333462016/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/0 e 0 to 0 dl 1734016112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016101.558067:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9f100 with x1818247333462016 ext(9359360->9363455) 00002000:00010000:0.0:1734016101.558072:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9f100 00000100:00100000:0.0:1734016101.558103:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8072 00000100:00100000:0.0:1734016101.558109:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333462016:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016101.558314:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333462016:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 205us (369us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016101.558322:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8072 00002000:00100000:0.0:1734016101.558327:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (9359360->9363455) req@ffff880073b9f100 x1818247333462016/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/4536 e 0 to 0 dl 1734016112 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016101.558334:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9f100 with x1818247333462016 ext(9359360->9363455) 00002000:00010000:0.0:1734016101.558337:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9f100 00000100:00100000:1.0:1734016101.576638:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.583251:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.589222:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333462656 00000100:00100000:0.0:1734016101.589230:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333462656 00002000:00100000:0.0:1734016101.589268:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (9351168->9377558) req@ffff88012b15fb80 x1818247333462656/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/0 e 0 to 0 dl 1734016112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016101.589278:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15fb80 with x1818247333462656 ext(9351168->9377558) 00002000:00010000:0.0:1734016101.589283:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15fb80 00000100:00100000:0.0:1734016101.589314:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8075 00000100:00100000:0.0:1734016101.589320:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333462656:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016101.592529:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333462656:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 3199us (3488us total) trans 4294969236 rc 0/0 00000100:00100000:0.0:1734016101.592540:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8075 00002000:00100000:0.0:1734016101.592551:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (9351168->9377558) req@ffff88012b15fb80 x1818247333462656/t4294969236(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/448 e 0 to 0 dl 1734016112 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016101.592559:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15fb80 with x1818247333462656 ext(9351168->9377558) 00002000:00010000:0.0:1734016101.592565:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15fb80 00000100:00100000:0.0:1734016101.594463:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333462784 00000100:00100000:0.0:1734016101.594470:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333462784 00000100:00100000:0.0:1734016101.594510:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2025 00000100:00100000:0.0:1734016101.594515:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333462784:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:0.0:1734016101.594940:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333462784:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 423us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016101.594946:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2025 00000100:00100000:0.0:1734016101.596941:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333462912 00000100:00100000:0.0:1734016101.596949:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333462912 00000100:00100000:0.0:1734016101.596992:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10356 00000100:00100000:0.0:1734016101.596999:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333462912:12345-192.168.201.16@tcp:16:fsx.0 00000100:00100000:0.0:1734016101.601721:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333462912:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 4716us (4837us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016101.601732:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10356 00000100:00100000:0.0:1734016101.606156:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.613324:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333463168 00000100:00100000:0.0:1734016101.613335:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333463168 00000100:00100000:0.0:1734016101.613386:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10357 00000100:00100000:0.0:1734016101.613393:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333463168:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016101.613410:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016101.613427:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc2711444a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4b98 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016101.613480:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335214336:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016101.613557:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee3c0 going to sleep for 11 seconds 00002000:00010000:0.0:1734016101.617471:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016101 -> 1734016102 00002000:00010000:0.0:1734016101.617479:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 952 -> 1008 00000100:00100000:0.0:1734016101.617501:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b4ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335214336:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016101.617537:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc2711444a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b98 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016101.617550:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc2711444a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4b98 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016101.617573:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581200, rc 0) 00000100:00100000:0.0:1734016101.617633:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333463168:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4238us (4568us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016101.617642:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10357 00000100:00100000:0.0:1734016101.622597:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.627588:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333463424 00000100:00100000:0.0:1734016101.627595:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333463424 00000100:00100000:0.0:1734016101.627642:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2027 00000100:00100000:0.0:1734016101.627648:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333463424:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016101.627664:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016101.627680:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27114458 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4ba6 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.627749:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc2711445f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016101.627760:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc2711445f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016101.627769:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc2711445f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016101.627787:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 9377559 00000004:00200000:0.0:1734016101.627790:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016101.627842:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc2711445f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016101.627860:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27114458 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ba6 expref: 16 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.628572:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc2711445f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ba6 expref: 15 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.628583:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016101.628585:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016101.628588:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:1.0:1734016101.628891:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:9668:x1818247333463424:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1240us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016101.628898:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2027 00000100:00100000:0.0:1734016101.633057:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.645423:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.650910:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333463936 00000100:00100000:1.0:1734016101.650918:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333463936 00000100:00100000:1.0:1734016101.650957:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10361 00000100:00100000:1.0:1734016101.650962:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333463936:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016101.650979:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016101.650994:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711446d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4bb4 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016101.651043:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075399880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335214848:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016101.651381:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f240 going to sleep for 11 seconds 00002000:00010000:1.0:1734016101.653578:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016101 -> 1734016102 00000100:00100000:1.0:1734016101.653606:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075399880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335214848:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016101.653638:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711446d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bb4 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016101.653649:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711446d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bb4 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016101.653732:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016101.654023:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333463936:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3057us (3196us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016101.654034:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10361 00000100:00100000:0.0:1734016101.659412:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.659530:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333464064 00000100:00100000:1.0:1734016101.659540:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333464064 00000100:00100000:0.0:1734016101.667913:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.681699:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333464448 00000100:00100000:0.0:1734016101.681707:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333464448 00010000:00010000:0.0:1734016101.681736:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114466 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2691072->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bad expref: 8 pid: 8216 timeout: 468 lvb_type: 0 00000100:00100000:0.0:1734016101.681766:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2790 00000100:00100000:0.0:1734016101.681772:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333464448:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016101.681784:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016101.681812:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114466 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2691072->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bad expref: 8 pid: 8216 timeout: 468 lvb_type: 0 00010000:00010000:0.0:1734016101.681822:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114466 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2691072->2732031) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bad expref: 8 pid: 8216 timeout: 468 lvb_type: 0 00010000:00010000:0.0:1734016101.681843:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016101.681844:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016101.681849:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114482 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7458816->7495679) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bc9 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.681857:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7458816->7495679) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bc9 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.681888:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7458816->7495679) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bc9 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016101.681900:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335215360:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016101.681947:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016101.686778:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b4b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335215360:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016101.686798:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016101.686856:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333464448:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5083us (5233us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016101.686865:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2790 00000100:00100000:0.0:1734016101.689644:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.689875:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333464704 00000100:00100000:1.0:1734016101.689882:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333464704 00000100:00100000:1.0:1734016101.689928:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10366 00000100:00100000:1.0:1734016101.689935:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333464704:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016101.689950:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016101.689963:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27114489 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4bd0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016101.690012:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075399880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335215488:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016101.690070:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f240 going to sleep for 11 seconds 00002000:00010000:1.0:1734016101.692445:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016101 -> 1734016102 00002000:00010000:1.0:1734016101.692452:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016101 -> 1734016102 00000100:00100000:1.0:1734016101.692469:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075399880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335215488:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016101.692495:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27114489 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bd0 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016101.692507:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27114489 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bd0 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016101.692536:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016101.692580:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333464704:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2644us (2943us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016101.692587:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10366 00000100:00100000:1.0:1734016101.694997:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333464832 00000100:00100000:1.0:1734016101.695003:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333464832 00000100:00100000:1.0:1734016101.695102:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10367 00000100:00100000:1.0:1734016101.695108:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333464832:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016101.695124:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016101.695138:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27114490 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4bd7 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016101.695185:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075399880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335215616:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016101.695252:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016101.697634:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075399880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335215616:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016101.697672:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27114490 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bd7 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016101.697684:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27114490 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bd7 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016101.698016:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016101.698072:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333464832:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2962us (3167us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016101.698083:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10367 00000100:00100000:1.0:1734016101.702047:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333464960 00000100:00100000:1.0:1734016101.702055:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333464960 00000100:00100000:1.0:1734016101.702115:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10368 00000100:00100000:1.0:1734016101.702120:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333464960:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016101.702135:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016101.702150:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27114497 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4bde expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.702175:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114482 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7458816->7495679) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bc9 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.702180:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016101.702182:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016101.702185:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27114497 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [9220096->9273343] (req 9220096->9273343) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bde expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.702221:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114482 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7458816->7495679) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bc9 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.702230:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7458816->7495679) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bc9 expref: 6 pid: 8216 timeout: 468 lvb_type: 0 00000100:00100000:1.0:1734016101.702241:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075399880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335215744:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016101.702461:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016101.704741:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075399880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335215744:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016101.704767:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27114497 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [9220096->9273343] (req 9220096->9273343) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bde expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.704782:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016101.704853:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333464960:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2731us (3120us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016101.704861:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10368 00000100:00100000:0.0:1734016101.705283:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.709264:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335215872:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016101.709281:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016101.709325:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333465088:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3872us (4043us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016101.709334:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2791 00000100:00100000:0.0:1734016101.709755:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333465216 00000100:00100000:0.0:1734016101.709760:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333465216 00000100:00100000:0.0:1734016101.714149:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333465344 00000100:00100000:0.0:1734016101.714157:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333465344 00000100:00100000:0.0:1734016101.714204:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10370 00000100:00100000:0.0:1734016101.714210:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333465344:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016101.714226:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016101.714239:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc2711449e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4be5 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016101.714285:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335216000:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016101.714340:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016101.719054:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.725758:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.729880:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.729967:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333465856 00000100:00100000:1.0:1734016101.729976:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333465856 00002000:00100000:1.0:1734016101.730014:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (856064->860159) req@ffff880073b4aa00 x1818247333465856/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/0 e 0 to 0 dl 1734016112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.730025:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b4aa00 with x1818247333465856 ext(856064->860159) 00002000:00010000:1.0:1734016101.730030:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b4aa00 00000100:00100000:1.0:1734016101.730067:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8076 00000100:00100000:1.0:1734016101.730073:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333465856:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016101.730232:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333465856:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 158us (359us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016101.730239:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8076 00002000:00100000:1.0:1734016101.730245:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (856064->860159) req@ffff880073b4aa00 x1818247333465856/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:62/0 lens 488/4536 e 0 to 0 dl 1734016112 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016101.730253:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b4aa00 with x1818247333465856 ext(856064->860159) 00002000:00010000:1.0:1734016101.730255:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b4aa00 00000100:00100000:0.0:1734016101.734120:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.739840:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.742913:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.746653:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.751267:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.756844:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016101.758058:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271144b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016101.758066:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271144b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:0.0:1734016101.758135:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968606 00000004:00010000:0.0:1734016101.758170:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075399f80 reply state ffff88007515f000 transno 4294968607 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271144b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016101.758176:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016101.758239:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:9668:x1818247333467008:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 6613us (6980us total) trans 4294968607 rc 0/0 00000100:00100000:0.0:1734016101.758245:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2028 00000020:00080000:0.0:1734016101.758248:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016101.761578:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.761917:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10373 00000100:00100000:0.0:1734016101.761923:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333467264:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016101.761963:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016101.761976:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc271144ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4bfa expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.762000:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271144a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 856064->860159) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bec expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.762007:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271144ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bf3 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016101.762011:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016101.762013:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016101.762016:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc271144ba lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bfa expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.762042:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271144ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bf3 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016101.762052:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271144ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bf3 expref: 8 pid: 7684 timeout: 468 lvb_type: 1 00000100:00100000:0.0:1734016101.762065:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335216512:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016101.762209:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271144a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 856064->860159) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bec expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.762216:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271144a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 856064->860159) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bec expref: 8 pid: 7684 timeout: 468 lvb_type: 0 00000100:00100000:0.0:1734016101.762222:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335216640:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016101.762236:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016101.766775:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335216512:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016101.766786:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335216640:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016101.767154:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc271144ba lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bfa expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.767168:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581680, rc 0) 00000100:00100000:1.0:1734016101.767374:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:9668:x1818247333467264:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5449us (5805us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016101.767382:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10373 00000100:00100000:1.0:1734016101.769453:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.769782:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.770242:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333467520 00000100:00100000:0.0:1734016101.770251:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333467520 00010000:00010000:0.0:1734016101.770280:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271144a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 856064->860159) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bec expref: 8 pid: 7684 timeout: 468 lvb_type: 0 00000100:00100000:0.0:1734016101.770313:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333467392 00000100:00100000:0.0:1734016101.770315:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333467392 00010000:00010000:0.0:1734016101.770323:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271144ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bf3 expref: 9 pid: 7684 timeout: 468 lvb_type: 1 00000100:00100000:0.0:1734016101.770345:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2794 00000100:00100000:0.0:1734016101.770350:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007539a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333467520:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016101.770364:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016101.770382:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271144a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 856064->860159) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bec expref: 8 pid: 7684 timeout: 468 lvb_type: 0 00010000:00010000:0.0:1734016101.770391:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271144a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 856064->860159) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bec expref: 8 pid: 7684 timeout: 468 lvb_type: 0 00010000:00010000:0.0:1734016101.770410:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271144a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 856064->860159) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bec expref: 8 pid: 7684 timeout: 468 lvb_type: 0 00010000:00010000:0.0:1734016101.770427:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016101.770465:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007539a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333467520:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 113us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016101.770471:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2794 00000100:00100000:0.0:1734016101.770484:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2795 00000100:00100000:0.0:1734016101.770488:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007539aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333467392:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016101.770498:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016101.770504:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271144ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bf3 expref: 9 pid: 7684 timeout: 468 lvb_type: 1 00010000:00010000:0.0:1734016101.770512:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271144ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bf3 expref: 9 pid: 7684 timeout: 468 lvb_type: 1 00010000:00010000:0.0:1734016101.770522:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271144ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bf3 expref: 9 pid: 7684 timeout: 468 lvb_type: 1 00010000:00010000:0.0:1734016101.770529:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016101.770531:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016101.770535:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc271144ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bfa expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.770542:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc271144ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bfa expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.770571:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc271144ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bfa expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016101.770585:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335216768:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016101.770615:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016101.780546:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.793696:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.802895:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.812354:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333468032 00000100:00100000:1.0:1734016101.812363:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333468032 00000100:00100000:1.0:1734016101.812959:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10375 00000100:00100000:1.0:1734016101.812966:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333468032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016101.812982:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016101.812997:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271144cf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4c08 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.813022:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc271144ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bfa expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.813029:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016101.813030:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016101.813033:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271144cf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2396160->2457599] (req 2396160->2457599) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c08 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.813058:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc271144ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bfa expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.813067:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc271144ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4bfa expref: 8 pid: 7684 timeout: 468 lvb_type: 0 00000100:00100000:1.0:1734016101.813082:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007539b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335216896:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016101.813141:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016101.821563:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.821927:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007539b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335216896:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016101.821954:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271144cf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2396160->2457599] (req 2396160->2457599) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c08 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016101.821971:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016101.822028:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:9668:x1818247333468032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9060us (10586us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016101.822036:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10375 00000100:00100000:0.0:1734016101.825869:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.826418:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333468288 00000100:00100000:1.0:1734016101.826425:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333468288 00000100:00100000:1.0:1734016101.826455:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10376 00000100:00100000:1.0:1734016101.826461:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333468288:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016101.826670:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 4382271 -> 4382271 00002000:00010000:1.0:1734016101.826673:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016102 -> 1734016102 00002000:00010000:1.0:1734016101.826676:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016101 -> 1734016101 00002000:00010000:1.0:1734016101.826678:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016102 -> 1734016102 00002000:00010000:1.0:1734016101.826679:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 952 -> 952 00000100:00100000:1.0:1734016101.827474:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333468288:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1012us (1612us total) trans 4294969242 rc 0/0 00000100:00100000:1.0:1734016101.827481:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10376 00000100:00100000:0.0:1734016101.831290:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.835945:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333468544 00000100:00100000:1.0:1734016101.835954:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333468544 00000100:00100000:1.0:1734016101.836004:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10377 00000100:00100000:1.0:1734016101.836010:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333468544:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016101.836024:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016101.836039:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271144e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4c16 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016101.836089:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007539b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335217152:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016101.836139:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f480 going to sleep for 11 seconds 00000100:00100000:1.0:1734016101.839046:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007539b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335217152:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016101.839072:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271144e4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c16 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016101.839083:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271144e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c16 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016101.839106:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016101.839651:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333468544:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3638us (3813us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016101.839657:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10377 00000100:00100000:0.0:1734016101.843256:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.850975:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.857261:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.861685:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.866157:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.873264:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.873721:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333469568 00000100:00100000:0.0:1734016101.873729:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333469568 00010000:00010000:0.0:1734016101.873756:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271144f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c24 expref: 10 pid: 8216 timeout: 468 lvb_type: 1 00000100:00100000:0.0:1734016101.874113:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2798 00000100:00100000:0.0:1734016101.874120:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333469568:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016101.874133:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016101.874152:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271144f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c24 expref: 10 pid: 8216 timeout: 468 lvb_type: 1 00010000:00010000:0.0:1734016101.874163:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271144f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c24 expref: 10 pid: 8216 timeout: 468 lvb_type: 1 00010000:00010000:0.0:1734016101.874182:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271144f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c24 expref: 10 pid: 8216 timeout: 468 lvb_type: 1 00010000:00010000:0.0:1734016101.874211:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016101.874213:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016101.874217:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114500 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5828608->5857279] (req 5828608->5857279) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.874226:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114500 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5828608->5857279] (req 5828608->5857279) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.874740:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016101.874790:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333469568:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 669us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016101.874798:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2798 00000001:00080000:1.0:1734016101.880697:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969243 is committed 00000001:00080000:1.0:1734016101.880711:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969242 is committed 00000100:00100000:0.0:1734016101.884241:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.887932:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.891581:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.899639:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.899675:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.899744:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333470208 00000100:00100000:0.0:1734016101.899752:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333470208 00010000:00010000:0.0:1734016101.899783:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114507 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c2b expref: 7 pid: 7684 timeout: 469 lvb_type: 1 00000100:00100000:0.0:1734016101.899821:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333470080 00000100:00100000:0.0:1734016101.899824:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333470080 00010000:00010000:0.0:1734016101.899835:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711450e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c32 expref: 7 pid: 7684 timeout: 469 lvb_type: 1 00000100:00100000:0.0:1734016101.899862:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2799 00000100:00100000:0.0:1734016101.899868:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007539a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333470208:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016101.899882:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016101.899901:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114507 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c2b expref: 7 pid: 7684 timeout: 469 lvb_type: 1 00010000:00010000:0.0:1734016101.899911:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114507 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c2b expref: 7 pid: 7684 timeout: 469 lvb_type: 1 00010000:00010000:0.0:1734016101.899929:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114507 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c2b expref: 7 pid: 7684 timeout: 469 lvb_type: 1 00010000:00010000:0.0:1734016101.899950:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016101.899985:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007539a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333470208:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 117us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016101.899991:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2799 00000100:00100000:0.0:1734016101.900003:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2800 00000100:00100000:0.0:1734016101.900007:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007539a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333470080:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016101.900012:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016101.900018:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711450e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c32 expref: 7 pid: 7684 timeout: 469 lvb_type: 1 00010000:00010000:0.0:1734016101.900027:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711450e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c32 expref: 7 pid: 7684 timeout: 469 lvb_type: 1 00010000:00010000:0.0:1734016101.900036:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711450e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c32 expref: 7 pid: 7684 timeout: 469 lvb_type: 1 00010000:00010000:0.0:1734016101.900043:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016101.900045:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016101.900050:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5423104->5468159) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c39 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.900056:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5423104->5468159) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c39 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016101.900081:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5423104->5468159) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c39 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016101.900092:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e607b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335217920:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016101.900120:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eec00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016101.904600:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e607b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335217920:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016101.904622:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016101.904670:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007539a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333470080:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4661us (4994us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016101.904680:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2800 00000100:00100000:0.0:1734016101.906063:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.912770:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.919418:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.946632:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.956269:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.963523:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.971466:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.978135:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.987034:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016101.995134:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016101.996308:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333471744 00000100:00100000:1.0:1734016101.996315:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333471744 00010000:00010000:1.0:1734016101.996341:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271144dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c0f expref: 14 pid: 6478 timeout: 469 lvb_type: 0 00000100:00100000:1.0:1734016101.997385:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2801 00000100:00100000:1.0:1734016101.997395:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247333471744:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016101.997409:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016101.997416:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271144dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c0f expref: 14 pid: 6478 timeout: 469 lvb_type: 0 00010000:00010000:1.0:1734016101.997428:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271144dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c0f expref: 14 pid: 6478 timeout: 469 lvb_type: 0 00010000:00010000:1.0:1734016101.997446:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271144dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c0f expref: 14 pid: 6478 timeout: 469 lvb_type: 0 00010000:00010000:1.0:1734016101.997468:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016101.997472:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114554 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016101.997480:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114554 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016101.997485:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114554 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016101.997766:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016101.998039:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333471744:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 643us (2914us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016101.998046:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2801 00010000:00010000:0.0:1734016102.002729:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114554 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016102.002741:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114554 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016102.002747:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114554 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016102.002752:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbf180 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016102.002756:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114554 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016102.002766:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114554 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016102.002780:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016102.002782:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016102.002785:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114554 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016102.002790:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114554 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00080000:0.0:1734016102.003356:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016072 00000100:00100000:0.0:1734016102.006717:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.012068:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.020127:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.028640:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.032774:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333472640 00000100:00100000:0.0:1734016102.032782:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333472640 00000100:00100000:0.0:1734016102.032842:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10394 00000100:00100000:0.0:1734016102.032849:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333472640:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016102.032865:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016102.032883:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711457e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4c8d expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016102.032910:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5423104->5468159) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c39 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016102.032916:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016102.032918:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016102.032922:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711457e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c8d expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016102.032955:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5423104->5468159) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c39 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016102.032967:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5423104->5468159) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c39 expref: 7 pid: 7684 timeout: 469 lvb_type: 0 00000100:00100000:0.0:1734016102.032981:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075887b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335219456:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016102.033052:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eec00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016102.039984:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.046331:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.052403:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.057683:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.066708:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.073313:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.079949:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.093745:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.097972:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016102.099113:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007546c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335220480:0@lo:400:kworker.0 00000100:00100000:1.0:1734016102.099162:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016102.099197:0:3503:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1734016102.099203:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67a75f73-9674-4938-8c12-63813a36f078:3503:1818247335220096:0@lo:400:kworker.0 00000100:00100000:1.0:1734016102.099225:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016102.099236:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007546ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3503:1818247335220608:0@lo:400:kworker.0 00000100:00100000:1.0:1734016102.099256:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016102.099273:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007546c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3506:1818247335220352:0@lo:400:kworker.0 00000100:00100000:1.0:1734016102.099288:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016102.099306:0:3506:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1734016102.099310:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007546c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3506:1818247335220224:0@lo:400:kworker.0 00000100:00100000:1.0:1734016102.099326:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016102.099335:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007546ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335220736:0@lo:400:kworker.0 00000100:00100000:1.0:1734016102.099348:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016102.099695:0:6474:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335220096 00000100:00100000:0.0:1734016102.099698:0:6474:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335220096 00000100:00100000:1.0:1734016102.100281:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335220224 00000100:00100000:1.0:1734016102.100285:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335220224 00000100:00100000:1.0:1734016102.100315:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1734016102.100321:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007546dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3506:x1818247335220224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016102.100370:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007546dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3506:x1818247335220224:12345-0@lo:400:kworker.0 Request processed in 49us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016102.100376:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1734016102.100414:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007546c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3506:1818247335220224:0@lo:400:kworker.0 00000100:00100000:1.0:1734016102.101646:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007546ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3503:1818247335220608:0@lo:400:kworker.0 00000100:00100000:0.0:1734016102.101957:0:6474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1734016102.101962:0:6474:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a75f73-9674-4938-8c12-63813a36f078+18:3503:x1818247335220096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1734016102.102001:0:6474:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a75f73-9674-4938-8c12-63813a36f078+18:3503:x1818247335220096:12345-0@lo:400:kworker.0 Request processed in 39us (2775us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016102.102006:0:6474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00080000:0.0:1734016102.102029:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016072 00000100:00080000:0.0:1734016102.102033:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016072 00000100:00100000:0.0:1734016102.102045:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335220480 00000100:00100000:0.0:1734016102.102049:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335220480 00000100:00080000:0.0:1734016102.102058:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016072 00000100:00100000:0.0:1734016102.102073:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335220736 00000100:00100000:0.0:1734016102.102076:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335220736 00000100:00080000:0.0:1734016102.102082:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016072 00000100:00100000:0.0:1734016102.102094:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1734016102.102098:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007546d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335220480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1734016102.102123:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007546d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335220480:12345-0@lo:400:kworker.0 Request processed in 25us (2961us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016102.102128:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1734016102.102135:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1734016102.102139:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007546df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335220736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1734016102.102162:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007546df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335220736:12345-0@lo:400:kworker.0 Request processed in 23us (2813us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016102.102167:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1734016102.102198:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007546ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335220736:0@lo:400:kworker.0 00000100:00100000:1.0:1734016102.102748:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67a75f73-9674-4938-8c12-63813a36f078:3503:1818247335220096:0@lo:400:kworker.0 00000100:00100000:1.0:1734016102.102757:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007546c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335220480:0@lo:400:kworker.0 00000100:00100000:0.0:1734016102.103892:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007546c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3506:1818247335220352:0@lo:400:kworker.0 00000100:00100000:0.0:1734016102.106731:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.116164:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.125236:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.132133:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.141782:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.145713:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.156863:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.163491:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335220864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1734016102.163542:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016102.164668:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335220864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1734016102.181289:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.196171:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.206599:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016102.220423:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.229923:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.238711:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016102.250576:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.262522:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.262562:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016102.262649:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333478144 00000100:00100000:1.0:1734016102.262656:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333478144 00010000:00010000:1.0:1734016102.262684:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711459a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 9797632->9801727) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ca2 expref: 9 pid: 7684 timeout: 469 lvb_type: 0 00000100:00100000:1.0:1734016102.262707:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333478016 00000100:00100000:1.0:1734016102.262709:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333478016 00010000:00010000:1.0:1734016102.262717:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271145a1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ca9 expref: 8 pid: 7684 timeout: 469 lvb_type: 1 00000100:00100000:1.0:1734016102.262731:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2804 00000100:00100000:1.0:1734016102.262737:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333478144:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016102.262748:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016102.262764:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711459a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 9797632->9801727) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ca2 expref: 9 pid: 7684 timeout: 469 lvb_type: 0 00010000:00010000:1.0:1734016102.262775:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711459a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 9797632->9801727) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ca2 expref: 9 pid: 7684 timeout: 469 lvb_type: 0 00010000:00010000:1.0:1734016102.262795:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016102.262855:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333478144:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 117us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016102.262862:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2804 00000100:00100000:1.0:1734016102.262877:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2805 00000100:00100000:1.0:1734016102.262881:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333478016:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016102.262888:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016102.262894:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271145a1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ca9 expref: 8 pid: 7684 timeout: 469 lvb_type: 1 00010000:00010000:1.0:1734016102.262903:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271145a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ca9 expref: 8 pid: 7684 timeout: 469 lvb_type: 1 00010000:00010000:1.0:1734016102.262913:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016102.262915:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016102.262919:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271145a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [2793472->2834431] (req 2793472->2834431) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016102.262926:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271145a8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [2793472->2834431] (req 2793472->2834431) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016102.262940:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016102.262953:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333478016:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 70us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016102.262958:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2805 00000001:00080000:1.0:1734016102.270758:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969247 is committed 00000001:00080000:1.0:1734016102.270767:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969246 is committed 00000100:00100000:1.0:1734016102.287308:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333478272 00000100:00100000:1.0:1734016102.287316:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333478272 00000100:00100000:1.0:1734016102.287352:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10398 00000100:00100000:1.0:1734016102.287358:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88009024d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333478272:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016102.287376:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016102.287394:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271145af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4cb0 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016102.287414:0:7683:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 10286476, mtime: 0x675afc66, atime: 0x675afc65, ctime: 0x675afc66, blocks: 0x440 00010000:00010000:1.0:1734016102.287431:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016102.287433:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016102.287440:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271145af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cb0 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016102.287454:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271145af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cb0 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016102.287463:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016102.287503:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88009024d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333478272:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 144us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016102.287509:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10398 00000100:00100000:0.0:1734016102.302900:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.313562:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016102.313640:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333478528 00000100:00100000:1.0:1734016102.313647:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333478528 00000100:00100000:1.0:1734016102.313732:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10400 00000100:00100000:1.0:1734016102.313738:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333478528:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016102.313753:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016102.313767:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271145bd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4cbe expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016102.313793:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271145af lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cb0 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016102.313824:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271145b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cb7 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016102.313829:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016102.313831:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016102.313833:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271145bd lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5246976->5251071] (req 5246976->5251071) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cbe expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016102.313855:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271145b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cb7 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016102.313864:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271145b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cb7 expref: 7 pid: 7684 timeout: 469 lvb_type: 1 00000100:00100000:1.0:1734016102.313874:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007546d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335221248:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016102.313917:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271145af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cb0 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016102.313923:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271145af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cb0 expref: 6 pid: 7683 timeout: 469 lvb_type: 1 00000100:00100000:1.0:1734016102.313929:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007546df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335221376:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016102.313938:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016102.324164:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007546d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335221248:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016102.324173:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007546df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335221376:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016102.324208:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271145bd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [5246976->5251071] (req 5246976->5251071) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cbe expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016102.324219:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016102.324255:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:9668:x1818247333478528:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10517us (10699us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016102.324261:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10400 00000100:00100000:1.0:1734016102.324283:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2807 00000100:00100000:1.0:1734016102.324286:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333478656:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016102.324292:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016102.324298:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271145b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cb7 expref: 7 pid: 7684 timeout: 469 lvb_type: 1 00010000:00010000:1.0:1734016102.324306:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271145b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cb7 expref: 7 pid: 7684 timeout: 469 lvb_type: 1 00010000:00010000:1.0:1734016102.324316:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271145b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cb7 expref: 7 pid: 7684 timeout: 469 lvb_type: 1 00010000:00010000:1.0:1734016102.324326:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016102.324327:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016102.324332:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271145bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5246976->5251071) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cbe expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016102.324339:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271145bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5246976->5251071) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cbe expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016102.324360:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271145bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5246976->5251071) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cbe expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016102.324370:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007546df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335221504:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016102.324395:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016102.334516:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007546df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335221504:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016102.334533:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016102.334568:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333478656:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 10280us (10499us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016102.334576:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2807 00000100:00100000:0.0:1734016102.348414:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333479296 00000100:00100000:0.0:1734016102.348422:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333479296 00002000:00100000:0.0:1734016102.348456:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5242880->5246975) req@ffff880073791c00 x1818247333479296/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:63/0 lens 488/0 e 0 to 0 dl 1734016113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016102.348465:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073791c00 with x1818247333479296 ext(5242880->5246975) 00002000:00010000:0.0:1734016102.348469:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073791c00 00000100:00100000:0.0:1734016102.360231:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.370931:0:3504:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1734016102.370943:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007546df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335221632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1734016102.370978:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016102.371230:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007546df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335221632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1734016102.383571:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.383664:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333479808 00000100:00100000:0.0:1734016102.383672:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333479808 00002000:00100000:0.0:1734016102.383707:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5234688->5238783) req@ffff88007546d180 x1818247333479808/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:63/0 lens 488/0 e 0 to 0 dl 1734016113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016102.383717:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007546d180 with x1818247333479808 ext(5234688->5238783) 00002000:00010000:0.0:1734016102.383721:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007546d180 00000100:00100000:0.0:1734016102.383752:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8105 00000100:00100000:0.0:1734016102.383758:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007546d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333479808:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016102.383939:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007546d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333479808:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 179us (374us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016102.383946:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8105 00002000:00100000:0.0:1734016102.383951:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5234688->5238783) req@ffff88007546d180 x1818247333479808/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:63/0 lens 488/4536 e 0 to 0 dl 1734016113 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016102.383958:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007546d180 with x1818247333479808 ext(5234688->5238783) 00002000:00010000:0.0:1734016102.383960:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007546d180 00000100:00100000:1.0:1734016102.403947:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016102.407030:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.407087:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333480576 00000100:00100000:0.0:1734016102.407094:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333480576 00002000:00100000:0.0:1734016102.407121:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5222400->5226495) req@ffff88007546e300 x1818247333480576/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:63/0 lens 488/0 e 0 to 0 dl 1734016113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016102.407129:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007546e300 with x1818247333480576 ext(5222400->5226495) 00002000:00010000:0.0:1734016102.407132:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007546e300 00000100:00100000:0.0:1734016102.407155:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8108 00000100:00100000:0.0:1734016102.407160:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007546e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333480576:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016102.407347:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007546e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333480576:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 185us (322us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016102.407353:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8108 00002000:00100000:0.0:1734016102.407358:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5222400->5226495) req@ffff88007546e300 x1818247333480576/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:63/0 lens 488/4536 e 0 to 0 dl 1734016113 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016102.407366:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007546e300 with x1818247333480576 ext(5222400->5226495) 00002000:00010000:0.0:1734016102.407369:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007546e300 00000100:00100000:0.0:1734016102.417504:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333480832 00000100:00100000:0.0:1734016102.417512:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333480832 00002000:00100000:0.0:1734016102.417547:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5218304->5222399) req@ffff880073945f80 x1818247333480832/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:63/0 lens 488/0 e 0 to 0 dl 1734016113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016102.417557:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073945f80 with x1818247333480832 ext(5218304->5222399) 00002000:00010000:0.0:1734016102.417561:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073945f80 00000100:00100000:0.0:1734016102.418198:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8109 00000100:00100000:0.0:1734016102.418204:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333480832:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016102.419625:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333480832:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1419us (2220us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016102.419632:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8109 00002000:00100000:0.0:1734016102.419637:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5218304->5222399) req@ffff880073945f80 x1818247333480832/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:63/0 lens 488/4536 e 0 to 0 dl 1734016113 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016102.419644:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073945f80 with x1818247333480832 ext(5218304->5222399) 00002000:00010000:0.0:1734016102.419647:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073945f80 00000100:00100000:1.0:1734016102.427715:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.427776:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333481088 00000100:00100000:0.0:1734016102.427783:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333481088 00002000:00100000:0.0:1734016102.427840:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5214208->5218303) req@ffff8800a7aad050 x1818247333481088/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:63/0 lens 488/0 e 0 to 0 dl 1734016113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016102.427849:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7aad050 with x1818247333481088 ext(5214208->5218303) 00002000:00010000:0.0:1734016102.427853:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7aad050 00000100:00100000:0.0:1734016102.427876:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8110 00000100:00100000:0.0:1734016102.427882:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333481088:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016102.428015:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333481088:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 133us (306us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016102.428021:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8110 00002000:00100000:0.0:1734016102.428026:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5214208->5218303) req@ffff8800a7aad050 x1818247333481088/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:63/0 lens 488/4536 e 0 to 0 dl 1734016113 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016102.428032:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7aad050 with x1818247333481088 ext(5214208->5218303) 00002000:00010000:0.0:1734016102.428034:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7aad050 00000100:00100000:1.0:1734016102.436607:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.446723:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333481600 00000100:00100000:0.0:1734016102.446731:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333481600 00002000:00100000:0.0:1734016102.446763:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5206016->5210111) req@ffff880073945500 x1818247333481600/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:63/0 lens 488/0 e 0 to 0 dl 1734016113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016102.446772:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073945500 with x1818247333481600 ext(5206016->5210111) 00002000:00010000:0.0:1734016102.446776:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073945500 00000100:00100000:1.0:1734016102.452111:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.452175:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333481856 00000100:00100000:0.0:1734016102.452314:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333481856 00002000:00100000:0.0:1734016102.452351:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5201920->5206015) req@ffff88007546ea00 x1818247333481856/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:63/0 lens 488/0 e 0 to 0 dl 1734016113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016102.452361:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007546ea00 with x1818247333481856 ext(5201920->5206015) 00002000:00010000:0.0:1734016102.452365:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007546ea00 00000100:00100000:0.0:1734016102.452391:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8113 00000100:00100000:0.0:1734016102.452396:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007546ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333481856:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016102.452540:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007546ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333481856:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 142us (435us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016102.452547:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8113 00002000:00100000:0.0:1734016102.452552:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5201920->5206015) req@ffff88007546ea00 x1818247333481856/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:63/0 lens 488/4536 e 0 to 0 dl 1734016113 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016102.452559:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007546ea00 with x1818247333481856 ext(5201920->5206015) 00002000:00010000:0.0:1734016102.452562:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007546ea00 00000100:00100000:1.0:1734016102.458730:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.458824:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333482112 00000100:00100000:0.0:1734016102.458832:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333482112 00002000:00100000:0.0:1734016102.458864:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5197824->5201919) req@ffff88007546ed80 x1818247333482112/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:63/0 lens 488/0 e 0 to 0 dl 1734016113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016102.458873:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007546ed80 with x1818247333482112 ext(5197824->5201919) 00002000:00010000:0.0:1734016102.458878:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007546ed80 00000100:00100000:0.0:1734016102.458906:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8114 00000100:00100000:0.0:1734016102.458911:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007546ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333482112:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016102.459035:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007546ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333482112:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 123us (311us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016102.459042:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8114 00002000:00100000:0.0:1734016102.459046:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5197824->5201919) req@ffff88007546ed80 x1818247333482112/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:63/0 lens 488/4536 e 0 to 0 dl 1734016113 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016102.459054:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007546ed80 with x1818247333482112 ext(5197824->5201919) 00002000:00010000:0.0:1734016102.459056:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007546ed80 00000100:00100000:0.0:1734016102.503022:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333482240:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 26370us (27990us total) trans 4294969248 rc 0/0 00000100:00100000:0.0:1734016102.503035:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8115 00002000:00100000:0.0:1734016102.503049:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5197824->5251071) req@ffff880073946680 x1818247333482240/t4294969248(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:63/0 lens 488/448 e 0 to 0 dl 1734016113 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016102.503058:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073946680 with x1818247333482240 ext(5197824->5251071) 00002000:00010000:0.0:1734016102.503063:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073946680 00000100:00100000:1.0:1734016102.508769:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016102.518733:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:1.0:1734016102.523961:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969248 is committed 00000100:00100000:0.0:1734016102.527126:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333482624 00000100:00100000:0.0:1734016102.527133:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333482624 00000100:00100000:0.0:1734016102.527170:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2036 00000100:00100000:0.0:1734016102.527176:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:9668:x1818247333482624:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016102.527201:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016102.527215:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc271145c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4cc5 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016102.527281:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc271145cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016102.527291:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc271145cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016102.527299:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc271145cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016102.527316:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 10286476 00000004:00200000:0.0:1734016102.527318:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016102.527330:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc271145cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016102.527346:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc271145c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cc5 expref: 20 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016102.527928:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc271145cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cc5 expref: 19 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016102.527935:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016102.527938:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016102.527940:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581b00, rc 0) 00000100:00100000:0.0:1734016102.528161:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:9668:x1818247333482624:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 984us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016102.528167:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2036 00000100:00100000:1.0:1734016102.532729:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016102.537849:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333482880 00000100:00100000:1.0:1734016102.537855:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333482880 00010000:00010000:1.0:1734016102.537879:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271145bd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5246976->5251071) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cbe expref: 6 pid: 7683 timeout: 469 lvb_type: 0 00000100:00100000:1.0:1734016102.537898:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2808 00000100:00100000:1.0:1734016102.537903:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333482880:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016102.537913:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1734016102.537925:0:9876:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016102 -> 1734016103 00002000:00010000:1.0:1734016102.537928:0:9876:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016102 -> 1734016103 00002000:00010000:1.0:1734016102.537929:0:9876:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1088 -> 1192 00010000:00010000:1.0:1734016102.537934:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271145bd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5246976->5251071) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cbe expref: 6 pid: 7683 timeout: 469 lvb_type: 0 00010000:00010000:1.0:1734016102.537944:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271145bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5246976->5251071) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cbe expref: 6 pid: 7683 timeout: 469 lvb_type: 0 00010000:00010000:1.0:1734016102.537962:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016102.537963:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016102.537968:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271145d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4870144->4898815) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ccc expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016102.537976:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271145d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4870144->4898815) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ccc expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016102.537999:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271145d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4870144->4898815) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ccc expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016102.538009:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007546fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335221888:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016102.538049:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00010000:00010000:0.0:1734016102.538131:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271145bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5246976->5251071) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cbe expref: 6 pid: 7683 timeout: 469 lvb_type: 0 00000100:00100000:0.0:1734016102.538144:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075887b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335221760:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016102.538159:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271145d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4870144->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ccc expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016102.538166:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:0.0:1734016102.538205:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007546f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333482752:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5128us (5482us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016102.538212:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10402 00000100:00100000:1.0:1734016102.552819:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007546fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335221888:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016102.552842:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016102.553003:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333482880:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 15097us (15223us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016102.553013:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2808 00000100:00100000:0.0:1734016102.553679:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333483008 00000100:00100000:0.0:1734016102.553685:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333483008 00000100:00100000:0.0:1734016102.553718:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10403 00000100:00100000:0.0:1734016102.553724:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333483008:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016102.553965:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10286476 -> 10286476 00002000:00010000:0.0:1734016102.553969:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016103 -> 1734016103 00002000:00010000:0.0:1734016102.553971:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016101 -> 1734016101 00002000:00010000:0.0:1734016102.553973:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016103 -> 1734016103 00002000:00010000:0.0:1734016102.553974:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1192 -> 1192 00000100:00100000:0.0:1734016102.554277:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333483008:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 551us (710us total) trans 4294969249 rc 0/0 00000100:00100000:0.0:1734016102.554283:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10403 00000100:00100000:1.0:1734016102.593620:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333483392 00000100:00100000:1.0:1734016102.593632:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333483392 00002000:00100000:1.0:1734016102.593673:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8388607) req@ffff880075887100 x1818247333483392/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:63/0 lens 504/0 e 0 to 0 dl 1734016113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016102.593682:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075887100 with x1818247333483392 ext(4190208->8388607) 00002000:00010000:1.0:1734016102.593687:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075887100 00000100:00100000:1.0:1734016102.593718:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333483264 00000100:00100000:1.0:1734016102.593721:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333483264 00002000:00100000:1.0:1734016102.593732:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->6098943) req@ffff880075884700 x1818247333483264/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:63/0 lens 504/0 e 0 to 0 dl 1734016113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016102.593739:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075884700 with x1818247333483264 ext(0->6098943) 00002000:00010000:1.0:1734016102.593741:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075884700 00000100:00100000:1.0:1734016102.593760:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8116 00000100:00100000:1.0:1734016102.593766:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333483392:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016102.599475:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8117 00000100:00100000:0.0:1734016102.599488:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333483264:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016102.781711:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333483264:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 182211us (190157us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1734016102.781730:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8117 00002000:00100000:0.0:1734016102.781746:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->6098943) req@ffff880075884700 x1818247333483264/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:63/0 lens 504/440 e 0 to 0 dl 1734016113 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016102.781756:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075884700 with x1818247333483264 ext(0->6098943) 00002000:00010000:0.0:1734016102.781761:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075884700 00000100:00100000:0.0:1734016102.821160:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333483392:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 227370us (229634us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1734016102.821198:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8116 00002000:00100000:0.0:1734016102.821219:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8388607) req@ffff880075887100 x1818247333483392/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:63/0 lens 504/440 e 0 to 0 dl 1734016113 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016102.821231:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075887100 with x1818247333483392 ext(4190208->8388607) 00002000:00010000:0.0:1734016102.821240:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075887100 00000100:00100000:0.0:1734016102.836618:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333483776 00000100:00100000:0.0:1734016102.836630:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333483776 00000100:00100000:0.0:1734016102.836690:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10404 00000100:00100000:0.0:1734016102.836698:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333483776:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016102.836724:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016102.836748:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271145d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4cd3 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016102.836862:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075874e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335222016:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016102.836954:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00002000:00010000:0.0:1734016102.838469:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016101 -> 1734016103 00000100:00100000:0.0:1734016102.838500:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075874e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335222016:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016102.838533:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271145d9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cd3 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016102.838547:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271145d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cd3 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016102.838569:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:0.0:1734016102.838621:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333483776:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1923us (2102us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016102.838630:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10404 00000100:00100000:0.0:1734016102.840582:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333483904 00000100:00100000:0.0:1734016102.840593:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333483904 00000100:00100000:0.0:1734016102.840645:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10405 00000100:00100000:0.0:1734016102.840654:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333483904:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016102.840679:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016102.840702:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271145e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4cda expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016102.840777:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075874e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335222144:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016102.840897:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016102.852947:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075874e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335222144:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016102.852994:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271145e0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cda expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016102.853013:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271145e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cda expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016102.853050:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016102.853112:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333483904:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12458us (12604us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016102.853122:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10405 00000100:00100000:0.0:1734016102.859759:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333484032 00000100:00100000:0.0:1734016102.859772:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333484032 00000100:00100000:0.0:1734016102.859896:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10406 00000100:00100000:0.0:1734016102.859906:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333484032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016102.859936:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016102.859965:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271145e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4ce1 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016102.860048:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075874e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335222272:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016102.860135:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016102.870010:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075874e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335222272:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016102.870078:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271145e7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ce1 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016102.870099:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271145e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ce1 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016102.870148:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016102.870253:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333484032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10346us (10613us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016102.870264:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10406 00000100:00100000:0.0:1734016102.875425:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333484288 00000100:00100000:0.0:1734016102.875437:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333484288 00000100:00100000:0.0:1734016102.875521:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8119 00000100:00100000:0.0:1734016102.875530:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333484288:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:0.0:1734016102.875581:0:14005:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271145ee lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016102.875602:0:14005:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271145d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4870144->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ccc expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016102.875609:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016102.875611:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016102.875614:0:14005:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271145ee lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016102.875649:0:14005:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271145d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4870144->4898815) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ccc expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016102.875665:0:14005:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271145d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4870144->4898815) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ccc expref: 7 pid: 7683 timeout: 470 lvb_type: 0 00000100:00100000:0.0:1734016102.875679:0:14005:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075874e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14005:1818247335222400:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016102.875768:0:14005:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016102.895378:0:14005:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075874e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14005:1818247335222400:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016102.895408:0:14005:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271145ee lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016102.940457:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333484416 00000100:00100000:1.0:1734016102.940474:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333484416 00010000:00010000:1.0:1734016102.940521:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271145d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4870144->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ccc expref: 8 pid: 7683 timeout: 470 lvb_type: 0 00000100:00100000:1.0:1734016102.940584:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2809 00000100:00100000:1.0:1734016102.940592:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333484416:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016102.940610:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016102.940635:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271145d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4870144->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ccc expref: 8 pid: 7683 timeout: 470 lvb_type: 0 00010000:00010000:1.0:1734016102.940648:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271145d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4870144->4898815) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ccc expref: 8 pid: 7683 timeout: 470 lvb_type: 0 00010000:00010000:1.0:1734016102.940676:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271145d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4870144->4898815) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ccc expref: 8 pid: 7683 timeout: 470 lvb_type: 0 00010000:00010000:1.0:1734016102.940711:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016102.940714:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016102.940719:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271145ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016102.940729:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271145ee lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016102.940754:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016102.940861:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333484416:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 267us (3884us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016102.940868:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2809 00010000:00010000:1.0:1734016102.940912:0:14005:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271145ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016102.940920:0:14005:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271145ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016102.945711:0:14005:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271145ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016102.945734:0:14005:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271145ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016102.945744:0:14005:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271145ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016102.945752:0:14005:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7580000 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016102.945758:0:14005:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271145ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016102.945770:0:14005:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271145ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016102.945819:0:14005:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271145ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016102.945826:0:14005:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271145ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016102.945955:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333484288:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 70417us (70615us total) trans 0 rc 40960/40960 00000100:00100000:1.0:1734016102.945971:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8119 00000100:00100000:0.0:1734016102.959357:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016102.964219:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.016662:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016103.017625:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016073 00000100:00100000:0.0:1734016103.032340:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.032476:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.032743:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335222528:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016103.032755:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075887b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335222656:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016103.033263:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->2850815) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cf6 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.033273:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:1.0:1734016103.033304:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333484800:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 16091us (16658us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016103.033311:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10409 00000100:00100000:0.0:1734016103.048721:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.048838:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333485184 00000100:00100000:1.0:1734016103.048847:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333485184 00000100:00100000:1.0:1734016103.048882:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10410 00000100:00100000:1.0:1734016103.048888:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333485184:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016103.049129:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10286476 -> 10286476 00002000:00010000:1.0:1734016103.049133:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016103 -> 1734016103 00002000:00010000:1.0:1734016103.049135:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016101 -> 1734016101 00002000:00010000:1.0:1734016103.049137:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016103 -> 1734016103 00002000:00010000:1.0:1734016103.049139:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1192 -> 1224 00000100:00100000:1.0:1734016103.049164:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333485184:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 276us (444us total) trans 4294969250 rc 0/0 00000100:00100000:1.0:1734016103.049178:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10410 00000100:00100000:1.0:1734016103.057065:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.096099:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333485696 00000100:00100000:0.0:1734016103.096112:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333485696 00000100:00100000:0.0:1734016103.096189:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2037 00000100:00100000:0.0:1734016103.096197:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:9668:x1818247333485696:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016103.096258:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016103.096289:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc271145cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cc5 expref: 19 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016103.096312:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016103.096317:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016103.096509:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114618 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016103.096524:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711458c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c94 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016103.096531:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114618 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016103.096566:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711458c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c94 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016103.096577:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711458c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4c94 expref: 15 pid: 6478 timeout: 470 lvb_type: 0 00000100:00100000:0.0:1734016103.096589:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075876680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335223168:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016103.096665:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016103.105086:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016103.106367:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016073 00010000:00010000:1.0:1734016103.107740:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114618 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.107754:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114618 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.107766:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114618 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.107773:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7580000 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:1.0:1734016103.107777:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114618 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.107783:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114618 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.107832:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016103.107834:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1734016103.107838:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114618 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.107842:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114618 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016103.108362:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333485952 00000100:00100000:0.0:1734016103.108372:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333485952 00000100:00100000:0.0:1734016103.108422:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10413 00000100:00100000:0.0:1734016103.108431:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333485952:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016103.108452:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016103.108471:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc2711461f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4d0b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016103.108503:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114603 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->2850815) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cf6 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016103.108516:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016103.108518:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016103.108521:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc2711461f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d0b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016103.108554:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114603 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->2850815) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cf6 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016103.108565:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->2850815) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cf6 expref: 8 pid: 7683 timeout: 470 lvb_type: 0 00000100:00100000:0.0:1734016103.108576:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075876a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335223296:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016103.108641:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eec00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016103.123387:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333486080 00000100:00100000:0.0:1734016103.123398:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333486080 00010000:00010000:0.0:1734016103.123431:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->2850815) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cf6 expref: 9 pid: 7683 timeout: 470 lvb_type: 0 00000100:00100000:0.0:1734016103.123468:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2813 00000100:00100000:0.0:1734016103.123475:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333486080:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016103.123493:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016103.123515:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->2850815) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cf6 expref: 9 pid: 7683 timeout: 470 lvb_type: 0 00010000:00010000:0.0:1734016103.123528:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114603 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->2850815) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cf6 expref: 9 pid: 7683 timeout: 470 lvb_type: 0 00010000:00010000:0.0:1734016103.123555:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114603 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->2850815) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4cf6 expref: 9 pid: 7683 timeout: 470 lvb_type: 0 00010000:00010000:0.0:1734016103.123578:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016103.123581:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016103.123586:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc2711461f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d0b expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016103.123594:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc2711461f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d0b expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016103.123623:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc2711461f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d0b expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016103.123633:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075876d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335223424:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016103.123690:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016103.130040:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075876d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335223424:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016103.130084:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016103.130162:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333486080:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6684us (6851us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016103.130186:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2813 00000100:00100000:1.0:1734016103.135888:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.189970:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333486464 00000100:00100000:0.0:1734016103.189990:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333486464 00000100:00100000:0.0:1734016103.190075:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10414 00000100:00100000:0.0:1734016103.190085:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333486464:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016103.190118:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016103.190146:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27114634 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4d19 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016103.190232:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075876d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335223552:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016103.190332:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee900 going to sleep for 11 seconds 00002000:00010000:0.0:1734016103.194660:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016101 -> 1734016103 00000100:00100000:0.0:1734016103.194708:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075876d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335223552:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016103.194759:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27114634 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d19 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016103.194778:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27114634 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d19 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016103.194853:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:0.0:1734016103.194932:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333486464:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4846us (7733us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016103.194943:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10414 00000100:00100000:0.0:1734016103.197186:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333486592 00000100:00100000:0.0:1734016103.197197:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333486592 00000100:00100000:0.0:1734016103.197263:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10415 00000100:00100000:0.0:1734016103.197273:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333486592:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016103.197303:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016103.197327:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711463b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4d20 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016103.197429:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075876d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335223680:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016103.197527:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016103.205992:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075876d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335223680:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016103.206043:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711463b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d20 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016103.206063:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711463b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d20 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016103.206097:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:0.0:1734016103.206155:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333486592:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8882us (9078us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016103.206179:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10415 00000100:00100000:0.0:1734016103.276290:0:7704:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335223808:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016103.276337:0:7704:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27114642 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016103.277214:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333486976 00000100:00100000:0.0:1734016103.277225:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333486976 00010000:00010000:0.0:1734016103.277267:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711462d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d12 expref: 16 pid: 13956 timeout: 470 lvb_type: 0 00000100:00100000:0.0:1734016103.277316:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2814 00000100:00100000:0.0:1734016103.277326:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+16:1982:x1818247333486976:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016103.277349:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016103.277358:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711462d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d12 expref: 16 pid: 13956 timeout: 470 lvb_type: 0 00010000:00010000:0.0:1734016103.277373:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711462d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d12 expref: 16 pid: 13956 timeout: 470 lvb_type: 0 00010000:00010000:0.0:1734016103.277406:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711462d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d12 expref: 16 pid: 13956 timeout: 470 lvb_type: 0 00010000:00010000:0.0:1734016103.277445:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016103.277452:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27114642 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016103.277463:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27114642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016103.277473:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27114642 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016103.277517:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016103.277575:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+15:1982:x1818247333486976:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 251us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016103.277584:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2814 00010000:00010000:1.0:1734016103.278164:0:7704:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27114642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016103.278179:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27114642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:1.0:1734016103.278318:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968614 00000004:00010000:1.0:1734016103.278382:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075884380 reply state ffff8800a7ac9000 transno 4294968615 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27114642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:1.0:1734016103.278389:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016103.278498:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:9668:x1818247333486848:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 8151us (8436us total) trans 4294968615 rc 0/0 00000100:00100000:1.0:1734016103.278509:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2039 00000020:00080000:1.0:1734016103.278516:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016103.284646:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.295478:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333487232 00000100:00100000:0.0:1734016103.295492:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333487232 00000100:00100000:0.0:1734016103.295569:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2040 00000100:00100000:0.0:1734016103.295581:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:9668:x1818247333487232:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016103.295637:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016103.295670:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27114649 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4d27 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016103.296189:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114650 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016103.296213:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016103.296230:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:0.0:1734016103.296274:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 3499673 00000004:00200000:0.0:1734016103.296281:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016103.296310:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016103.296345:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27114649 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d27 expref: 24 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016103.296929:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114650 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d27 expref: 23 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016103.296944:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016103.296948:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016103.296954:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:0.0:1734016103.297265:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:9668:x1818247333487232:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1686us (2044us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016103.297276:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2040 00000100:00100000:0.0:1734016103.322095:0:14005:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14005:1818247335223936:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016103.322138:0:14005:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114657 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2437120->2445311] (req 2437120->2445311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016103.330891:0:14005:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2437120->2445311] (req 2437120->2445311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016103.330913:0:14005:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2437120->2445311] (req 2437120->2445311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016103.348076:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969253 is committed 00000001:00080000:0.0:1734016103.348137:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969250 is committed 00000100:00100000:0.0:1734016103.360503:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333487744 00000100:00100000:0.0:1734016103.360518:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333487744 00000100:00100000:0.0:1734016103.361502:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10416 00000100:00100000:0.0:1734016103.361515:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333487744:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016103.361548:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016103.361577:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc2711465e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4d2e expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016103.361611:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 3499673, mtime: 0x675afc67, atime: 0x675afc67, ctime: 0x675afc67, blocks: 0x3c8 00010000:00010000:0.0:1734016103.361641:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016103.361644:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016103.361653:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc2711465e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d2e expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016103.361671:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc2711465e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d2e expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016103.361686:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75818c0, rc 0) 00000100:00100000:0.0:1734016103.361761:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333487744:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 247us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016103.361768:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10416 00000100:00100000:0.0:1734016103.371269:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.377923:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333488000 00000100:00100000:0.0:1734016103.377934:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333488000 00000100:00100000:0.0:1734016103.377996:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10417 00000100:00100000:0.0:1734016103.378006:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333488000:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016103.378038:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016103.378067:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114673 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4d3c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016103.378100:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016103.378102:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016103.378111:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114673 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d3c expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016103.378126:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114673 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d3c expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016103.378140:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:0.0:1734016103.378204:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333488000:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 200us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016103.378210:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10417 00000100:00100000:0.0:1734016103.406662:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333488256 00000100:00100000:0.0:1734016103.406678:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333488256 00002000:00100000:0.0:1734016103.406744:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (0->3502079) req@ffff8800749adc00 x1818247333488256/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:64/0 lens 488/0 e 0 to 0 dl 1734016114 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016103.406757:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749adc00 with x1818247333488256 ext(0->3502079) 00002000:00010000:0.0:1734016103.406765:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749adc00 00000100:00100000:0.0:1734016103.406833:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8123 00000100:00100000:0.0:1734016103.406840:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333488256:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016103.507973:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333488256:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 101110us (101441us total) trans 0 rc 3502080/3502080 00000100:00100000:1.0:1734016103.507992:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8123 00002000:00100000:1.0:1734016103.508013:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (0->3502079) req@ffff8800749adc00 x1818247333488256/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:64/0 lens 488/440 e 0 to 0 dl 1734016114 ref 1 fl Complete:/200/0 rc 3502080/3502080 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016103.508024:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749adc00 with x1818247333488256 ext(0->3502079) 00002000:00010000:1.0:1734016103.508033:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749adc00 00000100:00100000:0.0:1734016103.590932:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.610247:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335224064:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016103.610291:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711467a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016103.610739:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016103.612797:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711467a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.612844:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711467a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.612850:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711467a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.612855:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd440 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:1.0:1734016103.612859:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711467a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.612865:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711467a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.612878:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016103.612882:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1734016103.612886:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711467a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.612894:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711467a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016103.616724:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.617028:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333488768 00000100:00100000:1.0:1734016103.617042:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333488768 00000100:00100000:1.0:1734016103.617099:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10418 00000100:00100000:1.0:1734016103.617112:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333488768:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016103.617142:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016103.617181:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114681 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4d43 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.617218:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc2711465e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d2e expref: 5 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016103.617227:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114673 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d3c expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016103.617235:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016103.617237:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016103.617241:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114681 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d43 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.617284:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114673 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d3c expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016103.617296:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114673 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d3c expref: 8 pid: 7684 timeout: 470 lvb_type: 1 00000100:00100000:1.0:1734016103.617315:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007546ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335224192:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016103.617424:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc2711465e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d2e expref: 5 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016103.617434:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc2711465e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d2e expref: 5 pid: 7684 timeout: 470 lvb_type: 1 00000100:00100000:1.0:1734016103.617443:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007546d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335224320:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016103.617462:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f180 going to sleep for 11 seconds 00000100:00100000:1.0:1734016103.620158:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007546d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335224320:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016103.620191:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007546ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335224192:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016103.620230:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114681 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d43 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.620252:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016103.620314:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333488768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3204us (3606us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016103.620323:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10418 00000100:00100000:0.0:1734016103.625609:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333488896 00000100:00100000:0.0:1734016103.625620:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333488896 00010000:00010000:0.0:1734016103.625666:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114673 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d3c expref: 8 pid: 7684 timeout: 470 lvb_type: 1 00000100:00100000:0.0:1734016103.625710:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2817 00000100:00100000:0.0:1734016103.625720:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333488896:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016103.625737:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016103.625768:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114673 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d3c expref: 8 pid: 7684 timeout: 470 lvb_type: 1 00010000:00010000:0.0:1734016103.625788:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114673 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d3c expref: 8 pid: 7684 timeout: 470 lvb_type: 1 00010000:00010000:0.0:1734016103.625846:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114673 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d3c expref: 8 pid: 7684 timeout: 470 lvb_type: 1 00010000:00010000:0.0:1734016103.625876:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016103.625942:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333488896:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 223us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016103.625950:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2817 00000100:00100000:1.0:1734016103.628517:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333489024 00000100:00100000:1.0:1734016103.628534:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333489024 00010000:00010000:1.0:1734016103.628573:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc2711465e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d2e expref: 6 pid: 7684 timeout: 470 lvb_type: 1 00000100:00100000:1.0:1734016103.628606:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2818 00000100:00100000:1.0:1734016103.628613:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333489024:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016103.628627:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016103.628647:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc2711465e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d2e expref: 6 pid: 7684 timeout: 470 lvb_type: 1 00010000:00010000:1.0:1734016103.628659:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc2711465e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d2e expref: 6 pid: 7684 timeout: 470 lvb_type: 1 00010000:00010000:1.0:1734016103.628681:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc2711465e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d2e expref: 6 pid: 7684 timeout: 470 lvb_type: 1 00010000:00010000:1.0:1734016103.628725:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016103.628728:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016103.628735:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d43 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.628744:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114681 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d43 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.628779:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114681 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d43 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016103.628791:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007546ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335224448:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016103.628866:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f180 going to sleep for 11 seconds 00000100:00100000:0.0:1734016103.632763:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.632858:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007546ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335224448:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016103.632875:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016103.632931:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333489024:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4318us (6818us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016103.632938:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2818 00000100:00100000:0.0:1734016103.641677:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.649044:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.649120:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333489664 00000100:00100000:1.0:1734016103.649131:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333489664 00010000:00010000:1.0:1734016103.649180:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc2711468f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d4a expref: 18 pid: 13956 timeout: 470 lvb_type: 0 00000100:00100000:1.0:1734016103.649426:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2819 00000100:00100000:1.0:1734016103.649439:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+18:1981:x1818247333489664:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016103.649461:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016103.649470:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc2711468f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d4a expref: 18 pid: 13956 timeout: 470 lvb_type: 0 00010000:00010000:1.0:1734016103.649484:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc2711468f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d4a expref: 18 pid: 13956 timeout: 470 lvb_type: 0 00010000:00010000:1.0:1734016103.649517:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc2711468f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d4a expref: 18 pid: 13956 timeout: 470 lvb_type: 0 00010000:00010000:1.0:1734016103.649549:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016103.649555:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27114696 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016103.649566:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27114696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016103.649580:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27114696 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016103.649623:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016103.649685:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+17:1981:x1818247333489664:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 249us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016103.649695:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2819 00000100:00100000:1.0:1734016103.654788:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.661549:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.666987:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.672694:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.679037:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333490304 00000100:00100000:0.0:1734016103.679050:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333490304 00000100:00100000:0.0:1734016103.679113:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10420 00000100:00100000:0.0:1734016103.679122:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333490304:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016103.679147:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016103.679175:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc271146b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4d5f expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016103.679246:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075874000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335224960:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016103.679342:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016103.686082:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.686378:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333490560 00000100:00100000:1.0:1734016103.686390:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333490560 00000100:00100000:1.0:1734016103.686594:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8126 00000100:00100000:1.0:1734016103.686603:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333490560:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:1.0:1734016103.686651:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271146b9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.686673:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711469d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d51 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.686682:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016103.686685:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016103.686687:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271146b9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1060864->1118207] (req 1060864->1118207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.686736:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711469d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d51 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.686750:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711469d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d51 expref: 6 pid: 7683 timeout: 470 lvb_type: 0 00000100:00100000:1.0:1734016103.686768:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007546c000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335225088:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016103.686865:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016103.690229:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007546c000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335225088:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016103.690268:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271146b9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1060864->1118207] (req 1060864->1118207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016103.692578:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016103.693720:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271146b9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1060864->1118207] (req 1060864->1118207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.693730:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271146b9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1060864->1118207] (req 1060864->1118207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.696411:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271146b9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1060864->1118207] (req 1060864->1118207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.696431:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271146b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1060864->1118207] (req 1060864->1118207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.696439:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271146b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1060864->1118207] (req 1060864->1118207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.696445:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499c6c0 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016103.696448:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271146b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1060864->1118207] (req 1060864->1118207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.696457:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271146b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1060864->1118207] (req 1060864->1118207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.696480:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271146b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1060864->1118207] (req 1060864->1118207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.696486:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271146b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1060864->1118207] (req 1060864->1118207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016103.697054:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333490560:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 10445us (10974us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1734016103.697066:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8126 00000100:00100000:0.0:1734016103.705107:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.709651:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.715790:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333491200 00000100:00100000:1.0:1734016103.715818:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333491200 00010000:00010000:1.0:1734016103.715854:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271146ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d6d expref: 9 pid: 7683 timeout: 470 lvb_type: 1 00000100:00100000:1.0:1734016103.715887:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2822 00000100:00100000:1.0:1734016103.715893:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333491200:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016103.715910:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016103.715937:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271146ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d6d expref: 9 pid: 7683 timeout: 470 lvb_type: 1 00010000:00010000:1.0:1734016103.715949:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271146ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d6d expref: 9 pid: 7683 timeout: 470 lvb_type: 1 00010000:00010000:1.0:1734016103.715975:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271146ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d6d expref: 9 pid: 7683 timeout: 470 lvb_type: 1 00010000:00010000:1.0:1734016103.715998:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016103.716001:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016103.716008:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271146d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2740224->2744319) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d74 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.716017:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271146d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2740224->2744319) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d74 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.716053:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271146d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2740224->2744319) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d74 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016103.716067:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007546c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335225344:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016103.716117:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016103.717784:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007546c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335225344:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016103.717973:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016103.718015:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333491200:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 2121us (2559us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016103.718025:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2822 00000100:00100000:0.0:1734016103.727602:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.731612:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.732190:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333491712 00000100:00100000:1.0:1734016103.732199:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333491712 00010000:00010000:1.0:1734016103.732235:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271146d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2740224->2744319) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d74 expref: 9 pid: 7683 timeout: 470 lvb_type: 0 00000100:00100000:1.0:1734016103.732282:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2823 00000100:00100000:1.0:1734016103.732291:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333491712:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016103.732311:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016103.732338:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271146d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2740224->2744319) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d74 expref: 9 pid: 7683 timeout: 470 lvb_type: 0 00010000:00010000:1.0:1734016103.732352:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271146d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2740224->2744319) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d74 expref: 9 pid: 7683 timeout: 470 lvb_type: 0 00010000:00010000:1.0:1734016103.732381:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271146d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2740224->2744319) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d74 expref: 9 pid: 7683 timeout: 470 lvb_type: 0 00010000:00010000:1.0:1734016103.732400:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016103.732403:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016103.732409:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271146e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2576384->2580479) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d82 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.732417:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271146e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2576384->2580479) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d82 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.732463:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271146e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2576384->2580479) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d82 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016103.732477:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007546c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335225728:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016103.732544:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016103.739689:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333491968 00000100:00100000:0.0:1734016103.739703:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333491968 00002000:00100000:0.0:1734016103.739780:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2576384->4624383) req@ffff8800749ac000 x1818247333491968/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:64/0 lens 504/0 e 0 to 0 dl 1734016114 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016103.739794:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ac000 with x1818247333491968 ext(2576384->4624383) 00002000:00010000:0.0:1734016103.739823:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ac000 00000100:00100000:0.0:1734016103.739871:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8127 00000100:00100000:0.0:1734016103.739880:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333491968:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016103.742058:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007546c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335225728:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016103.742096:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016103.742139:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333491712:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9846us (10541us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016103.742173:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2823 00000100:00100000:0.0:1734016103.753212:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333491968:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 13308us (13705us total) trans 0 rc 1126400/1126400 00000100:00100000:0.0:1734016103.753232:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8127 00002000:00100000:0.0:1734016103.753261:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2576384->4624383) req@ffff8800749ac000 x1818247333491968/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:64/0 lens 504/440 e 0 to 0 dl 1734016114 ref 1 fl Complete:/200/0 rc 1126400/1126400 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016103.753275:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ac000 with x1818247333491968 ext(2576384->4624383) 00002000:00010000:0.0:1734016103.753287:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ac000 00000100:00100000:0.0:1734016103.756982:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.761620:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333492480 00000100:00100000:0.0:1734016103.761634:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333492480 00002000:00100000:0.0:1734016103.761694:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2568192->2572287) req@ffff8800749ae300 x1818247333492480/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:64/0 lens 488/0 e 0 to 0 dl 1734016114 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016103.761713:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ae300 with x1818247333492480 ext(2568192->2572287) 00002000:00010000:0.0:1734016103.761723:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ae300 00000100:00100000:0.0:1734016103.761764:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8129 00000100:00100000:0.0:1734016103.761771:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333492480:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016103.762078:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333492480:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 305us (681us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016103.762084:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8129 00002000:00100000:0.0:1734016103.762089:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2568192->2572287) req@ffff8800749ae300 x1818247333492480/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:64/0 lens 488/4536 e 0 to 0 dl 1734016114 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016103.762095:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ae300 with x1818247333492480 ext(2568192->2572287) 00002000:00010000:0.0:1734016103.762097:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ae300 00000100:00100000:1.0:1734016103.765358:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.770617:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.775530:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333493248 00000100:00100000:0.0:1734016103.775545:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333493248 00002000:00100000:0.0:1734016103.775605:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2555904->2559999) req@ffff8800749ad880 x1818247333493248/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:64/0 lens 488/0 e 0 to 0 dl 1734016114 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016103.775615:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad880 with x1818247333493248 ext(2555904->2559999) 00002000:00010000:0.0:1734016103.775623:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ad880 00000100:00100000:1.0:1734016103.776386:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8132 00000100:00100000:1.0:1734016103.776398:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333493248:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016103.777196:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333493248:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 798us (1785us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016103.777203:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8132 00002000:00100000:1.0:1734016103.777210:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2555904->2559999) req@ffff8800749ad880 x1818247333493248/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:64/0 lens 488/4536 e 0 to 0 dl 1734016114 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016103.777218:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad880 with x1818247333493248 ext(2555904->2559999) 00002000:00010000:1.0:1734016103.777222:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ad880 00000100:00100000:1.0:1734016103.780062:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.786785:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.797018:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.801089:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.804485:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.809104:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.814284:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.820929:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.821170:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333495040 00000100:00100000:1.0:1734016103.821179:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333495040 00010000:00010000:1.0:1734016103.821216:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271146e3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d82 expref: 9 pid: 7683 timeout: 470 lvb_type: 0 00000100:00100000:1.0:1734016103.821255:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2824 00000100:00100000:1.0:1734016103.821262:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333495040:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016103.821277:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016103.821300:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271146e3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2576384->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d82 expref: 9 pid: 7683 timeout: 470 lvb_type: 0 00010000:00010000:1.0:1734016103.821311:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271146e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2576384->2580479) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d82 expref: 9 pid: 7683 timeout: 470 lvb_type: 0 00010000:00010000:1.0:1734016103.821337:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016103.821339:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016103.821345:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271146ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2682879) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d89 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.821353:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271146ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2682879) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d89 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016103.821389:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271146ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2682879) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d89 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016103.821401:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075140700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335225984:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016103.821459:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016103.824295:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075140700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335225984:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016103.824330:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016103.824394:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333495040:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3129us (3481us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016103.824409:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2824 00000100:00100000:0.0:1734016103.829111:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.836857:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333495296 00000100:00100000:1.0:1734016103.836869:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333495296 00000100:00100000:1.0:1734016103.837170:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10428 00000100:00100000:1.0:1734016103.837178:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333495296:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016103.837201:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016103.837224:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271146f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4d90 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016103.837295:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075140700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335226112:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016103.840034:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00002000:00010000:1.0:1734016103.846329:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016103 -> 1734016104 00000100:00100000:1.0:1734016103.846377:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075140700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335226112:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016103.846437:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271146f1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d90 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016103.846458:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271146f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d90 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016103.846478:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016103.847942:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333495296:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10749us (11179us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016103.847959:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10428 00000100:00100000:1.0:1734016103.851592:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333495424 00000100:00100000:1.0:1734016103.851604:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333495424 00000100:00100000:1.0:1734016103.851676:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10429 00000100:00100000:1.0:1734016103.851690:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333495424:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016103.851724:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016103.851760:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc271146f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4d97 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016103.852028:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075140700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335226240:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016103.852447:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016103.856112:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075140700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335226240:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016103.856186:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc271146f8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d97 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016103.856203:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc271146f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d97 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016103.856227:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016103.856405:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333495424:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4718us (4981us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016103.856417:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10429 00000100:00100000:0.0:1734016103.861715:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.874244:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.874342:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333495808 00000100:00100000:1.0:1734016103.874353:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333495808 00010000:00010000:1.0:1734016103.874396:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271146c7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d66 expref: 18 pid: 7704 timeout: 470 lvb_type: 0 00000100:00100000:1.0:1734016103.874557:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2825 00000100:00100000:1.0:1734016103.874565:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247333495808:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016103.874580:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016103.874588:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271146c7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d66 expref: 18 pid: 7704 timeout: 470 lvb_type: 0 00010000:00010000:1.0:1734016103.874603:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271146c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4d66 expref: 18 pid: 7704 timeout: 470 lvb_type: 0 00010000:00010000:1.0:1734016103.874632:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016103.874638:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc271146ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.874647:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc271146ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.874654:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc271146ff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.874670:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016103.874722:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247333495808:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 157us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016103.874730:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2825 00010000:00010000:1.0:1734016103.877259:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc271146ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.877279:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc271146ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.877288:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc271146ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.877295:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4480 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:1.0:1734016103.877302:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc271146ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.877310:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc271146ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.877336:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016103.877339:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1734016103.877344:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc271146ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016103.877349:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc271146ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016103.878987:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.883662:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.891165:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.897763:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.904509:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.912537:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.919846:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.925496:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.929747:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.929886:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333496960 00000100:00100000:0.0:1734016103.929896:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333496960 00000100:00100000:0.0:1734016103.929947:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10435 00000100:00100000:0.0:1734016103.929954:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333496960:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016103.929972:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016103.929992:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc2711473e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4dc8 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016103.930053:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074939880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335227008:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016103.930112:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016103.936881:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.943697:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.953437:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.961147:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016103.962647:0:14005:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc2711474c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1982464->2011135] (req 1982464->2011135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016103.962655:0:14005:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc2711474c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1982464->2011135] (req 1982464->2011135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016103.968218:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969261 is committed 00000001:00080000:0.0:1734016103.968233:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969260 is committed 00000100:00100000:0.0:1734016103.972604:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.972708:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333497728 00000100:00100000:1.0:1734016103.972722:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333497728 00000100:00100000:1.0:1734016103.972961:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10438 00000100:00100000:1.0:1734016103.972969:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333497728:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016103.972991:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016103.973014:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114753 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4dd6 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016103.973042:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 8272893, mtime: 0x675afc68, atime: 0x675afc68, ctime: 0x675afc68, blocks: 0x4b8 00010000:00010000:1.0:1734016103.973073:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016103.973076:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016103.973087:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114753 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4dd6 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016103.973103:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114753 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4dd6 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016103.973123:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016103.973199:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333497728:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 229us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016103.973208:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10438 00000100:00100000:0.0:1734016103.976917:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.982430:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.987069:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016103.991548:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016103.991692:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333498240 00000100:00100000:1.0:1734016103.991706:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333498240 00000100:00100000:1.0:1734016103.991760:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10441 00000100:00100000:1.0:1734016103.991767:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333498240:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016103.991789:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016103.991838:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114761 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4de4 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016103.991890:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075143800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335227648:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016103.991950:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016103.994754:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075143800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335227648:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016103.994795:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114761 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4de4 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016103.994961:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114761 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4de4 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016103.995122:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016103.995188:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333498240:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3419us (3648us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016103.995197:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10441 00000100:00100000:0.0:1734016104.001766:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.001961:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333498368 00000100:00100000:1.0:1734016104.001980:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333498368 00000100:00100000:1.0:1734016104.002067:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10442 00000100:00100000:1.0:1734016104.002077:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333498368:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016104.002100:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016104.002126:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114768 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4deb expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016104.002209:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075143800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335227776:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016104.002278:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00080000:0.0:1734016104.002328:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016074 00000100:00100000:1.0:1734016104.005281:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075143800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335227776:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016104.005328:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114768 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4deb expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.005344:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114768 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4deb expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.005369:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016104.005436:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333498368:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3359us (3687us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016104.005446:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10442 00000100:00100000:0.0:1734016104.024018:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.044557:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333498880 00000100:00100000:0.0:1734016104.044581:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333498880 00002000:00100000:0.0:1734016104.044666:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8273919) req@ffff8800749af100 x1818247333498880/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 504/0 e 0 to 0 dl 1734016115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016104.044680:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749af100 with x1818247333498880 ext(4190208->8273919) 00002000:00010000:0.0:1734016104.044688:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749af100 00000100:00100000:0.0:1734016104.044746:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8142 00000100:00100000:0.0:1734016104.044757:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333498880:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016104.135431:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.141516:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.147381:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.148119:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333499392 00000100:00100000:1.0:1734016104.148129:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333499392 00000100:00100000:1.0:1734016104.148189:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10443 00000100:00100000:1.0:1734016104.148196:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88009024d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333499392:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016104.148211:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016104.148225:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27114776 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4df2 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.148251:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711475a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4280320->4308991) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ddd expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.148257:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016104.148259:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016104.148262:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27114776 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4df2 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.148296:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711475a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4280320->4308991) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ddd expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.148308:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711475a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4280320->4308991) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ddd expref: 7 pid: 7683 timeout: 471 lvb_type: 0 00000100:00100000:1.0:1734016104.148322:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075143800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335228032:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016104.148389:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016104.153121:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075143800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335228032:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016104.153168:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27114776 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4df2 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.153183:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f180, rc 0) 00000100:00100000:1.0:1734016104.153234:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88009024d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333499392:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5036us (5869us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016104.153242:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10443 00000100:00100000:0.0:1734016104.169008:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.169224:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333499520 00000100:00100000:1.0:1734016104.169236:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333499520 00010000:00010000:1.0:1734016104.169279:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711475a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4280320->4308991) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ddd expref: 8 pid: 7683 timeout: 471 lvb_type: 0 00000100:00100000:1.0:1734016104.169726:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2829 00000100:00100000:1.0:1734016104.169733:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333499520:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016104.169748:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016104.169775:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711475a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4280320->4308991) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ddd expref: 8 pid: 7683 timeout: 471 lvb_type: 0 00010000:00010000:1.0:1734016104.169787:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711475a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4280320->4308991) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ddd expref: 8 pid: 7683 timeout: 471 lvb_type: 0 00010000:00010000:1.0:1734016104.169850:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711475a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4280320->4308991) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ddd expref: 8 pid: 7683 timeout: 471 lvb_type: 0 00010000:00010000:1.0:1734016104.169876:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016104.169878:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016104.169885:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27114776 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4df2 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.169895:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27114776 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4df2 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.169937:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27114776 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4df2 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016104.169950:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075140700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335228160:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016104.170015:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016104.176135:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.178354:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075140700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335228160:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016104.178382:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016104.178415:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333499520:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 8681us (9425us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016104.178424:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2829 00000100:00100000:0.0:1734016104.181891:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.189639:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.201928:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333500032 00000100:00100000:1.0:1734016104.201939:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333500032 00000100:00100000:1.0:1734016104.202004:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10444 00000100:00100000:1.0:1734016104.202013:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333500032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016104.202035:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016104.202054:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114799 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4e07 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016104.202127:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075140700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335228288:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016104.202221:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016104.205714:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075140700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335228288:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016104.205755:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114799 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e07 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.205776:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114799 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e07 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.205791:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d8c0, rc 0) 00000100:00100000:1.0:1734016104.206094:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333500032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4080us (4428us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016104.206103:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10444 00000100:00100000:0.0:1734016104.210603:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.210762:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333500160 00000100:00100000:1.0:1734016104.210774:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333500160 00000100:00100000:1.0:1734016104.210868:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10445 00000100:00100000:1.0:1734016104.210875:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333500160:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016104.210898:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016104.210919:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc271147a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4e0e expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016104.210988:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075140700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335228416:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016104.211052:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016104.215395:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075140700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335228416:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016104.215441:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc271147a0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e0e expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.215457:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc271147a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e0e expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.215988:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016104.216084:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333500160:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5208us (5491us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016104.216095:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10445 00000100:00100000:0.0:1734016104.237889:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333500288 00000100:00100000:0.0:1734016104.237905:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333500288 00000100:00100000:0.0:1734016104.237983:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10446 00000100:00100000:0.0:1734016104.237990:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333500288:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016104.238011:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016104.238036:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc271147a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4e15 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016104.238095:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335228544:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016104.238199:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eec00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016104.248705:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333500416 00000100:00100000:0.0:1734016104.248713:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333500416 00000100:00100000:0.0:1734016104.248772:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10447 00000100:00100000:0.0:1734016104.248780:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333500416:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016104.248830:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016104.248854:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc271147ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4e1c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016104.248911:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335228672:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016104.248982:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016104.257901:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.267021:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.272767:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.273469:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333500800 00000100:00100000:0.0:1734016104.273478:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333500800 00010000:00010000:0.0:1734016104.273504:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27114776 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4df2 expref: 7 pid: 7684 timeout: 471 lvb_type: 0 00000100:00100000:0.0:1734016104.273536:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2830 00000100:00100000:0.0:1734016104.273542:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333500800:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016104.273556:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016104.273581:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27114776 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4df2 expref: 7 pid: 7684 timeout: 471 lvb_type: 0 00010000:00010000:0.0:1734016104.273598:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27114776 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4df2 expref: 7 pid: 7684 timeout: 471 lvb_type: 0 00010000:00010000:0.0:1734016104.273628:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27114776 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4df2 expref: 7 pid: 7684 timeout: 471 lvb_type: 0 00010000:00010000:0.0:1734016104.273656:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016104.273658:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016104.273664:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271147bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6451200->6455295) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e2a expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016104.273674:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271147bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6451200->6455295) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e2a expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016104.273700:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271147bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6451200->6455295) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e2a expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016104.273713:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335229056:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016104.273759:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016104.278432:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.282769:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.286993:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.295146:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.299957:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.304346:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.309038:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.312485:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.317366:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.322400:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.322635:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333503360:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016104.322892:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333503360:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 255us (501us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016104.322899:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8153 00002000:00100000:3.0:1734016104.322904:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (6414336->6418431) req@ffff8800a78cf800 x1818247333503360/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/4536 e 0 to 0 dl 1734016115 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.322910:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cf800 with x1818247333503360 ext(6414336->6418431) 00002000:00010000:3.0:1734016104.322912:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cf800 00000100:00100000:0.0:1734016104.327649:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.331941:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.332042:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333503872 00000100:00100000:3.0:1734016104.332053:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333503872 00002000:00100000:3.0:1734016104.332094:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (6406144->6410239) req@ffff880075141c00 x1818247333503872/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/0 e 0 to 0 dl 1734016115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.332105:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075141c00 with x1818247333503872 ext(6406144->6410239) 00002000:00010000:3.0:1734016104.332111:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075141c00 00000100:00100000:3.0:1734016104.332188:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8155 00000100:00100000:3.0:1734016104.332196:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333503872:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016104.332369:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333503872:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 172us (440us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016104.332375:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8155 00002000:00100000:3.0:1734016104.332380:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (6406144->6410239) req@ffff880075141c00 x1818247333503872/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/4536 e 0 to 0 dl 1734016115 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.332386:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075141c00 with x1818247333503872 ext(6406144->6410239) 00002000:00010000:3.0:1734016104.332388:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075141c00 00000100:00100000:0.0:1734016104.335797:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.340249:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.340395:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333504384 00000100:00100000:3.0:1734016104.340414:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333504384 00002000:00100000:3.0:1734016104.340484:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (6397952->6402047) req@ffff8800a78cfb80 x1818247333504384/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/0 e 0 to 0 dl 1734016115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.340499:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cfb80 with x1818247333504384 ext(6397952->6402047) 00002000:00010000:3.0:1734016104.340507:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cfb80 00000100:00100000:3.0:1734016104.340558:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8157 00000100:00100000:3.0:1734016104.340567:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333504384:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016104.340880:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333504384:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 310us (647us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016104.340889:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8157 00002000:00100000:3.0:1734016104.340895:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (6397952->6402047) req@ffff8800a78cfb80 x1818247333504384/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/4536 e 0 to 0 dl 1734016115 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.340902:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cfb80 with x1818247333504384 ext(6397952->6402047) 00002000:00010000:3.0:1734016104.340905:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cfb80 00000100:00100000:1.0:1734016104.344230:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.352318:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.352434:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333504896 00000100:00100000:3.0:1734016104.352444:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333504896 00002000:00100000:3.0:1734016104.352500:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (6455296->6459391) req@ffff88012e719c00 x1818247333504896/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/0 e 0 to 0 dl 1734016115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.352512:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e719c00 with x1818247333504896 ext(6455296->6459391) 00002000:00010000:3.0:1734016104.352519:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e719c00 00000100:00100000:3.0:1734016104.352557:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8159 00000100:00100000:3.0:1734016104.352563:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333504896:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016104.352754:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333504896:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 190us (448us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016104.352765:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8159 00002000:00100000:3.0:1734016104.352771:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (6455296->6459391) req@ffff88012e719c00 x1818247333504896/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/4536 e 0 to 0 dl 1734016115 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.352777:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e719c00 with x1818247333504896 ext(6455296->6459391) 00002000:00010000:3.0:1734016104.352780:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e719c00 00000100:00100000:0.0:1734016104.360767:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.368689:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333505024:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 7595us (7919us total) trans 4294969264 rc 0/0 00000100:00100000:0.0:1734016104.368706:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8160 00002000:00100000:0.0:1734016104.368724:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6393856->6459391) req@ffff88012e719500 x1818247333505024/t4294969264(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/448 e 0 to 0 dl 1734016115 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016104.368734:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e719500 with x1818247333505024 ext(6393856->6459391) 00002000:00010000:0.0:1734016104.368741:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e719500 00000100:00100000:0.0:1734016104.383897:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.384071:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333505152 00000100:00100000:3.0:1734016104.384080:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333505152 00000100:00100000:3.0:1734016104.385057:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2053 00000100:00100000:3.0:1734016104.385070:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333505152:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:3.0:1734016104.386751:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333505152:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 1676us (2858us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016104.386762:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2053 00000100:00100000:1.0:1734016104.391236:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.391452:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333505280 00000100:00100000:3.0:1734016104.391467:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333505280 00000100:00100000:3.0:1734016104.391549:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10450 00000100:00100000:3.0:1734016104.391559:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333505280:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016104.393425:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969264 is committed 00000001:00080000:0.0:1734016104.393446:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969263 is committed 00000100:00100000:3.0:1734016104.393949:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333505280:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2382us (2716us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016104.393965:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10450 00000100:00100000:1.0:1734016104.405521:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.405619:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333505536 00000100:00100000:0.0:1734016104.405632:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333505536 00002000:00100000:0.0:1734016104.405699:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3366912->3371007) req@ffff880075141f80 x1818247333505536/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/0 e 0 to 0 dl 1734016115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016104.405709:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075141f80 with x1818247333505536 ext(3366912->3371007) 00002000:00010000:0.0:1734016104.405716:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075141f80 00000100:00100000:0.0:1734016104.405758:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8161 00000100:00100000:0.0:1734016104.405766:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333505536:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016104.406036:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333505536:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 269us (525us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016104.406044:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8161 00002000:00100000:0.0:1734016104.406050:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3366912->3371007) req@ffff880075141f80 x1818247333505536/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/4536 e 0 to 0 dl 1734016115 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016104.406057:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075141f80 with x1818247333505536 ext(3366912->3371007) 00002000:00010000:0.0:1734016104.406059:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075141f80 00000100:00100000:0.0:1734016104.414997:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.415309:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333505792 00000100:00100000:3.0:1734016104.415322:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333505792 00002000:00100000:3.0:1734016104.415371:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3362816->3366911) req@ffff88012e71b800 x1818247333505792/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/0 e 0 to 0 dl 1734016115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.415386:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71b800 with x1818247333505792 ext(3362816->3366911) 00002000:00010000:3.0:1734016104.415392:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e71b800 00000100:00100000:3.0:1734016104.415420:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8162 00000100:00100000:3.0:1734016104.415429:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333505792:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016104.418566:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333505792:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 3112us (3557us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016104.418590:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8162 00002000:00100000:3.0:1734016104.418611:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3362816->3366911) req@ffff88012e71b800 x1818247333505792/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/4536 e 0 to 0 dl 1734016115 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.418623:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71b800 with x1818247333505792 ext(3362816->3366911) 00002000:00010000:3.0:1734016104.418632:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e71b800 00000100:00100000:0.0:1734016104.424669:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.424945:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333506048 00000100:00100000:3.0:1734016104.424958:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333506048 00002000:00100000:3.0:1734016104.425021:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3358720->3362815) req@ffff88012e718e00 x1818247333506048/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/0 e 0 to 0 dl 1734016115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.425032:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e718e00 with x1818247333506048 ext(3358720->3362815) 00002000:00010000:3.0:1734016104.425039:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e718e00 00000100:00100000:3.0:1734016104.425095:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8163 00000100:00100000:3.0:1734016104.425103:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333506048:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016104.425581:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333506048:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 477us (929us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016104.425588:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8163 00002000:00100000:3.0:1734016104.425593:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3358720->3362815) req@ffff88012e718e00 x1818247333506048/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/4536 e 0 to 0 dl 1734016115 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.425599:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e718e00 with x1818247333506048 ext(3358720->3362815) 00002000:00010000:3.0:1734016104.425602:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e718e00 00000100:00100000:1.0:1734016104.431875:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.432031:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333506304 00000100:00100000:3.0:1734016104.432044:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333506304 00002000:00100000:3.0:1734016104.432102:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3354624->3358719) req@ffff880073944700 x1818247333506304/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/0 e 0 to 0 dl 1734016115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.432115:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073944700 with x1818247333506304 ext(3354624->3358719) 00002000:00010000:3.0:1734016104.432123:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073944700 00000100:00100000:3.0:1734016104.432167:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8164 00000100:00100000:3.0:1734016104.432176:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333506304:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016104.432413:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333506304:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 236us (552us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016104.432420:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8164 00002000:00100000:3.0:1734016104.432428:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3354624->3358719) req@ffff880073944700 x1818247333506304/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/4536 e 0 to 0 dl 1734016115 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.432434:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073944700 with x1818247333506304 ext(3354624->3358719) 00002000:00010000:3.0:1734016104.432436:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073944700 00000100:00100000:1.0:1734016104.437703:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.437796:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333506560 00000100:00100000:0.0:1734016104.437857:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333506560 00002000:00100000:0.0:1734016104.437922:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3350528->3354623) req@ffff880073947b80 x1818247333506560/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/0 e 0 to 0 dl 1734016115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016104.437936:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073947b80 with x1818247333506560 ext(3350528->3354623) 00002000:00010000:0.0:1734016104.437943:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073947b80 00000100:00100000:0.0:1734016104.438040:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8165 00000100:00100000:0.0:1734016104.438047:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333506560:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016104.438267:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333506560:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 220us (573us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016104.438276:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8165 00002000:00100000:0.0:1734016104.438282:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3350528->3354623) req@ffff880073947b80 x1818247333506560/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/4536 e 0 to 0 dl 1734016115 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016104.438289:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073947b80 with x1818247333506560 ext(3350528->3354623) 00002000:00010000:0.0:1734016104.438292:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073947b80 00000100:00100000:0.0:1734016104.442915:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.443122:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333506816 00000100:00100000:3.0:1734016104.443132:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333506816 00002000:00100000:3.0:1734016104.443189:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3346432->3350527) req@ffff88012e71b100 x1818247333506816/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/0 e 0 to 0 dl 1734016115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.443198:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71b100 with x1818247333506816 ext(3346432->3350527) 00002000:00010000:3.0:1734016104.443203:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e71b100 00000100:00100000:3.0:1734016104.443228:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8166 00000100:00100000:3.0:1734016104.443236:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333506816:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016104.443417:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333506816:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 183us (514us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016104.443423:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8166 00002000:00100000:3.0:1734016104.443428:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3346432->3350527) req@ffff88012e71b100 x1818247333506816/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/4536 e 0 to 0 dl 1734016115 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.443434:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71b100 with x1818247333506816 ext(3346432->3350527) 00002000:00010000:3.0:1734016104.443436:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e71b100 00000100:00100000:1.0:1734016104.447744:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.447853:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333507072 00000100:00100000:0.0:1734016104.447865:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333507072 00002000:00100000:0.0:1734016104.447918:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3342336->3346431) req@ffff880073945f80 x1818247333507072/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/0 e 0 to 0 dl 1734016115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016104.447929:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073945f80 with x1818247333507072 ext(3342336->3346431) 00002000:00010000:0.0:1734016104.447935:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073945f80 00000100:00100000:0.0:1734016104.447970:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8167 00000100:00100000:0.0:1734016104.447978:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333507072:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016104.448165:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333507072:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 186us (432us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016104.448171:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8167 00002000:00100000:0.0:1734016104.448177:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3342336->3346431) req@ffff880073945f80 x1818247333507072/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/4536 e 0 to 0 dl 1734016115 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016104.448184:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073945f80 with x1818247333507072 ext(3342336->3346431) 00002000:00010000:0.0:1734016104.448187:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073945f80 00000100:00100000:1.0:1734016104.451234:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.451659:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333507328 00000100:00100000:3.0:1734016104.451671:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333507328 00002000:00100000:3.0:1734016104.451724:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3338240->3342335) req@ffff88007546f480 x1818247333507328/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/0 e 0 to 0 dl 1734016115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.451736:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007546f480 with x1818247333507328 ext(3338240->3342335) 00002000:00010000:3.0:1734016104.451744:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007546f480 00000100:00100000:3.0:1734016104.451830:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8168 00000100:00100000:3.0:1734016104.451843:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007546f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333507328:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016104.452072:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007546f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333507328:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 230us (860us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016104.452078:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8168 00002000:00100000:3.0:1734016104.452083:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3338240->3342335) req@ffff88007546f480 x1818247333507328/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/4536 e 0 to 0 dl 1734016115 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.452090:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007546f480 with x1818247333507328 ext(3338240->3342335) 00002000:00010000:3.0:1734016104.452092:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007546f480 00000100:00100000:1.0:1734016104.464460:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.464783:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333507584 00000100:00100000:0.0:1734016104.464794:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333507584 00002000:00100000:0.0:1734016104.464887:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3334144->3338239) req@ffff88007546f800 x1818247333507584/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/0 e 0 to 0 dl 1734016115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016104.464897:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007546f800 with x1818247333507584 ext(3334144->3338239) 00002000:00010000:0.0:1734016104.464903:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007546f800 00000100:00100000:0.0:1734016104.464943:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8169 00000100:00100000:0.0:1734016104.464951:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007546f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333507584:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016104.465171:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007546f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333507584:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 219us (725us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016104.465178:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8169 00002000:00100000:0.0:1734016104.465183:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3334144->3338239) req@ffff88007546f800 x1818247333507584/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/4536 e 0 to 0 dl 1734016115 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016104.465192:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007546f800 with x1818247333507584 ext(3334144->3338239) 00002000:00010000:0.0:1734016104.465194:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007546f800 00000100:00100000:1.0:1734016104.469619:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.469720:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333507840 00000100:00100000:3.0:1734016104.469731:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333507840 00002000:00100000:3.0:1734016104.469770:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3330048->3334143) req@ffff88007546fb80 x1818247333507840/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/0 e 0 to 0 dl 1734016115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.469779:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007546fb80 with x1818247333507840 ext(3330048->3334143) 00002000:00010000:3.0:1734016104.469784:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007546fb80 00000100:00100000:3.0:1734016104.469839:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8170 00000100:00100000:3.0:1734016104.469846:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007546fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333507840:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016104.469998:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007546fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333507840:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 151us (389us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016104.470006:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8170 00002000:00100000:3.0:1734016104.470011:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3330048->3334143) req@ffff88007546fb80 x1818247333507840/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/4536 e 0 to 0 dl 1734016115 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.470018:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007546fb80 with x1818247333507840 ext(3330048->3334143) 00002000:00010000:3.0:1734016104.470020:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007546fb80 00000100:00100000:0.0:1734016104.472488:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.472609:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333508096 00000100:00100000:3.0:1734016104.472620:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333508096 00002000:00100000:3.0:1734016104.472664:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3325952->3330047) req@ffff88012e71b480 x1818247333508096/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/0 e 0 to 0 dl 1734016115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.472672:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71b480 with x1818247333508096 ext(3325952->3330047) 00002000:00010000:3.0:1734016104.472679:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e71b480 00000100:00100000:3.0:1734016104.472711:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8171 00000100:00100000:3.0:1734016104.472716:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333508096:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016104.472929:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333508096:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 210us (452us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016104.472938:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8171 00002000:00100000:3.0:1734016104.472943:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3325952->3330047) req@ffff88012e71b480 x1818247333508096/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/4536 e 0 to 0 dl 1734016115 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.472948:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71b480 with x1818247333508096 ext(3325952->3330047) 00002000:00010000:3.0:1734016104.472950:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e71b480 00000100:00100000:1.0:1734016104.476482:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.476794:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333508352 00000100:00100000:3.0:1734016104.476851:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333508352 00002000:00100000:3.0:1734016104.476920:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3321856->3325951) req@ffff88007546ca80 x1818247333508352/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/0 e 0 to 0 dl 1734016115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.476932:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007546ca80 with x1818247333508352 ext(3321856->3325951) 00002000:00010000:3.0:1734016104.476938:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007546ca80 00000100:00100000:3.0:1734016104.476972:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8172 00000100:00100000:3.0:1734016104.476981:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007546ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333508352:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016104.477231:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007546ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333508352:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 249us (764us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016104.477241:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8172 00002000:00100000:3.0:1734016104.477247:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3321856->3325951) req@ffff88007546ca80 x1818247333508352/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/4536 e 0 to 0 dl 1734016115 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.477254:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007546ca80 with x1818247333508352 ext(3321856->3325951) 00002000:00010000:3.0:1734016104.477257:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007546ca80 00000100:00100000:1.0:1734016104.485929:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.486236:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333508608 00000100:00100000:0.0:1734016104.486249:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333508608 00002000:00100000:0.0:1734016104.486300:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3317760->3321855) req@ffff88007546ce00 x1818247333508608/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/0 e 0 to 0 dl 1734016115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016104.486312:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007546ce00 with x1818247333508608 ext(3317760->3321855) 00002000:00010000:0.0:1734016104.486318:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007546ce00 00000100:00100000:0.0:1734016104.486353:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8173 00000100:00100000:0.0:1734016104.486359:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007546ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333508608:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016104.486522:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007546ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333508608:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 162us (603us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016104.486530:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8173 00002000:00100000:0.0:1734016104.486536:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3317760->3321855) req@ffff88007546ce00 x1818247333508608/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/4536 e 0 to 0 dl 1734016115 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016104.486543:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007546ce00 with x1818247333508608 ext(3317760->3321855) 00002000:00010000:0.0:1734016104.486546:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007546ce00 00000100:00100000:1.0:1734016104.494753:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.495785:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333508864 00000100:00100000:3.0:1734016104.495815:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333508864 00002000:00100000:3.0:1734016104.495874:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3313664->3317759) req@ffff88012b15c380 x1818247333508864/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:65/0 lens 488/0 e 0 to 0 dl 1734016115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016104.495892:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15c380 with x1818247333508864 ext(3313664->3317759) 00002000:00010000:3.0:1734016104.495901:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15c380 00000100:00100000:3.0:1734016104.495936:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8174 00000100:00100000:3.0:1734016104.495943:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333508864:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016104.512985:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.513095:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333508992 00000100:00100000:3.0:1734016104.513102:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333508992 00000100:00100000:3.0:1734016104.513721:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10451 00000100:00100000:3.0:1734016104.513734:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333508992:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016104.513758:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016104.513782:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271147c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4e31 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016104.513904:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335229184:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016104.514005:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbb40 going to sleep for 11 seconds 00002000:00010000:3.0:1734016104.518089:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016104 -> 1734016105 00002000:00010000:3.0:1734016104.518103:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 1208 -> 1336 00000100:00100000:3.0:1734016104.518128:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335229184:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016104.518184:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271147c3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e31 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016104.518200:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271147c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e31 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016104.519018:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016104.520958:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333508992:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6066us (6823us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016104.520972:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10451 00000100:00100000:1.0:1734016104.522789:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.523071:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333509120 00000100:00100000:3.0:1734016104.523080:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333509120 00000100:00100000:3.0:1734016104.525251:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10452 00000100:00100000:3.0:1734016104.525262:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333509120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016104.525284:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016104.525300:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271147ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4e38 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016104.525360:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335229312:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016104.525447:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016104.529128:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335229312:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016104.529177:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271147ca lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e38 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016104.529192:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271147ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e38 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016104.529219:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016104.529286:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333509120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4024us (6506us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016104.529296:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10452 00000100:00100000:1.0:1734016104.533017:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.533076:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333509376 00000100:00100000:3.0:1734016104.533085:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333509376 00000100:00100000:3.0:1734016104.533677:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2054 00000100:00100000:3.0:1734016104.533687:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+29:9668:x1818247333509376:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016104.533771:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016104.534436:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114784 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4df9 expref: 29 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.534527:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016104.534532:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016104.534780:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271147d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016104.534797:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114792 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e00 expref: 17 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.534985:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271147d1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016104.535028:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114792 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e00 expref: 17 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.535042:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114792 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e00 expref: 17 pid: 13956 timeout: 471 lvb_type: 0 00000100:00100000:3.0:1734016104.535058:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335229440:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016104.535892:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016104.538290:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335229440:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016104.538322:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271147d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016104.539953:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1734016104.541360:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271147d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016104.541370:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271147d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:3.0:1734016104.541476:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968624 00000004:00010000:3.0:1734016104.541532:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012b15fb80 reply state ffff880073a04000 transno 4294968625 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271147d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:3.0:1734016104.541541:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016104.541633:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+31:9668:x1818247333509376:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 7946us (8626us total) trans 4294968625 rc 0/0 00000100:00100000:3.0:1734016104.541642:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2054 00000020:00080000:3.0:1734016104.541647:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016104.544567:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.548517:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333509632 00000100:00100000:3.0:1734016104.548530:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333509632 00000100:00100000:3.0:1734016104.548607:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10453 00000100:00100000:3.0:1734016104.548615:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333509632:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016104.548634:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016104.548655:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271147d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4e3f expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.548690:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271147bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6451200->6455295) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e2a expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.548698:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016104.548701:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016104.548705:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271147d8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e3f expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.548740:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271147bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6451200->6455295) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e2a expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.548755:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271147bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6451200->6455295) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e2a expref: 6 pid: 7684 timeout: 471 lvb_type: 0 00000100:00100000:3.0:1734016104.548768:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335229568:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016104.548881:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016104.551173:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335229568:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016104.551239:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271147d8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e3f expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.551267:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016104.551342:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333509632:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2725us (6788us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016104.551353:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10453 00000100:00100000:0.0:1734016104.553112:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.559056:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.560374:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333509888 00000100:00100000:3.0:1734016104.560387:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333509888 00002000:00010000:3.0:1734016104.562141:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (7215853->18446744073709551615) 00002000:00100000:3.0:1734016104.562166:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15dc00 with x1818247333509888 ext(7215853->18446744073709551615) 00002000:00010000:3.0:1734016104.562182:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15dc00. 00000100:00100000:3.0:1734016104.562248:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8175 00000100:00100000:3.0:1734016104.562258:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333509888:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016104.562601:0:14005:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 6964105 -> 7215853 00002000:00010000:3.0:1734016104.562607:0:14005:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016104 -> 1734016105 00002000:00010000:3.0:1734016104.562609:0:14005:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016105 -> 1734016104 00002000:00010000:3.0:1734016104.562611:0:14005:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016104 -> 1734016105 00002000:00010000:3.0:1734016104.562613:0:14005:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1336 -> 1336 00000100:00100000:3.0:1734016104.562704:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333509888:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 447us (3652us total) trans 4294969265 rc 0/0 00000100:00100000:3.0:1734016104.562714:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8175 00002000:00010000:3.0:1734016104.562717:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (7215853->18446744073709551615) 00002000:00100000:3.0:1734016104.562719:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15dc00 with x1818247333509888 ext(7215853->18446744073709551615) 00002000:00010000:3.0:1734016104.562723:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15dc00. 00000100:00100000:1.0:1734016104.567038:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.567125:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333510016 00000100:00100000:3.0:1734016104.567133:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333510016 00000100:00100000:3.0:1734016104.567196:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2055 00000100:00100000:3.0:1734016104.567203:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+30:9668:x1818247333510016:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016104.567225:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016104.567244:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc271147df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4e46 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.567334:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271147e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016104.567348:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271147e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016104.567359:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271147e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:3.0:1734016104.567385:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 7215853 00000004:00200000:3.0:1734016104.567391:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016104.567406:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271147e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016104.567428:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc271147df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e46 expref: 32 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.567449:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271147e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e46 expref: 31 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.567457:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016104.567460:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016104.567464:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016104.567524:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+31:9668:x1818247333510016:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 320us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016104.567532:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2055 00000100:00100000:1.0:1734016104.571577:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333510272 00000100:00100000:1.0:1734016104.571591:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333510272 00000100:00100000:1.0:1734016104.571961:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8176 00000100:00100000:1.0:1734016104.571967:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333510272:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:1.0:1734016104.572008:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc271147ed lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.572027:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271147d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e3f expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.572034:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016104.572035:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016104.572038:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc271147ed lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5234688->5271551] (req 5234688->5271551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.572074:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271147d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e3f expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.572087:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271147d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e3f expref: 7 pid: 7684 timeout: 471 lvb_type: 0 00000100:00100000:1.0:1734016104.572103:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335229824:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016104.572190:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016104.580866:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.590714:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.590843:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333510528 00000100:00100000:3.0:1734016104.590854:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333510528 00000100:00100000:3.0:1734016104.590892:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10454 00000100:00100000:3.0:1734016104.590899:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333510528:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016104.590918:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016104.590937:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271147f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4e4d expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1734016104.590962:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 7215853, mtime: 0x675afc69, atime: 0x675afc68, ctime: 0x675afc69, blocks: 0x538 00010000:00010000:3.0:1734016104.590982:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016104.590985:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016104.590992:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271147f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e4d expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016104.591009:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271147f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e4d expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016104.591019:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4480, rc 0) 00000100:00100000:3.0:1734016104.591071:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333510528:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 172us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016104.591076:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10454 00000100:00100000:1.0:1734016104.600963:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.605866:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.605970:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333510784 00000100:00100000:1.0:1734016104.605980:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333510784 00000100:00100000:1.0:1734016104.606037:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10455 00000100:00100000:1.0:1734016104.606047:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333510784:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016104.606079:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016104.606102:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27114809 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4e5b expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.606133:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016104.606135:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016104.606153:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27114809 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e5b expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.606169:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27114809 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e5b expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.606179:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016104.606247:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333510784:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 201us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016104.606254:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10455 00000100:00100000:1.0:1734016104.613093:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.613268:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333510912 00000100:00100000:3.0:1734016104.613281:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333510912 00000100:00100000:3.0:1734016104.613347:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10456 00000100:00100000:3.0:1734016104.613357:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333510912:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016104.613390:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016104.613423:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114810 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4e62 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.613465:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271147f4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e4d expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016104.613478:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27114809 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e5b expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016104.613485:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016104.613487:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016104.613491:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114810 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [376832->421887] (req 376832->421887) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e62 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.613546:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27114809 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e5b expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016104.613559:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27114809 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e5b expref: 6 pid: 7683 timeout: 471 lvb_type: 1 00000100:00100000:3.0:1734016104.613573:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335229952:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016104.613681:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271147f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e4d expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016104.613689:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271147f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e4d expref: 8 pid: 7684 timeout: 471 lvb_type: 1 00000100:00100000:3.0:1734016104.613697:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335230080:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016104.613717:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016104.622695:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335229952:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016104.622714:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335230080:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016104.622751:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114810 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [376832->421887] (req 376832->421887) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e62 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.622770:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4b40, rc 0) 00000100:00100000:3.0:1734016104.622848:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:9668:x1818247333510912:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9492us (9769us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016104.622860:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10456 00000100:00100000:0.0:1734016104.623905:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.623957:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.624220:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2835 00000100:00100000:3.0:1734016104.624225:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333511168:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016104.624231:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016104.624239:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27114809 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e5b expref: 7 pid: 7683 timeout: 471 lvb_type: 1 00010000:00010000:3.0:1734016104.624248:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27114809 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e5b expref: 7 pid: 7683 timeout: 471 lvb_type: 1 00010000:00010000:3.0:1734016104.624260:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27114809 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e5b expref: 7 pid: 7683 timeout: 471 lvb_type: 1 00010000:00010000:3.0:1734016104.624271:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016104.624273:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016104.624279:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 376832->421887) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e62 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.624289:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 376832->421887) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e62 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.624319:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 376832->421887) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e62 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016104.624331:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335230208:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016104.624367:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016104.627865:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335230208:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016104.627887:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016104.627933:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333511168:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3706us (3973us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016104.627943:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2835 00000100:00100000:0.0:1734016104.628904:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333511296 00000100:00100000:0.0:1734016104.628915:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333511296 00000100:00100000:0.0:1734016104.629936:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10457 00000100:00100000:0.0:1734016104.629945:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333511296:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016104.630213:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7215853 -> 7215853 00002000:00010000:0.0:1734016104.630216:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016105 -> 1734016105 00002000:00010000:0.0:1734016104.630218:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016104 -> 1734016104 00002000:00010000:0.0:1734016104.630220:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016105 -> 1734016104 00002000:00010000:0.0:1734016104.630223:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1336 -> 1424 00000100:00100000:0.0:1734016104.630283:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333511296:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 339us (2549us total) trans 4294969266 rc 0/0 00000100:00100000:0.0:1734016104.630291:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10457 00000100:00100000:0.0:1734016104.632775:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.633188:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333511424 00000100:00100000:1.0:1734016104.633200:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333511424 00000100:00100000:1.0:1734016104.633310:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10458 00000100:00100000:1.0:1734016104.633317:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333511424:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016104.633337:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016104.633354:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27114817 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4e69 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016104.633407:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335230336:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016104.633661:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00002000:00010000:1.0:1734016104.635795:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016104 -> 1734016105 00002000:00010000:1.0:1734016104.635922:0:7683:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016104 -> 1734016105 00000100:00100000:1.0:1734016104.635942:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335230336:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016104.635972:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27114817 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e69 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.635984:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27114817 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e69 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.636036:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016104.636171:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333511424:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2853us (3404us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016104.636180:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10458 00000100:00100000:1.0:1734016104.639453:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333511552 00000100:00100000:1.0:1734016104.639467:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333511552 00000100:00100000:1.0:1734016104.639524:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10459 00000100:00100000:1.0:1734016104.639532:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333511552:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016104.639551:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016104.639569:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711481e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4e70 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016104.639638:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335230464:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016104.639715:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016104.641902:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335230464:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016104.641951:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711481e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e70 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.641966:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711481e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e70 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.641978:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016104.642050:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333511552:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2517us (2708us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016104.642059:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10459 00000100:00100000:1.0:1734016104.646547:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333511680 00000100:00100000:1.0:1734016104.646561:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333511680 00000100:00100000:1.0:1734016104.646676:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10460 00000100:00100000:1.0:1734016104.646682:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333511680:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016104.646703:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016104.646731:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27114825 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4e77 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016104.646834:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335230592:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016104.646914:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016104.650472:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335230592:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016104.650517:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27114825 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e77 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.650531:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27114825 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e77 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.651284:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016104.651384:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333511680:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4697us (4960us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016104.651395:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10460 00000100:00100000:0.0:1734016104.656187:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.656331:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333511808 00000100:00100000:1.0:1734016104.656344:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333511808 00000100:00100000:1.0:1734016104.656394:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10461 00000100:00100000:1.0:1734016104.656405:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333511808:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016104.656437:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016104.656462:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711482c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4e7e expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016104.656548:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335230720:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016104.656640:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016104.659006:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335230720:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016104.659045:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711482c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e7e expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.659057:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711482c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e7e expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.659593:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016104.659653:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333511808:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3248us (3477us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016104.659664:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10461 00000100:00100000:1.0:1734016104.663571:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333511936 00000100:00100000:1.0:1734016104.663580:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333511936 00000100:00100000:1.0:1734016104.663755:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10462 00000100:00100000:1.0:1734016104.663763:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333511936:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016104.663784:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016104.663819:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114833 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4e85 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.663849:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 376832->421887) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e62 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.663856:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016104.663858:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016104.663861:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114833 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1015808->1036287] (req 1015808->1036287) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e85 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.663890:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 376832->421887) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e62 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.663902:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 376832->421887) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e62 expref: 7 pid: 7684 timeout: 471 lvb_type: 0 00000100:00100000:1.0:1734016104.663915:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335230848:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016104.663987:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016104.668837:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335230848:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016104.669054:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333512064 00000100:00100000:3.0:1734016104.669060:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333512064 00010000:00010000:3.0:1734016104.669092:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 376832->421887) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e62 expref: 8 pid: 7684 timeout: 471 lvb_type: 0 00000100:00100000:3.0:1734016104.669133:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2836 00000100:00100000:3.0:1734016104.669140:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333512064:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016104.669161:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016104.669183:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 376832->421887) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e62 expref: 8 pid: 7684 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1734016104.669194:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 376832->421887) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e62 expref: 8 pid: 7684 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1734016104.669214:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114810 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 376832->421887) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e62 expref: 8 pid: 7684 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1734016104.669232:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016104.669234:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016104.669240:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114833 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1036287) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e85 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.669248:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114833 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1036287) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e85 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.669282:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114833 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1036287) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e85 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016104.669294:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335230976:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016104.669355:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbb40 going to sleep for 11 seconds 00010000:00010000:1.0:1734016104.670140:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114833 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1036287) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e85 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.670161:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499eac0, rc 0) 00000100:00100000:1.0:1734016104.670201:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333511936:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6437us (6864us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016104.670208:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10462 00000100:00100000:0.0:1734016104.677628:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.677739:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333512192 00000100:00100000:1.0:1734016104.677750:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333512192 00000100:00100000:1.0:1734016104.677826:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10463 00000100:00100000:1.0:1734016104.677836:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333512192:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016104.678131:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7215853 -> 7215853 00002000:00010000:1.0:1734016104.678135:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016105 -> 1734016104 00002000:00010000:1.0:1734016104.678137:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016105 -> 1734016104 00002000:00010000:1.0:1734016104.678139:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016105 -> 1734016104 00002000:00010000:1.0:1734016104.678141:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1424 -> 1424 00000100:00100000:1.0:1734016104.678266:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333512192:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 430us (652us total) trans 4294969267 rc 0/0 00000100:00100000:1.0:1734016104.678274:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10463 00000100:00100000:3.0:1734016104.679391:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335230976:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016104.679416:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016104.679455:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333512064:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 10314us (10749us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016104.679465:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2836 00000100:00100000:0.0:1734016104.686585:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333512320 00000100:00100000:0.0:1734016104.686596:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333512320 00000100:00100000:0.0:1734016104.686796:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10464 00000100:00100000:0.0:1734016104.686827:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333512320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016104.686846:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016104.686863:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc2711483a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4e8c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016104.686915:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335231104:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016104.686977:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eee40 going to sleep for 11 seconds 00002000:00010000:0.0:1734016104.689491:0:7684:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime: 1734016104 -> 1734016105 00002000:00010000:0.0:1734016104.689498:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016104 -> 1734016105 00002000:00010000:0.0:1734016104.689500:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016104 -> 1734016105 00000100:00100000:0.0:1734016104.689520:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335231104:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016104.689549:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc2711483a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e8c expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016104.689562:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc2711483a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e8c expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016104.690714:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:0.0:1734016104.690773:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333512320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3944us (4323us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016104.690783:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10464 00000100:00100000:0.0:1734016104.693389:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.697081:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335231232:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016104.697126:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114841 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e93 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016104.697140:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114841 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e93 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016104.697163:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:0.0:1734016104.697229:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333512448:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3020us (3847us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016104.697238:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10465 00000100:00100000:3.0:1734016104.702281:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.707421:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.707552:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333512832 00000100:00100000:3.0:1734016104.707560:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333512832 00010000:00010000:3.0:1734016104.707596:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114833 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1036287) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e85 expref: 9 pid: 7683 timeout: 471 lvb_type: 0 00000100:00100000:3.0:1734016104.707637:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2837 00000100:00100000:3.0:1734016104.707645:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333512832:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016104.707662:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016104.707687:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114833 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1015808->1036287) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e85 expref: 9 pid: 7683 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1734016104.707699:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114833 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1015808->1036287) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e85 expref: 9 pid: 7683 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1734016104.707728:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114833 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1015808->1036287) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e85 expref: 9 pid: 7683 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1734016104.707761:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016104.707764:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016104.707771:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114848 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [126976->147455] (req 126976->147455) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.707781:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114848 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [126976->147455] (req 126976->147455) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.707826:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016104.707875:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333512832:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 230us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016104.707882:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2837 00000100:00100000:0.0:1734016104.715946:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.721040:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.721179:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333513088 00000100:00100000:1.0:1734016104.721191:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333513088 00000100:00100000:1.0:1734016104.721286:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10467 00000100:00100000:1.0:1734016104.721296:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333513088:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016104.721319:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016104.721345:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114856 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4ea1 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.721374:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016104.721377:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016104.721389:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114856 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ea1 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.721405:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114856 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ea1 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.721416:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499eac0, rc 0) 00000100:00100000:1.0:1734016104.721702:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333513088:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 405us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016104.721710:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10467 00000100:00100000:0.0:1734016104.726065:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.726288:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333513216 00000100:00100000:1.0:1734016104.726298:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333513216 00000100:00100000:1.0:1734016104.726571:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10468 00000100:00100000:1.0:1734016104.726578:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:9668:x1818247333513216:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016104.726600:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016104.726625:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711485d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4ea8 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.726655:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc2711484f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e9a expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.726663:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114856 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ea1 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.726673:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016104.726675:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016104.726677:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711485d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ea8 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016104.726711:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114856 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ea1 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.726722:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114856 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ea1 expref: 9 pid: 7683 timeout: 471 lvb_type: 1 00000100:00100000:1.0:1734016104.726736:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335231488:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016104.726848:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc2711484f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e9a expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016104.726856:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc2711484f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e9a expref: 7 pid: 7684 timeout: 471 lvb_type: 1 00000100:00100000:1.0:1734016104.726864:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335231616:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016104.726878:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016104.732451:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.733153:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335231488:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016104.733170:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335231616:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016104.733212:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711485d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ea8 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016104.733215:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016104.733239:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016104.733292:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:9668:x1818247333513216:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6713us (7241us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016104.733301:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10468 00000100:00100000:3.0:1734016104.733316:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333513344 00000100:00100000:3.0:1734016104.733324:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333513344 00010000:00010000:3.0:1734016104.733559:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114856 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ea1 expref: 9 pid: 7683 timeout: 471 lvb_type: 1 00000100:00100000:3.0:1734016104.733578:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2839 00000100:00100000:3.0:1734016104.733582:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333513344:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016104.733594:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016104.733602:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114856 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ea1 expref: 9 pid: 7683 timeout: 471 lvb_type: 1 00010000:00010000:3.0:1734016104.733614:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114856 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ea1 expref: 9 pid: 7683 timeout: 471 lvb_type: 1 00010000:00010000:3.0:1734016104.733624:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27114856 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ea1 expref: 9 pid: 7683 timeout: 471 lvb_type: 1 00010000:00010000:3.0:1734016104.733642:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016104.733644:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016104.733650:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711485d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 299008->303103) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ea8 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.733657:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711485d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 299008->303103) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ea8 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.733687:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711485d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 299008->303103) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ea8 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016104.733700:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335231744:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016104.734081:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016104.741563:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335231744:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016104.741589:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016104.741637:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333513344:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 8052us (9198us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016104.741647:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2839 00000100:00100000:0.0:1734016104.756884:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.756937:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.760261:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8179 00000100:00100000:1.0:1734016104.760274:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333513984:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016104.820682:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333513984:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 60397us (63731us total) trans 0 rc 3022848/3022848 00000100:00100000:0.0:1734016104.820696:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8179 00002000:00100000:0.0:1734016104.820713:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (4194304->7217151) req@ffff880075fc7b80 x1818247333513984/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:65/0 lens 488/440 e 0 to 0 dl 1734016115 ref 1 fl Complete:/200/0 rc 3022848/3022848 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016104.820725:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7b80 with x1818247333513984 ext(4194304->7217151) 00002000:00010000:0.0:1734016104.820732:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc7b80 00000100:00100000:0.0:1734016104.859565:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333514112 00000100:00100000:0.0:1734016104.859575:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333514112 00002000:00100000:0.0:1734016104.859621:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (237568->303103) req@ffff88012b15c700 x1818247333514112/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:65/0 lens 488/0 e 0 to 0 dl 1734016115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016104.859630:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15c700 with x1818247333514112 ext(237568->303103) 00002000:00010000:0.0:1734016104.859635:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15c700 00000100:00100000:0.0:1734016104.859661:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8180 00000100:00100000:0.0:1734016104.859667:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333514112:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016104.867877:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333514240 00000100:00100000:3.0:1734016104.867886:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333514240 00000100:00100000:3.0:1734016104.867942:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2057 00000100:00100000:3.0:1734016104.867949:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+31:9668:x1818247333514240:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:3.0:1734016104.868395:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+31:9668:x1818247333514240:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 444us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016104.868402:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2057 00000100:00100000:1.0:1734016104.871725:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:0.0:1734016104.905177:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969268 is committed 00000001:00080000:0.0:1734016104.905199:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969267 is committed 00000100:00100000:0.0:1734016104.923232:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016104.941434:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.941517:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333514624 00000100:00100000:3.0:1734016104.941528:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333514624 00010000:00010000:3.0:1734016104.941561:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711485d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 299008->303103) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ea8 expref: 6 pid: 7683 timeout: 472 lvb_type: 0 00000100:00100000:3.0:1734016104.941593:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2840 00000100:00100000:3.0:1734016104.941600:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333514624:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016104.941618:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1734016104.941632:0:7698:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016104 -> 1734016105 00002000:00010000:3.0:1734016104.941635:0:7698:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016104 -> 1734016105 00002000:00010000:3.0:1734016104.941636:0:7698:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1424 -> 1480 00010000:00010000:3.0:1734016104.941644:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711485d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 299008->303103) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ea8 expref: 6 pid: 7683 timeout: 472 lvb_type: 0 00010000:00010000:3.0:1734016104.941655:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711485d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 299008->303103) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ea8 expref: 6 pid: 7683 timeout: 472 lvb_type: 0 00010000:00010000:3.0:1734016104.941679:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711485d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 299008->303103) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ea8 expref: 6 pid: 7683 timeout: 472 lvb_type: 0 00010000:00010000:3.0:1734016104.941698:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016104.941700:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016104.941705:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114864 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4579328->4587519) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4eaf expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.941713:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114864 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4579328->4587519) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4eaf expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.941741:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114864 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4579328->4587519) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4eaf expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016104.941756:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335232000:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016104.941831:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016104.945547:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.947100:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335232000:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016104.947121:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016104.948366:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333514624:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6765us (6938us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016104.948374:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2840 00000100:00100000:0.0:1734016104.957225:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.957327:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333515008 00000100:00100000:3.0:1734016104.957338:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333515008 00000100:00100000:3.0:1734016104.957406:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2058 00000100:00100000:3.0:1734016104.957413:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333515008:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016104.957468:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016104.957495:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27114802 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e54 expref: 18 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.957523:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016104.957527:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016104.957672:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711486b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016104.957685:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271147e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e46 expref: 30 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.957691:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711486b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016104.957717:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271147e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e46 expref: 30 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.957728:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271147e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e46 expref: 30 pid: 13956 timeout: 472 lvb_type: 0 00000100:00100000:3.0:1734016104.957740:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335232128:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016104.957830:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016104.960786:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335232128:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016104.960868:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711486b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016104.961400:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.961468:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333515136 00000100:00100000:3.0:1734016104.961476:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333515136 00010000:00010000:3.0:1734016104.961505:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271147e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e46 expref: 31 pid: 13956 timeout: 472 lvb_type: 0 00000100:00100000:3.0:1734016104.961542:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2841 00000100:00100000:3.0:1734016104.961550:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+31:1981:x1818247333515136:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016104.961563:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016104.961568:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271147e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e46 expref: 31 pid: 13956 timeout: 472 lvb_type: 0 00010000:00010000:3.0:1734016104.961577:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271147e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e46 expref: 31 pid: 13956 timeout: 472 lvb_type: 0 00010000:00010000:3.0:1734016104.961597:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271147e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4e46 expref: 31 pid: 13956 timeout: 472 lvb_type: 0 00010000:00010000:3.0:1734016104.961611:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016104.961616:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711486b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016104.961624:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711486b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016104.961630:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711486b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016104.961646:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016104.961698:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+30:1981:x1818247333515136:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 147us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016104.961705:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2841 00010000:00010000:0.0:1734016104.962503:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711486b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016104.962512:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711486b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:0.0:1734016104.962614:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968626 00000004:00010000:0.0:1734016104.962666:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075fc4700 reply state ffff880073a06000 transno 4294968627 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711486b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016104.962673:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016104.962780:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333515008:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 5364us (5562us total) trans 4294968627 rc 0/0 00000100:00100000:0.0:1734016104.962787:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2058 00000020:00080000:0.0:1734016104.962793:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016104.965707:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.969291:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333515264 00000100:00100000:3.0:1734016104.969304:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333515264 00002000:00010000:3.0:1734016104.969344:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (9267515->18446744073709551615) 00002000:00100000:3.0:1734016104.969348:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbc380 with x1818247333515264 ext(9267515->18446744073709551615) 00002000:00010000:3.0:1734016104.969361:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbc380. 00000100:00100000:3.0:1734016104.969390:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8181 00000100:00100000:3.0:1734016104.969396:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333515264:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016104.969619:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7215853 -> 9267515 00002000:00010000:3.0:1734016104.969623:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016105 -> 1734016105 00002000:00010000:3.0:1734016104.969625:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016104 -> 1734016104 00002000:00010000:3.0:1734016104.969627:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016105 -> 1734016105 00002000:00010000:3.0:1734016104.969628:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1480 -> 1480 00000100:00100000:3.0:1734016104.969690:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333515264:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 293us (3999us total) trans 4294969270 rc 0/0 00000100:00100000:3.0:1734016104.969697:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8181 00002000:00010000:3.0:1734016104.969700:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (9267515->18446744073709551615) 00002000:00100000:3.0:1734016104.969702:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbc380 with x1818247333515264 ext(9267515->18446744073709551615) 00002000:00010000:3.0:1734016104.969705:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbc380. 00000100:00100000:0.0:1734016104.976402:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.982575:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016104.992321:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016104.992431:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333515776 00000100:00100000:3.0:1734016104.992442:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333515776 00000100:00100000:3.0:1734016104.992495:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8182 00000100:00100000:3.0:1734016104.992502:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333515776:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:3.0:1734016104.992533:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114880 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.992552:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114864 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4579328->4587519) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4eaf expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.992558:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016104.992560:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016104.992563:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114880 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6365184->6381567] (req 6365184->6381567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.992593:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114864 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4579328->4587519) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4eaf expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.992607:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114864 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4579328->4587519) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4eaf expref: 10 pid: 7683 timeout: 472 lvb_type: 0 00000100:00100000:3.0:1734016104.992620:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335232256:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016104.994277:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016104.998677:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1734016104.999263:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114864 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4579328->4587519) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4eaf expref: 10 pid: 7683 timeout: 472 lvb_type: 0 00000100:00100000:3.0:1734016104.999406:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335232256:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016104.999434:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6365184->6381567] (req 6365184->6381567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.999446:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6365184->6381567] (req 6365184->6381567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016104.999452:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6365184->6381567] (req 6365184->6381567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016105.025651:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969272 is committed 00002000:00010000:3.0:1734016105.025864:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1480 -> 1512 00010000:00010000:3.0:1734016105.025881:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6365184->6381567] (req 6365184->6381567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.025891:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114880 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6365184->6381567] (req 6365184->6381567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.025905:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6365184->6381567] (req 6365184->6381567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.025912:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df5b00 already unused, calling callback (ffffffffa080e100) 00010000:00010000:3.0:1734016105.025917:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6365184->6381567] (req 6365184->6381567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.025924:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114880 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6365184->6381567] (req 6365184->6381567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.025945:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114880 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6365184->6381567] (req 6365184->6381567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.025951:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114880 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6365184->6381567] (req 6365184->6381567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016105.026054:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333515776:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 33546us (33735us total) trans 4294969272 rc 0/0 00000100:00100000:3.0:1734016105.026064:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8182 00000100:00100000:0.0:1734016105.033711:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:0.0:1734016105.034293:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016075 00000100:00100000:0.0:1734016105.039870:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.042998:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.043117:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333516416 00000100:00100000:1.0:1734016105.043131:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333516416 00000100:00100000:1.0:1734016105.043211:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2061 00000100:00100000:1.0:1734016105.043218:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333516416:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016105.043277:0:7704:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016105.043308:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27114879 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4eb6 expref: 20 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016105.043334:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016105.043339:0:7704:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016105.043528:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711489c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016105.043542:0:7704:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711488e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ebd expref: 30 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016105.043549:0:7704:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711489c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016105.043585:0:7704:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711488e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ebd expref: 30 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016105.043598:0:7704:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711488e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ebd expref: 30 pid: 13956 timeout: 472 lvb_type: 0 00000100:00100000:1.0:1734016105.043611:0:7704:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335232384:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016105.043687:0:7704:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00080000:0.0:1734016105.043932:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016075 00000100:00100000:1.0:1734016105.046355:0:7704:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335232384:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016105.046406:0:7704:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711489c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016105.047777:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016105.048415:0:7704:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711489c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016105.048423:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711489c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:1.0:1734016105.048556:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968628 00000004:00010000:1.0:1734016105.048619:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880073bbed80 reply state ffff880075daf000 transno 4294968629 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711489c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:1.0:1734016105.048627:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016105.048698:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+22:9668:x1818247333516416:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 5480us (5711us total) trans 4294968629 rc 0/0 00000100:00100000:1.0:1734016105.048705:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2061 00000020:00080000:1.0:1734016105.048708:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016105.051745:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:1.0:1734016105.052323:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016075 00000100:00100000:0.0:1734016105.058934:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.062176:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075874a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335232640:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016105.062199:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016105.062252:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333516800:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3121us (3330us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016105.062262:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2844 00000100:00100000:0.0:1734016105.063191:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.063255:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333516928 00000100:00100000:3.0:1734016105.063263:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333516928 00002000:00010000:3.0:1734016105.063302:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6876179->18446744073709551615) 00002000:00100000:3.0:1734016105.063306:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e606a00 with x1818247333516928 ext(6876179->18446744073709551615) 00002000:00010000:3.0:1734016105.063316:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e606a00. 00000100:00100000:3.0:1734016105.063346:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8183 00000100:00100000:3.0:1734016105.063352:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333516928:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016105.063869:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9267515 -> 6876179 00002000:00010000:3.0:1734016105.063872:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016105 -> 1734016105 00002000:00010000:3.0:1734016105.063874:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016104 -> 1734016104 00002000:00010000:3.0:1734016105.063875:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016105 -> 1734016105 00002000:00010000:3.0:1734016105.063877:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1512 -> 1456 00000100:00100000:3.0:1734016105.063910:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333516928:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 556us (721us total) trans 4294969273 rc 0/0 00000100:00100000:3.0:1734016105.063916:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8183 00002000:00010000:3.0:1734016105.063919:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6876179->18446744073709551615) 00002000:00100000:3.0:1734016105.063921:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e606a00 with x1818247333516928 ext(6876179->18446744073709551615) 00002000:00010000:3.0:1734016105.063925:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e606a00. 00000100:00100000:0.0:1734016105.066329:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.066419:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333517056 00000100:00100000:1.0:1734016105.066429:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333517056 00000100:00100000:1.0:1734016105.066490:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2062 00000100:00100000:1.0:1734016105.066498:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+30:9668:x1818247333517056:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016105.066520:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016105.066540:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499eac0/0x5e3a3adc271148aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4ed2 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016105.066629:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc271148b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016105.066642:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc271148b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016105.066652:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc271148b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:1.0:1734016105.066674:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 6876179 00000004:00200000:1.0:1734016105.066678:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016105.066699:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc271148b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016105.066719:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499eac0/0x5e3a3adc271148aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ed2 expref: 32 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016105.066749:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc271148b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ed2 expref: 31 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016105.066757:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016105.066759:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016105.066762:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016105.066838:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+31:9668:x1818247333517056:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 341us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016105.066845:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2062 00000100:00100000:0.0:1734016105.069050:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.082052:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.090575:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.097465:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.103492:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.104340:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333517696 00000100:00100000:3.0:1734016105.104346:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333517696 00010000:00010000:3.0:1734016105.104371:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271148a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ecb expref: 8 pid: 7684 timeout: 472 lvb_type: 0 00000100:00100000:3.0:1734016105.104395:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2845 00000100:00100000:3.0:1734016105.104401:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333517696:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016105.104413:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016105.104431:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271148a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ecb expref: 8 pid: 7684 timeout: 472 lvb_type: 0 00010000:00010000:3.0:1734016105.104442:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271148a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ecb expref: 8 pid: 7684 timeout: 472 lvb_type: 0 00010000:00010000:3.0:1734016105.104466:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271148a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ecb expref: 8 pid: 7684 timeout: 472 lvb_type: 0 00010000:00010000:3.0:1734016105.104492:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016105.104494:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016105.104501:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271148cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6320128->6324223) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4eee expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.104509:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271148cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6320128->6324223) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4eee expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.104545:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271148cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6320128->6324223) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4eee expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016105.104557:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335233280:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016105.104594:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016105.108237:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335233280:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016105.108262:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016105.108308:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333517696:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3905us (4826us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016105.108319:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2845 00000100:00100000:0.0:1734016105.108831:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.109760:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333517952 00000100:00100000:1.0:1734016105.109774:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333517952 00002000:00100000:1.0:1734016105.109851:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6320128->6324223) req@ffff88012e607b80 x1818247333517952/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016105.109859:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e607b80 with x1818247333517952 ext(6320128->6324223) 00002000:00010000:1.0:1734016105.109865:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e607b80 00000100:00100000:1.0:1734016105.110561:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8184 00000100:00100000:1.0:1734016105.110571:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333517952:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016105.110846:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333517952:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 275us (2015us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016105.110853:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8184 00002000:00100000:1.0:1734016105.110860:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (6320128->6324223) req@ffff88012e607b80 x1818247333517952/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/4536 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016105.110867:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e607b80 with x1818247333517952 ext(6320128->6324223) 00002000:00010000:1.0:1734016105.110871:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e607b80 00000100:00100000:0.0:1734016105.116601:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.117394:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333518208 00000100:00100000:3.0:1734016105.117406:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333518208 00002000:00100000:3.0:1734016105.117465:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6316032->6320127) req@ffff88012e607480 x1818247333518208/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.117474:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e607480 with x1818247333518208 ext(6316032->6320127) 00002000:00010000:3.0:1734016105.117480:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e607480 00000100:00100000:3.0:1734016105.117513:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8185 00000100:00100000:3.0:1734016105.117521:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333518208:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016105.118303:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333518208:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 778us (1711us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016105.118312:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8185 00002000:00100000:3.0:1734016105.118320:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6316032->6320127) req@ffff88012e607480 x1818247333518208/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/4536 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.118326:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e607480 with x1818247333518208 ext(6316032->6320127) 00002000:00010000:3.0:1734016105.118330:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e607480 00000100:00100000:0.0:1734016105.122931:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.123238:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333518464 00000100:00100000:3.0:1734016105.123249:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333518464 00002000:00100000:3.0:1734016105.123297:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6311936->6316031) req@ffff8800739e0a80 x1818247333518464/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.123308:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800739e0a80 with x1818247333518464 ext(6311936->6316031) 00002000:00010000:3.0:1734016105.123313:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800739e0a80 00000100:00100000:3.0:1734016105.123390:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8186 00000100:00100000:3.0:1734016105.123396:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333518464:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016105.123726:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333518464:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 327us (806us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016105.123736:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8186 00002000:00100000:3.0:1734016105.123742:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6311936->6316031) req@ffff8800739e0a80 x1818247333518464/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/4536 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.123748:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800739e0a80 with x1818247333518464 ext(6311936->6316031) 00002000:00010000:3.0:1734016105.123751:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800739e0a80 00000100:00100000:0.0:1734016105.127487:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.127701:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333518720 00000100:00100000:3.0:1734016105.127711:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333518720 00002000:00100000:3.0:1734016105.127768:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6307840->6311935) req@ffff8800739e0380 x1818247333518720/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.127778:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800739e0380 with x1818247333518720 ext(6307840->6311935) 00002000:00010000:3.0:1734016105.127784:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800739e0380 00000100:00100000:3.0:1734016105.127851:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8187 00000100:00100000:3.0:1734016105.127858:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800739e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333518720:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016105.128033:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800739e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333518720:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 174us (557us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016105.128040:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8187 00002000:00100000:3.0:1734016105.128046:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6307840->6311935) req@ffff8800739e0380 x1818247333518720/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/4536 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.128054:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800739e0380 with x1818247333518720 ext(6307840->6311935) 00002000:00010000:3.0:1734016105.128056:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800739e0380 00000100:00100000:1.0:1734016105.133402:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.137453:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.141611:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.146447:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.146678:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333519744 00000100:00100000:3.0:1734016105.146687:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333519744 00002000:00100000:3.0:1734016105.146727:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6291456->6295551) req@ffff880073b9d500 x1818247333519744/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.146743:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9d500 with x1818247333519744 ext(6291456->6295551) 00002000:00010000:3.0:1734016105.146750:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9d500 00000100:00100000:3.0:1734016105.146794:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8191 00000100:00100000:3.0:1734016105.146835:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333519744:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016105.147012:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333519744:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 177us (575us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016105.147019:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8191 00002000:00100000:3.0:1734016105.147025:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6291456->6295551) req@ffff880073b9d500 x1818247333519744/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/4536 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.147031:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9d500 with x1818247333519744 ext(6291456->6295551) 00002000:00010000:3.0:1734016105.147034:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9d500 00000100:00100000:0.0:1734016105.150035:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.154416:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.158116:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.158306:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333520512 00000100:00100000:3.0:1734016105.158316:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333520512 00002000:00100000:3.0:1734016105.158369:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6279168->6283263) req@ffff880073b9f100 x1818247333520512/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.158379:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9f100 with x1818247333520512 ext(6279168->6283263) 00002000:00010000:3.0:1734016105.158384:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9f100 00000100:00100000:3.0:1734016105.158424:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8194 00000100:00100000:3.0:1734016105.158432:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333520512:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016105.158583:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333520512:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 151us (480us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016105.158590:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8194 00002000:00100000:3.0:1734016105.158595:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6279168->6283263) req@ffff880073b9f100 x1818247333520512/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/4536 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.158602:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9f100 with x1818247333520512 ext(6279168->6283263) 00002000:00010000:3.0:1734016105.158605:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9f100 00000100:00100000:0.0:1734016105.163793:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.168869:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.172531:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.172766:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333521280 00000100:00100000:3.0:1734016105.172777:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333521280 00002000:00100000:3.0:1734016105.172852:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6266880->6270975) req@ffff880073b9e680 x1818247333521280/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.172862:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9e680 with x1818247333521280 ext(6266880->6270975) 00002000:00010000:3.0:1734016105.172868:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9e680 00000100:00100000:3.0:1734016105.172895:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8197 00000100:00100000:3.0:1734016105.172900:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333521280:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016105.173066:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333521280:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 164us (545us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016105.173073:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8197 00002000:00100000:3.0:1734016105.173077:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6266880->6270975) req@ffff880073b9e680 x1818247333521280/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/4536 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.173084:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9e680 with x1818247333521280 ext(6266880->6270975) 00002000:00010000:3.0:1734016105.173087:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9e680 00000100:00100000:1.0:1734016105.178660:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.184267:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.188110:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.193075:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.193456:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333521920 00000100:00100000:3.0:1734016105.193467:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333521920 00010000:00010000:3.0:1734016105.193511:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc271148b1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ed2 expref: 31 pid: 7704 timeout: 472 lvb_type: 0 00000100:00100000:3.0:1734016105.193548:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2846 00000100:00100000:3.0:1734016105.193555:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+31:1982:x1818247333521920:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016105.193575:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016105.193581:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc271148b1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ed2 expref: 31 pid: 7704 timeout: 472 lvb_type: 0 00010000:00010000:3.0:1734016105.193596:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc271148b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ed2 expref: 31 pid: 7704 timeout: 472 lvb_type: 0 00010000:00010000:3.0:1734016105.193623:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016105.193630:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271148e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016105.193639:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271148e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016105.193649:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271148e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016105.193675:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016105.193735:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+31:1982:x1818247333521920:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 178us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016105.193742:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2846 00000100:00100000:1.0:1734016105.202951:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.203035:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333522048 00000100:00100000:0.0:1734016105.203045:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333522048 00000100:00100000:0.0:1734016105.203103:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10480 00000100:00100000:0.0:1734016105.203110:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333522048:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016105.203131:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016105.203160:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271148f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4f03 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016105.203196:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271148cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6320128->6324223) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4eee expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016105.203207:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271148e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4efc expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016105.203214:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016105.203216:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016105.203219:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271148f0 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f03 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016105.203253:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271148e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4efc expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016105.203266:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271148e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4efc expref: 9 pid: 7684 timeout: 472 lvb_type: 1 00000100:00100000:0.0:1734016105.203280:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335233536:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016105.203351:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271148cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6320128->6324223) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4eee expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016105.203360:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271148cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6320128->6324223) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4eee expref: 5 pid: 7684 timeout: 472 lvb_type: 0 00000100:00100000:0.0:1734016105.203367:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335233664:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016105.203385:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016105.208663:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333522304 00000100:00100000:1.0:1734016105.208680:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333522304 00010000:00010000:1.0:1734016105.208730:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271148cd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6320128->6324223) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4eee expref: 6 pid: 7684 timeout: 472 lvb_type: 0 00000100:00100000:1.0:1734016105.208765:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333522176 00000100:00100000:1.0:1734016105.208767:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333522176 00010000:00010000:1.0:1734016105.208778:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271148e2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4efc expref: 10 pid: 7684 timeout: 472 lvb_type: 1 00000100:00100000:1.0:1734016105.208817:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2847 00000100:00100000:1.0:1734016105.208827:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333522304:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016105.208843:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016105.208876:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271148cd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 6320128->6324223) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4eee expref: 6 pid: 7684 timeout: 472 lvb_type: 0 00010000:00010000:1.0:1734016105.208887:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271148cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 6320128->6324223) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4eee expref: 6 pid: 7684 timeout: 472 lvb_type: 0 00000100:00100000:0.0:1734016105.208893:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2848 00000100:00100000:0.0:1734016105.208899:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333522176:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016105.208909:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016105.208917:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271148e2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4efc expref: 10 pid: 7684 timeout: 472 lvb_type: 1 00010000:00010000:1.0:1734016105.208917:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016105.208926:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271148e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4efc expref: 10 pid: 7684 timeout: 472 lvb_type: 1 00010000:00010000:0.0:1734016105.208937:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016105.208939:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016105.208944:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271148f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f03 expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016105.208953:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271148f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f03 expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016105.208958:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333522304:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 132us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016105.208964:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2847 00010000:00010000:0.0:1734016105.208988:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271148f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f03 expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016105.209001:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335233792:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016105.209036:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1734016105.209072:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271148e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4efc expref: 10 pid: 7684 timeout: 472 lvb_type: 1 00000100:00100000:0.0:1734016105.209101:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335233536:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016105.209113:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271148cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6320128->6324223) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4eee expref: 5 pid: 7684 timeout: 472 lvb_type: 0 00000100:00100000:0.0:1734016105.209125:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335233664:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016105.209160:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271148f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f03 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016105.209170:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582f40, rc 0) 00000100:00100000:0.0:1734016105.209199:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:9668:x1818247333522048:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6089us (6272us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016105.209207:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10480 00000100:00100000:3.0:1734016105.213753:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333522432 00000100:00100000:3.0:1734016105.213768:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333522432 00002000:00010000:3.0:1734016105.213854:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (1592347->18446744073709551615) 00002000:00100000:3.0:1734016105.213859:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075875500 with x1818247333522432 ext(1592347->18446744073709551615) 00002000:00010000:3.0:1734016105.213876:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075875500. 00000100:00100000:3.0:1734016105.213910:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8198 00000100:00100000:3.0:1734016105.213918:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333522432:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:0.0:1734016105.216068:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335233792:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016105.216101:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016105.216180:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333522176:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7278us (7637us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016105.216192:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2848 00000100:00100000:0.0:1734016105.227923:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333522560 00000100:00100000:0.0:1734016105.227939:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333522560 00000100:00100000:0.0:1734016105.229113:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2065 00000100:00100000:0.0:1734016105.229126:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+23:9668:x1818247333522560:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016105.229184:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016105.229206:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc271148f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4f0a expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016105.229294:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc271148fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016105.229308:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc271148fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016105.229319:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc271148fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016105.229342:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 1592347 00000004:00200000:0.0:1734016105.229345:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016105.229362:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc271148fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016105.229383:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc271148f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f0a expref: 25 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016105.229416:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc271148fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f0a expref: 24 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016105.229426:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016105.229429:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016105.229433:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580900, rc 0) 00000100:00100000:0.0:1734016105.229492:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+24:9668:x1818247333522560:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 367us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016105.229500:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2065 00000100:00100000:1.0:1734016105.232435:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.239407:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.244585:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075876300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335233920:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016105.244630:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114913 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f18 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016105.244646:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114913 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f18 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016105.244667:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:0.0:1734016105.244734:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333522816:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5129us (5334us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016105.244745:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10481 00000100:00100000:1.0:1734016105.248577:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.248692:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333522944 00000100:00100000:0.0:1734016105.248702:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333522944 00000100:00100000:0.0:1734016105.248753:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10482 00000100:00100000:0.0:1734016105.248761:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333522944:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016105.248778:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016105.248797:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711491a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4f1f expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016105.248880:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335234048:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016105.249376:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016105.259243:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333523200 00000100:00100000:0.0:1734016105.259252:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333523200 00000100:00100000:0.0:1734016105.259310:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2067 00000100:00100000:0.0:1734016105.259318:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+31:9668:x1818247333523200:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016105.259367:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016105.259395:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711490c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f11 expref: 31 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016105.259424:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016105.259428:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016105.259557:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114921 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016105.259569:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc271148fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f0a expref: 23 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016105.259575:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114921 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016105.259604:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc271148fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f0a expref: 23 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016105.259613:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc271148fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f0a expref: 23 pid: 13956 timeout: 472 lvb_type: 0 00000100:00100000:0.0:1734016105.259624:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335234176:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016105.259693:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:1.0:1734016105.268209:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.269696:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335234176:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016105.269723:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114921 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016105.272053:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114921 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016105.272066:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114921 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:1.0:1734016105.272181:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968632 00000004:00010000:1.0:1734016105.272244:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075877b80 reply state ffff880075572000 transno 4294968633 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114921 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016105.272253:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016105.272352:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+33:9668:x1818247333523200:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 13034us (13223us total) trans 4294968633 rc 0/0 00000100:00100000:1.0:1734016105.272360:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2067 00000020:00080000:1.0:1734016105.272364:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1734016105.288696:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.289171:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333523456 00000100:00100000:3.0:1734016105.289185:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333523456 00000100:00100000:3.0:1734016105.289234:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10483 00000100:00100000:3.0:1734016105.289242:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333523456:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016105.289268:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016105.289292:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114928 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4f26 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.289323:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271148f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f03 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.289330:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016105.289332:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016105.289335:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114928 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f26 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.289376:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271148f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f03 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.289388:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271148f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f03 expref: 8 pid: 7683 timeout: 472 lvb_type: 0 00000100:00100000:3.0:1734016105.289403:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335234304:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016105.289482:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016105.298461:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335234304:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016105.298510:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114928 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f26 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.298540:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016105.301941:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333523456:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12684us (13241us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016105.301953:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10483 00000100:00100000:1.0:1734016105.302176:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.302985:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333523584 00000100:00100000:3.0:1734016105.302997:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333523584 00010000:00010000:3.0:1734016105.303047:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271148f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f03 expref: 9 pid: 7683 timeout: 472 lvb_type: 0 00000100:00100000:3.0:1734016105.303089:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2850 00000100:00100000:3.0:1734016105.303094:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333523584:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016105.303107:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016105.303145:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271148f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f03 expref: 9 pid: 7683 timeout: 472 lvb_type: 0 00010000:00010000:3.0:1734016105.303159:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271148f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f03 expref: 9 pid: 7683 timeout: 472 lvb_type: 0 00010000:00010000:3.0:1734016105.303187:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271148f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f03 expref: 9 pid: 7683 timeout: 472 lvb_type: 0 00010000:00010000:3.0:1734016105.305149:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016105.305157:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016105.305174:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114928 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f26 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.305196:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114928 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f26 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.305259:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114928 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f26 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016105.305278:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335234432:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016105.305405:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016105.316691:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.318705:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335234432:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016105.318726:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016105.323018:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333523584:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 19906us (20826us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016105.323035:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2850 00000100:00100000:0.0:1734016105.323437:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.330003:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.330523:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333524224 00000100:00100000:3.0:1734016105.330532:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333524224 00002000:00100000:3.0:1734016105.330581:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3072000->3076095) req@ffff880073b48e00 x1818247333524224/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.330591:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48e00 with x1818247333524224 ext(3072000->3076095) 00002000:00010000:3.0:1734016105.330597:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b48e00 00000100:00100000:3.0:1734016105.331323:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8201 00000100:00100000:3.0:1734016105.331331:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333524224:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016105.331688:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333524224:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 355us (1690us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016105.331697:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8201 00002000:00100000:3.0:1734016105.331703:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3072000->3076095) req@ffff880073b48e00 x1818247333524224/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/4536 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.331710:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48e00 with x1818247333524224 ext(3072000->3076095) 00002000:00010000:3.0:1734016105.331713:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b48e00 00000100:00100000:0.0:1734016105.335178:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.335286:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333524480 00000100:00100000:3.0:1734016105.335298:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333524480 00002000:00100000:3.0:1734016105.335348:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3067904->3071999) req@ffff8800849b6a00 x1818247333524480/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.335357:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b6a00 with x1818247333524480 ext(3067904->3071999) 00002000:00010000:3.0:1734016105.335362:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b6a00 00000100:00100000:3.0:1734016105.335696:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8202 00000100:00100000:3.0:1734016105.335705:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333524480:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016105.336206:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333524480:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 501us (1411us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016105.336213:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8202 00002000:00100000:3.0:1734016105.336219:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3067904->3071999) req@ffff8800849b6a00 x1818247333524480/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/4536 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.336226:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b6a00 with x1818247333524480 ext(3067904->3071999) 00002000:00010000:3.0:1734016105.336229:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b6a00 00000100:00100000:0.0:1734016105.339387:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.339515:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333524736 00000100:00100000:3.0:1734016105.339526:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333524736 00002000:00100000:3.0:1734016105.339584:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3063808->3067903) req@ffff8800849b4a80 x1818247333524736/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.339602:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b4a80 with x1818247333524736 ext(3063808->3067903) 00002000:00010000:3.0:1734016105.339611:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b4a80 00000100:00100000:3.0:1734016105.343303:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8203 00000100:00100000:3.0:1734016105.343320:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333524736:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016105.343564:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333524736:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 246us (4190us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016105.343570:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8203 00002000:00100000:3.0:1734016105.343579:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3063808->3067903) req@ffff8800849b4a80 x1818247333524736/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/4536 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.343588:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b4a80 with x1818247333524736 ext(3063808->3067903) 00002000:00010000:3.0:1734016105.343595:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b4a80 00000100:00100000:1.0:1734016105.347786:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.357637:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.358770:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333525248 00000100:00100000:3.0:1734016105.358787:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333525248 00002000:00100000:3.0:1734016105.358866:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3055616->3059711) req@ffff8800849b7800 x1818247333525248/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.358880:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b7800 with x1818247333525248 ext(3055616->3059711) 00002000:00010000:3.0:1734016105.358889:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b7800 00000100:00100000:3.0:1734016105.358936:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8205 00000100:00100000:3.0:1734016105.358947:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333525248:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016105.359225:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333525248:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 279us (1601us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016105.359233:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8205 00002000:00100000:3.0:1734016105.359239:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3055616->3059711) req@ffff8800849b7800 x1818247333525248/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/4536 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.359247:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b7800 with x1818247333525248 ext(3055616->3059711) 00002000:00010000:3.0:1734016105.359250:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b7800 00000100:00100000:0.0:1734016105.363561:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.367269:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.367626:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333525760 00000100:00100000:3.0:1734016105.367638:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333525760 00002000:00100000:3.0:1734016105.367683:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3047424->3051519) req@ffff880073b4aa00 x1818247333525760/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.367694:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b4aa00 with x1818247333525760 ext(3047424->3051519) 00002000:00010000:3.0:1734016105.367700:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b4aa00 00000100:00100000:3.0:1734016105.367738:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8207 00000100:00100000:3.0:1734016105.367744:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333525760:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016105.367993:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333525760:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 246us (731us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016105.368000:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8207 00002000:00100000:3.0:1734016105.368005:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3047424->3051519) req@ffff880073b4aa00 x1818247333525760/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/4536 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.368011:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b4aa00 with x1818247333525760 ext(3047424->3051519) 00002000:00010000:3.0:1734016105.368014:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b4aa00 00000100:00100000:0.0:1734016105.372538:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.377216:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.377385:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333526272 00000100:00100000:3.0:1734016105.377394:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333526272 00002000:00100000:3.0:1734016105.377435:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3039232->3043327) req@ffff8800849b5f80 x1818247333526272/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.377444:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b5f80 with x1818247333526272 ext(3039232->3043327) 00002000:00010000:3.0:1734016105.377448:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b5f80 00000100:00100000:3.0:1734016105.377477:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8209 00000100:00100000:3.0:1734016105.377482:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333526272:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016105.377635:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333526272:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 151us (430us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016105.377641:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8209 00002000:00100000:3.0:1734016105.377646:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3039232->3043327) req@ffff8800849b5f80 x1818247333526272/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/4536 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.377652:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b5f80 with x1818247333526272 ext(3039232->3043327) 00002000:00010000:3.0:1734016105.377654:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b5f80 00000100:00100000:1.0:1734016105.383927:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.388703:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.388840:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333526784 00000100:00100000:3.0:1734016105.388850:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333526784 00002000:00100000:3.0:1734016105.388892:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3031040->3035135) req@ffff88007bd3ce00 x1818247333526784/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.388901:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3ce00 with x1818247333526784 ext(3031040->3035135) 00002000:00010000:3.0:1734016105.388907:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3ce00 00000100:00100000:3.0:1734016105.388937:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8211 00000100:00100000:3.0:1734016105.388944:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333526784:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016105.389103:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333526784:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 159us (411us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016105.389109:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8211 00002000:00100000:3.0:1734016105.389113:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3031040->3035135) req@ffff88007bd3ce00 x1818247333526784/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/4536 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.389119:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3ce00 with x1818247333526784 ext(3031040->3035135) 00002000:00010000:3.0:1734016105.389122:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3ce00 00000100:00100000:0.0:1734016105.393367:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.400938:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.401047:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333527296 00000100:00100000:3.0:1734016105.401059:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333527296 00002000:00100000:3.0:1734016105.401108:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3022848->3026943) req@ffff880073b4b480 x1818247333527296/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.401119:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b4b480 with x1818247333527296 ext(3022848->3026943) 00002000:00010000:3.0:1734016105.401125:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b4b480 00000100:00100000:3.0:1734016105.401168:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8213 00000100:00100000:3.0:1734016105.401174:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333527296:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016105.401388:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333527296:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 213us (460us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016105.401395:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8213 00002000:00100000:3.0:1734016105.401401:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3022848->3026943) req@ffff880073b4b480 x1818247333527296/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/4536 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.401409:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b4b480 with x1818247333527296 ext(3022848->3026943) 00002000:00010000:3.0:1734016105.401413:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b4b480 00000100:00100000:0.0:1734016105.409973:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.423889:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.424096:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333527680 00000100:00100000:3.0:1734016105.424109:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333527680 00002000:00100000:3.0:1734016105.424165:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3018752->3078396) req@ffff88007bd3c700 x1818247333527680/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.424175:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3c700 with x1818247333527680 ext(3018752->3078396) 00002000:00010000:3.0:1734016105.424179:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3c700 00000100:00100000:3.0:1734016105.424217:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8215 00000100:00100000:3.0:1734016105.424223:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333527680:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016105.439027:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.440323:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333527808 00000100:00100000:1.0:1734016105.440333:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333527808 00000100:00100000:1.0:1734016105.440391:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2068 00000100:00100000:1.0:1734016105.440397:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+32:9668:x1818247333527808:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:1.0:1734016105.440508:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+32:9668:x1818247333527808:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 111us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016105.440514:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2068 00000100:00100000:0.0:1734016105.447343:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.447625:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333527936 00000100:00100000:3.0:1734016105.447634:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333527936 00000100:00100000:3.0:1734016105.447676:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10484 00000100:00100000:3.0:1734016105.447683:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333527936:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:1.0:1734016105.451276:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969276 is committed 00000001:00080000:1.0:1734016105.451308:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969274 is committed 00000100:00100000:3.0:1734016105.451519:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333527936:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 3830us (4179us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016105.451529:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10484 00000100:00100000:0.0:1734016105.456595:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.462413:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.463344:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333528192 00000100:00100000:1.0:1734016105.463357:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333528192 00000100:00100000:1.0:1734016105.463423:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2070 00000100:00100000:1.0:1734016105.463430:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+23:9668:x1818247333528192:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016105.463453:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016105.463470:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc2711493d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4f34 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016105.463568:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27114944 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016105.463581:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27114944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016105.463591:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27114944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:1.0:1734016105.463614:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 3078397 00000004:00200000:1.0:1734016105.463617:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016105.463629:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27114944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016105.463648:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc2711493d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f34 expref: 25 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016105.463665:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27114944 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f34 expref: 24 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016105.463671:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016105.463674:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016105.463677:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016105.463724:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+24:9668:x1818247333528192:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 295us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016105.463730:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2070 00000100:00100000:3.0:1734016105.466663:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333528320 00000100:00100000:3.0:1734016105.466675:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333528320 00000100:00100000:3.0:1734016105.466720:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10485 00000100:00100000:3.0:1734016105.466728:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333528320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016105.466746:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016105.466765:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711494b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4f3b expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016105.466876:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335234560:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016105.466951:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00002000:00010000:3.0:1734016105.471101:0:7683:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime: 1734016105 -> 1734016106 00002000:00010000:3.0:1734016105.471111:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016104 -> 1734016105 00002000:00010000:3.0:1734016105.471113:0:7683:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016105 -> 1734016106 00002000:00010000:3.0:1734016105.471115:0:7683:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 1096 -> 1216 00000100:00100000:3.0:1734016105.471157:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335234560:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016105.471199:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711494b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f3b expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016105.471213:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711494b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f3b expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016105.471414:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7840, rc 0) 00000100:00100000:3.0:1734016105.471473:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333528320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4744us (4937us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016105.471481:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10485 00000100:00100000:1.0:1734016105.475738:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.475899:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333528448 00000100:00100000:3.0:1734016105.475912:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333528448 00000100:00100000:3.0:1734016105.475964:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10486 00000100:00100000:3.0:1734016105.475972:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333528448:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016105.475995:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016105.476018:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114952 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4f42 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016105.476084:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335234688:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016105.476169:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016105.483819:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335234688:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016105.483860:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114952 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f42 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016105.483874:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114952 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f42 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016105.483886:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016105.484056:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333528448:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8083us (8325us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016105.484068:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10486 00000100:00100000:1.0:1734016105.489767:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.489972:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333528576 00000100:00100000:3.0:1734016105.489979:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333528576 00000100:00100000:3.0:1734016105.490014:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10487 00000100:00100000:3.0:1734016105.490021:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333528576:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016105.490043:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016105.490058:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114959 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4f49 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016105.490110:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335234816:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016105.490190:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016105.494553:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335234816:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016105.494585:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114959 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f49 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016105.494598:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114959 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f49 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016105.494610:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016105.494659:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333528576:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4637us (4899us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016105.494667:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10487 00000100:00100000:3.0:1734016105.499062:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333528704 00000100:00100000:3.0:1734016105.499071:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333528704 00000100:00100000:3.0:1734016105.499114:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10488 00000100:00100000:3.0:1734016105.499122:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88009024d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333528704:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016105.499147:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016105.499165:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114960 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4f50 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.499197:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114928 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f26 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.499203:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016105.499205:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016105.499208:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114960 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8577024->8646655] (req 8577024->8646655) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f50 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.499239:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114928 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f26 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.499250:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114928 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f26 expref: 5 pid: 7683 timeout: 472 lvb_type: 0 00000100:00100000:3.0:1734016105.499262:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335234944:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016105.499982:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016105.505496:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.505768:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335234944:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016105.505795:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114960 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8577024->8646655] (req 8577024->8646655) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f50 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.505838:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4b40, rc 0) 00000100:00100000:3.0:1734016105.505883:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88009024d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333528704:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6761us (7205us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016105.505891:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10488 00000100:00100000:0.0:1734016105.509717:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.510788:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333528960 00000100:00100000:3.0:1734016105.510821:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333528960 00000100:00100000:3.0:1734016105.510863:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10489 00000100:00100000:3.0:1734016105.510871:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333528960:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016105.511148:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 3078397 -> 3078397 00002000:00010000:3.0:1734016105.511152:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016106 -> 1734016106 00002000:00010000:3.0:1734016105.511154:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016105 -> 1734016104 00002000:00010000:3.0:1734016105.511156:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016106 -> 1734016105 00002000:00010000:3.0:1734016105.511158:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1216 -> 1352 00000100:00100000:3.0:1734016105.511224:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333528960:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 353us (1508us total) trans 4294969277 rc 0/0 00000100:00100000:3.0:1734016105.511232:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10489 00000100:00100000:0.0:1734016105.517012:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.523005:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.527922:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1734016105.528751:0:7687:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711496e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [512000->552959] (req 512000->552959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.528761:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711496e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [512000->552959] (req 512000->552959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.532797:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711496e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [512000->552959] (req 512000->552959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.532833:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711496e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [512000->552959] (req 512000->552959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.532845:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711496e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [512000->552959] (req 512000->552959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.532851:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc240 already unused, calling callback (ffffffffa080e100) 00010000:00010000:3.0:1734016105.532855:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711496e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [512000->552959] (req 512000->552959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.532863:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711496e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [512000->552959] (req 512000->552959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.532878:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711496e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [512000->552959] (req 512000->552959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.532883:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711496e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [512000->552959] (req 512000->552959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016105.533553:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333529344:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 10336us (10554us total) trans 0 rc 40960/40960 00000100:00100000:3.0:1734016105.533564:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8216 00000100:00100000:0.0:1734016105.541514:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.562958:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.563171:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333529856 00000100:00100000:3.0:1734016105.563182:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333529856 00002000:00100000:3.0:1734016105.563230:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->3080191) req@ffff88012db0a680 x1818247333529856/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.563239:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db0a680 with x1818247333529856 ext(0->3080191) 00002000:00010000:3.0:1734016105.563244:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db0a680 00000100:00100000:3.0:1734016105.563264:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8217 00000100:00100000:3.0:1734016105.563273:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333529856:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016105.614199:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333529856:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 50913us (51243us total) trans 0 rc 3080192/3080192 00000100:00100000:3.0:1734016105.614212:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8217 00002000:00100000:3.0:1734016105.614224:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->3080191) req@ffff88012db0a680 x1818247333529856/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:66/0 lens 488/440 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 3080192/3080192 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.614233:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db0a680 with x1818247333529856 ext(0->3080191) 00002000:00010000:3.0:1734016105.614241:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db0a680 00000100:00100000:0.0:1734016105.627943:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.629577:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333529984 00000100:00100000:3.0:1734016105.629587:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333529984 00000100:00100000:3.0:1734016105.629650:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10492 00000100:00100000:3.0:1734016105.629657:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333529984:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016105.629676:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016105.629694:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc2711497c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4f65 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.629716:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016105.629718:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016105.629725:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc2711497c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f65 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016105.629739:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc2711497c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f65 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016105.629750:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4480, rc 0) 00000100:00100000:3.0:1734016105.629854:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333529984:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 196us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016105.629862:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10492 00000100:00100000:0.0:1734016105.646347:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.657749:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.671319:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.711475:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.711595:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.711646:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333530624 00000100:00100000:1.0:1734016105.711656:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333530624 00010000:00010000:1.0:1734016105.711699:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114975 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f5e expref: 10 pid: 7684 timeout: 472 lvb_type: 1 00000100:00100000:1.0:1734016105.711745:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333530752 00000100:00100000:1.0:1734016105.711748:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333530752 00010000:00010000:1.0:1734016105.711759:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc2711497c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f65 expref: 6 pid: 7683 timeout: 472 lvb_type: 1 00000100:00100000:1.0:1734016105.711777:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2854 00000100:00100000:1.0:1734016105.711786:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333530624:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016105.711842:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016105.711868:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114975 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f5e expref: 10 pid: 7684 timeout: 472 lvb_type: 1 00010000:00010000:1.0:1734016105.711879:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114975 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f5e expref: 10 pid: 7684 timeout: 472 lvb_type: 1 00010000:00010000:1.0:1734016105.711907:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114975 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f5e expref: 10 pid: 7684 timeout: 472 lvb_type: 1 00010000:00010000:1.0:1734016105.711930:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016105.711973:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333530624:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 189us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016105.711979:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2854 00000100:00100000:3.0:1734016105.712302:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075875f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335235584:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016105.712330:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711498a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f6c expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.712341:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:3.0:1734016105.712363:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333530496:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 40900us (41051us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016105.712369:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10493 00000100:00100000:3.0:1734016105.712409:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2855 00000100:00100000:3.0:1734016105.712414:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333530752:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016105.712422:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016105.712432:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc2711497c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f65 expref: 6 pid: 7683 timeout: 472 lvb_type: 1 00010000:00010000:3.0:1734016105.712441:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc2711497c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f65 expref: 6 pid: 7683 timeout: 472 lvb_type: 1 00010000:00010000:3.0:1734016105.712455:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc2711497c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f65 expref: 6 pid: 7683 timeout: 472 lvb_type: 1 00010000:00010000:3.0:1734016105.712469:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016105.712471:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016105.712476:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711498a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f6c expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.712490:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711498a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f6c expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.713462:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711498a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f6c expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016105.713479:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335235840:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016105.713534:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016105.726632:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.728362:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335235840:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016105.728384:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016105.728441:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333530752:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 16026us (16845us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016105.728449:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2855 00000100:00100000:1.0:1734016105.742042:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.742157:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333531136 00000100:00100000:0.0:1734016105.742166:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333531136 00002000:00100000:0.0:1734016105.742207:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3080192->5124095) req@ffff880073b49180 x1818247333531136/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016105.742217:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b49180 with x1818247333531136 ext(3080192->5124095) 00002000:00010000:0.0:1734016105.742222:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b49180 00000100:00100000:0.0:1734016105.742254:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8219 00000100:00100000:0.0:1734016105.742261:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333531136:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016105.783723:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333531136:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 41450us (41679us total) trans 0 rc 2043904/2043904 00000100:00100000:0.0:1734016105.783741:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8219 00002000:00100000:0.0:1734016105.783753:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3080192->5124095) req@ffff880073b49180 x1818247333531136/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:66/0 lens 488/440 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 2043904/2043904 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016105.783762:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b49180 with x1818247333531136 ext(3080192->5124095) 00002000:00010000:0.0:1734016105.783768:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b49180 00000100:00100000:0.0:1734016105.792571:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.796980:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333531392 00000100:00100000:0.0:1734016105.796990:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333531392 00000100:00100000:1.0:1734016105.798132:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2072 00000100:00100000:1.0:1734016105.798142:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+25:9668:x1818247333531392:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:1.0:1734016105.798297:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+25:9668:x1818247333531392:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 156us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016105.798304:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2072 00000100:00100000:3.0:1734016105.800849:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.800920:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333531520 00000100:00100000:0.0:1734016105.800931:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333531520 00000100:00100000:0.0:1734016105.800965:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10494 00000100:00100000:0.0:1734016105.800971:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333531520:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016105.804712:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969279 is committed 00000100:00100000:0.0:1734016105.808301:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.813147:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.821474:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.828961:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.835467:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.840506:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.844863:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.853326:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.868482:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.877287:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.885932:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.887142:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333533312 00000100:00100000:3.0:1734016105.887151:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333533312 00000100:00100000:3.0:1734016105.887191:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10500 00000100:00100000:3.0:1734016105.887197:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333533312:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016105.887212:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016105.887226:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271149d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4fa4 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016105.887272:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335236608:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016105.887442:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016105.892542:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335236608:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016105.892579:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271149d0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fa4 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016105.892592:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271149d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fa4 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016105.892617:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016105.892666:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333533312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5468us (6744us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016105.892674:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10500 00000100:00100000:1.0:1734016105.901518:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.901635:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333533440 00000100:00100000:3.0:1734016105.901644:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333533440 00000100:00100000:3.0:1734016105.901695:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10501 00000100:00100000:3.0:1734016105.901702:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333533440:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016105.901719:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016105.901738:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271149d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4fab expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.901777:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711498a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f6c expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.901785:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016105.901786:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016105.901790:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271149d7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2809856->2867199] (req 2809856->2867199) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fab expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.901854:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711498a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f6c expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.901866:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711498a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f6c expref: 6 pid: 7684 timeout: 473 lvb_type: 0 00000100:00100000:3.0:1734016105.901879:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335236736:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016105.901941:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016105.906516:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335236736:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016105.906542:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271149d7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2809856->2867199] (req 2809856->2867199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fab expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.906558:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016105.907436:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333533440:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5730us (5928us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016105.907445:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10501 00000100:00100000:1.0:1734016105.909513:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.909697:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333533568 00000100:00100000:3.0:1734016105.909706:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333533568 00010000:00010000:3.0:1734016105.909735:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711498a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f6c expref: 7 pid: 7684 timeout: 473 lvb_type: 0 00000100:00100000:3.0:1734016105.909772:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2856 00000100:00100000:3.0:1734016105.909778:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333533568:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016105.909792:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016105.909846:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711498a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f6c expref: 7 pid: 7684 timeout: 473 lvb_type: 0 00010000:00010000:3.0:1734016105.909857:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711498a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f6c expref: 7 pid: 7684 timeout: 473 lvb_type: 0 00010000:00010000:3.0:1734016105.909877:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711498a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f6c expref: 7 pid: 7684 timeout: 473 lvb_type: 0 00010000:00010000:3.0:1734016105.909899:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016105.909901:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016105.909908:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271149d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->2867199) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fab expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.909916:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271149d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->2867199) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fab expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.909944:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271149d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->2867199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fab expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016105.909955:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335236864:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016105.910012:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016105.921543:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.922198:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335236864:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016105.922217:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016105.922268:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333533568:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 12489us (12767us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016105.922275:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2856 00000100:00100000:1.0:1734016105.934630:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.946920:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016105.951702:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.951789:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333534080 00000100:00100000:3.0:1734016105.952104:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333534080 00010000:00010000:3.0:1734016105.952144:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271149d7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->2867199) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fab expref: 7 pid: 7683 timeout: 473 lvb_type: 0 00000100:00100000:3.0:1734016105.952185:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2857 00000100:00100000:3.0:1734016105.952190:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333534080:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016105.952202:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016105.952226:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271149d7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->2867199) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fab expref: 7 pid: 7683 timeout: 473 lvb_type: 0 00010000:00010000:3.0:1734016105.952239:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271149d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->2867199) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fab expref: 7 pid: 7683 timeout: 473 lvb_type: 0 00010000:00010000:3.0:1734016105.952263:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016105.952265:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016105.952270:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271149e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1310719) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fb9 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.952278:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271149e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1310719) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fb9 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016105.952315:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271149e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1310719) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fb9 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016105.952327:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335237248:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016105.953730:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016105.958982:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335237248:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016105.959013:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016105.959076:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333534080:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6882us (7379us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016105.959087:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2857 00000100:00100000:0.0:1734016105.961759:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.966480:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.972709:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.976478:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.976681:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333535104 00000100:00100000:3.0:1734016105.976688:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333535104 00002000:00100000:3.0:1734016105.976724:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1294336->1298431) req@ffff8800756a5c00 x1818247333535104/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.976733:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a5c00 with x1818247333535104 ext(1294336->1298431) 00002000:00010000:3.0:1734016105.976738:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a5c00 00000100:00100000:3.0:1734016105.976770:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8227 00000100:00100000:3.0:1734016105.976776:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333535104:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016105.976953:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333535104:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 176us (482us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016105.976959:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8227 00002000:00100000:3.0:1734016105.976965:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1294336->1298431) req@ffff8800756a5c00 x1818247333535104/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:66/0 lens 488/4536 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.976972:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a5c00 with x1818247333535104 ext(1294336->1298431) 00002000:00010000:3.0:1734016105.976974:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a5c00 00000100:00100000:0.0:1734016105.980176:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.984387:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.984601:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333535616 00000100:00100000:3.0:1734016105.984612:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333535616 00002000:00100000:3.0:1734016105.984664:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1286144->1290239) req@ffff8800756a6300 x1818247333535616/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.984676:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6300 with x1818247333535616 ext(1286144->1290239) 00002000:00010000:3.0:1734016105.984682:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a6300 00000100:00100000:3.0:1734016105.985053:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8229 00000100:00100000:3.0:1734016105.985060:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333535616:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016105.985230:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333535616:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 168us (851us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016105.985236:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8229 00002000:00100000:3.0:1734016105.985241:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1286144->1290239) req@ffff8800756a6300 x1818247333535616/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:66/0 lens 488/4536 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.985248:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6300 with x1818247333535616 ext(1286144->1290239) 00002000:00010000:3.0:1734016105.985251:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a6300 00000100:00100000:0.0:1734016105.989914:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016105.995401:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016105.995698:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333536128 00000100:00100000:3.0:1734016105.995709:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333536128 00002000:00100000:3.0:1734016105.995750:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1277952->1282047) req@ffff8800756a6a00 x1818247333536128/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:66/0 lens 488/0 e 0 to 0 dl 1734016116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.995759:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6a00 with x1818247333536128 ext(1277952->1282047) 00002000:00010000:3.0:1734016105.995765:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a6a00 00000100:00100000:3.0:1734016105.996075:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8231 00000100:00100000:3.0:1734016105.996083:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333536128:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016105.996566:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333536128:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 481us (1175us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016105.996573:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8231 00002000:00100000:3.0:1734016105.996579:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1277952->1282047) req@ffff8800756a6a00 x1818247333536128/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:66/0 lens 488/4536 e 0 to 0 dl 1734016116 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016105.996586:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6a00 with x1818247333536128 ext(1277952->1282047) 00002000:00010000:3.0:1734016105.996589:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a6a00 00000100:00100000:0.0:1734016106.000516:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.000623:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333536384 00000100:00100000:3.0:1734016106.000631:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333536384 00002000:00100000:3.0:1734016106.000668:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1273856->1277951) req@ffff8800756a7100 x1818247333536384/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:67/0 lens 488/0 e 0 to 0 dl 1734016117 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016106.000677:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a7100 with x1818247333536384 ext(1273856->1277951) 00002000:00010000:3.0:1734016106.000682:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a7100 00000100:00100000:3.0:1734016106.001364:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8232 00000100:00100000:3.0:1734016106.001372:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333536384:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016106.001526:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333536384:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 153us (1020us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016106.001533:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8232 00002000:00100000:3.0:1734016106.001538:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1273856->1277951) req@ffff8800756a7100 x1818247333536384/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:67/0 lens 488/4536 e 0 to 0 dl 1734016117 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016106.001545:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a7100 with x1818247333536384 ext(1273856->1277951) 00002000:00010000:3.0:1734016106.001549:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a7100 00000100:00100000:0.0:1734016106.006477:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.010777:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.010930:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333536896 00000100:00100000:3.0:1734016106.010938:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333536896 00002000:00100000:3.0:1734016106.010975:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1265664->1269759) req@ffff8800756a7800 x1818247333536896/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:67/0 lens 488/0 e 0 to 0 dl 1734016117 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016106.010984:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a7800 with x1818247333536896 ext(1265664->1269759) 00002000:00010000:3.0:1734016106.010989:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a7800 00000100:00100000:3.0:1734016106.011016:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8234 00000100:00100000:3.0:1734016106.011022:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333536896:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016106.011171:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333536896:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 148us (402us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016106.011177:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8234 00002000:00100000:3.0:1734016106.011181:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1265664->1269759) req@ffff8800756a7800 x1818247333536896/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:67/0 lens 488/4536 e 0 to 0 dl 1734016117 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016106.011188:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a7800 with x1818247333536896 ext(1265664->1269759) 00002000:00010000:3.0:1734016106.011190:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a7800 00000100:00100000:0.0:1734016106.016157:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.020796:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333537024:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4217us (4638us total) trans 4294969281 rc 0/0 00000100:00100000:0.0:1734016106.020904:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8235 00002000:00100000:0.0:1734016106.020916:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1265664->1310719) req@ffff8800756a7b80 x1818247333537024/t4294969281(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:67/0 lens 488/448 e 0 to 0 dl 1734016117 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016106.020925:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a7b80 with x1818247333537024 ext(1265664->1310719) 00002000:00010000:0.0:1734016106.020931:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a7b80 00000100:00100000:0.0:1734016106.023150:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000001:00080000:1.0:1734016106.025480:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969281 is committed 00000001:00080000:1.0:1734016106.025497:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969280 is committed 00000100:00100000:0.0:1734016106.030633:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:1.0:1734016106.031693:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016076 00000100:00100000:0.0:1734016106.038985:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.045114:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.045373:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333537536 00000100:00100000:3.0:1734016106.045382:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333537536 00010000:00010000:3.0:1734016106.045413:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271149e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1310719) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fb9 expref: 7 pid: 7683 timeout: 473 lvb_type: 0 00000100:00100000:3.0:1734016106.045453:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2858 00000100:00100000:3.0:1734016106.045459:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075398a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333537536:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016106.045475:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016106.045501:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271149e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1310719) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fb9 expref: 7 pid: 7683 timeout: 473 lvb_type: 0 00010000:00010000:3.0:1734016106.045513:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271149e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1310719) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fb9 expref: 7 pid: 7683 timeout: 473 lvb_type: 0 00010000:00010000:3.0:1734016106.045536:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271149e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1310719) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fb9 expref: 7 pid: 7683 timeout: 473 lvb_type: 0 00010000:00010000:3.0:1734016106.045577:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016106.045580:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016106.045590:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271149f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fc7 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.045599:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271149f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fc7 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.045642:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271149f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fc7 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016106.045656:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335237632:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016106.045730:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016106.059207:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335237632:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016106.059240:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016106.059302:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075398a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333537536:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 13840us (14194us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016106.059314:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2858 00000100:00100000:0.0:1734016106.063980:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.064035:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.064695:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8236 00000100:00100000:0.0:1734016106.064702:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333537920:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016106.070328:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.070377:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.070412:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333538304 00000100:00100000:0.0:1734016106.070419:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333538304 00000100:00100000:0.0:1734016106.070474:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 151 00000100:00100000:0.0:1734016106.070481:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333538304:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1734016106.070538:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333538304:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 57us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016106.070543:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 151 00000100:00080000:1.0:1734016106.070655:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016076 00000100:00100000:3.0:1734016106.070816:0:6475:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333538176 00000100:00100000:3.0:1734016106.070820:0:6475:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333538176 00000100:00080000:1.0:1734016106.071929:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016076 00000100:00100000:3.0:1734016106.076023:0:6475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 320 00000100:00100000:3.0:1734016106.076036:0:6475:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7613450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99867e87-1bc2-4e49-bd45-a757ae2fdd76+12:1981:x1818247333538176:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1734016106.076138:0:6475:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7613450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99867e87-1bc2-4e49-bd45-a757ae2fdd76+12:1981:x1818247333538176:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 103us (5816us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016106.076145:0:6475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 320 00000100:00100000:1.0:1734016106.104234:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333537920:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 39518us (40248us total) trans 0 rc 929792/929792 00000100:00100000:1.0:1734016106.104246:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8236 00002000:00100000:1.0:1734016106.104258:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (4194304->5124095) req@ffff880075398e00 x1818247333537920/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:67/0 lens 488/440 e 0 to 0 dl 1734016117 ref 1 fl Complete:/200/0 rc 929792/929792 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016106.104267:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075398e00 with x1818247333537920 ext(4194304->5124095) 00002000:00010000:1.0:1734016106.104273:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075398e00 00000100:00100000:0.0:1734016106.141647:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.149947:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.159979:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.160886:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333538816 00000100:00100000:3.0:1734016106.160899:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333538816 00010000:00010000:3.0:1734016106.160944:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271149b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f88 expref: 26 pid: 7704 timeout: 473 lvb_type: 0 00000100:00100000:3.0:1734016106.161347:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2859 00000100:00100000:3.0:1734016106.161360:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+26:1982:x1818247333538816:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016106.161381:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016106.161388:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271149b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f88 expref: 26 pid: 7704 timeout: 473 lvb_type: 0 00010000:00010000:3.0:1734016106.161401:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271149b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f88 expref: 26 pid: 7704 timeout: 473 lvb_type: 0 00010000:00010000:3.0:1734016106.161431:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271149b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4f88 expref: 26 pid: 7704 timeout: 473 lvb_type: 0 00010000:00010000:3.0:1734016106.161468:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016106.161474:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27114a01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016106.161485:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27114a01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016106.161495:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27114a01 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016106.161540:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016106.161613:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+25:1982:x1818247333538816:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 254us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016106.161621:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2859 00000100:00100000:1.0:1734016106.165930:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.166694:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333538944 00000100:00100000:3.0:1734016106.166705:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333538944 00000100:00100000:3.0:1734016106.166789:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10509 00000100:00100000:3.0:1734016106.166796:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333538944:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016106.166840:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016106.166856:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27114a08 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4fd5 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.166881:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271149f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fc7 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.166889:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271149fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fce expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016106.166895:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016106.166898:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016106.166901:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27114a08 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fd5 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.166934:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271149fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fce expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016106.166946:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271149fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fce expref: 6 pid: 7683 timeout: 473 lvb_type: 1 00000100:00100000:3.0:1734016106.166960:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335237888:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016106.167685:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271149f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fc7 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.167699:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271149f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fc7 expref: 7 pid: 7683 timeout: 473 lvb_type: 0 00000100:00100000:3.0:1734016106.167708:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335238016:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016106.167730:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016106.178197:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.178248:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.179371:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335237888:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016106.179382:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335238016:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016106.179415:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27114a08 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fd5 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.179433:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016106.179484:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333538944:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12688us (13570us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016106.179492:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10509 00000100:00100000:0.0:1734016106.193378:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.198097:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075874000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335238144:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016106.198137:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016106.198195:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333539200:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 16859us (19944us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016106.198206:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2861 00000100:00100000:0.0:1734016106.217292:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333539584 00000100:00100000:0.0:1734016106.217314:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333539584 00002000:00100000:0.0:1734016106.217407:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5124096->6279167) req@ffff880075874e00 x1818247333539584/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:67/0 lens 488/0 e 0 to 0 dl 1734016117 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016106.217420:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075874e00 with x1818247333539584 ext(5124096->6279167) 00002000:00010000:0.0:1734016106.217431:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075874e00 00000100:00100000:0.0:1734016106.217499:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8239 00000100:00100000:0.0:1734016106.217507:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333539584:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016106.275897:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333539712 00000100:00100000:0.0:1734016106.275908:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333539712 00002000:00100000:0.0:1734016106.275964:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6254592->6276759) req@ffff880075877800 x1818247333539712/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:67/0 lens 488/0 e 0 to 0 dl 1734016117 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016106.275977:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075877800 with x1818247333539712 ext(6254592->6276759) 00002000:00010000:0.0:1734016106.275982:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075877800 00000100:00100000:0.0:1734016106.276022:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8240 00000100:00100000:0.0:1734016106.276030:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333539712:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016106.285755:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333539712:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 9706us (9967us total) trans 4294969283 rc 0/0 00000100:00100000:0.0:1734016106.285774:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8240 00002000:00100000:0.0:1734016106.285793:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6254592->6276759) req@ffff880075877800 x1818247333539712/t4294969283(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:67/0 lens 488/448 e 0 to 0 dl 1734016117 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016106.286571:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075877800 with x1818247333539712 ext(6254592->6276759) 00002000:00010000:0.0:1734016106.286577:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075877800 00000100:00100000:0.0:1734016106.289137:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.291625:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333539968 00000100:00100000:3.0:1734016106.291634:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333539968 00000100:00100000:3.0:1734016106.291679:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10510 00000100:00100000:3.0:1734016106.291685:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333539968:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:1.0:1734016106.293256:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969283 is committed 00000100:00100000:3.0:1734016106.293951:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333539968:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2258us (2406us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016106.293964:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10510 00000100:00100000:0.0:1734016106.299291:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.304004:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333540096 00000100:00100000:1.0:1734016106.304023:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333540096 00000100:00100000:1.0:1734016106.304101:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2077 00000100:00100000:1.0:1734016106.304109:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007539b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+25:9668:x1818247333540096:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016106.304139:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016106.304158:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27114a0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4fdc expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016106.304257:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114a16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016106.304270:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114a16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016106.304279:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114a16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:1.0:1734016106.304308:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 6276760 00000004:00200000:1.0:1734016106.304311:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016106.304327:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114a16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016106.304349:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27114a0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fdc expref: 27 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016106.304374:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114a16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fdc expref: 26 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016106.304382:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016106.304384:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016106.304387:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016106.304467:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007539b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+26:9668:x1818247333540096:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 357us (5194us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016106.304474:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2077 00000100:00100000:0.0:1734016106.306584:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.306998:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333540224 00000100:00100000:3.0:1734016106.307008:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333540224 00000100:00100000:3.0:1734016106.307043:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10511 00000100:00100000:3.0:1734016106.307050:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007539bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333540224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016106.307071:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016106.307091:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114a1d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4fe3 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016106.307153:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335238272:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016106.307217:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00002000:00010000:3.0:1734016106.315966:0:7683:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 1304 -> 1352 00000100:00100000:3.0:1734016106.316004:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335238272:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016106.316045:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114a1d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fe3 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016106.316062:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114a1d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fe3 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016106.316086:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016106.316161:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007539bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333540224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9109us (9586us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016106.316170:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10511 00000100:00100000:1.0:1734016106.319852:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.319899:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333540352 00000100:00100000:3.0:1734016106.319908:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333540352 00000100:00100000:3.0:1734016106.319949:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10512 00000100:00100000:3.0:1734016106.319955:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333540352:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016106.319972:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016106.319986:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27114a24 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4fea expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016106.320029:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335238400:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016106.322290:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016106.323585:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335238400:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016106.323617:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27114a24 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fea expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016106.323628:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27114a24 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fea expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016106.323641:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7a80, rc 0) 00000100:00100000:3.0:1734016106.323691:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333540352:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3735us (3847us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016106.323699:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10512 00000100:00100000:3.0:1734016106.332478:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333540480 00000100:00100000:3.0:1734016106.332489:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333540480 00000100:00100000:3.0:1734016106.332552:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10513 00000100:00100000:3.0:1734016106.332559:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333540480:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016106.332577:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016106.332593:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27114a2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4ff1 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016106.332643:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335238528:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016106.332708:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016106.342617:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335238528:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016106.342660:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27114a2b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ff1 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016106.342676:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27114a2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ff1 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016106.342707:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df58c0, rc 0) 00000100:00100000:3.0:1734016106.342759:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333540480:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10199us (13545us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016106.342768:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10513 00000100:00100000:0.0:1734016106.347484:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.347601:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333540608 00000100:00100000:3.0:1734016106.347611:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333540608 00000100:00100000:3.0:1734016106.347682:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10514 00000100:00100000:3.0:1734016106.347690:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007539aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333540608:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016106.347718:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016106.347744:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114a32 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e4ff8 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016106.347848:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335238656:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016106.347927:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016106.352673:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335238656:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016106.352714:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114a32 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ff8 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016106.352728:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114a32 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4ff8 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016106.353015:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016106.353082:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007539aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333540608:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5392us (5612us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016106.353091:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10514 00000100:00100000:0.0:1734016106.360557:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.366582:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.373790:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.379100:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.395310:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.404929:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.405006:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333542144 00000100:00100000:0.0:1734016106.405017:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333542144 00002000:00100000:0.0:1734016106.405059:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (4722688->4726783) req@ffff880075fc7480 x1818247333542144/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:67/0 lens 488/0 e 0 to 0 dl 1734016117 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016106.405069:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7480 with x1818247333542144 ext(4722688->4726783) 00002000:00010000:0.0:1734016106.405074:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc7480 00000100:00100000:0.0:1734016106.405109:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8246 00000100:00100000:0.0:1734016106.405124:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333542144:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016106.405307:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333542144:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 190us (385us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016106.405320:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8246 00002000:00100000:0.0:1734016106.405327:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (4722688->4726783) req@ffff880075fc7480 x1818247333542144/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:67/0 lens 488/4536 e 0 to 0 dl 1734016117 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016106.405333:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7480 with x1818247333542144 ext(4722688->4726783) 00002000:00010000:0.0:1734016106.405336:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc7480 00000100:00100000:1.0:1734016106.408701:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.427218:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.427402:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333542400 00000100:00100000:3.0:1734016106.427412:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333542400 00000100:00100000:3.0:1734016106.427466:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10515 00000100:00100000:3.0:1734016106.427474:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333542400:12345-192.168.201.16@tcp:16:fsx.0 00000100:00100000:3.0:1734016106.439628:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333542400:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 12148us (12420us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016106.439639:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10515 00000100:00100000:1.0:1734016106.441752:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.455024:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.455188:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333542656 00000100:00100000:3.0:1734016106.455200:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333542656 00000100:00100000:3.0:1734016106.455246:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10516 00000100:00100000:3.0:1734016106.455253:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333542656:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016106.455272:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016106.455292:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114a47 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5006 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016106.455351:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335238784:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016106.455407:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00002000:00010000:3.0:1734016106.463871:0:7683:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime: 1734016106 -> 1734016107 00002000:00010000:3.0:1734016106.463879:0:7683:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016106 -> 1734016107 00002000:00010000:3.0:1734016106.463880:0:7683:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 1352 -> 1400 00000100:00100000:3.0:1734016106.463902:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335238784:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016106.463935:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114a47 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5006 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016106.463950:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114a47 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5006 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016106.463986:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016106.464048:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333542656:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8794us (9032us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016106.464057:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10516 00000100:00100000:0.0:1734016106.472467:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.472564:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333542784 00000100:00100000:3.0:1734016106.472572:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333542784 00000100:00100000:3.0:1734016106.472617:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10517 00000100:00100000:3.0:1734016106.472623:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333542784:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016106.472638:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016106.472652:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114a4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e500d expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.472685:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27114a08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fd5 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.472692:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016106.472693:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016106.472697:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114a4e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3153920->3158015] (req 3153920->3158015) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e500d expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.472722:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27114a08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fd5 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.472732:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27114a08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fd5 expref: 5 pid: 7683 timeout: 473 lvb_type: 0 00000100:00100000:3.0:1734016106.472743:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335238912:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016106.472798:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016106.480840:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335238912:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016106.480879:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114a4e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3153920->3158015] (req 3153920->3158015) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e500d expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.480896:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016106.480947:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333542784:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8323us (8487us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016106.480956:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10517 00000100:00100000:0.0:1734016106.483132:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.483262:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333542912 00000100:00100000:3.0:1734016106.483276:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333542912 00010000:00010000:3.0:1734016106.483314:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27114a08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fd5 expref: 6 pid: 7683 timeout: 473 lvb_type: 0 00000100:00100000:3.0:1734016106.483356:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2862 00000100:00100000:3.0:1734016106.483362:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075399500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333542912:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016106.483380:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016106.483399:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27114a08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fd5 expref: 6 pid: 7683 timeout: 473 lvb_type: 0 00010000:00010000:3.0:1734016106.483409:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27114a08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fd5 expref: 6 pid: 7683 timeout: 473 lvb_type: 0 00010000:00010000:3.0:1734016106.483431:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27114a08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fd5 expref: 6 pid: 7683 timeout: 473 lvb_type: 0 00010000:00010000:3.0:1734016106.483459:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016106.483461:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016106.483468:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114a4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3158015) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e500d expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.483477:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114a4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3158015) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e500d expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.483511:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114a4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3158015) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e500d expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016106.483524:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335239040:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016106.483593:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016106.499287:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335239040:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016106.499309:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016106.499373:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075399500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333542912:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 16009us (16248us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016106.499383:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2862 00000100:00100000:1.0:1734016106.513918:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.538553:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.549517:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.549935:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333543680 00000100:00100000:0.0:1734016106.549944:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333543680 00002000:00100000:0.0:1734016106.549989:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3145728->3149823) req@ffff88012e606d80 x1818247333543680/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:67/0 lens 488/0 e 0 to 0 dl 1734016117 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016106.549998:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e606d80 with x1818247333543680 ext(3145728->3149823) 00002000:00010000:0.0:1734016106.550003:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e606d80 00000100:00100000:0.0:1734016106.550029:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8250 00000100:00100000:0.0:1734016106.550034:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333543680:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016106.550183:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333543680:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 147us (674us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016106.550189:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8250 00002000:00100000:0.0:1734016106.550194:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3145728->3149823) req@ffff88012e606d80 x1818247333543680/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:67/0 lens 488/4536 e 0 to 0 dl 1734016117 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016106.550200:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e606d80 with x1818247333543680 ext(3145728->3149823) 00002000:00010000:0.0:1734016106.550203:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e606d80 00000100:00100000:1.0:1734016106.557912:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.566919:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.567797:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333544192 00000100:00100000:0.0:1734016106.567840:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333544192 00002000:00100000:0.0:1734016106.567887:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3137536->3141631) req@ffff88012e605180 x1818247333544192/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:67/0 lens 488/0 e 0 to 0 dl 1734016117 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016106.567897:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605180 with x1818247333544192 ext(3137536->3141631) 00002000:00010000:0.0:1734016106.567901:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e605180 00000100:00100000:0.0:1734016106.567940:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8252 00000100:00100000:0.0:1734016106.567946:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333544192:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016106.568136:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333544192:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 189us (1236us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016106.568144:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8252 00002000:00100000:0.0:1734016106.568151:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3137536->3141631) req@ffff88012e605180 x1818247333544192/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:67/0 lens 488/4536 e 0 to 0 dl 1734016117 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016106.568158:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605180 with x1818247333544192 ext(3137536->3141631) 00002000:00010000:0.0:1734016106.568161:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e605180 00000001:00080000:0.0:1734016106.571385:0:6461:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968637 is committed 00000001:00080000:0.0:1734016106.571399:0:6461:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968635 is committed 00000100:00100000:1.0:1734016106.587559:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.598646:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.598765:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333544704 00000100:00100000:0.0:1734016106.598779:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333544704 00002000:00100000:0.0:1734016106.598887:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3129344->3133439) req@ffff88012e605500 x1818247333544704/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:67/0 lens 488/0 e 0 to 0 dl 1734016117 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016106.598899:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605500 with x1818247333544704 ext(3129344->3133439) 00002000:00010000:0.0:1734016106.598905:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e605500 00000100:00100000:0.0:1734016106.598943:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8254 00000100:00100000:0.0:1734016106.598951:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333544704:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016106.599170:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333544704:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 218us (534us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016106.599179:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8254 00002000:00100000:0.0:1734016106.599185:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3129344->3133439) req@ffff88012e605500 x1818247333544704/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:67/0 lens 488/4536 e 0 to 0 dl 1734016117 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016106.599192:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605500 with x1818247333544704 ext(3129344->3133439) 00002000:00010000:0.0:1734016106.599195:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e605500 00000100:00100000:1.0:1734016106.615544:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.615642:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333544960 00000100:00100000:0.0:1734016106.615653:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333544960 00002000:00100000:0.0:1734016106.615703:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3125248->3129343) req@ffff880075e50000 x1818247333544960/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:67/0 lens 488/0 e 0 to 0 dl 1734016117 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016106.615714:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50000 with x1818247333544960 ext(3125248->3129343) 00002000:00010000:0.0:1734016106.615720:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e50000 00000100:00100000:0.0:1734016106.615755:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8255 00000100:00100000:0.0:1734016106.615763:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333544960:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016106.621205:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333544960:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 5428us (5660us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016106.621222:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8255 00002000:00100000:1.0:1734016106.621233:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3125248->3129343) req@ffff880075e50000 x1818247333544960/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:67/0 lens 488/4536 e 0 to 0 dl 1734016117 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016106.621244:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50000 with x1818247333544960 ext(3125248->3129343) 00002000:00010000:1.0:1734016106.621250:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e50000 00000100:00100000:1.0:1734016106.626866:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.637126:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333545472 00000100:00100000:0.0:1734016106.637135:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333545472 00002000:00100000:0.0:1734016106.637185:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3117056->3121151) req@ffff880075874000 x1818247333545472/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:67/0 lens 488/0 e 0 to 0 dl 1734016117 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016106.637195:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075874000 with x1818247333545472 ext(3117056->3121151) 00002000:00010000:0.0:1734016106.637201:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075874000 00000100:00100000:0.0:1734016106.637244:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8257 00000100:00100000:0.0:1734016106.637252:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333545472:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016106.637466:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333545472:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 214us (746us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016106.637480:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8257 00002000:00100000:0.0:1734016106.637488:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3117056->3121151) req@ffff880075874000 x1818247333545472/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:67/0 lens 488/4536 e 0 to 0 dl 1734016117 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016106.637496:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075874000 with x1818247333545472 ext(3117056->3121151) 00002000:00010000:0.0:1734016106.637499:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075874000 00000100:00100000:1.0:1734016106.662631:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.674231:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.674353:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333545856 00000100:00100000:3.0:1734016106.674365:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333545856 00000100:00100000:3.0:1734016106.674463:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10518 00000100:00100000:3.0:1734016106.674473:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333545856:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016106.674496:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016106.674523:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114a55 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5014 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.674563:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114a4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3158015) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e500d expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.674572:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016106.674574:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016106.674577:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114a55 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4440064->4501503] (req 4440064->4501503) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5014 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.674610:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114a4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3158015) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e500d expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.674621:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114a4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3158015) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e500d expref: 6 pid: 7683 timeout: 473 lvb_type: 0 00000100:00100000:3.0:1734016106.674633:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335239168:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016106.675551:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016106.681478:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335239168:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016106.681523:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114a55 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4440064->4501503] (req 4440064->4501503) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5014 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016106.681542:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:1.0:1734016106.681609:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333545856:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7137us (7390us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016106.681623:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10518 00000100:00100000:1.0:1734016106.682688:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.686033:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2863 00000100:00100000:0.0:1734016106.686048:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333545984:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016106.686071:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016106.686097:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114a4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3153920->3158015) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e500d expref: 7 pid: 7683 timeout: 473 lvb_type: 0 00010000:00010000:0.0:1734016106.686143:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114a4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3153920->3158015) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e500d expref: 7 pid: 7683 timeout: 473 lvb_type: 0 00010000:00010000:0.0:1734016106.686168:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114a4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3153920->3158015) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e500d expref: 7 pid: 7683 timeout: 473 lvb_type: 0 00010000:00010000:0.0:1734016106.686212:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016106.686215:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016106.686222:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114a55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4440064->4501503) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5014 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.686231:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114a55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4440064->4501503) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5014 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.686274:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114a55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4440064->4501503) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5014 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016106.686287:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335239296:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016106.686365:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016106.690448:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335239296:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016106.690482:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016106.690549:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333545984:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4501us (7862us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016106.690562:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2863 00000100:00100000:3.0:1734016106.690838:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.690994:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333546112 00000100:00100000:1.0:1734016106.691002:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333546112 00000100:00100000:1.0:1734016106.691332:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10519 00000100:00100000:1.0:1734016106.691340:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333546112:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016106.691668:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 6276760 -> 6276760 00002000:00010000:1.0:1734016106.691672:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016107 -> 1734016107 00002000:00010000:1.0:1734016106.691674:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016106 -> 1734016106 00002000:00010000:1.0:1734016106.691676:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016107 -> 1734016107 00002000:00010000:1.0:1734016106.691678:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1400 -> 1400 00000100:00100000:1.0:1734016106.691743:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333546112:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 403us (905us total) trans 4294969285 rc 0/0 00000100:00100000:1.0:1734016106.691750:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10519 00000100:00100000:0.0:1734016106.699665:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333546240 00000100:00100000:0.0:1734016106.699676:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333546240 00000100:00100000:0.0:1734016106.699733:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10520 00000100:00100000:0.0:1734016106.699739:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333546240:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016106.699755:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016106.699771:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27114a5c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e501b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016106.699852:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335239424:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016106.700605:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eec00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016106.712731:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333546368 00000100:00100000:0.0:1734016106.712740:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333546368 00000100:00100000:0.0:1734016106.713343:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10521 00000100:00100000:0.0:1734016106.713353:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333546368:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016106.713375:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016106.713391:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27114a63 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5022 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016106.713448:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335239552:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016106.713667:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016106.720964:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335239552:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016106.721015:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27114a63 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5022 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016106.721031:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27114a63 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5022 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016106.721059:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582d00, rc 0) 00000100:00100000:0.0:1734016106.721131:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333546368:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7778us (8750us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016106.721141:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10521 00000100:00100000:0.0:1734016106.726950:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333546496 00000100:00100000:0.0:1734016106.726962:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333546496 00000100:00100000:0.0:1734016106.727023:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10522 00000100:00100000:0.0:1734016106.727033:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333546496:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016106.727058:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016106.727080:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114a6a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5029 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016106.727153:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335239680:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016106.727235:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016106.730338:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335239680:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016106.730394:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114a6a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5029 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016106.730424:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114a6a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5029 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016106.730460:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580900, rc 0) 00000100:00100000:0.0:1734016106.730692:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333546496:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3656us (4011us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016106.730705:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10522 00000100:00100000:3.0:1734016106.735088:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.735461:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333546624 00000100:00100000:0.0:1734016106.735473:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333546624 00000100:00100000:0.0:1734016106.735526:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10523 00000100:00100000:0.0:1734016106.735534:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333546624:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016106.735553:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016106.735572:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114a71 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5030 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.735608:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114a55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4440064->4501503) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5014 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.735615:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016106.735617:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016106.735620:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114a71 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2535424->2539519] (req 2535424->2539519) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5030 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.735650:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114a55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4440064->4501503) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5014 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.735665:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114a55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4440064->4501503) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5014 expref: 6 pid: 7683 timeout: 473 lvb_type: 0 00000100:00100000:0.0:1734016106.735680:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335239808:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016106.736399:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016106.738589:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335239808:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016106.738626:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114a71 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2535424->2539519] (req 2535424->2539519) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5030 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.738646:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581d40, rc 0) 00000100:00100000:0.0:1734016106.738795:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333546624:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3259us (3720us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016106.738833:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10523 00000100:00100000:1.0:1734016106.739158:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333546752 00000100:00100000:1.0:1734016106.739166:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333546752 00010000:00010000:1.0:1734016106.739193:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114a55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4440064->4501503) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5014 expref: 7 pid: 7683 timeout: 473 lvb_type: 0 00000100:00100000:1.0:1734016106.739213:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2864 00000100:00100000:1.0:1734016106.739218:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333546752:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016106.739231:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016106.739256:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114a55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4440064->4501503) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5014 expref: 7 pid: 7683 timeout: 473 lvb_type: 0 00010000:00010000:1.0:1734016106.739271:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114a55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4440064->4501503) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5014 expref: 7 pid: 7683 timeout: 473 lvb_type: 0 00010000:00010000:1.0:1734016106.739293:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114a55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4440064->4501503) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5014 expref: 7 pid: 7683 timeout: 473 lvb_type: 0 00010000:00010000:1.0:1734016106.739305:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016106.739307:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016106.739313:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114a71 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2539519) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5030 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016106.739320:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114a71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2539519) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5030 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016106.739348:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114a71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2539519) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5030 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016106.739362:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e52300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335239936:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016106.739395:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016106.742296:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e52300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335239936:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016106.742327:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016106.742399:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333546752:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3178us (3374us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016106.742411:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2864 00000100:00100000:0.0:1734016106.743023:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.743106:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333547008 00000100:00100000:1.0:1734016106.743121:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333547008 00002000:00100000:1.0:1734016106.743223:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2535424->2539519) req@ffff8800750c2a00 x1818247333547008/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:67/0 lens 488/0 e 0 to 0 dl 1734016117 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016106.743233:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c2a00 with x1818247333547008 ext(2535424->2539519) 00002000:00010000:1.0:1734016106.743237:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c2a00 00000100:00100000:1.0:1734016106.743262:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8259 00000100:00100000:1.0:1734016106.743267:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333547008:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016106.743402:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333547008:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 134us (385us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016106.743408:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8259 00002000:00100000:1.0:1734016106.743413:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2535424->2539519) req@ffff8800750c2a00 x1818247333547008/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:67/0 lens 488/4536 e 0 to 0 dl 1734016117 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016106.743421:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c2a00 with x1818247333547008 ext(2535424->2539519) 00002000:00010000:1.0:1734016106.743423:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c2a00 00000100:00100000:3.0:1734016106.747217:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.752446:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.752531:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333547392 00000100:00100000:0.0:1734016106.752540:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333547392 00000100:00100000:0.0:1734016106.752605:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10524 00000100:00100000:0.0:1734016106.752614:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333547392:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016106.752632:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016106.752651:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114a78 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5037 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.752673:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016106.752676:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016106.752684:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114a78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5037 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016106.752700:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114a78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5037 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016106.752724:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00000100:00100000:0.0:1734016106.752788:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333547392:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 174us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016106.752797:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10524 00000100:00100000:0.0:1734016106.761739:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.761923:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333547648 00000100:00100000:3.0:1734016106.761933:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333547648 00000100:00100000:3.0:1734016106.761995:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2079 00000100:00100000:3.0:1734016106.762003:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:9668:x1818247333547648:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016106.762069:0:7704:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016106.762101:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27114a40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fff expref: 12 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.762136:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016106.762141:0:7704:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016106.762330:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114a7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016106.762345:0:7704:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114a16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fdc expref: 13 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.762354:0:7704:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114a7f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016106.762396:0:7704:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114a16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fdc expref: 13 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.762413:0:7704:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114a16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fdc expref: 13 pid: 13956 timeout: 473 lvb_type: 0 00000100:00100000:3.0:1734016106.762437:0:7704:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335240064:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016106.764940:0:7704:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb840 going to sleep for 11 seconds 00000100:00100000:0.0:1734016106.769286:0:7704:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335240064:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016106.769324:0:7704:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114a7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016106.769667:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.769973:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333547776 00000100:00100000:1.0:1734016106.769982:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333547776 00010000:00010000:1.0:1734016106.770017:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114a16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fdc expref: 14 pid: 13956 timeout: 473 lvb_type: 0 00000100:00100000:1.0:1734016106.770060:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2865 00000100:00100000:1.0:1734016106.770067:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333547776:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016106.770085:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016106.770092:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114a16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fdc expref: 14 pid: 13956 timeout: 473 lvb_type: 0 00010000:00010000:1.0:1734016106.770103:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114a16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fdc expref: 14 pid: 13956 timeout: 473 lvb_type: 0 00010000:00010000:1.0:1734016106.770142:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114a16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e4fdc expref: 14 pid: 13956 timeout: 473 lvb_type: 0 00010000:00010000:1.0:1734016106.770177:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016106.770181:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114a7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016106.770194:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114a7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016106.770202:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114a7f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016106.770237:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016106.770294:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333547776:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 226us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016106.770302:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2865 00010000:00010000:0.0:1734016106.770367:0:7704:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114a7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016106.770372:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114a7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:0.0:1734016106.770495:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968638 00000004:00010000:0.0:1734016106.770550:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800750c0e00 reply state ffff8800759b1000 transno 4294968639 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114a7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016106.770557:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016106.770636:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333547648:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 8634us (8910us total) trans 4294968639 rc 0/0 00000100:00100000:0.0:1734016106.770643:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2079 00000020:00080000:0.0:1734016106.770648:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1734016106.774787:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.775986:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333547904 00000100:00100000:1.0:1734016106.775999:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333547904 00000100:00100000:1.0:1734016106.776062:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10525 00000100:00100000:1.0:1734016106.776071:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333547904:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016106.776093:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016106.776127:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27114a86 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e503e expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016106.776161:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114a71 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2535424->2539519) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5030 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016106.776173:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114a78 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5037 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016106.776179:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016106.776181:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016106.776184:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27114a86 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e503e expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016106.776217:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114a78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5037 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016106.776229:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114a78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5037 expref: 8 pid: 7684 timeout: 473 lvb_type: 1 00000100:00100000:1.0:1734016106.776247:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335240192:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016106.776341:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114a71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2535424->2539519) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5030 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016106.776350:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114a71 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2535424->2539519) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5030 expref: 6 pid: 7684 timeout: 473 lvb_type: 0 00000100:00100000:1.0:1734016106.776359:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335240320:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016106.776378:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1734016106.780183:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335240192:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016106.780202:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335240320:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016106.780245:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27114a86 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e503e expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016106.780268:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016106.780355:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:9668:x1818247333547904:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4283us (5584us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016106.780367:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10525 00000100:00100000:1.0:1734016106.781433:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333548160 00000100:00100000:1.0:1734016106.781442:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333548160 00010000:00010000:1.0:1734016106.781482:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114a71 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2535424->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5030 expref: 7 pid: 7684 timeout: 473 lvb_type: 0 00000100:00100000:1.0:1734016106.781514:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333548032 00000100:00100000:1.0:1734016106.781516:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333548032 00010000:00010000:1.0:1734016106.781525:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114a78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5037 expref: 8 pid: 7684 timeout: 473 lvb_type: 1 00000100:00100000:1.0:1734016106.781542:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2866 00000100:00100000:1.0:1734016106.781550:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333548160:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016106.781570:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016106.781599:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114a71 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2535424->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5030 expref: 7 pid: 7684 timeout: 473 lvb_type: 0 00010000:00010000:1.0:1734016106.781612:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114a71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2535424->2539519) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5030 expref: 7 pid: 7684 timeout: 473 lvb_type: 0 00010000:00010000:1.0:1734016106.781651:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114a71 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2535424->2539519) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5030 expref: 7 pid: 7684 timeout: 473 lvb_type: 0 00010000:00010000:1.0:1734016106.781681:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016106.781714:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333548160:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 165us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016106.781722:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2866 00000100:00100000:1.0:1734016106.781735:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2867 00000100:00100000:1.0:1734016106.781739:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333548032:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016106.781746:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016106.781751:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114a78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5037 expref: 8 pid: 7684 timeout: 473 lvb_type: 1 00010000:00010000:1.0:1734016106.781762:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114a78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5037 expref: 8 pid: 7684 timeout: 473 lvb_type: 1 00010000:00010000:1.0:1734016106.781773:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114a78 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5037 expref: 8 pid: 7684 timeout: 473 lvb_type: 1 00010000:00010000:1.0:1734016106.781781:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016106.781783:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016106.781789:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27114a86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e503e expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016106.781828:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27114a86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e503e expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016106.781868:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27114a86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e503e expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016106.781895:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e53480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335240448:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016106.781938:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016106.785687:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.785865:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e53480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335240448:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016106.785902:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016106.785969:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333548032:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4225us (4587us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016106.785986:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2867 00000100:00100000:3.0:1734016106.797195:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.797378:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333548544 00000100:00100000:1.0:1734016106.797393:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333548544 00002000:00100000:1.0:1734016106.797450:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6279168->7299071) req@ffff8800750d1f80 x1818247333548544/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:67/0 lens 488/0 e 0 to 0 dl 1734016117 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016106.797461:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d1f80 with x1818247333548544 ext(6279168->7299071) 00002000:00010000:1.0:1734016106.797467:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d1f80 00000100:00100000:1.0:1734016106.797506:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8262 00000100:00100000:1.0:1734016106.797514:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333548544:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016106.812735:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333548544:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 15200us (15540us total) trans 0 rc 1019904/1019904 00000100:00100000:1.0:1734016106.812754:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8262 00002000:00100000:1.0:1734016106.812772:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6279168->7299071) req@ffff8800750d1f80 x1818247333548544/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:67/0 lens 488/440 e 0 to 0 dl 1734016117 ref 1 fl Complete:/200/0 rc 1019904/1019904 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016106.812787:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d1f80 with x1818247333548544 ext(6279168->7299071) 00002000:00010000:1.0:1734016106.812797:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d1f80 00000100:00100000:0.0:1734016106.818951:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.819087:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333548672 00000100:00100000:1.0:1734016106.819097:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333548672 00002000:00100000:1.0:1734016106.819155:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7294976->7297304) req@ffff8800750c3480 x1818247333548672/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:67/0 lens 2824/0 e 0 to 0 dl 1734016117 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016106.819165:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c3480 with x1818247333548672 ext(7294976->7297304) 00002000:00010000:1.0:1734016106.819170:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c3480 00000100:00100000:1.0:1734016106.819202:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8263 00000100:00100000:1.0:1734016106.819207:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333548672:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016106.824151:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333548672:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4924us (5192us total) trans 4294969287 rc 0/0 00000100:00100000:1.0:1734016106.824167:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8263 00002000:00100000:1.0:1734016106.824182:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7294976->7297304) req@ffff8800750c3480 x1818247333548672/t4294969287(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:67/0 lens 2824/448 e 0 to 0 dl 1734016117 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016106.824192:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c3480 with x1818247333548672 ext(7294976->7297304) 00002000:00010000:1.0:1734016106.824199:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c3480 00000100:00100000:3.0:1734016106.827274:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.827373:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333548800 00000100:00100000:0.0:1734016106.827384:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333548800 00000100:00100000:0.0:1734016106.827457:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2080 00000100:00100000:0.0:1734016106.827466:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:9668:x1818247333548800:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:0.0:1734016106.828906:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:9668:x1818247333548800:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 1434us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016106.828920:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2080 00000100:00100000:0.0:1734016106.833407:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.833559:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333548928 00000100:00100000:1.0:1734016106.833577:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333548928 00000100:00100000:1.0:1734016106.833839:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10526 00000100:00100000:1.0:1734016106.833849:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333548928:12345-192.168.201.16@tcp:16:fsx.0 00000100:00100000:1.0:1734016106.838178:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333548928:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 4319us (4775us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016106.838197:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10526 00000100:00100000:1.0:1734016106.841347:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.841777:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333549056 00000100:00100000:0.0:1734016106.841791:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333549056 00000100:00100000:0.0:1734016106.841970:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2081 00000100:00100000:0.0:1734016106.841980:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:9668:x1818247333549056:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016106.842009:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016106.842038:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27114a8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5045 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.842178:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27114a94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016106.842196:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27114a94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016106.842209:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27114a94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:0.0:1734016106.842242:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 7297305 00000004:00200000:0.0:1734016106.842247:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016106.842267:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27114a94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016106.842298:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27114a8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5045 expref: 15 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.842339:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27114a94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5045 expref: 14 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.842348:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016106.842352:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016106.842356:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581d40, rc 0) 00000100:00100000:0.0:1734016106.842437:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+14:9668:x1818247333549056:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 458us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016106.842444:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2081 00000100:00100000:3.0:1734016106.847749:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.851550:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333549184 00000100:00100000:1.0:1734016106.851564:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333549184 00000100:00100000:1.0:1734016106.851628:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10527 00000100:00100000:1.0:1734016106.851636:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333549184:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016106.851654:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016106.851674:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27114a9b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e504c expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016106.851727:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335240576:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016106.851824:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016106.864763:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.888264:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.911666:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016106.913423:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114aa9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7032832->7077887] (req 7032832->7077887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.913436:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114aa9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7032832->7077887] (req 7032832->7077887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.919498:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114aa9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7032832->7077887] (req 7032832->7077887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.919516:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114aa9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7032832->7077887] (req 7032832->7077887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.919525:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114aa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7032832->7077887] (req 7032832->7077887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.919541:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc900 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016106.919545:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114aa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7032832->7077887] (req 7032832->7077887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.919553:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114aa9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7032832->7077887] (req 7032832->7077887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.919572:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114aa9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7032832->7077887] (req 7032832->7077887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.919578:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114aa9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7032832->7077887] (req 7032832->7077887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016106.919679:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333549568:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 30790us (31419us total) trans 0 rc 45056/45056 00000100:00100000:0.0:1734016106.919691:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8264 00000100:00100000:0.0:1734016106.923926:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.927283:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333549952 00000100:00100000:0.0:1734016106.927293:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333549952 00000100:00100000:0.0:1734016106.927339:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10529 00000100:00100000:0.0:1734016106.927346:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333549952:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016106.927366:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016106.927390:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114abe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5061 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016106.927414:0:7683:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 7297305, mtime: 0x675afc6b, atime: 0x675afc6a, ctime: 0x675afc6b, blocks: 0x580 00010000:00010000:0.0:1734016106.927438:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016106.927441:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016106.927448:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114abe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5061 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016106.927461:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114abe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5061 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016106.927472:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00000100:00100000:0.0:1734016106.927534:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333549952:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 187us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016106.927542:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10529 00000100:00100000:1.0:1734016106.932027:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.932655:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333550208 00000100:00100000:0.0:1734016106.932667:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333550208 00000100:00100000:0.0:1734016106.932732:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2083 00000100:00100000:0.0:1734016106.932741:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+14:9668:x1818247333550208:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016106.932847:0:7704:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016106.932882:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27114a94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5045 expref: 14 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.932909:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016106.932913:0:7704:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016106.933094:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27114ac5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016106.933121:0:7704:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114ab7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e505a expref: 13 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.933132:0:7704:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27114ac5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016106.933169:0:7704:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e505a expref: 13 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016106.933181:0:7704:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114ab7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e505a expref: 13 pid: 13956 timeout: 474 lvb_type: 0 00000100:00100000:0.0:1734016106.933204:0:7704:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335240960:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016106.933290:0:7704:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eee40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016106.938981:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.944988:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.953283:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016106.960120:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.960570:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333550720 00000100:00100000:0.0:1734016106.960577:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333550720 00002000:00010000:0.0:1734016106.960611:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (3013129->18446744073709551615) 00002000:00100000:0.0:1734016106.960615:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b132d80 with x1818247333550720 ext(3013129->18446744073709551615) 00002000:00010000:0.0:1734016106.960627:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b132d80. 00000100:00100000:0.0:1734016106.960651:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8265 00000100:00100000:0.0:1734016106.960656:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333550720:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016106.964045:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7297305 -> 3013129 00002000:00010000:0.0:1734016106.964058:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016107 -> 1734016107 00002000:00010000:0.0:1734016106.964061:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016106 -> 1734016106 00002000:00010000:0.0:1734016106.964064:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016107 -> 1734016107 00002000:00010000:0.0:1734016106.964066:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1408 -> 1152 00000100:00100000:0.0:1734016106.968907:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333550720:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 8228us (8794us total) trans 4294969288 rc 0/0 00000100:00100000:0.0:1734016106.968929:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8265 00002000:00010000:0.0:1734016106.968939:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (3013129->18446744073709551615) 00002000:00100000:0.0:1734016106.968942:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b132d80 with x1818247333550720 ext(3013129->18446744073709551615) 00002000:00010000:0.0:1734016106.968955:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b132d80. 00000100:00100000:0.0:1734016106.970221:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.973460:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2084 00000100:00100000:3.0:1734016106.973473:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+15:9668:x1818247333550848:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016106.973518:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016106.973547:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114ad3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e506f expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.973682:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114ada lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016106.973701:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016106.973717:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:3.0:1734016106.973745:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 3013129 00000004:00200000:3.0:1734016106.973749:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016106.973770:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016106.973794:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114ad3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e506f expref: 17 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.974779:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114ada lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e506f expref: 16 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.974789:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016106.974792:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016106.974795:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016106.975288:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+16:9668:x1818247333550848:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1816us (5074us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016106.975297:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2084 00000100:00100000:0.0:1734016106.980477:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016106.984603:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.985176:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333551232 00000100:00100000:3.0:1734016106.985184:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333551232 00010000:00010000:3.0:1734016106.985220:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114acc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5068 expref: 9 pid: 7684 timeout: 474 lvb_type: 0 00000100:00100000:3.0:1734016106.985261:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2871 00000100:00100000:3.0:1734016106.985269:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333551232:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016106.985288:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016106.985312:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114acc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5068 expref: 9 pid: 7684 timeout: 474 lvb_type: 0 00010000:00010000:3.0:1734016106.985322:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114acc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5068 expref: 9 pid: 7684 timeout: 474 lvb_type: 0 00010000:00010000:3.0:1734016106.985351:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114acc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5068 expref: 9 pid: 7684 timeout: 474 lvb_type: 0 00010000:00010000:3.0:1734016106.985389:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016106.985392:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016106.985398:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114ae1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2875392->2912255] (req 2875392->2912255) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.985406:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114ae1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2875392->2912255] (req 2875392->2912255) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.985434:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016106.985480:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333551232:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 211us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016106.985486:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2871 00000100:00100000:0.0:1734016106.990871:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.991017:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333551360 00000100:00100000:3.0:1734016106.991030:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333551360 00000100:00100000:3.0:1734016106.991533:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2085 00000100:00100000:3.0:1734016106.991543:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:9668:x1818247333551360:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016106.991578:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016106.991608:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27114ae8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5076 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.991732:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114aef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016106.991748:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016106.991759:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:3.0:1734016106.991790:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 3013129 00000004:00200000:3.0:1734016106.991794:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016106.991906:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016106.991933:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27114ae8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5076 expref: 15 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.991950:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5076 expref: 14 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016106.991958:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016106.991960:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016106.991964:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4480, rc 0) 00000100:00100000:3.0:1734016106.993025:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333551360:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1477us (2159us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016106.993034:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2085 00000100:00100000:0.0:1734016106.999562:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016106.999697:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333551488 00000100:00100000:3.0:1734016106.999709:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333551488 00000100:00100000:3.0:1734016107.000263:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10531 00000100:00100000:3.0:1734016107.000270:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333551488:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016107.000293:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016107.000315:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114af6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e507d expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1734016107.000339:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 3013129, mtime: 0x675afc6b, atime: 0x675afc6a, ctime: 0x675afc6b, blocks: 0x480 00010000:00010000:3.0:1734016107.000363:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016107.000367:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016107.000374:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114af6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e507d expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016107.000389:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114af6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e507d expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016107.000400:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4b40, rc 0) 00000100:00100000:3.0:1734016107.000998:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333551488:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 726us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016107.001006:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10531 00000100:00100000:0.0:1734016107.003437:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016107.003608:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333551616 00000100:00100000:3.0:1734016107.003621:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333551616 00000100:00080000:1.0:1734016107.004061:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016077 00000100:00100000:3.0:1734016107.004638:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10532 00000100:00100000:3.0:1734016107.004650:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88009024cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333551616:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016107.004673:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016107.004700:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114afd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5084 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016107.004733:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016107.004735:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016107.004744:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114afd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5084 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016107.004760:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114afd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5084 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016107.004771:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016107.005390:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88009024cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333551616:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 739us (1964us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016107.005399:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10532 00000100:00100000:0.0:1734016107.015573:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016107.050445:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333551872:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 33909us (34870us total) trans 0 rc 3014656/3014656 00000100:00100000:3.0:1734016107.050464:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8267 00002000:00100000:3.0:1734016107.050480:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->3014655) req@ffff880130409180 x1818247333551872/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:68/0 lens 488/440 e 0 to 0 dl 1734016118 ref 1 fl Complete:/200/0 rc 3014656/3014656 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016107.050489:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880130409180 with x1818247333551872 ext(0->3014655) 00002000:00010000:3.0:1734016107.050495:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130409180 00000100:00100000:0.0:1734016107.059527:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016107.059680:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333552000 00000100:00100000:3.0:1734016107.059693:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333552000 00000100:00100000:3.0:1734016107.059750:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10533 00000100:00100000:3.0:1734016107.059761:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333552000:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016107.059786:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016107.060022:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114b04 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e508b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016107.060057:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114af6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e507d expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016107.060066:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114afd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5084 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016107.060072:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016107.060073:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016107.060078:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114b04 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5992448->6029311] (req 5992448->6029311) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e508b expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016107.060128:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114afd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5084 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016107.060141:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114afd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5084 expref: 7 pid: 7684 timeout: 474 lvb_type: 1 00000100:00100000:3.0:1734016107.060154:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335241472:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016107.060248:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114af6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e507d expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016107.060255:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114af6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e507d expref: 7 pid: 7684 timeout: 474 lvb_type: 1 00000100:00100000:3.0:1734016107.060263:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335241600:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016107.060284:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016107.062975:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016107.063119:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333552128 00000100:00100000:1.0:1734016107.063129:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333552128 00010000:00010000:1.0:1734016107.063176:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114af6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e507d expref: 8 pid: 7684 timeout: 474 lvb_type: 1 00000100:00100000:3.0:1734016107.063427:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335241472:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016107.063437:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335241600:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016107.063470:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114b04 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5992448->6029311] (req 5992448->6029311) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e508b expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016107.063487:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016107.063539:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:9668:x1818247333552000:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3779us (4029us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016107.063550:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10533 00000100:00100000:1.0:1734016107.063749:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2872 00000100:00100000:1.0:1734016107.063755:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130409500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333552128:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016107.063775:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016107.063821:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114af6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e507d expref: 7 pid: 7684 timeout: 474 lvb_type: 1 00010000:00010000:1.0:1734016107.063831:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114af6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e507d expref: 7 pid: 7684 timeout: 474 lvb_type: 1 00010000:00010000:1.0:1734016107.063858:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114af6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e507d expref: 7 pid: 7684 timeout: 474 lvb_type: 1 00010000:00010000:1.0:1734016107.063873:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016107.063896:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130409500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333552128:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 141us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016107.063901:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2872 00000100:00100000:0.0:1734016107.069021:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333552256 00000100:00100000:0.0:1734016107.069033:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333552256 00010000:00010000:0.0:1734016107.069073:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114afd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5084 expref: 8 pid: 7684 timeout: 474 lvb_type: 1 00000100:00100000:0.0:1734016107.069212:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2873 00000100:00100000:0.0:1734016107.069220:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333552256:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016107.069239:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016107.069265:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114afd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5084 expref: 8 pid: 7684 timeout: 474 lvb_type: 1 00010000:00010000:0.0:1734016107.069278:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114afd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5084 expref: 8 pid: 7684 timeout: 474 lvb_type: 1 00010000:00010000:0.0:1734016107.069314:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114afd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5084 expref: 8 pid: 7684 timeout: 474 lvb_type: 1 00010000:00010000:0.0:1734016107.069346:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016107.069348:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016107.069355:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114b04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5992448->6029311) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e508b expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.069366:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114b04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5992448->6029311) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e508b expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.069407:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114b04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5992448->6029311) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e508b expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016107.069420:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335241728:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016107.069484:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eef00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016107.072417:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016107.072954:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333552384 00000100:00100000:3.0:1734016107.072965:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333552384 00000100:00100000:3.0:1734016107.073065:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10534 00000100:00100000:3.0:1734016107.073073:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333552384:12345-192.168.201.16@tcp:22:fsx.0 00000100:00100000:0.0:1734016107.084598:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016107.091383:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016107.100433:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016107.100955:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333552896 00000100:00100000:3.0:1734016107.100966:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333552896 00000100:00100000:3.0:1734016107.101301:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2086 00000100:00100000:3.0:1734016107.101311:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+16:9668:x1818247333552896:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016107.101379:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016107.101413:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114ada lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e506f expref: 16 pid: 13956 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1734016107.101575:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016077 00010000:00010000:3.0:1734016107.101770:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016107.101776:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016107.102448:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27114b19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016107.102465:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114aef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5076 expref: 13 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016107.102470:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27114b19 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016107.102504:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5076 expref: 13 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016107.102516:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114aef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5076 expref: 13 pid: 13956 timeout: 474 lvb_type: 0 00000100:00100000:3.0:1734016107.102530:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335242112:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016107.102603:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016107.105405:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00080000:1.0:1734016107.106290:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016077 00010000:00010000:3.0:1734016107.106729:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114aef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5076 expref: 13 pid: 13956 timeout: 474 lvb_type: 0 00000100:00100000:3.0:1734016107.106746:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335242112:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016107.106769:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27114b19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016107.106778:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27114b19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016107.106784:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27114b19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:3.0:1734016107.106906:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968642 00000004:00010000:3.0:1734016107.106961:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007560b480 reply state ffff8800759b6000 transno 4294968643 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27114b19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:3.0:1734016107.106969:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016107.107049:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333552896:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 5739us (6630us total) trans 4294968643 rc 0/0 00000100:00100000:3.0:1734016107.107055:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2086 00000020:00080000:3.0:1734016107.107060:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016107.113271:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67a75f73-9674-4938-8c12-63813a36f078:3504:1818247335242240:0@lo:400:kworker.0 00000100:00100000:0.0:1734016107.113361:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016107.113389:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3504:1818247335242752:0@lo:400:kworker.0 00000100:00100000:0.0:1734016107.113415:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016107.113453:0:3504:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1734016107.113459:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335242624:0@lo:400:kworker.0 00000100:00100000:0.0:1734016107.113482:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016107.113507:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3506:1818247335242496:0@lo:400:kworker.0 00000100:00100000:0.0:1734016107.113527:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016107.113537:0:3506:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1734016107.113541:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3506:1818247335242368:0@lo:400:kworker.0 00000100:00100000:0.0:1734016107.113558:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016107.113569:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335242880:0@lo:400:kworker.0 00000100:00100000:0.0:1734016107.113582:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016107.113613:0:6474:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335242240 00000100:00100000:0.0:1734016107.113621:0:6474:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335242240 00000100:00100000:0.0:1734016107.113666:0:6474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1734016107.113674:0:6474:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7613050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a75f73-9674-4938-8c12-63813a36f078+18:3504:x1818247335242240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1734016107.113722:0:6474:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7613050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a75f73-9674-4938-8c12-63813a36f078+18:3504:x1818247335242240:12345-0@lo:400:kworker.0 Request processed in 48us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016107.113729:0:6474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1734016107.113777:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67a75f73-9674-4938-8c12-63813a36f078:3504:1818247335242240:0@lo:400:kworker.0 00000100:00080000:1.0:1734016107.115035:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016077 00000100:00080000:1.0:1734016107.115041:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016077 00000100:00080000:1.0:1734016107.115043:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016077 00000100:00080000:1.0:1734016107.115045:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016077 00000100:00100000:0.0:1734016107.115575:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3506:1818247335242368:0@lo:400:kworker.0 00000100:00100000:0.0:1734016107.115589:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335242880:0@lo:400:kworker.0 00000100:00100000:0.0:1734016107.115600:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3506:1818247335242496:0@lo:400:kworker.0 00000100:00100000:0.0:1734016107.115637:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335242624:0@lo:400:kworker.0 00000100:00100000:0.0:1734016107.115647:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3504:1818247335242752:0@lo:400:kworker.0 00000100:00100000:1.0:1734016107.116738:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333553152 00000100:00100000:1.0:1734016107.116747:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333553152 00010000:00010000:0.0:1734016107.117300:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27114b19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.117311:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27114b19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.117318:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27114b19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.117323:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df7cc0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016107.117327:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27114b19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.117334:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27114b19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.117351:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016107.117354:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016107.117358:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27114b19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.117363:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27114b19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016107.117445:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10537 00000100:00100000:1.0:1734016107.117452:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333553152:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016107.117472:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016107.117488:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114b20 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e50a0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.117520:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114b04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5992448->6029311) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e508b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.117526:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016107.117528:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016107.117531:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114b20 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50a0 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.117565:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114b04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5992448->6029311) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e508b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.117578:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114b04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5992448->6029311) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e508b expref: 6 pid: 7684 timeout: 474 lvb_type: 0 00000100:00100000:1.0:1734016107.117591:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b130380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335243008:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016107.117660:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016107.122403:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b130380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335243008:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016107.122451:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114b20 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50a0 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.122476:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016107.122551:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333553152:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5097us (5914us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016107.122562:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10537 00000100:00100000:0.0:1734016107.123175:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016107.129387:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008719ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335243136:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016107.129418:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016107.129469:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b20450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333553280:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5797us (6295us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016107.129486:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2875 00000100:00100000:1.0:1734016107.129758:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016107.130041:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333553408 00000100:00100000:3.0:1734016107.130051:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333553408 00002000:00010000:3.0:1734016107.130092:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6172009->18446744073709551615) 00002000:00100000:3.0:1734016107.130097:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b130380 with x1818247333553408 ext(6172009->18446744073709551615) 00002000:00010000:3.0:1734016107.130122:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b130380. 00000100:00100000:3.0:1734016107.130146:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8268 00000100:00100000:3.0:1734016107.130155:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333553408:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016107.130434:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 6028944 -> 6172009 00002000:00010000:3.0:1734016107.130438:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016107 -> 1734016107 00002000:00010000:3.0:1734016107.130441:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016106 -> 1734016106 00002000:00010000:3.0:1734016107.130444:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016107 -> 1734016107 00002000:00010000:3.0:1734016107.130446:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1224 -> 1224 00000100:00100000:3.0:1734016107.130478:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333553408:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 324us (721us total) trans 4294969290 rc 0/0 00000100:00100000:3.0:1734016107.130484:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8268 00002000:00010000:3.0:1734016107.130487:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6172009->18446744073709551615) 00002000:00100000:3.0:1734016107.130490:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b130380 with x1818247333553408 ext(6172009->18446744073709551615) 00002000:00010000:3.0:1734016107.130494:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b130380. 00000100:00100000:1.0:1734016107.140355:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016107.140444:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333553664 00000100:00100000:0.0:1734016107.140457:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333553664 00002000:00100000:0.0:1734016107.140509:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (3014656->6172671) req@ffff88012b131880 x1818247333553664/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:68/0 lens 488/0 e 0 to 0 dl 1734016118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016107.140519:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b131880 with x1818247333553664 ext(3014656->6172671) 00002000:00010000:0.0:1734016107.140525:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b131880 00000100:00100000:0.0:1734016107.140564:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8269 00000100:00100000:0.0:1734016107.140571:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333553664:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016107.172027:0:3505:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1734016107.172062:0:3505:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335243264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1734016107.172149:0:3505:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016107.172254:0:7685:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335243264 00000100:00100000:0.0:1734016107.172267:0:7685:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335243264 00000100:00100000:0.0:1734016107.172322:0:7685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1734016107.172332:0:7685:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335243264:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1734016107.172757:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333553664:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 32181us (32411us total) trans 0 rc 3158016/3158016 00000100:00100000:1.0:1734016107.172770:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8269 00002000:00100000:1.0:1734016107.172784:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (3014656->6172671) req@ffff88012b131880 x1818247333553664/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:68/0 lens 488/440 e 0 to 0 dl 1734016118 ref 1 fl Complete:/200/0 rc 3158016/3158016 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016107.172796:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b131880 with x1818247333553664 ext(3014656->6172671) 00002000:00010000:1.0:1734016107.172822:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b131880 00002000:00000024:0.0:1734016107.172965:0:7685:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 980042304 pending 0 free 3923038208 avail 3691319296 00000100:00100000:0.0:1734016107.173020:0:7685:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335243264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 689us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016107.173027:0:7685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1734016107.173121:0:3505:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335243264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1734016107.179431:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016107.179555:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333553792 00000100:00100000:1.0:1734016107.179569:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333553792 00002000:00100000:1.0:1734016107.179628:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (6148096->6172008) req@ffff88007560ad80 x1818247333553792/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:68/0 lens 488/0 e 0 to 0 dl 1734016118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016107.179640:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560ad80 with x1818247333553792 ext(6148096->6172008) 00002000:00010000:1.0:1734016107.179647:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560ad80 00000100:00100000:1.0:1734016107.179779:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8270 00000100:00100000:1.0:1734016107.179787:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333553792:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016107.183599:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333553792:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 3799us (4167us total) trans 4294969291 rc 0/0 00000100:00100000:1.0:1734016107.183615:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8270 00002000:00100000:1.0:1734016107.183632:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (6148096->6172008) req@ffff88007560ad80 x1818247333553792/t4294969291(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:68/0 lens 488/448 e 0 to 0 dl 1734016118 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016107.183642:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560ad80 with x1818247333553792 ext(6148096->6172008) 00002000:00010000:1.0:1734016107.183649:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560ad80 00000100:00100000:3.0:1734016107.186681:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333553920 00000100:00100000:3.0:1734016107.186694:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333553920 00000100:00100000:3.0:1734016107.186746:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2087 00000100:00100000:3.0:1734016107.186754:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+17:9668:x1818247333553920:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:3.0:1734016107.186923:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+17:9668:x1818247333553920:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 169us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016107.186930:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2087 00000100:00100000:0.0:1734016107.188997:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016107.189138:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333554048 00000100:00100000:1.0:1734016107.189149:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333554048 00000100:00100000:1.0:1734016107.189429:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10538 00000100:00100000:1.0:1734016107.189437:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333554048:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016107.191382:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969291 is committed 00000001:00080000:0.0:1734016107.191399:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969289 is committed 00000100:00100000:1.0:1734016107.191617:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333554048:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2173us (2629us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016107.191631:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10538 00000100:00100000:0.0:1734016107.197033:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016107.203372:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333554304 00000100:00100000:1.0:1734016107.203382:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333554304 00000100:00100000:1.0:1734016107.203432:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10539 00000100:00100000:1.0:1734016107.203439:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333554304:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016107.203460:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016107.203482:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114b35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e50ae expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016107.203547:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335243392:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016107.203614:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00002000:00010000:1.0:1734016107.205753:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016106 -> 1734016107 00002000:00010000:1.0:1734016107.205762:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 1224 -> 1272 00000100:00100000:1.0:1734016107.205784:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335243392:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016107.205832:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114b35 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50ae expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016107.205849:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114b35 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50ae expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016107.205870:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d8c0, rc 0) 00000100:00100000:1.0:1734016107.205940:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333554304:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2500us (2694us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016107.205950:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10539 00000100:00100000:0.0:1734016107.211308:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016107.211418:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333554432 00000100:00100000:1.0:1734016107.211432:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333554432 00000100:00100000:1.0:1734016107.212325:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10540 00000100:00100000:1.0:1734016107.212334:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333554432:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016107.212356:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016107.212375:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114b3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e50b5 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016107.212438:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335243520:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016107.213302:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016107.215640:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335243520:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016107.215684:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114b3c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50b5 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016107.215699:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114b3c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50b5 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016107.216834:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016107.217357:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333554432:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5016us (6051us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016107.217371:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10540 00000100:00100000:3.0:1734016107.225170:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016107.225273:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333554688 00000100:00100000:0.0:1734016107.225284:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333554688 00000100:00100000:0.0:1734016107.225351:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2089 00000100:00100000:0.0:1734016107.225359:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+17:9668:x1818247333554688:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016107.225606:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114b43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.225629:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27114b2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50a7 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.225635:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114b43 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.225672:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27114b2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50a7 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.225684:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27114b2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50a7 expref: 13 pid: 6478 timeout: 474 lvb_type: 0 00000100:00100000:0.0:1734016107.225700:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075608380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335243648:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016107.225766:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016107.235628:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075608380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335243648:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016107.236308:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333554816 00000100:00100000:1.0:1734016107.236317:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333554816 00010000:00010000:1.0:1734016107.236355:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27114b2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50a7 expref: 14 pid: 6478 timeout: 474 lvb_type: 0 00000100:00100000:1.0:1734016107.236385:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2876 00000100:00100000:1.0:1734016107.236393:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1981:x1818247333554816:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016107.236408:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016107.236414:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27114b2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50a7 expref: 14 pid: 6478 timeout: 474 lvb_type: 0 00010000:00010000:1.0:1734016107.236425:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27114b2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50a7 expref: 14 pid: 6478 timeout: 474 lvb_type: 0 00010000:00010000:1.0:1734016107.236447:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27114b2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50a7 expref: 14 pid: 6478 timeout: 474 lvb_type: 0 00010000:00010000:1.0:1734016107.236465:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016107.236470:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114b43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016107.236480:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114b43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016107.236487:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114b43 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016107.236502:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016107.237237:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114b43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016107.239709:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1981:x1818247333554816:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3291us (3474us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016107.239728:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2876 00010000:00010000:0.0:1734016107.240575:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114b43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.240591:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114b43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:0.0:1734016107.240740:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968644 00000004:00010000:0.0:1734016107.240833:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880073b4bb80 reply state ffff880075574000 transno 4294968645 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27114b43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016107.240841:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016107.241020:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333554688:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 15659us (15861us total) trans 4294968645 rc 0/0 00000100:00100000:0.0:1734016107.241030:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2089 00000020:00080000:0.0:1734016107.241035:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016107.249843:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333554944 00000100:00100000:0.0:1734016107.249854:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333554944 00002000:00010000:0.0:1734016107.249899:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6696054->18446744073709551615) 00002000:00100000:0.0:1734016107.249903:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719d880 with x1818247333554944 ext(6696054->18446744073709551615) 00002000:00010000:0.0:1734016107.249918:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719d880. 00000100:00100000:0.0:1734016107.249956:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8271 00000100:00100000:0.0:1734016107.249968:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333554944:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016107.250488:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 6172009 -> 6696054 00002000:00010000:0.0:1734016107.250491:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016107 -> 1734016107 00002000:00010000:0.0:1734016107.250541:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016107 -> 1734016106 00002000:00010000:0.0:1734016107.250543:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016107 -> 1734016107 00002000:00010000:0.0:1734016107.250545:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1272 -> 1272 00000100:00100000:0.0:1734016107.251523:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333554944:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1552us (2246us total) trans 4294969292 rc 0/0 00000100:00100000:0.0:1734016107.251532:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8271 00002000:00010000:0.0:1734016107.251536:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6696054->18446744073709551615) 00002000:00100000:0.0:1734016107.251539:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719d880 with x1818247333554944 ext(6696054->18446744073709551615) 00002000:00010000:0.0:1734016107.251546:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719d880. 00000100:00100000:0.0:1734016107.254330:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333555072 00000100:00100000:0.0:1734016107.254341:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333555072 00000100:00100000:0.0:1734016107.254393:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2090 00000100:00100000:0.0:1734016107.254401:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+19:9668:x1818247333555072:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016107.254432:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016107.254454:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27114b4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e50bc expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.254553:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27114b51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.254566:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27114b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.254577:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27114b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016107.254600:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 6696054 00000004:00200000:0.0:1734016107.254603:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016107.254618:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27114b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.254638:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27114b4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50bc expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.257420:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27114b51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50bc expref: 20 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.257440:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016107.257443:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016107.257447:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:0.0:1734016107.257538:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333555072:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3134us (3298us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016107.257549:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2090 00000100:00100000:1.0:1734016107.270563:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333555328 00000100:00100000:1.0:1734016107.270576:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333555328 00002000:00100000:1.0:1734016107.270628:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (6172672->6696959) req@ffff88008719df80 x1818247333555328/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:68/0 lens 488/0 e 0 to 0 dl 1734016118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016107.270639:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719df80 with x1818247333555328 ext(6172672->6696959) 00002000:00010000:1.0:1734016107.270646:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719df80 00000100:00100000:1.0:1734016107.270679:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8272 00000100:00100000:1.0:1734016107.270685:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333555328:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016107.292546:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333555328:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 20262us (20666us total) trans 0 rc 524288/524288 00000100:00100000:1.0:1734016107.292564:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8272 00002000:00100000:1.0:1734016107.292582:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (6172672->6696959) req@ffff88008719df80 x1818247333555328/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:68/0 lens 488/440 e 0 to 0 dl 1734016118 ref 1 fl Complete:/200/0 rc 524288/524288 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016107.292593:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719df80 with x1818247333555328 ext(6172672->6696959) 00002000:00010000:1.0:1734016107.292601:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719df80 00000100:00100000:3.0:1734016107.299677:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016107.301568:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333555456 00000100:00100000:1.0:1734016107.301584:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333555456 00002000:00100000:1.0:1734016107.301640:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (6471680->6488063) req@ffff880073b49880 x1818247333555456/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:68/0 lens 16872/0 e 0 to 0 dl 1734016118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016107.301650:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b49880 with x1818247333555456 ext(6471680->6488063) 00002000:00010000:1.0:1734016107.301655:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b49880 00000100:00100000:1.0:1734016107.301698:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8273 00000100:00100000:1.0:1734016107.301705:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333555456:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016107.303563:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333555456:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1848us (3889us total) trans 4294969293 rc 0/0 00000100:00100000:1.0:1734016107.303579:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8273 00002000:00100000:1.0:1734016107.303590:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (6471680->6488063) req@ffff880073b49880 x1818247333555456/t4294969293(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:68/0 lens 16872/448 e 0 to 0 dl 1734016118 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016107.303598:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b49880 with x1818247333555456 ext(6471680->6488063) 00002000:00010000:1.0:1734016107.303604:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b49880 00000100:00100000:0.0:1734016107.305984:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333555584 00000100:00100000:0.0:1734016107.305995:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333555584 00000100:00100000:0.0:1734016107.306049:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2091 00000100:00100000:0.0:1734016107.306058:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333555584:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:0.0:1734016107.306233:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333555584:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 175us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016107.306246:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2091 00000100:00100000:1.0:1734016107.311057:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333555712 00000100:00100000:1.0:1734016107.311073:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333555712 00000100:00100000:1.0:1734016107.311238:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10541 00000100:00100000:1.0:1734016107.311249:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333555712:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016107.313066:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969293 is committed 00000100:00100000:1.0:1734016107.313378:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333555712:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2125us (2507us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016107.313391:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10541 00000100:00100000:3.0:1734016107.319277:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016107.320256:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333555840 00000100:00100000:1.0:1734016107.320269:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333555840 00000100:00100000:1.0:1734016107.320337:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10542 00000100:00100000:1.0:1734016107.320345:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333555840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016107.320371:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016107.320394:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114b58 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e50c3 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.320429:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114b20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50a0 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.320438:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016107.320440:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016107.320444:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114b58 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2920448->2953215] (req 2920448->2953215) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50c3 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.320482:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114b20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50a0 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.320495:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114b20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50a0 expref: 6 pid: 8216 timeout: 474 lvb_type: 0 00000100:00100000:1.0:1734016107.320512:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335243776:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016107.320605:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016107.328326:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333555968 00000100:00100000:0.0:1734016107.328338:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333555968 00010000:00010000:0.0:1734016107.328386:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114b20 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50a0 expref: 7 pid: 8216 timeout: 474 lvb_type: 0 00000100:00100000:0.0:1734016107.328430:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2877 00000100:00100000:0.0:1734016107.328438:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333555968:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016107.328463:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1734016107.328490:0:9876:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1272 -> 1304 00010000:00010000:0.0:1734016107.328497:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114b20 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50a0 expref: 7 pid: 8216 timeout: 474 lvb_type: 0 00010000:00010000:0.0:1734016107.328512:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114b20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50a0 expref: 7 pid: 8216 timeout: 474 lvb_type: 0 00010000:00010000:0.0:1734016107.328548:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016107.328551:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016107.328558:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114b58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2920448->2953215) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50c3 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.328568:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114b58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2920448->2953215) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50c3 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.328609:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114b58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2920448->2953215) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50c3 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016107.328621:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075608380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335243904:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016107.328698:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00010000:00010000:1.0:1734016107.330082:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114b20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50a0 expref: 7 pid: 8216 timeout: 474 lvb_type: 0 00000100:00100000:1.0:1734016107.330137:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335243776:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016107.330173:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114b58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2920448->2953215) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50c3 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.330185:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016107.330236:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333555840:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9889us (11186us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016107.330247:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10542 00000100:00100000:3.0:1734016107.334962:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016107.335106:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075608380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335243904:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016107.335142:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016107.335311:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333556096 00000100:00100000:1.0:1734016107.335322:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333556096 00000100:00100000:1.0:1734016107.335391:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10543 00000100:00100000:1.0:1734016107.335401:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333556096:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016107.335758:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 6696054 -> 6696054 00002000:00010000:1.0:1734016107.335761:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016107 -> 1734016107 00002000:00010000:1.0:1734016107.335764:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016106 -> 1734016106 00002000:00010000:1.0:1734016107.335766:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016107 -> 1734016107 00002000:00010000:1.0:1734016107.335768:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:0.0:1734016107.335882:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333555968:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7430us (8014us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016107.335894:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2877 00000100:00100000:1.0:1734016107.336967:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333556096:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1564us (2024us total) trans 4294969294 rc 0/0 00000100:00100000:1.0:1734016107.336975:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10543 00000100:00100000:3.0:1734016107.344795:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016107.345017:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333556224 00000100:00100000:1.0:1734016107.345029:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333556224 00000100:00100000:1.0:1734016107.345084:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10544 00000100:00100000:1.0:1734016107.345091:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333556224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016107.345122:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016107.345144:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27114b5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e50ca expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016107.345211:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335244032:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016107.345297:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016107.348843:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335244032:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016107.348900:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27114b5f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50ca expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016107.348917:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27114b5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50ca expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016107.348953:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016107.349032:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333556224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3939us (4247us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016107.349043:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10544 00000100:00100000:1.0:1734016107.356927:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333556352 00000100:00100000:1.0:1734016107.356946:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333556352 00000100:00100000:0.0:1734016107.357078:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10545 00000100:00100000:0.0:1734016107.357087:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333556352:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016107.357119:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016107.357146:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114b66 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e50d1 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016107.357214:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075608380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335244160:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016107.357289:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016107.362058:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075608380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335244160:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016107.362126:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114b66 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50d1 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016107.362146:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114b66 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50d1 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016107.362183:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581200, rc 0) 00000100:00100000:0.0:1734016107.363475:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333556352:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6382us (9389us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016107.363488:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10545 00000100:00100000:0.0:1734016107.368610:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333556608 00000100:00100000:0.0:1734016107.368624:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333556608 00000100:00100000:0.0:1734016107.369078:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2092 00000100:00100000:0.0:1734016107.369089:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333556608:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016107.369178:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016107.369210:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27114b51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50bc expref: 20 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.369248:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016107.369253:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016107.369441:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b6d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.369454:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.369462:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:0.0:1734016107.369499:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968646 00000004:00010000:0.0:1734016107.369518:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88008719f100 reply state ffff880075573000 transno 4294968647 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016107.369524:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016107.369624:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+22:9668:x1818247333556608:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 535us (1415us total) trans 4294968647 rc 0/0 00000100:00100000:0.0:1734016107.369631:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2092 00000020:00080000:0.0:1734016107.369636:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1734016107.375635:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.375652:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.375660:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.375669:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581200 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016107.375675:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.375686:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b6d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.375716:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016107.375719:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016107.375723:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b6d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.375728:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:1.0:1734016107.379796:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333556736 00000100:00100000:1.0:1734016107.379838:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333556736 00000100:00100000:1.0:1734016107.379916:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10546 00000100:00100000:1.0:1734016107.379925:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333556736:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016107.379951:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016107.379974:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27114b74 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e50d8 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.380013:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114b58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2920448->2953215) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50c3 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.380021:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016107.380023:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016107.380027:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27114b74 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50d8 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.380065:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114b58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2920448->2953215) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50c3 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.380078:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114b58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2920448->2953215) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50c3 expref: 6 pid: 8216 timeout: 474 lvb_type: 0 00000100:00100000:1.0:1734016107.380093:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335244288:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016107.380199:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016107.382237:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008719f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335244416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1734016107.382305:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016107.382716:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008719f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335244416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1734016107.387248:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335244288:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016107.388042:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27114b74 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50d8 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.388066:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016107.389700:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333556736:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9757us (15851us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016107.389719:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10546 00000100:00100000:0.0:1734016107.390013:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333556864 00000100:00100000:0.0:1734016107.390024:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333556864 00010000:00010000:0.0:1734016107.390061:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114b58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2920448->2953215) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50c3 expref: 7 pid: 8216 timeout: 474 lvb_type: 0 00000100:00100000:0.0:1734016107.390089:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2878 00000100:00100000:0.0:1734016107.390108:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333556864:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016107.390125:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016107.390149:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114b58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2920448->2953215) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50c3 expref: 7 pid: 8216 timeout: 474 lvb_type: 0 00010000:00010000:0.0:1734016107.390163:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114b58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2920448->2953215) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50c3 expref: 7 pid: 8216 timeout: 474 lvb_type: 0 00010000:00010000:0.0:1734016107.390186:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114b58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2920448->2953215) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50c3 expref: 7 pid: 8216 timeout: 474 lvb_type: 0 00010000:00010000:0.0:1734016107.390222:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016107.390224:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016107.390231:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27114b74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50d8 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.390240:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27114b74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50d8 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.390279:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27114b74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50d8 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016107.390949:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075609880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335244544:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016107.391019:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:3.0:1734016107.403428:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016107.403535:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333556992 00000100:00100000:1.0:1734016107.403549:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333556992 00002000:00010000:1.0:1734016107.403594:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (4506742->18446744073709551615) 00002000:00100000:1.0:1734016107.403599:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db0aa00 with x1818247333556992 ext(4506742->18446744073709551615) 00002000:00010000:1.0:1734016107.403621:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db0aa00. 00000100:00100000:1.0:1734016107.403676:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8274 00000100:00100000:1.0:1734016107.403685:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333556992:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016107.407229:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 6696054 -> 4506742 00002000:00010000:1.0:1734016107.407240:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016107 -> 1734016107 00002000:00010000:1.0:1734016107.407243:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016106 -> 1734016106 00002000:00010000:1.0:1734016107.407245:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016107 -> 1734016107 00002000:00010000:1.0:1734016107.407246:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1304 -> 1152 00000100:00100000:1.0:1734016107.407353:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333556992:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 3659us (3935us total) trans 4294969295 rc 0/0 00000100:00100000:1.0:1734016107.407368:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8274 00002000:00010000:1.0:1734016107.407376:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (4506742->18446744073709551615) 00002000:00100000:1.0:1734016107.407380:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db0aa00 with x1818247333556992 ext(4506742->18446744073709551615) 00002000:00010000:1.0:1734016107.407386:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db0aa00. 00000100:00100000:3.0:1734016107.416715:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016107.425586:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333557376 00000100:00100000:0.0:1734016107.425597:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333557376 00000100:00100000:0.0:1734016107.425692:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2094 00000100:00100000:0.0:1734016107.425700:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+22:9668:x1818247333557376:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016107.425764:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016107.425796:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114b82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50df expref: 22 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.425860:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016107.425864:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016107.426060:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.426073:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.426081:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:0.0:1734016107.426127:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968648 00000004:00010000:0.0:1734016107.426147:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88008719c380 reply state ffff880073a07000 transno 4294968649 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016107.426153:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016107.430286:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+24:9668:x1818247333557376:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 4557us (4775us total) trans 4294968649 rc 0/0 00000100:00100000:0.0:1734016107.430303:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2094 00000020:00080000:0.0:1734016107.430314:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1734016107.442771:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.442792:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.442852:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.442859:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581200 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016107.442865:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.442875:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.442901:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016107.442905:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016107.442911:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.442917:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27114b89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016107.445965:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016107.446059:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333557504 00000100:00100000:0.0:1734016107.446069:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333557504 00002000:00010000:0.0:1734016107.446122:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (161251->18446744073709551615) 00002000:00100000:0.0:1734016107.446127:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db08380 with x1818247333557504 ext(161251->18446744073709551615) 00002000:00010000:0.0:1734016107.446141:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db08380. 00000100:00100000:0.0:1734016107.446171:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8275 00000100:00100000:0.0:1734016107.446180:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333557504:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016107.450004:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 4506742 -> 161251 00002000:00010000:1.0:1734016107.450014:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016107 -> 1734016108 00002000:00010000:1.0:1734016107.450017:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016106 -> 1734016106 00002000:00010000:1.0:1734016107.450019:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016107 -> 1734016108 00002000:00010000:1.0:1734016107.450021:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1152 -> 256 00000100:00100000:1.0:1734016107.450136:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333557504:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 3949us (4177us total) trans 4294969296 rc 0/0 00000100:00100000:1.0:1734016107.450149:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8275 00002000:00010000:1.0:1734016107.450155:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (161251->18446744073709551615) 00002000:00100000:1.0:1734016107.450158:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db08380 with x1818247333557504 ext(161251->18446744073709551615) 00002000:00010000:1.0:1734016107.450164:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db08380. 00000100:00100000:0.0:1734016107.452325:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333557632 00000100:00100000:0.0:1734016107.452335:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333557632 00000100:00100000:0.0:1734016107.452381:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2095 00000100:00100000:0.0:1734016107.452388:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+23:9668:x1818247333557632:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016107.452415:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016107.452435:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27114b90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e50e6 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.452552:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27114b97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.452566:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27114b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.452580:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27114b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:0.0:1734016107.452610:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 161251 00000004:00200000:0.0:1734016107.452615:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016107.452633:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27114b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.452657:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27114b90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50e6 expref: 25 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.452673:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27114b97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50e6 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.452682:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016107.452684:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016107.452687:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:0.0:1734016107.455000:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+24:9668:x1818247333557632:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2599us (2894us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016107.455019:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2095 00000100:00100000:0.0:1734016107.458586:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333557760 00000100:00100000:0.0:1734016107.458601:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333557760 00000100:00100000:0.0:1734016107.458659:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2096 00000100:00100000:0.0:1734016107.458669:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:9668:x1818247333557760:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016107.458695:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016107.458720:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114b9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e50ed expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.458860:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27114ba5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.458875:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27114ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.458885:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27114ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:0.0:1734016107.458913:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 161251 00000004:00200000:0.0:1734016107.458917:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016107.458935:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27114ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016107.458959:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114b9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50ed expref: 15 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.458978:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27114ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50ed expref: 14 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.458986:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016107.458989:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016107.458992:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:0.0:1734016107.463342:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333557760:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4655us (4854us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016107.463356:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2096 00000100:00100000:3.0:1734016107.467780:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016107.468958:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333557888 00000100:00100000:1.0:1734016107.468971:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333557888 00000100:00100000:1.0:1734016107.469560:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10547 00000100:00100000:1.0:1734016107.469571:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333557888:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016107.469597:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016107.469625:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114bac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e50f4 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016107.469697:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335244672:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016107.472286:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016107.484719:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335244672:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016107.484775:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114bac lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50f4 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016107.484794:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114bac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50f4 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016107.485545:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016107.485618:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333557888:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 16046us (17847us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016107.485629:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10547 00000100:00100000:1.0:1734016107.489144:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333558016 00000100:00100000:1.0:1734016107.489159:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333558016 00000100:00100000:1.0:1734016107.489234:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10548 00000100:00100000:1.0:1734016107.489244:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333558016:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016107.489279:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016107.489310:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114bb3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e50fb expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.489365:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27114b74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50d8 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.489373:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016107.489376:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016107.489380:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114bb3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [32768->69631] (req 32768->69631) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50fb expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.489435:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27114b74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50d8 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.489450:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27114b74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50d8 expref: 8 pid: 8216 timeout: 474 lvb_type: 0 00000100:00100000:1.0:1734016107.489468:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335244800:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016107.489572:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016107.501582:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016107.502874:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27114b74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50d8 expref: 9 pid: 8216 timeout: 474 lvb_type: 0 00000100:00100000:1.0:1734016107.502896:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335244800:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016107.502930:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114bb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 32768->69631) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50fb expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.502941:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016107.503144:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333558016:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 13900us (14153us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016107.503154:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10548 00000100:00100000:3.0:1734016107.512155:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016107.512261:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333558272 00000100:00100000:1.0:1734016107.512275:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333558272 00000100:00100000:1.0:1734016107.512343:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10549 00000100:00100000:1.0:1734016107.512351:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333558272:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016107.512664:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 161251 -> 161251 00002000:00010000:1.0:1734016107.512669:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016108 -> 1734016108 00002000:00010000:1.0:1734016107.512671:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016106 -> 1734016106 00002000:00010000:1.0:1734016107.512674:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016108 -> 1734016107 00002000:00010000:1.0:1734016107.512676:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 256 -> 264 00000100:00100000:1.0:1734016107.512737:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333558272:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 385us (597us total) trans 4294969297 rc 0/0 00000100:00100000:1.0:1734016107.512743:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10549 00000100:00100000:0.0:1734016107.552770:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016107.552917:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333558400 00000100:00100000:3.0:1734016107.552927:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333558400 00000100:00100000:3.0:1734016107.552982:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10550 00000100:00100000:3.0:1734016107.552989:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333558400:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016107.553014:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016107.553039:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114bba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5102 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016107.553123:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335245056:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016107.553216:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb480 going to sleep for 11 seconds 00002000:00010000:3.0:1734016107.555550:0:7683:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016107 -> 1734016108 00000100:00100000:3.0:1734016107.555597:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335245056:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016107.555643:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114bba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5102 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016107.555662:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114bba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5102 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016107.556322:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016107.557049:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333558400:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4052us (4284us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016107.557061:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10550 00000100:00100000:3.0:1734016107.564709:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333558528 00000100:00100000:3.0:1734016107.564724:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333558528 00000100:00100000:1.0:1734016107.564934:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10551 00000100:00100000:1.0:1734016107.564948:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007539b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333558528:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016107.564974:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016107.565005:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27114bc1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5109 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016107.565108:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335245184:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016107.565181:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016107.569526:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335245184:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016107.569608:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27114bc1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5109 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016107.569634:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27114bc1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5109 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016107.569661:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016107.569748:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007539b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333558528:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4800us (5188us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016107.569766:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10551 00000100:00100000:1.0:1734016107.575789:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016107.591292:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016107.602795:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007539bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335245312:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016107.602854:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114bc8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:3.0:1734016107.603017:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333559040 00000100:00100000:3.0:1734016107.603028:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333559040 00010000:00010000:3.0:1734016107.603075:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27114ba5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50ed expref: 14 pid: 6478 timeout: 474 lvb_type: 0 00000100:00100000:3.0:1734016107.603139:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2880 00000100:00100000:3.0:1734016107.603148:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007539aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1981:x1818247333559040:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016107.603171:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016107.603179:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27114ba5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50ed expref: 14 pid: 6478 timeout: 474 lvb_type: 0 00010000:00010000:3.0:1734016107.603192:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27114ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50ed expref: 14 pid: 6478 timeout: 474 lvb_type: 0 00010000:00010000:3.0:1734016107.603222:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27114ba5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50ed expref: 14 pid: 6478 timeout: 474 lvb_type: 0 00010000:00010000:3.0:1734016107.603605:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016107.603610:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114bc8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016107.603622:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114bc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016107.603629:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114bc8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.604359:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114bc8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.604368:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114bc8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:0.0:1734016107.604501:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968650 00000004:00010000:0.0:1734016107.604557:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012b131180 reply state ffff8800756fd000 transno 4294968651 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114bc8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016107.604565:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016107.604692:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+26:9668:x1818247333558912:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 13050us (13418us total) trans 4294968651 rc 0/0 00000100:00100000:0.0:1734016107.604702:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2097 00000020:00080000:0.0:1734016107.604708:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1734016107.606900:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016107.606969:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007539aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1981:x1818247333559040:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3815us (4317us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016107.606980:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2880 00010000:00010000:0.0:1734016107.609478:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114bc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.609501:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114bc8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.609508:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114bc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.609516:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcb40 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016107.609521:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114bc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.609529:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114bc8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.609548:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016107.609551:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016107.609555:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114bc8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.609560:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114bc8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016107.610089:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016107.611335:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333559168 00000100:00100000:3.0:1734016107.611350:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333559168 00000100:00100000:3.0:1734016107.611945:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10553 00000100:00100000:3.0:1734016107.611957:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333559168:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016107.611987:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016107.612018:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114bcf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5110 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016107.612063:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 32768->69631) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50fb expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016107.612072:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016107.612075:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016107.612080:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114bcf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5110 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016107.612137:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 32768->69631) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50fb expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016107.612156:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114bb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 32768->69631) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50fb expref: 8 pid: 8216 timeout: 474 lvb_type: 0 00000100:00100000:3.0:1734016107.612171:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335245440:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016107.612273:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb480 going to sleep for 11 seconds 00010000:00010000:3.0:1734016107.619085:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114bb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 32768->69631) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e50fb expref: 9 pid: 8216 timeout: 474 lvb_type: 0 00000100:00100000:3.0:1734016107.619109:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335245440:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016107.619136:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114bcf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5110 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016107.619148:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016107.619208:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:9668:x1818247333559168:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7253us (9124us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016107.619216:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10553 00000100:00100000:3.0:1734016107.622075:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075399500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335245568:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016107.622106:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016107.622151:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075398a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333559296:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4576us (4767us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016107.622162:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2881 00000100:00100000:1.0:1734016107.624208:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016107.626517:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016107.634413:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016107.634507:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333559680 00000100:00100000:3.0:1734016107.634517:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333559680 00000100:00100000:3.0:1734016107.634562:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10554 00000100:00100000:3.0:1734016107.634571:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333559680:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016107.634593:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016107.634614:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114be4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e511e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016107.634679:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335245696:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016107.634767:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016107.638190:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335245696:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016107.638247:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114be4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e511e expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016107.638263:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114be4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e511e expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016107.638295:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:0.0:1734016107.638370:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333559680:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3797us (3966us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016107.638383:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10554 00000100:00100000:0.0:1734016107.642661:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016107.648620:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016107.655036:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016107.672259:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016107.685571:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1734016107.685747:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114bcf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5110 expref: 10 pid: 8216 timeout: 474 lvb_type: 0 00000100:00100000:2.0:1734016107.685775:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2882 00000100:00100000:2.0:1734016107.685780:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333560320:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016107.685811:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016107.685836:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114bcf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5110 expref: 10 pid: 8216 timeout: 474 lvb_type: 0 00010000:00010000:2.0:1734016107.685848:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114bcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5110 expref: 10 pid: 8216 timeout: 474 lvb_type: 0 00010000:00010000:2.0:1734016107.686523:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114bcf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5110 expref: 10 pid: 8216 timeout: 474 lvb_type: 0 00010000:00010000:2.0:1734016107.686571:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016107.686574:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016107.686582:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c07 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6959104->6963199) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e513a expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016107.686591:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6959104->6963199) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e513a expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016107.686639:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6959104->6963199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e513a expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016107.686654:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075399500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335246208:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016107.686725:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016107.701730:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075399500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335246208:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016107.701758:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016107.701844:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333560320:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 16061us (16272us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016107.701858:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2882 00000100:00100000:0.0:1734016107.715109:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016107.715220:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333560576 00000100:00100000:1.0:1734016107.715230:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333560576 00002000:00100000:1.0:1734016107.715278:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->6963199) req@ffff8801369f3b80 x1818247333560576/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:68/0 lens 504/0 e 0 to 0 dl 1734016118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016107.715289:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f3b80 with x1818247333560576 ext(0->6963199) 00002000:00010000:1.0:1734016107.715295:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f3b80 00000100:00100000:1.0:1734016107.715327:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8277 00000100:00100000:1.0:1734016107.715333:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333560576:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016107.721132:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016107.721199:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016107.721324:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333560704 00000100:00100000:2.0:1734016107.721338:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333560704 00002000:00100000:2.0:1734016107.721393:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8388607) req@ffff8801369f1180 x1818247333560704/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:68/0 lens 504/0 e 0 to 0 dl 1734016118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016107.721404:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1180 with x1818247333560704 ext(4190208->8388607) 00002000:00010000:2.0:1734016107.721410:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f1180 00000100:00100000:2.0:1734016107.721433:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333560832 00000100:00100000:2.0:1734016107.721436:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333560832 00002000:00100000:2.0:1734016107.721446:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8388608->8699903) req@ffff8801369f3100 x1818247333560832/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:68/0 lens 488/0 e 0 to 0 dl 1734016118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016107.721453:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f3100 with x1818247333560832 ext(8388608->8699903) 00002000:00010000:2.0:1734016107.721455:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f3100 00000100:00100000:2.0:1734016107.721472:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8278 00000100:00100000:2.0:1734016107.721481:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333560704:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016107.724295:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8279 00000100:00100000:3.0:1734016107.724310:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333560832:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016107.757688:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1982:x1818247333560832:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 33371us (36478us total) trans 0 rc 311296/311296 00000100:00100000:3.0:1734016107.757704:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8279 00002000:00100000:3.0:1734016107.757717:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8388608->8699903) req@ffff8801369f3100 x1818247333560832/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:68/0 lens 488/440 e 0 to 0 dl 1734016118 ref 1 fl Complete:/200/0 rc 311296/311296 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016107.757726:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f3100 with x1818247333560832 ext(8388608->8699903) 00002000:00010000:3.0:1734016107.757732:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f3100 00000100:00100000:0.0:1734016107.789916:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333560576:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 74563us (74810us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1734016107.789933:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8277 00002000:00100000:0.0:1734016107.789953:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->6963199) req@ffff8801369f3b80 x1818247333560576/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:68/0 lens 504/440 e 0 to 0 dl 1734016118 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016107.789964:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f3b80 with x1818247333560576 ext(0->6963199) 00002000:00010000:0.0:1734016107.789970:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f3b80 00000100:00100000:3.0:1734016107.815901:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333560704:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 94399us (94762us total) trans 0 rc 4194304/4194304 00000100:00100000:3.0:1734016107.815914:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8278 00002000:00100000:3.0:1734016107.815928:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8388607) req@ffff8801369f1180 x1818247333560704/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:68/0 lens 504/440 e 0 to 0 dl 1734016118 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016107.815937:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1180 with x1818247333560704 ext(4190208->8388607) 00002000:00010000:3.0:1734016107.815947:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f1180 00000100:00100000:2.0:1734016107.834397:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016107.834527:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333561088 00000100:00100000:0.0:1734016107.834539:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333561088 00000100:00100000:0.0:1734016107.834908:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10558 00000100:00100000:0.0:1734016107.834916:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007539aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:9668:x1818247333561088:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016107.834941:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016107.834964:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114c0e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5141 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.834999:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c07 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6959104->6963199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e513a expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.835007:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016107.835009:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016107.835013:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114c0e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6176768->6205439] (req 6176768->6205439) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5141 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.835050:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6959104->6963199) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e513a expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.835062:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6959104->6963199) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e513a expref: 8 pid: 8216 timeout: 474 lvb_type: 0 00000100:00100000:0.0:1734016107.835075:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335246336:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016107.835158:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eec00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016107.855643:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016107.855719:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333561216 00000100:00100000:2.0:1734016107.855731:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333561216 00000100:00100000:0.0:1734016107.855749:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335246336:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016107.855771:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6959104->6963199) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e513a expref: 9 pid: 8216 timeout: 474 lvb_type: 0 00010000:00010000:0.0:1734016107.855780:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114c0e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [6176768->6205439] (req 6176768->6205439) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5141 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016107.855796:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:2.0:1734016107.855837:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2883 00000100:00100000:2.0:1734016107.855844:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333561216:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016107.855859:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016107.855883:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6959104->6963199) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e513a expref: 9 pid: 8216 timeout: 474 lvb_type: 0 00000100:00100000:0.0:1734016107.855893:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007539aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:9668:x1818247333561088:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 20977us (21510us total) trans 0 rc 0/0 00010000:00010000:2.0:1734016107.855894:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6959104->6963199) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e513a expref: 9 pid: 8216 timeout: 474 lvb_type: 0 00000100:00100000:0.0:1734016107.855901:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10558 00010000:00010000:2.0:1734016107.855918:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c07 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6959104->6963199) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e513a expref: 9 pid: 8216 timeout: 474 lvb_type: 0 00010000:00010000:2.0:1734016107.855933:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016107.855936:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016107.855943:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114c0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6176768->6205439) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5141 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016107.855952:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114c0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6176768->6205439) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5141 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016107.855982:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114c0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6176768->6205439) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5141 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016107.856003:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075398a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335246464:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016107.856042:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016107.861508:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075398a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335246464:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016107.861522:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1734016107.861537:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016107.861590:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333561344 00000100:00100000:1.0:1734016107.861597:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333561344 00000100:00100000:1.0:1734016107.861657:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10559 00000100:00100000:1.0:1734016107.861665:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333561344:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016107.862005:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8698860 -> 8698860 00002000:00010000:1.0:1734016107.862009:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016108 -> 1734016108 00002000:00010000:1.0:1734016107.862011:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016106 -> 1734016106 00002000:00010000:1.0:1734016107.862013:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016108 -> 1734016108 00002000:00010000:1.0:1734016107.862016:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 192 -> 192 00000100:00100000:1.0:1734016107.862084:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333561344:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 418us (561us total) trans 4294969300 rc 0/0 00000100:00100000:1.0:1734016107.862104:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10559 00000100:00100000:2.0:1734016107.863500:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333561216:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7648us (7862us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016107.863510:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2883 00000100:00100000:0.0:1734016107.871440:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016107.871609:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333561600 00000100:00100000:2.0:1734016107.871628:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333561600 00000100:00100000:2.0:1734016107.871727:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2100 00000100:00100000:2.0:1734016107.871742:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+26:9668:x1818247333561600:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016107.871946:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016107.871992:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114bf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e512c expref: 26 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016107.872021:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016107.872028:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016107.872265:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27114c15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016107.872283:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27114bdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5117 expref: 13 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016107.872290:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27114c15 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016107.872328:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27114bdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5117 expref: 13 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016107.872342:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27114bdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5117 expref: 13 pid: 13956 timeout: 475 lvb_type: 0 00000100:00100000:2.0:1734016107.872355:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075398a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335246592:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016107.875395:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016107.876398:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075398a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335246592:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016107.876429:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27114c15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016107.876858:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016107.876953:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333561728 00000100:00100000:0.0:1734016107.876961:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333561728 00010000:00010000:0.0:1734016107.876995:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27114bdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5117 expref: 14 pid: 13956 timeout: 475 lvb_type: 0 00000100:00100000:0.0:1734016107.877036:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2884 00000100:00100000:0.0:1734016107.877044:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075398a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1981:x1818247333561728:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016107.877059:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016107.877065:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27114bdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5117 expref: 14 pid: 13956 timeout: 475 lvb_type: 0 00010000:00010000:0.0:1734016107.877075:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27114bdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5117 expref: 14 pid: 13956 timeout: 475 lvb_type: 0 00010000:00010000:0.0:1734016107.877111:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27114bdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5117 expref: 14 pid: 13956 timeout: 475 lvb_type: 0 00010000:00010000:0.0:1734016107.877130:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016107.877135:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27114c15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.877144:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27114c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.877152:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27114c15 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.877179:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016107.877228:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075398a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1981:x1818247333561728:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 184us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016107.877236:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2884 00010000:00010000:3.0:1734016107.877519:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27114c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016107.877526:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27114c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:3.0:1734016107.877624:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968652 00000004:00010000:3.0:1734016107.877665:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8801369f3800 reply state ffff8800756fb000 transno 4294968653 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27114c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:3.0:1734016107.877672:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016107.877741:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+28:9668:x1818247333561600:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 6004us (6314us total) trans 4294968653 rc 0/0 00000100:00100000:3.0:1734016107.877747:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2100 00000020:00080000:3.0:1734016107.877751:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1734016107.879198:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27114c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.879209:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27114c15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.879215:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27114c15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.879221:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc240 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016107.879226:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27114c15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.879232:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27114c15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.879246:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016107.879249:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016107.879252:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27114c15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016107.879258:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27114c15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016107.879980:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016107.880083:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333561856 00000100:00100000:3.0:1734016107.880103:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333561856 00002000:00010000:3.0:1734016107.880142:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (7641996->18446744073709551615) 00002000:00100000:3.0:1734016107.880148:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1f80 with x1818247333561856 ext(7641996->18446744073709551615) 00002000:00010000:3.0:1734016107.880160:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f1f80. 00000100:00100000:3.0:1734016107.880262:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8280 00000100:00100000:3.0:1734016107.880271:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333561856:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016107.881683:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8698860 -> 7641996 00002000:00010000:3.0:1734016107.881695:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016108 -> 1734016108 00002000:00010000:3.0:1734016107.881698:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016106 -> 1734016106 00002000:00010000:3.0:1734016107.881700:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016108 -> 1734016108 00002000:00010000:3.0:1734016107.881703:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 192 -> 192 00000100:00100000:3.0:1734016107.884615:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333561856:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 4325us (4619us total) trans 4294969301 rc 0/0 00000100:00100000:3.0:1734016107.884636:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8280 00002000:00010000:3.0:1734016107.884645:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (7641996->18446744073709551615) 00002000:00100000:3.0:1734016107.884650:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1f80 with x1818247333561856 ext(7641996->18446744073709551615) 00002000:00010000:3.0:1734016107.884660:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f1f80. 00000100:00100000:0.0:1734016107.893178:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016107.893323:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333561984 00000100:00100000:3.0:1734016107.893335:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333561984 00000100:00100000:1.0:1734016107.894668:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2101 00000100:00100000:1.0:1734016107.894679:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+27:9668:x1818247333561984:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016107.894714:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016107.894738:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27114c1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5148 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.894881:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27114c23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016107.894900:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27114c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016107.894913:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27114c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:1.0:1734016107.894942:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 7641996 00000004:00200000:1.0:1734016107.894947:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016107.894968:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27114c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016107.894995:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27114c1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5148 expref: 29 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.895589:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27114c23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5148 expref: 28 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016107.895597:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016107.895600:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016107.895604:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016107.895675:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+28:9668:x1818247333561984:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 996us (2510us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016107.895683:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2101 00000100:00100000:0.0:1734016107.907516:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016107.907624:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333562112 00000100:00100000:3.0:1734016107.907637:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333562112 00000100:00100000:3.0:1734016107.907786:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10560 00000100:00100000:3.0:1734016107.907794:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333562112:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016107.907857:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016107.907880:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27114c2a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e514f expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016107.907952:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335246720:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016107.908022:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016107.915214:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335246720:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016107.915268:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27114c2a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e514f expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016107.915283:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27114c2a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e514f expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016107.915303:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7840, rc 0) 00000100:00100000:3.0:1734016107.919930:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333562112:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12114us (12406us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016107.919942:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10560 00000100:00100000:0.0:1734016107.922114:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016107.922329:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333562240 00000100:00100000:3.0:1734016107.922347:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333562240 00000100:00100000:3.0:1734016107.923396:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10561 00000100:00100000:3.0:1734016107.923407:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:9668:x1818247333562240:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016107.923433:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016107.923458:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c31 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5156 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016107.923491:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114c0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6176768->6205439) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5141 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016107.923499:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016107.923501:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016107.923504:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c31 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5967872->5971967] (req 5967872->5971967) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5156 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016107.923539:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114c0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6176768->6205439) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5141 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016107.923551:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114c0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6176768->6205439) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5141 expref: 11 pid: 8216 timeout: 475 lvb_type: 0 00000100:00100000:3.0:1734016107.923563:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335246848:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016107.923636:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016107.927154:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335246848:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016107.927193:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c31 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5967872->5971967] (req 5967872->5971967) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5156 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016107.929160:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016107.929428:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333562368 00000100:00100000:1.0:1734016107.929443:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333562368 00010000:00010000:1.0:1734016107.929489:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114c0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6176768->6205439) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5141 expref: 12 pid: 8216 timeout: 475 lvb_type: 0 00000100:00100000:1.0:1734016107.929543:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2885 00000100:00100000:1.0:1734016107.929551:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333562368:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016107.929574:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016107.929604:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114c0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 6176768->6205439) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5141 expref: 12 pid: 8216 timeout: 475 lvb_type: 0 00010000:00010000:1.0:1734016107.929619:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114c0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 6176768->6205439) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5141 expref: 12 pid: 8216 timeout: 475 lvb_type: 0 00010000:00010000:1.0:1734016107.929651:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114c0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 6176768->6205439) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5141 expref: 12 pid: 8216 timeout: 475 lvb_type: 0 00010000:00010000:3.0:1734016107.930055:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016107.930057:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016107.930066:0:7683:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5967872->5971967) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5156 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016107.930075:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5967872->5971967) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5156 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016107.930125:0:7683:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5967872->5971967) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5156 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016107.930139:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335246976:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016107.930214:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00010000:00010000:1.0:1734016107.931995:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016107.932052:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333562368:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 2497us (2898us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016107.932065:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2885 00000100:00100000:0.0:1734016107.935442:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335246976:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016107.935476:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:0.0:1734016107.935543:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:9668:x1818247333562240:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12137us (13442us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016107.935554:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10561 00000100:00100000:0.0:1734016107.939061:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016107.942141:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333562624 00000100:00100000:3.0:1734016107.942158:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333562624 00002000:00100000:3.0:1734016107.942228:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5967872->5971967) req@ffff880073ad7480 x1818247333562624/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:68/0 lens 488/0 e 0 to 0 dl 1734016118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016107.942238:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad7480 with x1818247333562624 ext(5967872->5971967) 00002000:00010000:3.0:1734016107.942246:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad7480 00000100:00100000:3.0:1734016107.942302:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8281 00000100:00100000:3.0:1734016107.942310:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333562624:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016107.943158:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333562624:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 843us (4105us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016107.943175:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8281 00002000:00100000:3.0:1734016107.943184:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5967872->5971967) req@ffff880073ad7480 x1818247333562624/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:68/0 lens 488/4536 e 0 to 0 dl 1734016118 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016107.943193:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad7480 with x1818247333562624 ext(5967872->5971967) 00002000:00010000:3.0:1734016107.943197:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad7480 00000100:00100000:1.0:1734016107.946911:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016107.947029:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333562880 00000100:00100000:3.0:1734016107.947041:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333562880 00002000:00100000:3.0:1734016107.947105:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5963776->5967871) req@ffff88007487e680 x1818247333562880/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:68/0 lens 488/0 e 0 to 0 dl 1734016118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016107.947115:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487e680 with x1818247333562880 ext(5963776->5967871) 00002000:00010000:3.0:1734016107.947121:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487e680 00000100:00100000:3.0:1734016107.947150:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8282 00000100:00100000:3.0:1734016107.947157:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333562880:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016107.947361:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333562880:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 204us (471us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016107.947368:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8282 00002000:00100000:3.0:1734016107.947374:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5963776->5967871) req@ffff88007487e680 x1818247333562880/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:68/0 lens 488/4536 e 0 to 0 dl 1734016118 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016107.947381:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487e680 with x1818247333562880 ext(5963776->5967871) 00002000:00010000:3.0:1734016107.947383:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487e680 00000100:00100000:0.0:1734016107.954585:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016107.955918:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333563136 00000100:00100000:2.0:1734016107.955932:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333563136 00002000:00100000:2.0:1734016107.956956:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5959680->5963775) req@ffff880073ad7b80 x1818247333563136/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:68/0 lens 488/0 e 0 to 0 dl 1734016118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016107.956967:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad7b80 with x1818247333563136 ext(5959680->5963775) 00002000:00010000:2.0:1734016107.956973:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad7b80 00000100:00100000:2.0:1734016107.957015:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8283 00000100:00100000:2.0:1734016107.957022:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333563136:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016107.960887:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333563136:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 3846us (6301us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016107.960906:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8283 00002000:00100000:2.0:1734016107.960925:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5959680->5963775) req@ffff880073ad7b80 x1818247333563136/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:68/0 lens 488/4536 e 0 to 0 dl 1734016118 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016107.960936:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad7b80 with x1818247333563136 ext(5959680->5963775) 00002000:00010000:2.0:1734016107.960944:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad7b80 00000100:00100000:0.0:1734016107.978558:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016107.978638:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333563392 00000100:00100000:2.0:1734016107.978650:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333563392 00002000:00100000:2.0:1734016107.978707:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5955584->5959679) req@ffff880073ad5500 x1818247333563392/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:68/0 lens 488/0 e 0 to 0 dl 1734016118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016107.978724:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5500 with x1818247333563392 ext(5955584->5959679) 00002000:00010000:2.0:1734016107.978731:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5500 00000100:00100000:2.0:1734016107.978770:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8284 00000100:00100000:2.0:1734016107.978776:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333563392:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016107.979002:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333563392:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 225us (456us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016107.979009:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8284 00002000:00100000:2.0:1734016107.979013:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5955584->5959679) req@ffff880073ad5500 x1818247333563392/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:68/0 lens 488/4536 e 0 to 0 dl 1734016118 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016107.979019:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5500 with x1818247333563392 ext(5955584->5959679) 00002000:00010000:2.0:1734016107.979022:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5500 00000100:00100000:0.0:1734016107.989974:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016107.990097:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333563648 00000100:00100000:3.0:1734016107.990109:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333563648 00002000:00100000:3.0:1734016107.990165:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5951488->5955583) req@ffff880073ad6a00 x1818247333563648/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:68/0 lens 488/0 e 0 to 0 dl 1734016118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016107.990178:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad6a00 with x1818247333563648 ext(5951488->5955583) 00002000:00010000:3.0:1734016107.990184:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad6a00 00000100:00100000:3.0:1734016107.990257:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8285 00000100:00100000:3.0:1734016107.990264:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333563648:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016107.991522:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333563648:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1249us (1552us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016107.991535:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8285 00002000:00100000:3.0:1734016107.991547:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5951488->5955583) req@ffff880073ad6a00 x1818247333563648/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:68/0 lens 488/4536 e 0 to 0 dl 1734016118 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016107.991554:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad6a00 with x1818247333563648 ext(5951488->5955583) 00002000:00010000:3.0:1734016107.991561:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad6a00 00000100:00100000:0.0:1734016107.997186:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016107.997408:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333563904 00000100:00100000:3.0:1734016107.997419:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333563904 00002000:00100000:3.0:1734016107.997472:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5947392->5951487) req@ffff880073ad5880 x1818247333563904/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:68/0 lens 488/0 e 0 to 0 dl 1734016118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016107.997482:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5880 with x1818247333563904 ext(5947392->5951487) 00002000:00010000:3.0:1734016107.997488:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5880 00000100:00100000:3.0:1734016107.997600:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8286 00000100:00100000:3.0:1734016107.997607:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333563904:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016107.999007:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333563904:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1392us (1824us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016107.999014:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8286 00002000:00100000:3.0:1734016107.999023:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5947392->5951487) req@ffff880073ad5880 x1818247333563904/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:68/0 lens 488/4536 e 0 to 0 dl 1734016118 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016107.999031:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5880 with x1818247333563904 ext(5947392->5951487) 00002000:00010000:3.0:1734016107.999034:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5880 00000100:00100000:0.0:1734016108.007533:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016108.007663:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333564160 00000100:00100000:3.0:1734016108.007674:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333564160 00000100:00080000:1.0:1734016108.009113:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016078 00002000:00100000:2.0:1734016108.009821:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5943296->5947391) req@ffff880073ad6d80 x1818247333564160/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.009834:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad6d80 with x1818247333564160 ext(5943296->5947391) 00002000:00010000:2.0:1734016108.009842:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad6d80 00000100:00100000:2.0:1734016108.010490:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8287 00000100:00100000:2.0:1734016108.010505:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333564160:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.013384:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333564160:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 2864us (5844us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.013399:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8287 00002000:00100000:2.0:1734016108.013417:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5943296->5947391) req@ffff880073ad6d80 x1818247333564160/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.013435:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad6d80 with x1818247333564160 ext(5943296->5947391) 00002000:00010000:2.0:1734016108.013444:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad6d80 00000100:00100000:0.0:1734016108.022744:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.022875:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333564416 00000100:00100000:2.0:1734016108.022886:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333564416 00002000:00100000:2.0:1734016108.022942:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5939200->5943295) req@ffff880073ad4a80 x1818247333564416/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.022953:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4a80 with x1818247333564416 ext(5939200->5943295) 00002000:00010000:2.0:1734016108.022959:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4a80 00000100:00100000:2.0:1734016108.023189:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8288 00000100:00100000:2.0:1734016108.023196:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333564416:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.023703:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333564416:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 506us (972us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.023711:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8288 00002000:00100000:2.0:1734016108.023717:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5939200->5943295) req@ffff880073ad4a80 x1818247333564416/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.023724:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4a80 with x1818247333564416 ext(5939200->5943295) 00002000:00010000:2.0:1734016108.023727:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4a80 00000100:00100000:0.0:1734016108.027383:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.027482:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333564672 00000100:00100000:2.0:1734016108.027495:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333564672 00002000:00100000:2.0:1734016108.027549:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5935104->5939199) req@ffff880073ad4000 x1818247333564672/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.027560:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4000 with x1818247333564672 ext(5935104->5939199) 00002000:00010000:2.0:1734016108.027566:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4000 00000100:00100000:2.0:1734016108.027593:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8289 00000100:00100000:2.0:1734016108.027600:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333564672:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.027820:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333564672:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 201us (431us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.027829:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8289 00002000:00100000:2.0:1734016108.027837:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5935104->5939199) req@ffff880073ad4000 x1818247333564672/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.027844:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4000 with x1818247333564672 ext(5935104->5939199) 00002000:00010000:2.0:1734016108.027847:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4000 00000100:00100000:0.0:1734016108.030849:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.031215:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333564928 00000100:00100000:2.0:1734016108.031229:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333564928 00002000:00100000:2.0:1734016108.031282:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5931008->5935103) req@ffff880073ad7800 x1818247333564928/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.031294:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad7800 with x1818247333564928 ext(5931008->5935103) 00002000:00010000:2.0:1734016108.031301:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad7800 00000100:00100000:2.0:1734016108.031370:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8290 00000100:00100000:2.0:1734016108.031379:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333564928:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.032279:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333564928:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 897us (1484us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.032289:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8290 00002000:00100000:2.0:1734016108.032297:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5931008->5935103) req@ffff880073ad7800 x1818247333564928/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.032306:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad7800 with x1818247333564928 ext(5931008->5935103) 00002000:00010000:2.0:1734016108.032311:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad7800 00000100:00100000:0.0:1734016108.035524:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.036294:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333565184 00000100:00100000:2.0:1734016108.036308:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333565184 00002000:00100000:2.0:1734016108.036365:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5926912->5931007) req@ffff880073ad6680 x1818247333565184/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.036378:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad6680 with x1818247333565184 ext(5926912->5931007) 00002000:00010000:2.0:1734016108.036384:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad6680 00000100:00100000:2.0:1734016108.036954:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8291 00000100:00100000:2.0:1734016108.036963:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333565184:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.037343:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333565184:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 378us (1835us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.037352:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8291 00002000:00100000:2.0:1734016108.037358:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (5926912->5931007) req@ffff880073ad6680 x1818247333565184/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.037366:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad6680 with x1818247333565184 ext(5926912->5931007) 00002000:00010000:2.0:1734016108.037369:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad6680 00000100:00100000:0.0:1734016108.040430:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016108.041241:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333565312 00000100:00100000:3.0:1734016108.041256:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333565312 00000100:00100000:3.0:1734016108.041670:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2102 00000100:00100000:3.0:1734016108.041679:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:9668:x1818247333565312:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016108.041704:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016108.041728:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27114c38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e515d expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.041855:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27114c3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016108.041871:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27114c3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016108.041886:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27114c3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:3.0:1734016108.041918:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 7641996 00000004:00200000:3.0:1734016108.041923:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016108.041943:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27114c3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016108.041972:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27114c38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e515d expref: 15 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.042287:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27114c3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e515d expref: 14 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.042298:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016108.042301:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016108.042304:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016108.042372:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333565312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 694us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016108.042379:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2102 00000100:00100000:0.0:1734016108.044981:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.045123:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333565568 00000100:00100000:2.0:1734016108.045137:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333565568 00002000:00100000:2.0:1734016108.045207:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (7639040->7643135) req@ffff8800749eb100 x1818247333565568/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.045303:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749eb100 with x1818247333565568 ext(7639040->7643135) 00002000:00010000:2.0:1734016108.045309:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749eb100 00000100:00100000:2.0:1734016108.045382:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8292 00000100:00100000:2.0:1734016108.045391:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333565568:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.046038:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333565568:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 646us (1071us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.046047:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8292 00002000:00100000:2.0:1734016108.046053:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (7639040->7643135) req@ffff8800749eb100 x1818247333565568/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.046060:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749eb100 with x1818247333565568 ext(7639040->7643135) 00002000:00010000:2.0:1734016108.046063:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749eb100 00000100:00100000:2.0:1734016108.048593:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.048718:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333565824 00000100:00100000:0.0:1734016108.048728:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333565824 00002000:00100000:0.0:1734016108.048779:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (7634944->7639039) req@ffff880075399500 x1818247333565824/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016108.048790:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075399500 with x1818247333565824 ext(7634944->7639039) 00002000:00010000:0.0:1734016108.048795:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075399500 00000100:00100000:0.0:1734016108.048855:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8293 00000100:00100000:0.0:1734016108.048862:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333565824:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016108.049052:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333565824:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 188us (472us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016108.049061:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8293 00002000:00100000:0.0:1734016108.049067:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (7634944->7639039) req@ffff880075399500 x1818247333565824/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016108.049074:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075399500 with x1818247333565824 ext(7634944->7639039) 00002000:00010000:0.0:1734016108.049077:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075399500 00000100:00100000:0.0:1734016108.051444:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.051555:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333566080 00000100:00100000:2.0:1734016108.051564:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333566080 00002000:00100000:2.0:1734016108.051609:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (7630848->7634943) req@ffff8800749e9c00 x1818247333566080/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.051619:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e9c00 with x1818247333566080 ext(7630848->7634943) 00002000:00010000:2.0:1734016108.051625:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e9c00 00000100:00100000:2.0:1734016108.051645:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8294 00000100:00100000:2.0:1734016108.051652:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333566080:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.051867:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333566080:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 212us (436us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.051874:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8294 00002000:00100000:2.0:1734016108.051880:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (7630848->7634943) req@ffff8800749e9c00 x1818247333566080/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.051885:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e9c00 with x1818247333566080 ext(7630848->7634943) 00002000:00010000:2.0:1734016108.051889:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e9c00 00000100:00100000:0.0:1734016108.055000:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.055140:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333566336 00000100:00100000:2.0:1734016108.055152:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333566336 00002000:00100000:2.0:1734016108.055205:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7626752->7630847) req@ffff8800749e9180 x1818247333566336/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.055215:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e9180 with x1818247333566336 ext(7626752->7630847) 00002000:00010000:2.0:1734016108.055221:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e9180 00000100:00100000:2.0:1734016108.055261:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8295 00000100:00100000:2.0:1734016108.055270:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333566336:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.055623:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333566336:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 352us (637us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.055629:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8295 00002000:00100000:2.0:1734016108.055635:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7626752->7630847) req@ffff8800749e9180 x1818247333566336/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.055641:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e9180 with x1818247333566336 ext(7626752->7630847) 00002000:00010000:2.0:1734016108.055644:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e9180 00000100:00100000:0.0:1734016108.058518:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.058633:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333566592 00000100:00100000:2.0:1734016108.058644:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333566592 00002000:00100000:2.0:1734016108.058691:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7622656->7626751) req@ffff8800749eb800 x1818247333566592/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.058702:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749eb800 with x1818247333566592 ext(7622656->7626751) 00002000:00010000:2.0:1734016108.058708:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749eb800 00000100:00100000:2.0:1734016108.059221:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8296 00000100:00100000:2.0:1734016108.059229:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333566592:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.059434:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333566592:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 204us (926us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.059442:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8296 00002000:00100000:2.0:1734016108.059449:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7622656->7626751) req@ffff8800749eb800 x1818247333566592/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.059457:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749eb800 with x1818247333566592 ext(7622656->7626751) 00002000:00010000:2.0:1734016108.059460:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749eb800 00000100:00100000:0.0:1734016108.063443:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.063649:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333566848 00000100:00100000:2.0:1734016108.063665:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333566848 00002000:00100000:2.0:1734016108.063741:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (7618560->7622655) req@ffff8800749eb480 x1818247333566848/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.063755:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749eb480 with x1818247333566848 ext(7618560->7622655) 00002000:00010000:2.0:1734016108.063762:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749eb480 00000100:00100000:2.0:1734016108.063793:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8297 00000100:00100000:2.0:1734016108.064513:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333566848:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.064733:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333566848:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 932us (1314us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.064741:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8297 00002000:00100000:2.0:1734016108.064747:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (7618560->7622655) req@ffff8800749eb480 x1818247333566848/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.064754:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749eb480 with x1818247333566848 ext(7618560->7622655) 00002000:00010000:2.0:1734016108.064759:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749eb480 00000100:00100000:0.0:1734016108.068954:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.069188:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333567104 00000100:00100000:2.0:1734016108.069201:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333567104 00002000:00100000:2.0:1734016108.069268:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (7614464->7618559) req@ffff8800749e9880 x1818247333567104/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.069282:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e9880 with x1818247333567104 ext(7614464->7618559) 00002000:00010000:2.0:1734016108.069287:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e9880 00000100:00100000:2.0:1734016108.069713:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8298 00000100:00100000:2.0:1734016108.069724:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333567104:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.070477:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333567104:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 751us (1541us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.070486:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8298 00002000:00100000:2.0:1734016108.070498:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (7614464->7618559) req@ffff8800749e9880 x1818247333567104/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.070506:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e9880 with x1818247333567104 ext(7614464->7618559) 00002000:00010000:2.0:1734016108.070511:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e9880 00000100:00100000:0.0:1734016108.073950:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.074205:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333567360 00000100:00100000:2.0:1734016108.074218:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333567360 00002000:00100000:2.0:1734016108.074282:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (7610368->7614463) req@ffff8800749eaa00 x1818247333567360/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.074296:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749eaa00 with x1818247333567360 ext(7610368->7614463) 00002000:00010000:2.0:1734016108.074303:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749eaa00 00000100:00100000:2.0:1734016108.074328:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8299 00000100:00100000:2.0:1734016108.074336:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333567360:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.074569:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333567360:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 233us (636us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.074577:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8299 00002000:00100000:2.0:1734016108.074583:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (7610368->7614463) req@ffff8800749eaa00 x1818247333567360/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.074591:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749eaa00 with x1818247333567360 ext(7610368->7614463) 00002000:00010000:2.0:1734016108.074594:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749eaa00 00000100:00100000:0.0:1734016108.077289:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.077414:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333567616 00000100:00100000:2.0:1734016108.077428:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333567616 00002000:00100000:2.0:1734016108.077481:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7606272->7610367) req@ffff8800749e8a80 x1818247333567616/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.077491:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e8a80 with x1818247333567616 ext(7606272->7610367) 00002000:00010000:2.0:1734016108.077501:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e8a80 00000100:00100000:2.0:1734016108.077529:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8300 00000100:00100000:2.0:1734016108.077537:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333567616:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.078427:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333567616:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 887us (1153us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.078435:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8300 00002000:00100000:2.0:1734016108.078443:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7606272->7610367) req@ffff8800749e8a80 x1818247333567616/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.078449:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e8a80 with x1818247333567616 ext(7606272->7610367) 00002000:00010000:2.0:1734016108.078452:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e8a80 00000100:00100000:0.0:1734016108.082168:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.082487:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333567872 00000100:00100000:2.0:1734016108.082499:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333567872 00002000:00100000:2.0:1734016108.082548:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7602176->7606271) req@ffff880075444a80 x1818247333567872/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.082559:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075444a80 with x1818247333567872 ext(7602176->7606271) 00002000:00010000:2.0:1734016108.082565:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075444a80 00000100:00100000:2.0:1734016108.082591:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8301 00000100:00100000:2.0:1734016108.082600:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333567872:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.082839:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333567872:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 239us (683us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.082847:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8301 00002000:00100000:2.0:1734016108.082853:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7602176->7606271) req@ffff880075444a80 x1818247333567872/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.082859:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075444a80 with x1818247333567872 ext(7602176->7606271) 00002000:00010000:2.0:1734016108.082862:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075444a80 00000100:00100000:0.0:1734016108.086277:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.086381:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333568000 00000100:00100000:2.0:1734016108.086391:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333568000 00000100:00100000:2.0:1734016108.086606:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10562 00000100:00100000:2.0:1734016108.086614:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:9668:x1818247333568000:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016108.086636:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016108.086658:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c46 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5164 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.086699:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c31 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5967872->5971967) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5156 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.086706:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.086708:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.086712:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c46 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3715072->3735551] (req 3715072->3735551) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5164 expref: 12 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.086753:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5967872->5971967) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5156 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.086766:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5967872->5971967) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5156 expref: 8 pid: 7683 timeout: 475 lvb_type: 0 00000100:00100000:2.0:1734016108.086783:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007539bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335247104:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016108.086987:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016108.089432:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007539bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335247104:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016108.089474:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c46 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3715072->3735551] (req 3715072->3735551) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5164 expref: 12 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.089493:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016108.089547:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:9668:x1818247333568000:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2932us (3280us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016108.089557:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10562 00000100:00100000:0.0:1734016108.090023:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016108.090268:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333568128 00000100:00100000:1.0:1734016108.090278:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333568128 00010000:00010000:1.0:1734016108.090308:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5967872->5971967) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5156 expref: 9 pid: 7683 timeout: 475 lvb_type: 0 00000100:00100000:1.0:1734016108.090335:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2886 00000100:00100000:1.0:1734016108.090342:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333568128:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016108.090361:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016108.090386:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5967872->5971967) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5156 expref: 9 pid: 7683 timeout: 475 lvb_type: 0 00010000:00010000:1.0:1734016108.090398:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5967872->5971967) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5156 expref: 9 pid: 7683 timeout: 475 lvb_type: 0 00010000:00010000:1.0:1734016108.090427:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c31 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5967872->5971967) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5156 expref: 9 pid: 7683 timeout: 475 lvb_type: 0 00010000:00010000:1.0:1734016108.090457:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016108.090460:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016108.090466:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3715072->3735551) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5164 expref: 11 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.090475:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3715072->3735551) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5164 expref: 11 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.090510:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3715072->3735551) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5164 expref: 11 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016108.090528:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335247232:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016108.090570:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016108.093453:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335247232:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016108.093499:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016108.093562:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333568128:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3218us (3537us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016108.093578:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2886 00000100:00100000:0.0:1734016108.093863:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016108.094279:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333568256 00000100:00100000:3.0:1734016108.094288:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333568256 00000100:00100000:3.0:1734016108.094337:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10563 00000100:00100000:3.0:1734016108.094344:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333568256:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016108.094645:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7641996 -> 7641996 00002000:00010000:3.0:1734016108.094649:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016108 -> 1734016108 00002000:00010000:3.0:1734016108.094652:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016106 -> 1734016106 00002000:00010000:3.0:1734016108.094654:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016108 -> 1734016108 00002000:00010000:3.0:1734016108.094656:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 192 -> 192 00000100:00100000:3.0:1734016108.094691:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333568256:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 347us (830us total) trans 4294969302 rc 0/0 00000100:00100000:3.0:1734016108.094697:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10563 00000100:00100000:0.0:1734016108.098056:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016108.098187:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333568384 00000100:00100000:1.0:1734016108.098199:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333568384 00000100:00100000:1.0:1734016108.098259:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10564 00000100:00100000:1.0:1734016108.098268:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333568384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016108.098297:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016108.098320:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114c4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e516b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016108.098388:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335247360:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016108.099083:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016108.107043:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335247360:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016108.107140:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114c4d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e516b expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.107161:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27114c4d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e516b expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.107774:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:2.0:1734016108.107901:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333568384:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9630us (9856us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016108.107910:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10564 00000100:00100000:0.0:1734016108.112185:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.112503:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333568512 00000100:00100000:2.0:1734016108.112516:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333568512 00000100:00100000:2.0:1734016108.112586:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10565 00000100:00100000:2.0:1734016108.112596:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333568512:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016108.112628:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016108.112659:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114c54 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5172 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016108.112739:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007539bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335247488:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016108.112841:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016108.114644:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007539bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335247488:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016108.114687:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114c54 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5172 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.114702:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114c54 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5172 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.115095:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016108.115388:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333568512:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2789us (3219us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016108.115399:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10565 00000100:00100000:0.0:1734016108.121140:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.121278:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333568768 00000100:00100000:2.0:1734016108.121290:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333568768 00002000:00100000:2.0:1734016108.121344:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2789376->7643135) req@ffff88007bd29180 x1818247333568768/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 504/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.121354:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd29180 with x1818247333568768 ext(2789376->7643135) 00002000:00010000:2.0:1734016108.121359:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd29180 00000100:00100000:2.0:1734016108.121392:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8302 00000100:00100000:2.0:1734016108.121400:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247333568768:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.131329:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247333568768:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 9907us (10181us total) trans 0 rc 950272/950272 00000100:00100000:2.0:1734016108.131348:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8302 00002000:00100000:2.0:1734016108.131369:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2789376->7643135) req@ffff88007bd29180 x1818247333568768/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 504/440 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 950272/950272 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.131382:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd29180 with x1818247333568768 ext(2789376->7643135) 00002000:00010000:2.0:1734016108.131390:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd29180 00000100:00100000:0.0:1734016108.135227:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.135342:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333569024 00000100:00100000:2.0:1734016108.135354:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333569024 00002000:00100000:2.0:1734016108.135413:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2785280->2789375) req@ffff88007bd2b100 x1818247333569024/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.135424:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd2b100 with x1818247333569024 ext(2785280->2789375) 00002000:00010000:2.0:1734016108.135431:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd2b100 00000100:00100000:2.0:1734016108.135607:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8303 00000100:00100000:2.0:1734016108.135615:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333569024:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.135844:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333569024:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 227us (627us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.135852:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8303 00002000:00100000:2.0:1734016108.135857:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2785280->2789375) req@ffff88007bd2b100 x1818247333569024/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.135863:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd2b100 with x1818247333569024 ext(2785280->2789375) 00002000:00010000:2.0:1734016108.135866:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd2b100 00000100:00100000:0.0:1734016108.139012:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.139150:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333569280 00000100:00100000:2.0:1734016108.139162:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333569280 00002000:00100000:2.0:1734016108.139220:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2781184->2785279) req@ffff88007bd2b800 x1818247333569280/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.139231:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd2b800 with x1818247333569280 ext(2781184->2785279) 00002000:00010000:2.0:1734016108.139237:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd2b800 00000100:00100000:2.0:1734016108.139265:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8304 00000100:00100000:2.0:1734016108.139272:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333569280:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.139722:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333569280:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 449us (723us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.139730:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8304 00002000:00100000:2.0:1734016108.139735:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2781184->2785279) req@ffff88007bd2b800 x1818247333569280/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.139743:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd2b800 with x1818247333569280 ext(2781184->2785279) 00002000:00010000:2.0:1734016108.139746:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd2b800 00000100:00100000:0.0:1734016108.142723:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.142859:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333569536 00000100:00100000:2.0:1734016108.142872:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333569536 00002000:00100000:2.0:1734016108.142926:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2777088->2781183) req@ffff88007bd29500 x1818247333569536/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.142943:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd29500 with x1818247333569536 ext(2777088->2781183) 00002000:00010000:2.0:1734016108.142950:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd29500 00000100:00100000:2.0:1734016108.142973:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8305 00000100:00100000:2.0:1734016108.142981:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333569536:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.143611:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333569536:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 629us (900us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.143620:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8305 00002000:00100000:2.0:1734016108.143625:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2777088->2781183) req@ffff88007bd29500 x1818247333569536/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.143632:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd29500 with x1818247333569536 ext(2777088->2781183) 00002000:00010000:2.0:1734016108.143634:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd29500 00000100:00100000:0.0:1734016108.147502:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.148127:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333569792 00000100:00100000:2.0:1734016108.148143:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333569792 00002000:00100000:2.0:1734016108.148202:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2772992->2777087) req@ffff88007bd28380 x1818247333569792/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.148213:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd28380 with x1818247333569792 ext(2772992->2777087) 00002000:00010000:2.0:1734016108.148220:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd28380 00000100:00100000:2.0:1734016108.148249:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8306 00000100:00100000:2.0:1734016108.148257:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333569792:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.148512:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333569792:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 253us (1026us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.148521:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8306 00002000:00100000:2.0:1734016108.148528:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2772992->2777087) req@ffff88007bd28380 x1818247333569792/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.148535:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd28380 with x1818247333569792 ext(2772992->2777087) 00002000:00010000:2.0:1734016108.148538:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd28380 00000100:00100000:0.0:1734016108.151235:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.151406:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333570048 00000100:00100000:2.0:1734016108.151421:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333570048 00002000:00100000:2.0:1734016108.151479:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2768896->2772991) req@ffff88007bd28000 x1818247333570048/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.151496:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd28000 with x1818247333570048 ext(2768896->2772991) 00002000:00010000:2.0:1734016108.151503:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd28000 00000100:00100000:2.0:1734016108.152115:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8307 00000100:00100000:2.0:1734016108.152125:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333570048:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.152590:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333570048:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 465us (1368us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.152600:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8307 00002000:00100000:2.0:1734016108.152609:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2768896->2772991) req@ffff88007bd28000 x1818247333570048/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.152617:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd28000 with x1818247333570048 ext(2768896->2772991) 00002000:00010000:2.0:1734016108.152623:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd28000 00000100:00100000:1.0:1734016108.156230:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.156521:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333570304 00000100:00100000:2.0:1734016108.156532:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333570304 00002000:00100000:2.0:1734016108.156588:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2764800->2768895) req@ffff88007487ed80 x1818247333570304/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.156599:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487ed80 with x1818247333570304 ext(2764800->2768895) 00002000:00010000:2.0:1734016108.156605:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487ed80 00000100:00100000:2.0:1734016108.157207:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8308 00000100:00100000:2.0:1734016108.157216:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333570304:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.157472:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333570304:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 255us (1258us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.157480:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8308 00002000:00100000:2.0:1734016108.157486:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2764800->2768895) req@ffff88007487ed80 x1818247333570304/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.157493:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487ed80 with x1818247333570304 ext(2764800->2768895) 00002000:00010000:2.0:1734016108.157496:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487ed80 00000100:00100000:0.0:1734016108.159657:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.159788:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333570560 00000100:00100000:2.0:1734016108.159820:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333570560 00002000:00100000:2.0:1734016108.159873:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2760704->2764799) req@ffff8800758af480 x1818247333570560/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.159883:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758af480 with x1818247333570560 ext(2760704->2764799) 00002000:00010000:2.0:1734016108.159889:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758af480 00000100:00100000:2.0:1734016108.159916:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8309 00000100:00100000:2.0:1734016108.159925:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333570560:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.161039:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333570560:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1108us (1390us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.161052:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8309 00002000:00100000:2.0:1734016108.161062:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2760704->2764799) req@ffff8800758af480 x1818247333570560/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.161071:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758af480 with x1818247333570560 ext(2760704->2764799) 00002000:00010000:2.0:1734016108.161074:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758af480 00000100:00100000:0.0:1734016108.163739:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.163987:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333570816 00000100:00100000:2.0:1734016108.163997:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333570816 00002000:00100000:2.0:1734016108.164049:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2756608->2760703) req@ffff8800758ad500 x1818247333570816/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.164060:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758ad500 with x1818247333570816 ext(2756608->2760703) 00002000:00010000:2.0:1734016108.164066:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758ad500 00000100:00100000:2.0:1734016108.164103:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8310 00000100:00100000:2.0:1734016108.164110:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333570816:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.165171:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333570816:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1057us (1440us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.165180:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8310 00002000:00100000:2.0:1734016108.165186:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2756608->2760703) req@ffff8800758ad500 x1818247333570816/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.165194:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758ad500 with x1818247333570816 ext(2756608->2760703) 00002000:00010000:2.0:1734016108.165197:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758ad500 00000100:00100000:1.0:1734016108.167655:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.167742:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333571072 00000100:00100000:2.0:1734016108.167751:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333571072 00002000:00100000:2.0:1734016108.167792:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2752512->2756607) req@ffff88007487f800 x1818247333571072/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.167830:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487f800 with x1818247333571072 ext(2752512->2756607) 00002000:00010000:2.0:1734016108.167835:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487f800 00000100:00100000:2.0:1734016108.167857:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8311 00000100:00100000:2.0:1734016108.167863:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333571072:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.168037:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333571072:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 173us (391us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.168044:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8311 00002000:00100000:2.0:1734016108.168050:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2752512->2756607) req@ffff88007487f800 x1818247333571072/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.168056:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487f800 with x1818247333571072 ext(2752512->2756607) 00002000:00010000:2.0:1734016108.168059:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487f800 00000100:00100000:0.0:1734016108.170543:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.170997:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333571328 00000100:00100000:2.0:1734016108.171007:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333571328 00002000:00100000:2.0:1734016108.171052:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2748416->2752511) req@ffff8800758adc00 x1818247333571328/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.171062:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758adc00 with x1818247333571328 ext(2748416->2752511) 00002000:00010000:2.0:1734016108.171067:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758adc00 00000100:00100000:2.0:1734016108.171614:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8312 00000100:00100000:2.0:1734016108.171621:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333571328:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.171884:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333571328:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 262us (1347us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.171891:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8312 00002000:00100000:2.0:1734016108.171897:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2748416->2752511) req@ffff8800758adc00 x1818247333571328/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.171903:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758adc00 with x1818247333571328 ext(2748416->2752511) 00002000:00010000:2.0:1734016108.171907:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758adc00 00000100:00100000:0.0:1734016108.174511:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.174640:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333571584 00000100:00100000:2.0:1734016108.174652:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333571584 00002000:00100000:2.0:1734016108.174702:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2744320->2748415) req@ffff8800758ae680 x1818247333571584/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.174713:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758ae680 with x1818247333571584 ext(2744320->2748415) 00002000:00010000:2.0:1734016108.174719:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758ae680 00000100:00100000:2.0:1734016108.174899:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8313 00000100:00100000:2.0:1734016108.174906:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333571584:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.175314:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333571584:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 405us (811us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.175322:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8313 00002000:00100000:2.0:1734016108.175328:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2744320->2748415) req@ffff8800758ae680 x1818247333571584/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.175335:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758ae680 with x1818247333571584 ext(2744320->2748415) 00002000:00010000:2.0:1734016108.175338:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758ae680 00000100:00100000:1.0:1734016108.178650:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.181174:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333571840 00000100:00100000:2.0:1734016108.181191:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333571840 00002000:00100000:2.0:1734016108.181253:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2740224->2744319) req@ffff88007487f480 x1818247333571840/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.181262:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487f480 with x1818247333571840 ext(2740224->2744319) 00002000:00010000:2.0:1734016108.181267:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487f480 00000100:00100000:2.0:1734016108.181830:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8314 00000100:00100000:2.0:1734016108.181837:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333571840:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.182017:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333571840:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 179us (3378us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.182024:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8314 00002000:00100000:2.0:1734016108.182030:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2740224->2744319) req@ffff88007487f480 x1818247333571840/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.182035:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487f480 with x1818247333571840 ext(2740224->2744319) 00002000:00010000:2.0:1734016108.182038:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487f480 00000100:00100000:0.0:1734016108.190550:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.190658:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333572096 00000100:00100000:2.0:1734016108.190670:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333572096 00002000:00100000:2.0:1734016108.190715:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2736128->2740223) req@ffff8800758aea00 x1818247333572096/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.190730:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758aea00 with x1818247333572096 ext(2736128->2740223) 00002000:00010000:2.0:1734016108.190736:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758aea00 00000100:00100000:2.0:1734016108.190774:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8315 00000100:00100000:2.0:1734016108.190780:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333572096:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.192847:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333572096:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 2061us (2302us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.192856:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8315 00002000:00100000:2.0:1734016108.192866:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2736128->2740223) req@ffff8800758aea00 x1818247333572096/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.192874:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758aea00 with x1818247333572096 ext(2736128->2740223) 00002000:00010000:2.0:1734016108.192878:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758aea00 00000100:00100000:0.0:1734016108.212594:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.217865:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333572352 00000100:00100000:2.0:1734016108.217879:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333572352 00002000:00100000:2.0:1734016108.217931:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2732032->2736127) req@ffff8800758aed80 x1818247333572352/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.217940:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758aed80 with x1818247333572352 ext(2732032->2736127) 00002000:00010000:2.0:1734016108.217945:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758aed80 00000100:00100000:2.0:1734016108.218048:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8316 00000100:00100000:2.0:1734016108.218057:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333572352:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.218285:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333572352:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 228us (5698us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.218292:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8316 00002000:00100000:2.0:1734016108.218298:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2732032->2736127) req@ffff8800758aed80 x1818247333572352/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/4536 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.218305:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758aed80 with x1818247333572352 ext(2732032->2736127) 00002000:00010000:2.0:1734016108.218308:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758aed80 00000100:00100000:1.0:1734016108.222780:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.223104:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333572480 00000100:00100000:2.0:1734016108.223112:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333572480 00000100:00100000:2.0:1734016108.223165:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10566 00000100:00100000:2.0:1734016108.223171:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333572480:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016108.223188:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016108.223204:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114c5b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5179 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016108.223264:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007539bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335247616:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016108.224236:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e0c0 going to sleep for 11 seconds 00002000:00010000:2.0:1734016108.238138:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016106 -> 1734016108 00000100:00100000:2.0:1734016108.238167:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007539bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335247616:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016108.238200:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114c5b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5179 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.238213:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114c5b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5179 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.238241:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016108.238299:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333572480:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 15126us (15527us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016108.238307:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10566 00000100:00100000:1.0:1734016108.241393:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.241543:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333572608 00000100:00100000:2.0:1734016108.241552:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333572608 00000100:00100000:2.0:1734016108.241597:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10567 00000100:00100000:2.0:1734016108.241603:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333572608:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016108.241617:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016108.241632:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114c62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5180 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016108.241680:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007539bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335247744:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016108.241737:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016108.247201:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007539bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335247744:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016108.247234:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114c62 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5180 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.247248:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114c62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5180 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.247276:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016108.247338:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333572608:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5734us (5953us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016108.247347:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10567 00000100:00100000:1.0:1734016108.254190:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.254309:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333572736 00000100:00100000:2.0:1734016108.254324:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333572736 00000100:00100000:2.0:1734016108.258399:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10568 00000100:00100000:2.0:1734016108.258413:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333572736:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016108.258432:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016108.258451:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114c69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5187 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016108.258506:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007539bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335247872:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016108.258595:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016108.269706:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007539bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335247872:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016108.269755:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114c69 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5187 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.269770:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114c69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5187 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.269814:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016108.269894:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333572736:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11481us (15713us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016108.269904:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10568 00000100:00100000:1.0:1734016108.276470:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.276623:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333572864 00000100:00100000:2.0:1734016108.276636:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333572864 00000100:00100000:2.0:1734016108.277599:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10569 00000100:00100000:2.0:1734016108.277611:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333572864:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016108.277636:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016108.277658:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114c70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e518e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016108.277732:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007539bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335248000:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016108.278614:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016108.280931:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007539bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335248000:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016108.280977:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114c70 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e518e expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.280991:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114c70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e518e expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.281984:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016108.282090:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333572864:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4469us (5622us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016108.282101:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10569 00000100:00100000:0.0:1734016108.287313:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.287435:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333573120 00000100:00100000:2.0:1734016108.287448:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333573120 00000100:00100000:2.0:1734016108.287532:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8317 00000100:00100000:2.0:1734016108.287541:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333573120:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:2.0:1734016108.287589:0:7688:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114c77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.287609:0:7688:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3715072->3735551) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5164 expref: 12 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.287615:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016108.287617:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016108.287621:0:7688:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114c77 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8093696->8146943] (req 8093696->8146943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.287664:0:7688:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3715072->3735551) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5164 expref: 12 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.287676:0:7688:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3715072->3735551) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5164 expref: 12 pid: 7683 timeout: 475 lvb_type: 0 00000100:00100000:2.0:1734016108.287692:0:7688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007539bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335248128:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016108.287782:0:7688:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016108.293120:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.293213:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333573248 00000100:00100000:0.0:1734016108.293225:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333573248 00010000:00010000:0.0:1734016108.293282:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c46 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3715072->3735551) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5164 expref: 13 pid: 7683 timeout: 475 lvb_type: 0 00000100:00100000:0.0:1734016108.293330:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2887 00000100:00100000:0.0:1734016108.293339:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333573248:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016108.293355:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016108.293383:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c46 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3715072->3735551) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5164 expref: 13 pid: 7683 timeout: 475 lvb_type: 0 00010000:00010000:0.0:1734016108.293397:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3715072->3735551) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5164 expref: 13 pid: 7683 timeout: 475 lvb_type: 0 00010000:00010000:0.0:1734016108.293423:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.293426:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.293432:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [8093696->8146943] (req 8093696->8146943) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.293442:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114c77 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [8093696->8146943] (req 8093696->8146943) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.293462:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016108.293510:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333573248:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 171us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016108.293517:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2887 00010000:00010000:2.0:1734016108.293697:0:7688:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114c46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3715072->3735551) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5164 expref: 12 pid: 7683 timeout: 475 lvb_type: 0 00000100:00100000:2.0:1734016108.294644:0:7688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007539bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335248128:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016108.294669:0:7688:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8093696->8146943] (req 8093696->8146943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.294679:0:7688:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8093696->8146943] (req 8093696->8146943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.294684:0:7688:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8093696->8146943] (req 8093696->8146943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016108.302349:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969303 is committed 00000001:00080000:0.0:1734016108.302367:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969302 is committed 00002000:00010000:2.0:1734016108.302579:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7641996 -> 8146944 00002000:00010000:2.0:1734016108.302585:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 192 -> 296 00010000:00010000:2.0:1734016108.302598:0:7688:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8093696->8146943] (req 8093696->8146943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.302610:0:7688:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114c77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8093696->8146943] (req 8093696->8146943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.302623:0:7688:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114c77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8093696->8146943] (req 8093696->8146943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.302630:0:7688:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcb40 already unused, calling callback (ffffffffa080e100) 00010000:00010000:2.0:1734016108.302634:0:7688:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114c77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8093696->8146943] (req 8093696->8146943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.302642:0:7688:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114c77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8093696->8146943] (req 8093696->8146943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.302663:0:7688:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114c77 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8093696->8146943] (req 8093696->8146943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.302669:0:7688:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114c77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8093696->8146943] (req 8093696->8146943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016108.303310:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333573120:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 15764us (16007us total) trans 4294969303 rc 0/0 00000100:00100000:2.0:1734016108.303322:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8317 00000100:00100000:0.0:1734016108.306719:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.306846:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333573376 00000100:00100000:2.0:1734016108.306857:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333573376 00000100:00100000:2.0:1734016108.306923:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10570 00000100:00100000:2.0:1734016108.306930:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333573376:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016108.306950:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016108.306977:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114c7e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5195 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1734016108.307005:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 8146944, mtime: 0x675afc6c, atime: 0x675afc6c, ctime: 0x675afc6c, blocks: 0x128 00010000:00010000:2.0:1734016108.307029:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.307031:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.307041:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114c7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5195 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.307057:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114c7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5195 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.307069:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016108.307140:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333573376:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 208us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016108.307147:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10570 00000100:00100000:0.0:1734016108.311123:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016108.311264:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333573504 00000100:00100000:3.0:1734016108.311282:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333573504 00000100:00100000:3.0:1734016108.311361:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10571 00000100:00100000:3.0:1734016108.311374:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333573504:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016108.311402:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016108.311428:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e519c expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.311468:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016108.311471:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016108.311482:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e519c expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016108.311499:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e519c expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016108.311512:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016108.311579:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333573504:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 209us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016108.311586:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10571 00000100:00100000:1.0:1734016108.314883:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.315271:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333573760 00000100:00100000:2.0:1734016108.315282:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333573760 00000100:00100000:2.0:1734016108.315471:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8318 00000100:00100000:2.0:1734016108.315479:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333573760:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:2.0:1734016108.315530:0:7688:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114c8c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.315546:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.315548:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.315554:0:7688:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114c8c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.315568:0:7688:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114c8c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.315687:0:7688:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114c8c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.315695:0:7688:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114c8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.315702:0:7688:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114c8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.315708:0:7688:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbdf80 already unused, calling callback (ffffffffa080e100) 00010000:00010000:2.0:1734016108.315713:0:7688:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114c8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.315720:0:7688:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114c8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.315736:0:7688:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114c8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.315741:0:7688:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114c8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016108.315849:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333573760:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 370us (986us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016108.315857:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8318 00000100:00100000:0.0:1734016108.319401:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.319516:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333574016 00000100:00100000:2.0:1734016108.319529:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333574016 00000100:00100000:2.0:1734016108.319608:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8319 00000100:00100000:2.0:1734016108.319618:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333574016:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:2.0:1734016108.319662:0:7688:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114c93 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.319688:0:7688:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114c7e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5195 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.319697:0:7688:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c85 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e519c expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.319702:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.319705:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.319708:0:7688:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114c93 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [10235904->10239999] (req 10235904->10239999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.319745:0:7688:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e519c expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.319760:0:7688:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e519c expref: 6 pid: 7683 timeout: 475 lvb_type: 1 00000100:00100000:2.0:1734016108.319776:0:7688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007539bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335248256:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016108.320219:0:7688:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114c7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5195 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.320227:0:7688:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114c7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5195 expref: 6 pid: 8216 timeout: 475 lvb_type: 1 00000100:00100000:2.0:1734016108.320235:0:7688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008719d500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335248384:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016108.320252:0:7688:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016108.322209:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.322309:0:7688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007539bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335248256:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016108.322329:0:7688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008719d500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335248384:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016108.322354:0:7688:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114c93 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [10235904->10239999] (req 10235904->10239999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016108.322524:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333574144 00000100:00100000:1.0:1734016108.322532:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333574144 00010000:00010000:1.0:1734016108.322564:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e519c expref: 7 pid: 7683 timeout: 475 lvb_type: 1 00000100:00100000:1.0:1734016108.322597:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2888 00000100:00100000:1.0:1734016108.322604:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333574144:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016108.322619:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016108.322643:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e519c expref: 7 pid: 7683 timeout: 475 lvb_type: 1 00010000:00010000:1.0:1734016108.322653:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e519c expref: 7 pid: 7683 timeout: 475 lvb_type: 1 00010000:00010000:1.0:1734016108.322677:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114c85 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e519c expref: 7 pid: 7683 timeout: 475 lvb_type: 1 00010000:00010000:1.0:1734016108.322715:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016108.322757:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333574144:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 153us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016108.322764:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2888 00000100:00100000:2.0:1734016108.324546:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.324621:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333574272 00000100:00100000:0.0:1734016108.324628:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333574272 00010000:00010000:0.0:1734016108.325659:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114c7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5195 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00000100:00100000:0.0:1734016108.326253:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2889 00000100:00100000:0.0:1734016108.326261:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a780a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333574272:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016108.326277:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016108.326298:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114c7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5195 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:0.0:1734016108.326311:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114c7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5195 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:0.0:1734016108.326334:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114c7e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5195 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:0.0:1734016108.326364:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.326366:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.326371:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114c93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [10235904->10239999] (req 10235904->10239999) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.326380:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114c93 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [10235904->10239999] (req 10235904->10239999) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.326415:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016108.326462:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a780a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333574272:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 202us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016108.326468:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2889 00010000:00010000:3.0:1734016108.326716:0:7688:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114c93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10235904->10239999] (req 10235904->10239999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.326726:0:7688:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114c93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10235904->10239999] (req 10235904->10239999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016108.329658:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969304 is committed 00002000:00010000:3.0:1734016108.330441:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8146944 -> 10240000 00002000:00010000:3.0:1734016108.330446:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 296 -> 304 00010000:00010000:3.0:1734016108.330460:0:7688:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114c93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10235904->10239999] (req 10235904->10239999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.330471:0:7688:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114c93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10235904->10239999] (req 10235904->10239999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.330478:0:7688:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114c93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10235904->10239999] (req 10235904->10239999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.330486:0:7688:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd680 already unused, calling callback (ffffffffa080e100) 00010000:00010000:3.0:1734016108.330489:0:7688:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114c93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10235904->10239999] (req 10235904->10239999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.330496:0:7688:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114c93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10235904->10239999] (req 10235904->10239999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.330513:0:7688:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114c93 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10235904->10239999] (req 10235904->10239999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.330519:0:7688:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114c93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10235904->10239999] (req 10235904->10239999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016108.330632:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333574016:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 11010us (11243us total) trans 4294969304 rc 0/0 00000100:00100000:3.0:1734016108.330643:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8319 00000100:00100000:2.0:1734016108.334350:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.334639:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333574400 00000100:00100000:0.0:1734016108.334652:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333574400 00000100:00100000:0.0:1734016108.334721:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10572 00000100:00100000:0.0:1734016108.334730:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333574400:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016108.334755:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016108.334781:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114c9a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e51a3 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016108.334842:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 10240000, mtime: 0x675afc6c, atime: 0x675afc6c, ctime: 0x675afc6c, blocks: 0x130 00010000:00010000:0.0:1734016108.334869:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.334872:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.334881:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114c9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51a3 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.334899:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114c9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51a3 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.334912:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581680, rc 0) 00000100:00100000:0.0:1734016108.334973:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333574400:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 243us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016108.334980:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10572 00000100:00100000:1.0:1734016108.340784:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016108.340850:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333574656 00000100:00100000:3.0:1734016108.340864:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333574656 00000100:00100000:3.0:1734016108.340922:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2103 00000100:00100000:3.0:1734016108.340929:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+28:9668:x1818247333574656:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016108.340990:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016108.341167:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27114c23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5148 expref: 28 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.341183:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016108.341187:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016108.341335:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114ca1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016108.341347:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27114c3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e515d expref: 13 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.341353:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114ca1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016108.341387:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27114c3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e515d expref: 13 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.341397:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27114c3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e515d expref: 13 pid: 13956 timeout: 475 lvb_type: 0 00000100:00100000:3.0:1734016108.341408:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335248512:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016108.341481:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb300 going to sleep for 11 seconds 00000100:00100000:1.0:1734016108.344967:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016108.345575:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335248512:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016108.345605:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114ca1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016108.345683:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333574784 00000100:00100000:0.0:1734016108.345690:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333574784 00010000:00010000:0.0:1734016108.345725:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27114c3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e515d expref: 14 pid: 13956 timeout: 475 lvb_type: 0 00000100:00100000:0.0:1734016108.345768:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2890 00000100:00100000:0.0:1734016108.345775:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1981:x1818247333574784:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016108.345795:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016108.345838:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27114c3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e515d expref: 14 pid: 13956 timeout: 475 lvb_type: 0 00010000:00010000:0.0:1734016108.345849:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27114c3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e515d expref: 14 pid: 13956 timeout: 475 lvb_type: 0 00010000:00010000:0.0:1734016108.345872:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27114c3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e515d expref: 14 pid: 13956 timeout: 475 lvb_type: 0 00010000:00010000:0.0:1734016108.345900:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016108.345905:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114ca1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.345913:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114ca1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.345921:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114ca1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.345937:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016108.345983:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1981:x1818247333574784:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 208us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016108.345989:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2890 00010000:00010000:3.0:1734016108.346047:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114ca1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016108.346054:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114ca1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:3.0:1734016108.346166:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968654 00000004:00010000:3.0:1734016108.346213:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800752a7b80 reply state ffff8800759b4000 transno 4294968655 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114ca1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:3.0:1734016108.346221:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016108.346299:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+30:9668:x1818247333574656:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 5370us (5529us total) trans 4294968655 rc 0/0 00000100:00100000:3.0:1734016108.346490:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2103 00000020:00080000:3.0:1734016108.346495:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1734016108.348923:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114ca1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016108.348940:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114ca1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016108.348947:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114ca1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016108.348951:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4480 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:1.0:1734016108.348955:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114ca1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016108.348961:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114ca1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016108.348981:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016108.348983:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1734016108.348987:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114ca1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016108.348991:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114ca1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016108.350232:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.350493:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333574912 00000100:00100000:2.0:1734016108.350507:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333574912 00000100:00100000:2.0:1734016108.350573:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10573 00000100:00100000:2.0:1734016108.350581:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333574912:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016108.350607:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016108.350633:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114ca8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e51aa expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.350668:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114c9a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51a3 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.350675:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.350676:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.350679:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114ca8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51aa expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.350727:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114c9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51a3 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.350742:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114c9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51a3 expref: 8 pid: 8216 timeout: 475 lvb_type: 1 00000100:00100000:2.0:1734016108.350755:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008719ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335248640:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016108.350855:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016108.355108:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008719ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335248640:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016108.355148:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114ca8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51aa expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.355166:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd680, rc 0) 00000100:00100000:0.0:1734016108.355229:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333574912:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4647us (5006us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016108.355238:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10573 00000100:00100000:2.0:1734016108.355355:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016108.356016:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333575040 00000100:00100000:3.0:1734016108.356025:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333575040 00010000:00010000:3.0:1734016108.356057:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114c9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51a3 expref: 8 pid: 8216 timeout: 475 lvb_type: 1 00000100:00100000:3.0:1734016108.356098:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2891 00000100:00100000:3.0:1734016108.356106:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333575040:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016108.356125:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016108.356157:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114c9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51a3 expref: 8 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:3.0:1734016108.356171:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114c9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51a3 expref: 8 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:3.0:1734016108.356204:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114c9a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51a3 expref: 8 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:3.0:1734016108.356228:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016108.356231:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016108.356236:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114ca8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51aa expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.356246:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114ca8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51aa expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.356290:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114ca8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51aa expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016108.356305:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335248768:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016108.356356:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016108.362462:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.362518:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333575168 00000100:00100000:2.0:1734016108.362531:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333575168 00002000:00010000:2.0:1734016108.362573:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (2093026->18446744073709551615) 00002000:00100000:2.0:1734016108.362578:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800752a6a00 with x1818247333575168 ext(2093026->18446744073709551615) 00002000:00010000:2.0:1734016108.362589:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800752a6a00. 00000100:00100000:3.0:1734016108.362610:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335248768:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016108.362622:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8320 00000100:00100000:2.0:1734016108.362629:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333575168:12345-192.168.201.16@tcp:10:fsx.0 00010000:00010000:3.0:1734016108.362630:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016108.362676:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333575040:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6570us (7322us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016108.362683:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2891 00002000:00010000:2.0:1734016108.366901:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10240000 -> 2093026 00002000:00010000:2.0:1734016108.366911:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016108 -> 1734016108 00002000:00010000:2.0:1734016108.366914:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016108 -> 1734016108 00002000:00010000:2.0:1734016108.366916:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016108 -> 1734016108 00002000:00010000:2.0:1734016108.366918:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 304 -> 192 00000100:00100000:2.0:1734016108.366984:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333575168:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 4349us (4527us total) trans 4294969305 rc 0/0 00000100:00100000:2.0:1734016108.366995:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8320 00002000:00010000:2.0:1734016108.367002:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (2093026->18446744073709551615) 00002000:00100000:2.0:1734016108.367005:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800752a6a00 with x1818247333575168 ext(2093026->18446744073709551615) 00002000:00010000:2.0:1734016108.367012:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800752a6a00. 00000100:00100000:2.0:1734016108.368971:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.369052:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333575296 00000100:00100000:0.0:1734016108.369063:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333575296 00000100:00100000:0.0:1734016108.369118:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2104 00000100:00100000:0.0:1734016108.369126:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+29:9668:x1818247333575296:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016108.369158:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016108.369181:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27114caf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e51b1 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.369281:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114cb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.369296:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.369307:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016108.369411:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 2093026 00000004:00200000:0.0:1734016108.369416:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016108.369435:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.369459:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27114caf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51b1 expref: 31 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.369623:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51b1 expref: 30 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.369636:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016108.369638:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016108.369641:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:0.0:1734016108.369702:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+30:9668:x1818247333575296:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 576us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016108.369708:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2104 00000100:00100000:2.0:1734016108.377211:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.377262:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333575552 00000100:00100000:0.0:1734016108.377276:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333575552 00002000:00100000:0.0:1734016108.377329:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->2093055) req@ffff880075398a80 x1818247333575552/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016108.377340:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075398a80 with x1818247333575552 ext(0->2093055) 00002000:00010000:0.0:1734016108.377346:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075398a80 00000100:00100000:0.0:1734016108.377383:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8321 00000100:00100000:0.0:1734016108.377391:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333575552:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016108.390600:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333575552:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 13191us (13381us total) trans 0 rc 2093056/2093056 00000100:00100000:0.0:1734016108.390621:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8321 00002000:00100000:0.0:1734016108.390640:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->2093055) req@ffff880075398a80 x1818247333575552/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/440 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 2093056/2093056 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016108.390650:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075398a80 with x1818247333575552 ext(0->2093055) 00002000:00010000:0.0:1734016108.390658:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075398a80 00000100:00100000:1.0:1734016108.398180:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.398269:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333575680 00000100:00100000:0.0:1734016108.398280:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333575680 00000100:00100000:0.0:1734016108.398341:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2105 00000100:00100000:0.0:1734016108.398350:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:9668:x1818247333575680:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016108.398375:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016108.398398:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27114cbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e51b8 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.398499:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27114cc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.398515:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27114cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.398527:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27114cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016108.398548:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 2093026 00000004:00200000:0.0:1734016108.398552:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016108.398567:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27114cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.398591:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27114cbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51b8 expref: 15 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.399467:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27114cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51b8 expref: 14 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.399478:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016108.399481:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016108.399484:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016108.399948:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333575680:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1597us (1782us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016108.399957:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2105 00000100:00100000:2.0:1734016108.402969:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016108.403727:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333575808 00000100:00100000:1.0:1734016108.403742:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333575808 00000100:00100000:1.0:1734016108.403852:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10574 00000100:00100000:1.0:1734016108.403863:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007539bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333575808:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016108.403889:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016108.403913:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27114ccb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e51bf expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016108.403997:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800752a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335248896:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016108.404660:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016108.407895:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800752a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335248896:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016108.407937:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27114ccb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51bf expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016108.407950:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27114ccb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51bf expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016108.407971:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016108.408191:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007539bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333575808:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4328us (5232us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016108.408199:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10574 00000100:00100000:2.0:1734016108.410433:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016108.410661:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333575936 00000100:00100000:1.0:1734016108.410674:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333575936 00000100:00100000:1.0:1734016108.410743:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10575 00000100:00100000:1.0:1734016108.410752:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88009024c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333575936:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016108.410774:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016108.410796:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27114cd2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e51c6 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016108.410900:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800752a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335249024:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016108.410964:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016108.414477:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800752a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335249024:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016108.414519:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27114cd2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51c6 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016108.414532:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27114cd2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51c6 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016108.414541:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016108.414921:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88009024c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333575936:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4170us (4503us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016108.414930:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10575 00000100:00100000:2.0:1734016108.419040:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016108.419170:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333576064 00000100:00100000:1.0:1734016108.419185:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333576064 00000100:00100000:1.0:1734016108.419256:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10576 00000100:00100000:1.0:1734016108.419265:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333576064:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016108.419292:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016108.419320:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114cd9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e51cd expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016108.419396:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800752a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335249152:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016108.419481:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016108.424900:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800752a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335249152:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016108.424941:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114cd9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51cd expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016108.424957:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27114cd9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51cd expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016108.425028:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016108.425424:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333576064:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6157us (6395us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016108.425433:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10576 00000100:00100000:3.0:1734016108.430299:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016108.430543:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333576192 00000100:00100000:1.0:1734016108.430553:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333576192 00000100:00100000:1.0:1734016108.430607:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10577 00000100:00100000:1.0:1734016108.430615:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333576192:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016108.430639:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016108.430659:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27114ce0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e51d4 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016108.430728:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800752a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335249280:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016108.431558:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016108.436014:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800752a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335249280:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016108.436055:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27114ce0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51d4 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016108.436068:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27114ce0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51d4 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016108.436232:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016108.436555:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333576192:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5938us (6270us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016108.436566:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10577 00000100:00100000:2.0:1734016108.439934:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.440051:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333576448 00000100:00100000:0.0:1734016108.440063:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333576448 00000100:00100000:0.0:1734016108.440150:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8322 00000100:00100000:0.0:1734016108.440158:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007539b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333576448:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:0.0:1734016108.440207:0:7688:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114ce7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.440228:0:7688:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114ca8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51aa expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.440235:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016108.440237:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016108.440240:0:7688:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114ce7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1638400->1675263] (req 1638400->1675263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.440276:0:7688:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114ca8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51aa expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.440289:0:7688:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114ca8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51aa expref: 8 pid: 7683 timeout: 475 lvb_type: 0 00000100:00100000:0.0:1734016108.440303:0:7688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335249408:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016108.440367:0:7688:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eee40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016108.446977:0:7688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335249408:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016108.447011:0:7688:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114ce7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1638400->1675263] (req 1638400->1675263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016108.448031:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016108.448412:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333576576 00000100:00100000:3.0:1734016108.448421:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333576576 00010000:00010000:3.0:1734016108.448454:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114ca8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51aa expref: 9 pid: 7683 timeout: 475 lvb_type: 0 00000100:00100000:3.0:1734016108.448482:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2892 00000100:00100000:3.0:1734016108.448488:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007539aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333576576:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016108.448502:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016108.448527:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114ca8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51aa expref: 9 pid: 7683 timeout: 475 lvb_type: 0 00010000:00010000:3.0:1734016108.448537:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114ca8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51aa expref: 9 pid: 7683 timeout: 475 lvb_type: 0 00010000:00010000:3.0:1734016108.448563:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114ca8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51aa expref: 9 pid: 7683 timeout: 475 lvb_type: 0 00010000:00010000:3.0:1734016108.448579:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016108.448581:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016108.448585:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114ce7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1638400->1675263] (req 1638400->1675263) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.448593:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114ce7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1638400->1675263] (req 1638400->1675263) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.448768:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016108.448845:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007539aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333576576:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 356us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016108.448851:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2892 00010000:00010000:1.0:1734016108.449512:0:7688:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114ce7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1638400->1675263] (req 1638400->1675263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.449522:0:7688:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114ce7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1638400->1675263] (req 1638400->1675263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.452758:0:7688:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114ce7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1638400->1675263] (req 1638400->1675263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.452775:0:7688:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114ce7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1638400->1675263] (req 1638400->1675263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.452783:0:7688:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114ce7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1638400->1675263] (req 1638400->1675263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.452790:0:7688:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581b00 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016108.452794:0:7688:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114ce7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1638400->1675263] (req 1638400->1675263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.452878:0:7688:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114ce7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1638400->1675263] (req 1638400->1675263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.452897:0:7688:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114ce7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1638400->1675263] (req 1638400->1675263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.452904:0:7688:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114ce7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1638400->1675263] (req 1638400->1675263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016108.453016:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007539b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333576448:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 12851us (13085us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1734016108.453027:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8322 00000100:00100000:2.0:1734016108.462646:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016108.462904:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333576704 00000100:00100000:1.0:1734016108.462917:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333576704 00000100:00100000:1.0:1734016108.462977:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10578 00000100:00100000:1.0:1734016108.462984:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007539bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333576704:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016108.463018:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016108.463042:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114cee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e51db expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016108.463064:0:7683:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 2093026, mtime: 0x675afc6c, atime: 0x675afc6c, ctime: 0x675afc6c, blocks: 0xc0 00010000:00010000:1.0:1734016108.463096:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016108.463098:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016108.463107:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114cee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51db expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016108.463122:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114cee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51db expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016108.463133:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016108.463204:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007539bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333576704:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 221us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016108.463210:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10578 00000100:00100000:0.0:1734016108.468582:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016108.468717:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333576960 00000100:00100000:1.0:1734016108.468729:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333576960 00000100:00100000:1.0:1734016108.469205:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8323 00000100:00100000:1.0:1734016108.469213:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333576960:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:1.0:1734016108.469258:0:7688:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114cf5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.469278:0:7688:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114cee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51db expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016108.469285:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016108.469288:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016108.469292:0:7688:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114cf5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1609728->1671167] (req 1609728->1671167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.469328:0:7688:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114cee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51db expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016108.469341:0:7688:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114cee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51db expref: 8 pid: 7683 timeout: 475 lvb_type: 1 00000100:00100000:1.0:1734016108.469356:0:7688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800752a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335249536:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016108.469434:0:7688:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016108.474331:0:7688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800752a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335249536:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016108.474363:0:7688:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114cf5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1609728->1671167] (req 1609728->1671167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016108.474905:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016108.475592:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333577088 00000100:00100000:3.0:1734016108.475600:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333577088 00010000:00010000:3.0:1734016108.475634:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114cee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51db expref: 9 pid: 7683 timeout: 475 lvb_type: 1 00000100:00100000:3.0:1734016108.475672:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2893 00000100:00100000:3.0:1734016108.475679:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333577088:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016108.475695:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016108.475721:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114cee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51db expref: 9 pid: 7683 timeout: 475 lvb_type: 1 00010000:00010000:3.0:1734016108.475739:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114cee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51db expref: 9 pid: 7683 timeout: 475 lvb_type: 1 00010000:00010000:3.0:1734016108.475763:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114cee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51db expref: 9 pid: 7683 timeout: 475 lvb_type: 1 00010000:00010000:3.0:1734016108.475818:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016108.475820:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016108.475825:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114cf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1609728->1671167] (req 1609728->1671167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.475834:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114cf5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1609728->1671167] (req 1609728->1671167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.475856:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016108.475918:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333577088:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 238us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016108.475926:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2893 00010000:00010000:0.0:1734016108.476006:0:7688:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114cf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1609728->1671167] (req 1609728->1671167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.476012:0:7688:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114cf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1609728->1671167] (req 1609728->1671167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016108.484894:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969306 is committed 00002000:00010000:2.0:1734016108.485090:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016108 -> 1734016109 00002000:00010000:2.0:1734016108.485098:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016108 -> 1734016109 00002000:00010000:2.0:1734016108.485100:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 192 -> 312 00010000:00010000:2.0:1734016108.485115:0:7688:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114cf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1609728->1671167] (req 1609728->1671167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.485126:0:7688:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114cf5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1609728->1671167] (req 1609728->1671167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.485135:0:7688:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114cf5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1609728->1671167] (req 1609728->1671167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.485142:0:7688:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499d200 already unused, calling callback (ffffffffa080e100) 00010000:00010000:2.0:1734016108.485147:0:7688:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114cf5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1609728->1671167] (req 1609728->1671167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.485155:0:7688:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114cf5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1609728->1671167] (req 1609728->1671167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.485179:0:7688:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114cf5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1609728->1671167] (req 1609728->1671167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.485184:0:7688:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27114cf5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1609728->1671167] (req 1609728->1671167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016108.487211:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333576960:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 17986us (18633us total) trans 4294969306 rc 0/0 00000100:00100000:2.0:1734016108.487224:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8323 00000100:00100000:2.0:1734016108.490479:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.491167:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333577216 00000100:00100000:0.0:1734016108.491179:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333577216 00000100:00100000:0.0:1734016108.492014:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10579 00000100:00100000:0.0:1734016108.492022:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333577216:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016108.492045:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016108.492068:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114cfc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e51e2 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016108.492103:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 2093026, mtime: 0x675afc6d, atime: 0x675afc6c, ctime: 0x675afc6d, blocks: 0x138 00010000:00010000:0.0:1734016108.492129:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.492131:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.492141:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114cfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51e2 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.492157:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114cfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51e2 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.492176:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:0.0:1734016108.492235:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333577216:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 214us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016108.492242:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10579 00000100:00100000:0.0:1734016108.495359:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.496582:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333577344 00000100:00100000:2.0:1734016108.496594:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333577344 00000100:00100000:2.0:1734016108.496653:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10580 00000100:00100000:2.0:1734016108.496661:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333577344:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016108.496683:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016108.496707:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114d03 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e51e9 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.496736:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.496738:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.496746:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114d03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51e9 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.496762:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114d03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51e9 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.496782:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016108.498108:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333577344:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1439us (2751us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016108.498119:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10580 00000100:00100000:2.0:1734016108.506362:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.506468:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333577600 00000100:00100000:0.0:1734016108.506481:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333577600 00002000:00100000:0.0:1734016108.506543:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->2093055) req@ffff880075df1500 x1818247333577600/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016108.506554:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075df1500 with x1818247333577600 ext(0->2093055) 00002000:00010000:0.0:1734016108.506560:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075df1500 00000100:00100000:0.0:1734016108.506604:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8324 00000100:00100000:0.0:1734016108.506612:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333577600:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:2.0:1734016108.513545:0:6469:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1734016108.532014:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333577600:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 25376us (25647us total) trans 0 rc 2093056/2093056 00000100:00100000:0.0:1734016108.532037:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8324 00002000:00100000:0.0:1734016108.532063:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->2093055) req@ffff880075df1500 x1818247333577600/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/440 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 2093056/2093056 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016108.532075:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075df1500 with x1818247333577600 ext(0->2093055) 00002000:00010000:0.0:1734016108.532094:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075df1500 00000100:00100000:1.0:1734016108.547353:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.547431:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333577856 00000100:00100000:0.0:1734016108.547441:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333577856 00000100:00100000:0.0:1734016108.547500:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2106 00000100:00100000:0.0:1734016108.547508:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333577856:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016108.547570:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016108.547599:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27114cc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51b8 expref: 14 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.547635:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016108.547640:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016108.547836:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27114d0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.547850:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114cb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51b1 expref: 29 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.547857:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27114d0a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.547889:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51b1 expref: 29 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.547900:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114cb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51b1 expref: 29 pid: 13956 timeout: 475 lvb_type: 0 00000100:00100000:0.0:1734016108.547915:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335249664:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016108.547978:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016108.552377:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335249664:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016108.552418:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27114d0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016108.552589:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.553381:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333577984 00000100:00100000:0.0:1734016108.553391:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333577984 00010000:00010000:0.0:1734016108.553440:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114cb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51b1 expref: 30 pid: 13956 timeout: 475 lvb_type: 0 00000100:00100000:0.0:1734016108.553489:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2894 00000100:00100000:0.0:1734016108.553499:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+30:1982:x1818247333577984:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016108.553520:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016108.553527:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114cb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51b1 expref: 30 pid: 13956 timeout: 475 lvb_type: 0 00010000:00010000:0.0:1734016108.553539:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51b1 expref: 30 pid: 13956 timeout: 475 lvb_type: 0 00010000:00010000:0.0:1734016108.553567:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27114cb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51b1 expref: 30 pid: 13956 timeout: 475 lvb_type: 0 00010000:00010000:0.0:1734016108.553588:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016108.553593:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27114d0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.553602:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27114d0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.553609:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27114d0a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.555293:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016108.555379:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+29:1982:x1818247333577984:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1876us (2787us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016108.555390:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2894 00010000:00010000:1.0:1734016108.555482:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27114d0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016108.555490:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27114d0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:1.0:1734016108.555587:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968656 00000004:00010000:1.0:1734016108.555639:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800752a5c00 reply state ffff880075a24000 transno 4294968657 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27114d0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016108.555646:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016108.555717:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333577856:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 8210us (8377us total) trans 4294968657 rc 0/0 00000100:00100000:1.0:1734016108.555724:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2106 00000020:00080000:1.0:1734016108.555728:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1734016108.558048:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27114d0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.558067:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27114d0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.558073:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27114d0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.558086:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581680 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016108.558091:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27114d0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.558098:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27114d0a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.558117:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016108.558120:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016108.558124:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27114d0a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016108.558128:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27114d0a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016108.558197:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.558349:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333578112 00000100:00100000:0.0:1734016108.558358:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333578112 00000100:00100000:0.0:1734016108.558405:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10581 00000100:00100000:0.0:1734016108.558412:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333578112:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016108.558430:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016108.558447:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114d11 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e51f0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.558478:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114cfc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51e2 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.558493:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114d03 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51e9 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.558499:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.558501:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.558504:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114d11 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51f0 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.558537:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114d03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51e9 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.558547:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114d03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51e9 expref: 6 pid: 8216 timeout: 475 lvb_type: 1 00000100:00100000:0.0:1734016108.558559:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335249792:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016108.558635:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114cfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51e2 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.558642:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114cfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51e2 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00000100:00100000:0.0:1734016108.558649:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073791f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335249920:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016108.558665:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016108.562066:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335249792:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016108.562094:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073791f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335249920:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016108.562139:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114d11 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51f0 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.562160:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:0.0:1734016108.562226:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333578112:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3811us (4034us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016108.562236:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10581 00000100:00100000:2.0:1734016108.563547:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.563619:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333578240 00000100:00100000:0.0:1734016108.563628:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333578240 00010000:00010000:0.0:1734016108.563666:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114cfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51e2 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00000100:00100000:3.0:1734016108.564252:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2895 00000100:00100000:3.0:1734016108.564262:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333578240:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016108.564280:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016108.564306:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114cfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51e2 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:3.0:1734016108.564318:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114cfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51e2 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:3.0:1734016108.564350:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27114cfc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51e2 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:3.0:1734016108.565037:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016108.565105:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333578240:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 841us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016108.565112:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2895 00000100:00100000:3.0:1734016108.565236:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016108.565253:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333578368 00000100:00100000:3.0:1734016108.565258:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333578368 00010000:00010000:3.0:1734016108.565273:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114d03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51e9 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00000100:00100000:3.0:1734016108.565289:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2896 00000100:00100000:3.0:1734016108.565293:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a780a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333578368:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016108.565300:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016108.565310:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114d03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51e9 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:3.0:1734016108.565319:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114d03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51e9 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:3.0:1734016108.565331:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114d03 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51e9 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:3.0:1734016108.565345:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016108.565346:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016108.565351:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114d11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51f0 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.565359:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114d11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51f0 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.565390:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114d11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51f0 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016108.565404:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335250048:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016108.565436:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016108.570692:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335250048:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016108.570726:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016108.570796:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a780a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333578368:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5498us (5557us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016108.570838:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2896 00000100:00100000:0.0:1734016108.571250:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016108.571358:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333578496 00000100:00100000:1.0:1734016108.571366:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333578496 00002000:00010000:1.0:1734016108.571398:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (9279021->18446744073709551615) 00002000:00100000:1.0:1734016108.571402:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073791f80 with x1818247333578496 ext(9279021->18446744073709551615) 00002000:00010000:1.0:1734016108.571414:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073791f80. 00000100:00100000:1.0:1734016108.571444:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8325 00000100:00100000:1.0:1734016108.571451:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333578496:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016108.571678:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 2093026 -> 9279021 00002000:00010000:1.0:1734016108.571681:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016109 -> 1734016109 00002000:00010000:1.0:1734016108.571683:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016108 -> 1734016108 00002000:00010000:1.0:1734016108.571685:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016109 -> 1734016109 00002000:00010000:1.0:1734016108.571686:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 312 -> 312 00000100:00100000:1.0:1734016108.571714:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333578496:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 262us (464us total) trans 4294969307 rc 0/0 00000100:00100000:1.0:1734016108.571720:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8325 00002000:00010000:1.0:1734016108.571723:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (9279021->18446744073709551615) 00002000:00100000:1.0:1734016108.571725:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073791f80 with x1818247333578496 ext(9279021->18446744073709551615) 00002000:00010000:1.0:1734016108.571729:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073791f80. 00000100:00100000:0.0:1734016108.575698:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016108.575823:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333578752 00000100:00100000:3.0:1734016108.575833:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333578752 00002000:00100000:3.0:1734016108.575880:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8699904->9281535) req@ffff880073790700 x1818247333578752/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016108.575890:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790700 with x1818247333578752 ext(8699904->9281535) 00002000:00010000:3.0:1734016108.575895:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073790700 00000100:00100000:3.0:1734016108.575925:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8326 00000100:00100000:3.0:1734016108.575932:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333578752:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016108.587402:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333578752:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 11449us (11696us total) trans 0 rc 581632/581632 00000100:00100000:3.0:1734016108.587421:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8326 00002000:00100000:3.0:1734016108.587441:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8699904->9281535) req@ffff880073790700 x1818247333578752/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 488/440 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 581632/581632 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016108.587452:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790700 with x1818247333578752 ext(8699904->9281535) 00002000:00010000:3.0:1734016108.587459:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073790700 00000100:00100000:2.0:1734016108.591739:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016108.592012:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333578880 00000100:00100000:3.0:1734016108.592024:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333578880 00002000:00100000:3.0:1734016108.592087:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (9277440->9279020) req@ffff880075deb100 x1818247333578880/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 2072/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016108.592098:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075deb100 with x1818247333578880 ext(9277440->9279020) 00002000:00010000:3.0:1734016108.592105:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075deb100 00000100:00100000:3.0:1734016108.592297:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8327 00000100:00100000:3.0:1734016108.592305:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333578880:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016108.593215:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333578880:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 907us (1487us total) trans 4294969308 rc 0/0 00000100:00100000:0.0:1734016108.593225:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8327 00002000:00100000:0.0:1734016108.593232:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (9277440->9279020) req@ffff880075deb100 x1818247333578880/t4294969308(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:69/0 lens 2072/448 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016108.593239:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075deb100 with x1818247333578880 ext(9277440->9279020) 00002000:00010000:0.0:1734016108.593244:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075deb100 00000100:00100000:0.0:1734016108.596217:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016108.596581:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333579008 00000100:00100000:1.0:1734016108.596601:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333579008 00000100:00100000:1.0:1734016108.596681:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2107 00000100:00100000:1.0:1734016108.596691:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:9668:x1818247333579008:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:1.0:1734016108.596934:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:9668:x1818247333579008:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 244us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016108.596942:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2107 00000100:00100000:2.0:1734016108.598699:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.598760:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333579136 00000100:00100000:0.0:1734016108.598768:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333579136 00000100:00100000:0.0:1734016108.598832:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10582 00000100:00100000:0.0:1734016108.598838:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333579136:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016108.600236:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969308 is committed 00000100:00100000:0.0:1734016108.600719:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333579136:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 1876us (2023us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016108.600727:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10582 00000100:00100000:3.0:1734016108.602940:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.603210:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333579264 00000100:00100000:2.0:1734016108.603219:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333579264 00000100:00100000:2.0:1734016108.603279:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2108 00000100:00100000:2.0:1734016108.603286:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+29:9668:x1818247333579264:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016108.603309:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016108.603334:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27114d18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e51f7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.603435:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114d1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016108.603450:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016108.603461:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016108.603493:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 9279021 00000004:00200000:2.0:1734016108.603498:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016108.603514:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016108.603538:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27114d18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51f7 expref: 31 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.603568:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114d1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51f7 expref: 30 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.603576:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016108.603578:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016108.603582:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016108.603629:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+30:9668:x1818247333579264:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 343us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016108.603635:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2108 00000100:00100000:1.0:1734016108.607579:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.607654:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333579392 00000100:00100000:0.0:1734016108.607662:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333579392 00000100:00100000:0.0:1734016108.607707:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10583 00000100:00100000:0.0:1734016108.607712:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333579392:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016108.607730:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016108.607748:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27114d26 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e51fe expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016108.607821:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335250176:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016108.607892:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00002000:00010000:0.0:1734016108.611975:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016108 -> 1734016109 00002000:00010000:0.0:1734016108.611984:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 312 -> 320 00000100:00100000:0.0:1734016108.612008:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335250176:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016108.612049:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27114d26 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51fe expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.612063:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27114d26 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51fe expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.612099:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:0.0:1734016108.612389:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333579392:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4673us (4818us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016108.612400:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10583 00000100:00100000:3.0:1734016108.616682:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.616786:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333579520 00000100:00100000:0.0:1734016108.616797:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333579520 00000100:00100000:0.0:1734016108.616912:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10584 00000100:00100000:0.0:1734016108.616919:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333579520:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016108.616939:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016108.616958:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27114d2d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5205 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016108.617013:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335250304:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016108.617088:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016108.619160:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335250304:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016108.619201:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27114d2d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5205 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.619213:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27114d2d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5205 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.619238:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:0.0:1734016108.619398:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333579520:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2477us (2728us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016108.619407:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10584 00000100:00100000:2.0:1734016108.622645:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.622736:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333579648 00000100:00100000:0.0:1734016108.622748:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333579648 00000100:00100000:0.0:1734016108.622797:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10585 00000100:00100000:0.0:1734016108.622823:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333579648:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016108.623124:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9279021 -> 9279021 00002000:00010000:0.0:1734016108.623128:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016109 -> 1734016109 00002000:00010000:0.0:1734016108.623130:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016109 -> 1734016108 00002000:00010000:0.0:1734016108.623132:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016109 -> 1734016109 00002000:00010000:0.0:1734016108.623134:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 320 -> 320 00000100:00100000:0.0:1734016108.623229:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333579648:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 406us (597us total) trans 4294969309 rc 0/0 00000100:00100000:0.0:1734016108.623237:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10585 00000100:00100000:2.0:1734016108.626986:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016108.627063:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333579776 00000100:00100000:1.0:1734016108.627074:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333579776 00000100:00100000:1.0:1734016108.627250:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10586 00000100:00100000:1.0:1734016108.627258:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333579776:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016108.627279:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016108.627300:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114d34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e520c expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016108.627360:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800752a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335250432:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016108.627437:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fe40 going to sleep for 11 seconds 00002000:00010000:2.0:1734016108.629361:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016108 -> 1734016109 00000100:00100000:2.0:1734016108.629387:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800752a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335250432:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016108.629420:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114d34 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e520c expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.629432:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27114d34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e520c expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.630043:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:2.0:1734016108.630105:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333579776:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2846us (3130us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016108.630114:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10586 00000100:00100000:2.0:1734016108.634147:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.634531:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333579904 00000100:00100000:0.0:1734016108.634543:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333579904 00000100:00100000:0.0:1734016108.634622:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10587 00000100:00100000:0.0:1734016108.634631:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333579904:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016108.634652:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016108.634673:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114d3b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5213 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016108.634740:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335250560:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016108.634834:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016108.637096:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335250560:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016108.637143:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114d3b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5213 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.637157:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114d3b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5213 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.637188:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75818c0, rc 0) 00000100:00100000:2.0:1734016108.637234:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333579904:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2604us (3100us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016108.637244:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10587 00000100:00100000:1.0:1734016108.640095:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.640237:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333580160 00000100:00100000:0.0:1734016108.640247:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333580160 00000100:00100000:0.0:1734016108.640303:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8328 00000100:00100000:0.0:1734016108.640309:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333580160:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:0.0:1734016108.640348:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114d42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.640369:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114d11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51f0 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.640375:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016108.640377:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016108.640379:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114d42 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [778240->798719] (req 778240->798719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.640409:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114d11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51f0 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.640419:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114d11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51f0 expref: 6 pid: 8216 timeout: 475 lvb_type: 0 00000100:00100000:0.0:1734016108.640432:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073791c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335250688:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016108.640486:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016108.644313:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.644562:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073791c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335250688:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016108.644594:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114d42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [778240->798719] (req 778240->798719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016108.644835:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333580288 00000100:00100000:3.0:1734016108.644842:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333580288 00010000:00010000:3.0:1734016108.644880:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114d11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51f0 expref: 7 pid: 8216 timeout: 475 lvb_type: 0 00000100:00100000:3.0:1734016108.644909:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2897 00000100:00100000:3.0:1734016108.644916:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333580288:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016108.644934:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016108.644957:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114d11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51f0 expref: 7 pid: 8216 timeout: 475 lvb_type: 0 00010000:00010000:3.0:1734016108.644968:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114d11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51f0 expref: 7 pid: 8216 timeout: 475 lvb_type: 0 00010000:00010000:3.0:1734016108.644992:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114d11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51f0 expref: 7 pid: 8216 timeout: 475 lvb_type: 0 00010000:00010000:3.0:1734016108.645027:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016108.645029:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016108.645033:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114d42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [778240->798719] (req 778240->798719) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.645041:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114d42 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [778240->798719] (req 778240->798719) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.645257:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016108.645301:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333580288:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 384us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016108.645307:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2897 00010000:00010000:2.0:1734016108.645362:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114d42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [778240->798719] (req 778240->798719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.645369:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114d42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [778240->798719] (req 778240->798719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016108.654724:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969310 is committed 00000001:00080000:0.0:1734016108.654745:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969309 is committed 00002000:00010000:2.0:1734016108.654887:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 320 -> 360 00010000:00010000:2.0:1734016108.654907:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114d42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [778240->798719] (req 778240->798719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.654921:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114d42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [778240->798719] (req 778240->798719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.654929:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114d42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [778240->798719] (req 778240->798719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.654935:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581200 already unused, calling callback (ffffffffa080e100) 00010000:00010000:2.0:1734016108.654940:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114d42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [778240->798719] (req 778240->798719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.654947:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114d42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [778240->798719] (req 778240->798719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.654968:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114d42 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [778240->798719] (req 778240->798719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.654973:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114d42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [778240->798719] (req 778240->798719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016108.655528:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333580160:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 15207us (15439us total) trans 4294969310 rc 0/0 00000100:00100000:2.0:1734016108.655542:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8328 00000100:00100000:1.0:1734016108.662402:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.663428:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333580416 00000100:00100000:2.0:1734016108.663442:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333580416 00000100:00100000:3.0:1734016108.663581:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2109 00000100:00100000:3.0:1734016108.663590:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:9668:x1818247333580416:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016108.663619:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016108.663644:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27114d49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e521a expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.663768:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114d50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016108.663787:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016108.663825:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:3.0:1734016108.663851:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 9279021 00000004:00200000:3.0:1734016108.663856:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016108.663872:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016108.663894:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27114d49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e521a expref: 17 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.663926:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e521a expref: 16 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.663934:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016108.663937:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016108.663940:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016108.663997:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333580416:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 408us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016108.664004:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2109 00000100:00100000:0.0:1734016108.666957:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.667070:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333580544 00000100:00100000:2.0:1734016108.667089:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333580544 00000100:00100000:2.0:1734016108.667136:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10588 00000100:00100000:2.0:1734016108.667144:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333580544:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016108.667167:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016108.667190:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114d57 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5221 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1734016108.667215:0:7683:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 9279021, mtime: 0x675afc6d, atime: 0x675afc6d, ctime: 0x675afc6d, blocks: 0x168 00010000:00010000:2.0:1734016108.667237:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.667240:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.667250:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114d57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5221 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.667266:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114d57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5221 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.667277:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd680, rc 0) 00000100:00100000:2.0:1734016108.667345:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333580544:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 202us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016108.667351:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10588 00000100:00100000:2.0:1734016108.670991:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.671095:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333580800 00000100:00100000:0.0:1734016108.671108:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333580800 00000100:00100000:0.0:1734016108.671193:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8329 00000100:00100000:0.0:1734016108.671200:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333580800:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:0.0:1734016108.671245:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114d5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.671272:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114d57 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5221 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.671279:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.671282:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.671284:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114d5e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8744960->8790015] (req 8744960->8790015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.671321:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114d57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5221 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.671332:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114d57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5221 expref: 6 pid: 7683 timeout: 475 lvb_type: 1 00000100:00100000:0.0:1734016108.671349:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335250816:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016108.672059:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016108.674624:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335250816:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016108.674658:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114d5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8744960->8790015] (req 8744960->8790015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016108.675675:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.675775:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333580928 00000100:00100000:0.0:1734016108.675782:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333580928 00010000:00010000:0.0:1734016108.675899:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114d57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5221 expref: 7 pid: 7683 timeout: 475 lvb_type: 1 00000100:00100000:0.0:1734016108.675937:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2898 00000100:00100000:0.0:1734016108.675944:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075650380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333580928:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016108.675959:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016108.675985:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114d57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5221 expref: 7 pid: 7683 timeout: 475 lvb_type: 1 00010000:00010000:0.0:1734016108.675995:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114d57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5221 expref: 7 pid: 7683 timeout: 475 lvb_type: 1 00010000:00010000:0.0:1734016108.676019:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27114d57 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5221 expref: 7 pid: 7683 timeout: 475 lvb_type: 1 00010000:00010000:0.0:1734016108.676046:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.676048:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.676053:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114d5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8744960->8790015] (req 8744960->8790015) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.676061:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114d5e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8744960->8790015] (req 8744960->8790015) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.676099:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016108.676144:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075650380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333580928:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 199us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016108.676151:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2898 00010000:00010000:1.0:1734016108.676474:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114d5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8744960->8790015] (req 8744960->8790015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.676484:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114d5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8744960->8790015] (req 8744960->8790015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016108.684012:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969311 is committed 00002000:00010000:1.0:1734016108.684145:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 360 -> 448 00010000:00010000:1.0:1734016108.684167:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114d5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8744960->8790015] (req 8744960->8790015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.684179:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114d5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8744960->8790015] (req 8744960->8790015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.684186:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114d5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8744960->8790015] (req 8744960->8790015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.684193:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7583180 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016108.684197:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114d5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8744960->8790015] (req 8744960->8790015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.684206:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114d5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8744960->8790015] (req 8744960->8790015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.684224:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114d5e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8744960->8790015] (req 8744960->8790015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.684230:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114d5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8744960->8790015] (req 8744960->8790015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016108.684560:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333580800:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 13353us (13577us total) trans 4294969311 rc 0/0 00000100:00100000:1.0:1734016108.684571:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8329 00000100:00100000:1.0:1734016108.691091:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.691169:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333581056 00000100:00100000:0.0:1734016108.691179:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333581056 00000100:00100000:0.0:1734016108.691234:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10589 00000100:00100000:0.0:1734016108.691240:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333581056:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016108.691259:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016108.691276:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114d65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5228 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016108.691295:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 9279021, mtime: 0x675afc6d, atime: 0x675afc6d, ctime: 0x675afc6d, blocks: 0x1c0 00010000:00010000:0.0:1734016108.691311:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.691313:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.691319:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114d65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5228 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.691331:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114d65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5228 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.691340:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582f40, rc 0) 00000100:00100000:0.0:1734016108.691402:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333581056:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 161us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016108.691408:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10589 00000100:00100000:0.0:1734016108.697691:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016108.697840:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333581312 00000100:00100000:1.0:1734016108.697855:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333581312 00000100:00100000:1.0:1734016108.697948:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8330 00000100:00100000:1.0:1734016108.697957:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333581312:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:1.0:1734016108.698005:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114d6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.698025:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114d65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5228 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016108.698032:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016108.698035:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016108.698038:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114d6c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1429504->1482751] (req 1429504->1482751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.698092:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114d65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5228 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016108.698104:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114d65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5228 expref: 6 pid: 8216 timeout: 475 lvb_type: 1 00000100:00100000:1.0:1734016108.698121:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800752a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335250944:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016108.698206:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:2.0:1734016108.704461:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016108.704548:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333581440 00000100:00100000:3.0:1734016108.704557:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333581440 00010000:00010000:3.0:1734016108.704592:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114d65 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5228 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00000100:00100000:3.0:1734016108.704637:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2899 00000100:00100000:3.0:1734016108.704643:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075651880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333581440:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016108.704658:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016108.704681:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114d65 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5228 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:3.0:1734016108.704700:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114d65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5228 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:3.0:1734016108.704726:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016108.704728:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016108.704733:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114d6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1429504->1482751] (req 1429504->1482751) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.704741:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114d6c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1429504->1482751] (req 1429504->1482751) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016108.704761:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016108.704848:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075651880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333581440:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 205us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016108.704855:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2899 00010000:00010000:1.0:1734016108.706239:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114d65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5228 expref: 6 pid: 8216 timeout: 475 lvb_type: 1 00000100:00100000:1.0:1734016108.708437:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800752a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335250944:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016108.708479:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114d6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1429504->1482751] (req 1429504->1482751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.708494:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114d6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1429504->1482751] (req 1429504->1482751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.708500:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114d6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1429504->1482751] (req 1429504->1482751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016108.718155:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969312 is committed 00002000:00010000:1.0:1734016108.718312:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 448 -> 552 00010000:00010000:1.0:1734016108.718328:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114d6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1429504->1482751] (req 1429504->1482751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.718340:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114d6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1429504->1482751] (req 1429504->1482751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.718347:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114d6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1429504->1482751] (req 1429504->1482751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.718355:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499d8c0 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016108.718359:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114d6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1429504->1482751] (req 1429504->1482751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.718367:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114d6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1429504->1482751] (req 1429504->1482751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.718390:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114d6c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1429504->1482751] (req 1429504->1482751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.718396:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27114d6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1429504->1482751] (req 1429504->1482751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016108.719283:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333581312:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 21320us (21597us total) trans 4294969312 rc 0/0 00000100:00100000:1.0:1734016108.719294:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8330 00000100:00100000:0.0:1734016108.722160:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.723362:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333581568 00000100:00100000:2.0:1734016108.723376:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333581568 00000100:00100000:2.0:1734016108.723429:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10590 00000100:00100000:2.0:1734016108.723437:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333581568:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016108.723460:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016108.723485:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114d73 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e522f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1734016108.723513:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 9279021, mtime: 0x675afc6d, atime: 0x675afc6d, ctime: 0x675afc6d, blocks: 0x228 00010000:00010000:2.0:1734016108.723535:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.723537:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.723544:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114d73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e522f expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.723558:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114d73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e522f expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.723570:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016108.723633:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333581568:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 196us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016108.723639:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10590 00000100:00100000:0.0:1734016108.727267:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.727406:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333581696 00000100:00100000:2.0:1734016108.727417:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333581696 00000100:00100000:2.0:1734016108.727467:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10591 00000100:00100000:2.0:1734016108.727475:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333581696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016108.727499:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016108.727520:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114d7a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5236 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.727554:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114d73 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e522f expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.727562:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.727564:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.727567:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114d7a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [10199040->10248191] (req 10199040->10248191) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5236 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.727602:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114d73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e522f expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.727615:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114d73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e522f expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00000100:00100000:2.0:1734016108.727627:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335251072:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016108.727965:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e180 going to sleep for 11 seconds 00000100:00100000:3.0:1734016108.730873:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.730983:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335251072:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016108.731017:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114d7a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [10199040->10248191] (req 10199040->10248191) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5236 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.731036:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016108.731110:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333581696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3634us (3857us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016108.731119:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10591 00000100:00100000:0.0:1734016108.731303:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333581824 00000100:00100000:0.0:1734016108.731312:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333581824 00010000:00010000:0.0:1734016108.731344:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114d73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e522f expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00000100:00100000:0.0:1734016108.731366:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2900 00000100:00100000:0.0:1734016108.731372:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333581824:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016108.731387:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016108.731411:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114d73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e522f expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:0.0:1734016108.731422:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114d73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e522f expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:0.0:1734016108.731445:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114d73 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e522f expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:0.0:1734016108.731460:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.731462:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.731468:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114d7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10199040->10248191) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5236 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.731477:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114d7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10199040->10248191) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5236 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.731506:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114d7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10199040->10248191) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5236 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016108.731517:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335251200:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016108.731549:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016108.734017:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335251200:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016108.734045:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016108.734112:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333581824:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 2737us (3248us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016108.734124:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2900 00000100:00100000:1.0:1734016108.734684:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.735504:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333581952 00000100:00100000:2.0:1734016108.735512:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333581952 00000100:00100000:2.0:1734016108.735560:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10592 00000100:00100000:2.0:1734016108.735567:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800752a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333581952:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016108.735837:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9279021 -> 10245772 00002000:00010000:2.0:1734016108.735840:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016109 -> 1734016108 00002000:00010000:2.0:1734016108.735842:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016109 -> 1734016109 00002000:00010000:2.0:1734016108.735844:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016109 -> 1734016108 00002000:00010000:2.0:1734016108.735846:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 552 -> 648 00000100:00100000:2.0:1734016108.735907:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800752a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333581952:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 340us (1223us total) trans 4294969313 rc 0/0 00000100:00100000:2.0:1734016108.735914:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10592 00000100:00100000:3.0:1734016108.739931:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.740009:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333582080 00000100:00100000:0.0:1734016108.740018:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333582080 00000100:00100000:0.0:1734016108.740189:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10593 00000100:00100000:0.0:1734016108.740198:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333582080:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016108.740223:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016108.740243:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27114d81 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e523d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016108.740307:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335251328:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016108.740383:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00002000:00010000:0.0:1734016108.743534:0:8216:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime: 1734016108 -> 1734016109 00002000:00010000:0.0:1734016108.743543:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016108 -> 1734016109 00000100:00100000:0.0:1734016108.743566:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335251328:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016108.743601:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27114d81 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e523d expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.743615:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27114d81 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e523d expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.744131:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582d00, rc 0) 00000100:00100000:0.0:1734016108.744200:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333582080:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4001us (4277us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016108.744209:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10593 00000100:00100000:1.0:1734016108.747481:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.747596:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333582336 00000100:00100000:2.0:1734016108.747609:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333582336 00000100:00100000:2.0:1734016108.747690:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8331 00000100:00100000:2.0:1734016108.747698:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333582336:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:2.0:1734016108.747750:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114d88 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.747771:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114d7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10199040->10248191) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5236 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.747778:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016108.747779:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016108.747782:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114d88 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.747868:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114d7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10199040->10248191) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5236 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.747881:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114d7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10199040->10248191) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5236 expref: 6 pid: 7683 timeout: 475 lvb_type: 0 00000100:00100000:2.0:1734016108.747899:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335251456:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016108.747991:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e180 going to sleep for 11 seconds 00000100:00100000:0.0:1734016108.750062:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335251456:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016108.750095:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114d88 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016108.751220:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.751330:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333582464 00000100:00100000:0.0:1734016108.751339:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333582464 00010000:00010000:0.0:1734016108.751371:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114d7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10199040->10248191) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5236 expref: 7 pid: 7683 timeout: 475 lvb_type: 0 00000100:00100000:0.0:1734016108.751437:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2901 00000100:00100000:0.0:1734016108.751444:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333582464:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016108.751460:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016108.751481:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114d7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10199040->10248191) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5236 expref: 7 pid: 7683 timeout: 475 lvb_type: 0 00010000:00010000:0.0:1734016108.751493:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114d7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10199040->10248191) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5236 expref: 7 pid: 7683 timeout: 475 lvb_type: 0 00010000:00010000:0.0:1734016108.751515:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114d7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10199040->10248191) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5236 expref: 7 pid: 7683 timeout: 475 lvb_type: 0 00010000:00010000:0.0:1734016108.751544:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.751546:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.751550:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114d88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.751559:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114d88 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.751594:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016108.751635:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333582464:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 191us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016108.751642:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2901 00010000:00010000:1.0:1734016108.751700:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114d88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016108.751708:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114d88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.756914:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114d88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.756933:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114d88 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.756941:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114d88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.756948:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc240 already unused, calling callback (ffffffffa080e100) 00010000:00010000:2.0:1734016108.756952:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114d88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.756961:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114d88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.756980:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114d88 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.756985:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114d88 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016108.757111:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333582336:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 9407us (9639us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1734016108.757127:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8331 00000100:00100000:2.0:1734016108.760093:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.760179:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333582592 00000100:00100000:0.0:1734016108.760189:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333582592 00000100:00100000:0.0:1734016108.760231:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10594 00000100:00100000:0.0:1734016108.760238:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333582592:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016108.760258:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016108.760280:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114d8f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5244 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016108.760302:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 10245772, mtime: 0x675afc6c, atime: 0x675afc6d, ctime: 0x675afc6c, blocks: 0x288 00010000:00010000:0.0:1734016108.760323:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.760325:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.760332:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114d8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5244 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.760346:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114d8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5244 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.760357:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00000100:00100000:0.0:1734016108.760609:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333582592:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 370us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016108.760616:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10594 00000100:00100000:0.0:1734016108.764547:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.764655:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333582720 00000100:00100000:2.0:1734016108.764666:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333582720 00000100:00100000:2.0:1734016108.764713:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10595 00000100:00100000:2.0:1734016108.764720:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333582720:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016108.764741:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016108.764761:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114d96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e524b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.764786:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.764788:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.764796:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114d96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e524b expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.764836:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114d96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e524b expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.764849:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016108.764907:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333582720:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 188us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016108.764913:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10595 00000100:00100000:1.0:1734016108.766785:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.766873:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333582848 00000100:00100000:0.0:1734016108.766880:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333582848 00000100:00100000:0.0:1734016108.767083:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10596 00000100:00100000:0.0:1734016108.767090:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333582848:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016108.767106:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016108.767123:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114d9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5252 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.767154:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114d8f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5244 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.767162:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114d96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e524b expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.767167:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.767169:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016108.767172:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114d9d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [4169728->4222975] (req 4169728->4222975) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5252 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.767200:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114d96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e524b expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.767213:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114d96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e524b expref: 8 pid: 8216 timeout: 475 lvb_type: 1 00000100:00100000:0.0:1734016108.767226:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335251584:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016108.767296:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114d8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5244 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016108.767305:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114d8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5244 expref: 6 pid: 8216 timeout: 475 lvb_type: 1 00000100:00100000:0.0:1734016108.767313:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335251712:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016108.767332:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016108.769741:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016108.770328:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335251584:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016108.770339:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335251712:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016108.770372:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114d9d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [4169728->4222975] (req 4169728->4222975) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5252 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016108.770391:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580900, rc 0) 00000100:00100000:0.0:1734016108.770449:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333582848:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3358us (3670us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016108.770458:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10596 00000100:00100000:3.0:1734016108.770631:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.770860:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333582976 00000100:00100000:2.0:1734016108.770867:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333582976 00010000:00010000:2.0:1734016108.770893:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114d96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e524b expref: 8 pid: 8216 timeout: 475 lvb_type: 1 00000100:00100000:2.0:1734016108.770928:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333583104 00000100:00100000:2.0:1734016108.770930:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333583104 00010000:00010000:2.0:1734016108.770939:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114d8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5244 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00000100:00100000:2.0:1734016108.770953:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2902 00000100:00100000:2.0:1734016108.770958:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007539aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333582976:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016108.770970:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016108.770990:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114d96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e524b expref: 8 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:2.0:1734016108.771000:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114d96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e524b expref: 8 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:2.0:1734016108.771021:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114d96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e524b expref: 8 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:2.0:1734016108.771047:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016108.771069:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007539aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333582976:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 111us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016108.771087:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2902 00000100:00100000:2.0:1734016108.771099:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2903 00000100:00100000:2.0:1734016108.771103:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a780ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333583104:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016108.771110:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016108.771117:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114d8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5244 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:2.0:1734016108.771126:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114d8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5244 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:2.0:1734016108.771137:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114d8f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5244 expref: 7 pid: 8216 timeout: 475 lvb_type: 1 00010000:00010000:2.0:1734016108.771145:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.771146:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016108.771152:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114d9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4169728->4222975) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5252 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.771161:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114d9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4169728->4222975) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5252 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016108.771189:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114d9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4169728->4222975) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5252 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016108.771202:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335251840:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016108.771233:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016108.774665:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.774761:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335251840:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016108.774783:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016108.774879:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a780ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333583104:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3765us (4239us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016108.774890:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2903 00000100:00100000:0.0:1734016108.775482:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333583232 00000100:00100000:0.0:1734016108.775489:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333583232 00000100:00100000:0.0:1734016108.775518:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10597 00000100:00100000:0.0:1734016108.775524:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333583232:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016108.775737:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10245772 -> 10245772 00002000:00010000:0.0:1734016108.775740:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016108 -> 1734016108 00002000:00010000:0.0:1734016108.775742:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016109 -> 1734016109 00002000:00010000:0.0:1734016108.775744:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016108 -> 1734016108 00002000:00010000:0.0:1734016108.775745:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 648 -> 752 00000100:00100000:0.0:1734016108.775777:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333583232:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 253us (1123us total) trans 4294969314 rc 0/0 00000100:00100000:0.0:1734016108.775782:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10597 00000100:00100000:1.0:1734016108.795328:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016108.795380:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016108.795420:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.795911:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333583488 00000100:00100000:2.0:1734016108.795924:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333583488 00002000:00100000:2.0:1734016108.795978:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff880073b48380 x1818247333583488/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.795988:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48380 with x1818247333583488 ext(0->4194303) 00002000:00010000:2.0:1734016108.795994:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b48380 00000100:00100000:2.0:1734016108.796012:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333583872 00000100:00100000:2.0:1734016108.796015:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333583872 00002000:00100000:2.0:1734016108.796024:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8388608->10248191) req@ffff88012db08000 x1818247333583872/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.796030:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db08000 with x1818247333583872 ext(8388608->10248191) 00002000:00010000:2.0:1734016108.796033:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db08000 00000100:00100000:2.0:1734016108.796049:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333583744 00000100:00100000:2.0:1734016108.796051:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333583744 00002000:00100000:2.0:1734016108.796062:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (4194304->8388607) req@ffff880075609f80 x1818247333583744/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.796068:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609f80 with x1818247333583744 ext(4194304->8388607) 00002000:00010000:2.0:1734016108.796070:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075609f80 00000100:00100000:2.0:1734016108.796091:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8332 00000100:00100000:2.0:1734016108.796097:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333583488:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016108.799191:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8333 00000100:00100000:3.0:1734016108.799206:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333583872:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016108.801145:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8334 00000100:00100000:0.0:1734016108.801157:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333583744:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016108.840914:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247333583872:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 41691us (45513us total) trans 0 rc 1859584/1859584 00000100:00100000:2.0:1734016108.840938:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8333 00002000:00100000:2.0:1734016108.840959:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8388608->10248191) req@ffff88012db08000 x1818247333583872/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/440 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 1859584/1859584 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016108.840976:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db08000 with x1818247333583872 ext(8388608->10248191) 00002000:00010000:2.0:1734016108.840985:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db08000 00000100:00100000:1.0:1734016108.875043:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333583744:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 73873us (79607us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016108.875056:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8334 00002000:00100000:1.0:1734016108.875071:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (4194304->8388607) req@ffff880075609f80 x1818247333583744/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/440 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016108.875090:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609f80 with x1818247333583744 ext(4194304->8388607) 00002000:00010000:1.0:1734016108.875096:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075609f80 00000100:00100000:3.0:1734016108.900376:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333583488:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 104261us (105045us total) trans 0 rc 4194304/4194304 00000100:00100000:3.0:1734016108.900395:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8332 00002000:00100000:3.0:1734016108.900410:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff880073b48380 x1818247333583488/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 488/440 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016108.900420:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48380 with x1818247333583488 ext(0->4194303) 00002000:00010000:3.0:1734016108.900427:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b48380 00000100:00100000:0.0:1734016108.908588:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016108.908725:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333584128 00000100:00100000:3.0:1734016108.908735:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333584128 00002000:00100000:3.0:1734016108.908793:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1138688->1150975) req@ffff88007487c380 x1818247333584128/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 12776/0 e 0 to 0 dl 1734016119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016108.908866:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487c380 with x1818247333584128 ext(1138688->1150975) 00002000:00010000:3.0:1734016108.908873:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487c380 00000100:00100000:3.0:1734016108.909114:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8335 00000100:00100000:3.0:1734016108.909123:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333584128:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016108.910024:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333584128:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 897us (1443us total) trans 4294969315 rc 0/0 00000100:00100000:3.0:1734016108.910035:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8335 00002000:00100000:3.0:1734016108.910046:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1138688->1150975) req@ffff88007487c380 x1818247333584128/t4294969315(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:69/0 lens 12776/448 e 0 to 0 dl 1734016119 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016108.910054:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487c380 with x1818247333584128 ext(1138688->1150975) 00002000:00010000:3.0:1734016108.910059:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487c380 00000100:00100000:0.0:1734016108.912987:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.913159:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333584256 00000100:00100000:2.0:1734016108.913169:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333584256 00000100:00100000:2.0:1734016108.913226:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2110 00000100:00100000:2.0:1734016108.913234:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+30:9668:x1818247333584256:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:2.0:1734016108.913385:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+30:9668:x1818247333584256:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 150us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016108.913393:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2110 00000100:00100000:0.0:1734016108.915259:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.915332:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333584384 00000100:00100000:2.0:1734016108.915340:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333584384 00000100:00100000:2.0:1734016108.915386:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10598 00000100:00100000:2.0:1734016108.915394:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333584384:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016108.917390:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969315 is committed 00000001:00080000:0.0:1734016108.917414:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969313 is committed 00000100:00100000:2.0:1734016108.917606:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333584384:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2205us (2347us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016108.917619:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10598 00000100:00100000:0.0:1734016108.927249:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.927382:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333584512 00000100:00100000:2.0:1734016108.927394:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333584512 00000100:00100000:2.0:1734016108.927450:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10599 00000100:00100000:2.0:1734016108.927458:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333584512:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016108.927483:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016108.927510:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114da4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5259 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016108.927599:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335251968:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016108.927699:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ecc0 going to sleep for 11 seconds 00002000:00010000:2.0:1734016108.939893:0:8216:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime: 1734016108 -> 1734016109 00002000:00010000:2.0:1734016108.939907:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016108 -> 1734016109 00002000:00010000:2.0:1734016108.939909:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 752 -> 776 00000100:00100000:2.0:1734016108.939942:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335251968:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016108.939992:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114da4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5259 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.940008:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114da4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5259 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.940036:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016108.940100:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333584512:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12640us (12863us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016108.940111:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10599 00000100:00100000:1.0:1734016108.950945:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016108.953735:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333584640 00000100:00100000:2.0:1734016108.953752:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333584640 00000100:00100000:2.0:1734016108.953839:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10600 00000100:00100000:2.0:1734016108.953847:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333584640:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016108.953870:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016108.953891:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114dab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5260 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016108.953967:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335252096:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016108.954059:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016108.966754:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335252096:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016108.966860:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114dab lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5260 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.966882:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114dab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5260 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016108.966916:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016108.969183:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333584640:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 15306us (18233us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016108.969757:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10600 00000100:00100000:1.0:1734016108.976059:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016108.976917:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333584768 00000100:00100000:3.0:1734016108.976929:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333584768 00000100:00100000:3.0:1734016108.977410:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10601 00000100:00100000:3.0:1734016108.977421:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333584768:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016108.977450:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016108.977473:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114db2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5267 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016108.977556:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335252224:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016108.977655:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016108.981480:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335252224:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016108.981546:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114db2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5267 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016108.981569:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114db2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5267 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016108.981608:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4b40, rc 0) 00000100:00100000:3.0:1734016108.981718:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333584768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4297us (5686us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016108.981730:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10601 00000100:00100000:1.0:1734016108.986731:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016108.987428:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333584896 00000100:00100000:3.0:1734016108.987439:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333584896 00000100:00100000:3.0:1734016108.987560:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10602 00000100:00100000:3.0:1734016108.987569:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333584896:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016108.987595:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016108.987621:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27114db9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e526e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016108.987682:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335252352:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016108.987760:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016108.995449:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335252352:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016108.995496:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27114db9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e526e expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016108.995512:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27114db9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e526e expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016108.996275:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016108.996899:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333584896:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9325us (10179us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016108.996908:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10602 00000100:00100000:0.0:1734016109.014950:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.015096:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333585152 00000100:00100000:3.0:1734016109.015106:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333585152 00000100:00100000:3.0:1734016109.015178:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2111 00000100:00100000:3.0:1734016109.015185:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a751c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+30:9668:x1818247333585152:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016109.015243:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016109.015274:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114d1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e51f7 expref: 30 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.015299:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016109.015304:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016109.015468:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114dc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016109.015481:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114d50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e521a expref: 15 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.015488:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114dc0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016109.015524:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e521a expref: 15 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.015537:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114d50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e521a expref: 15 pid: 13956 timeout: 476 lvb_type: 0 00000100:00100000:3.0:1734016109.015549:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335252480:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016109.018901:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbcc0 going to sleep for 11 seconds 00000100:00080000:1.0:1734016109.019225:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016079 00000100:00100000:3.0:1734016109.023566:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335252480:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016109.023606:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114dc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016109.024163:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016109.024242:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333585280 00000100:00100000:2.0:1734016109.024252:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333585280 00010000:00010000:2.0:1734016109.024317:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114d50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e521a expref: 16 pid: 13956 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1734016109.024364:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2904 00000100:00100000:2.0:1734016109.024372:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333585280:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016109.024390:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016109.024402:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114d50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e521a expref: 16 pid: 13956 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1734016109.024418:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e521a expref: 16 pid: 13956 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1734016109.024453:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114d50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e521a expref: 16 pid: 13956 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1734016109.024487:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016109.024492:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114dc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.024503:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114dc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.024510:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114dc0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.024529:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016109.024572:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247333585280:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 201us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016109.024580:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2904 00010000:00010000:2.0:1734016109.024618:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114dc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.024623:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114dc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:2.0:1734016109.024738:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968658 00000004:00010000:2.0:1734016109.024786:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800a751c050 reply state ffff88007570b000 transno 4294968659 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114dc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016109.024793:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016109.024888:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a751c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+32:9668:x1818247333585152:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 9704us (9951us total) trans 4294968659 rc 0/0 00000100:00100000:2.0:1734016109.024894:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2111 00000020:00080000:2.0:1734016109.024899:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1734016109.026688:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016079 00010000:00010000:1.0:1734016109.030575:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114dc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016109.030592:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114dc0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016109.030600:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114dc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016109.030607:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df7a80 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:1.0:1734016109.030612:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114dc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016109.030619:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114dc0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016109.030637:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016109.030640:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1734016109.030643:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114dc0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016109.030648:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114dc0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016109.031176:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.031244:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333585408 00000100:00100000:3.0:1734016109.031257:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333585408 00002000:00010000:3.0:1734016109.032497:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (5533265->18446744073709551615) 00002000:00100000:3.0:1734016109.032505:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4380 with x1818247333585408 ext(5533265->18446744073709551615) 00002000:00010000:3.0:1734016109.032518:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4380. 00000100:00080000:1.0:1734016109.032753:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016079 00000100:00100000:3.0:1734016109.032902:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8336 00000100:00100000:3.0:1734016109.032916:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333585408:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016109.038096:0:14005:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10245772 -> 5533265 00002000:00010000:2.0:1734016109.038106:0:14005:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016109 -> 1734016109 00002000:00010000:2.0:1734016109.038109:0:14005:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016109 -> 1734016109 00002000:00010000:2.0:1734016109.038110:0:14005:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016109 -> 1734016109 00002000:00010000:2.0:1734016109.038112:0:14005:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 776 -> 584 00000100:00100000:2.0:1734016109.038191:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333585408:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 5273us (7014us total) trans 4294969316 rc 0/0 00000100:00100000:2.0:1734016109.038202:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8336 00002000:00010000:2.0:1734016109.038207:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (5533265->18446744073709551615) 00002000:00100000:2.0:1734016109.038210:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4380 with x1818247333585408 ext(5533265->18446744073709551615) 00002000:00010000:2.0:1734016109.038216:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4380. 00000100:00100000:0.0:1734016109.046320:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016109.046487:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333585536 00000100:00100000:2.0:1734016109.046502:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333585536 00000100:00100000:2.0:1734016109.046588:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2112 00000100:00100000:2.0:1734016109.046597:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+31:9668:x1818247333585536:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016109.046895:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016109.046926:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114dc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5275 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.047067:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27114dce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.047096:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27114dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.047109:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27114dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:2.0:1734016109.047141:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 5533265 00000004:00200000:2.0:1734016109.047147:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016109.047168:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27114dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.047194:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114dc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5275 expref: 33 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.047216:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27114dce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5275 expref: 32 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.047225:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016109.047228:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016109.047232:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016109.048720:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+32:9668:x1818247333585536:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2108us (2399us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016109.048734:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2112 00000100:00100000:0.0:1734016109.057404:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016109.057468:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333585664 00000100:00100000:2.0:1734016109.057480:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333585664 00000100:00100000:2.0:1734016109.057553:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2113 00000100:00100000:2.0:1734016109.057562:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:9668:x1818247333585664:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016109.057590:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016109.057615:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114dd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e527c expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.057714:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114ddc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.057728:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.057738:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:2.0:1734016109.057766:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 5533265 00000004:00200000:2.0:1734016109.057770:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016109.057787:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.057842:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114dd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e527c expref: 17 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.057862:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114ddc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e527c expref: 16 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.057870:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016109.057873:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016109.057876:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016109.059264:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333585664:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1685us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016109.059278:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2113 00000100:00100000:0.0:1734016109.065246:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.065447:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333585792 00000100:00100000:3.0:1734016109.065467:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333585792 00000100:00100000:3.0:1734016109.066156:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10603 00000100:00100000:3.0:1734016109.066165:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333585792:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016109.066187:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016109.066546:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27114de3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5283 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016109.066648:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335252608:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016109.066752:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016109.076164:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335252608:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016109.076223:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27114de3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5283 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.076246:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27114de3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5283 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.076343:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7a80, rc 0) 00000100:00100000:3.0:1734016109.076953:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333585792:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10785us (11726us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016109.076963:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10603 00000100:00100000:0.0:1734016109.081320:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.081439:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333585920 00000100:00100000:3.0:1734016109.081450:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333585920 00000100:00100000:3.0:1734016109.081515:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10604 00000100:00100000:3.0:1734016109.081526:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333585920:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016109.081550:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016109.081570:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114dea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e528a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016109.081645:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335252736:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016109.081733:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016109.085240:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335252736:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016109.085308:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114dea lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e528a expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.085327:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114dea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e528a expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.085366:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016109.085441:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333585920:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3915us (4132us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016109.085453:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10604 00000100:00100000:0.0:1734016109.087873:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.088117:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333586048 00000100:00100000:3.0:1734016109.088130:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333586048 00000100:00100000:3.0:1734016109.088186:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10605 00000100:00100000:3.0:1734016109.088196:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333586048:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016109.088226:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016109.088258:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27114df1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5291 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016109.088346:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335252864:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016109.088439:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016109.091028:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335252864:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016109.091062:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27114df1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5291 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.091088:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27114df1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5291 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.091301:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df58c0, rc 0) 00000100:00100000:3.0:1734016109.091377:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333586048:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3182us (3514us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016109.091386:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10605 00000100:00100000:0.0:1734016109.094060:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.094194:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333586176 00000100:00100000:3.0:1734016109.094205:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333586176 00000100:00100000:3.0:1734016109.094792:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10606 00000100:00100000:3.0:1734016109.094881:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333586176:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016109.094902:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016109.094923:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114df8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5298 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016109.094988:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335252992:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016109.095058:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016109.098929:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335252992:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016109.098998:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114df8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5298 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.099018:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114df8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5298 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.099039:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016109.099156:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333586176:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4351us (5103us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016109.099171:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10606 00000100:00100000:0.0:1734016109.102711:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.103549:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333586432 00000100:00100000:3.0:1734016109.103563:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333586432 00000100:00100000:3.0:1734016109.103639:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2114 00000100:00100000:3.0:1734016109.103649:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+32:9668:x1818247333586432:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016109.103748:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016109.104750:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27114dce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5275 expref: 32 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.104781:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016109.104788:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016109.105083:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114dff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016109.105099:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114ddc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e527c expref: 15 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.105107:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114dff lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016109.105148:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114ddc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e527c expref: 15 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.105162:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114ddc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e527c expref: 15 pid: 13956 timeout: 476 lvb_type: 0 00000100:00100000:3.0:1734016109.105178:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335253120:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016109.105258:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016109.109350:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335253120:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016109.109386:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114dff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016109.110297:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.110584:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333586560 00000100:00100000:0.0:1734016109.110597:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333586560 00010000:00010000:0.0:1734016109.110669:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114ddc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e527c expref: 16 pid: 13956 timeout: 476 lvb_type: 0 00000100:00100000:0.0:1734016109.110717:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2905 00000100:00100000:0.0:1734016109.110730:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1981:x1818247333586560:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016109.110754:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016109.110763:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114ddc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e527c expref: 16 pid: 13956 timeout: 476 lvb_type: 0 00010000:00010000:0.0:1734016109.110779:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114ddc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e527c expref: 16 pid: 13956 timeout: 476 lvb_type: 0 00010000:00010000:0.0:1734016109.110867:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27114ddc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e527c expref: 16 pid: 13956 timeout: 476 lvb_type: 0 00010000:00010000:0.0:1734016109.110913:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016109.110920:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114dff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016109.110933:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016109.110944:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114dff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016109.110988:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016109.111056:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1981:x1818247333586560:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 329us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016109.111066:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2905 00010000:00010000:3.0:1734016109.111329:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016109.111338:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:3.0:1734016109.111501:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968660 00000004:00010000:3.0:1734016109.111573:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075446680 reply state ffff88007570c000 transno 4294968661 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:3.0:1734016109.111583:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016109.111693:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+34:9668:x1818247333586432:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 8045us (9005us total) trans 4294968661 rc 0/0 00000100:00100000:3.0:1734016109.111702:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2114 00000020:00080000:3.0:1734016109.111707:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016109.115264:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1734016109.115279:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.115291:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114dff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.115300:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114dff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.115306:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df58c0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016109.115312:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114dff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.115329:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114dff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.115350:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016109.115353:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016109.115358:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114dff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.115363:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114dff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016109.115419:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333586688 00000100:00100000:2.0:1734016109.115431:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333586688 00002000:00010000:2.0:1734016109.115475:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (2533165->18446744073709551615) 00002000:00100000:2.0:1734016109.115480:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075446300 with x1818247333586688 ext(2533165->18446744073709551615) 00002000:00010000:2.0:1734016109.115493:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075446300. 00000100:00100000:2.0:1734016109.115586:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8337 00000100:00100000:2.0:1734016109.115596:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333586688:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016109.118261:0:14005:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 5533265 -> 2533165 00002000:00010000:3.0:1734016109.118272:0:14005:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016109 -> 1734016109 00002000:00010000:3.0:1734016109.118275:0:14005:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016109 -> 1734016109 00002000:00010000:3.0:1734016109.118277:0:14005:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016109 -> 1734016109 00002000:00010000:3.0:1734016109.118278:0:14005:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 584 -> 480 00000100:00100000:3.0:1734016109.118382:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333586688:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 2777us (3125us total) trans 4294969317 rc 0/0 00000100:00100000:3.0:1734016109.118401:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8337 00002000:00010000:3.0:1734016109.118410:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (2533165->18446744073709551615) 00002000:00100000:3.0:1734016109.118415:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075446300 with x1818247333586688 ext(2533165->18446744073709551615) 00002000:00010000:3.0:1734016109.118424:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075446300. 00000100:00100000:0.0:1734016109.123318:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.123421:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333586816 00000100:00100000:3.0:1734016109.123434:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333586816 00000100:00100000:3.0:1734016109.123518:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2115 00000100:00100000:3.0:1734016109.123529:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:9668:x1818247333586816:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016109.123564:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016109.123596:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27114e06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e529f expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.123710:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27114e0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016109.123726:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27114e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016109.123737:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27114e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:3.0:1734016109.123761:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 2533165 00000004:00200000:3.0:1734016109.123765:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016109.123783:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27114e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016109.123840:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27114e06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e529f expref: 17 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.123854:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27114e0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e529f expref: 16 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.123862:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016109.123864:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016109.123867:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016109.123914:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333586816:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 388us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016109.123919:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2115 00000100:00100000:0.0:1734016109.128956:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.129388:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333586944 00000100:00100000:3.0:1734016109.129400:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333586944 00000100:00100000:3.0:1734016109.129448:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10607 00000100:00100000:3.0:1734016109.129456:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333586944:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016109.129479:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016109.129500:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27114e14 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e52a6 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016109.129573:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335253248:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016109.129645:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016109.133675:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335253248:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016109.133721:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27114e14 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52a6 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.133735:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27114e14 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52a6 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.133747:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016109.133839:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333586944:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4381us (4895us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016109.133849:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10607 00000100:00100000:0.0:1734016109.137116:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.137245:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333587072 00000100:00100000:3.0:1734016109.137256:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333587072 00000100:00100000:3.0:1734016109.138100:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10608 00000100:00100000:3.0:1734016109.138109:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333587072:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016109.138134:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016109.138158:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114e1b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e52ad expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016109.138217:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335253376:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016109.138297:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016109.142918:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335253376:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016109.142962:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114e1b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52ad expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.142977:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114e1b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52ad expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.143003:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016109.143062:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333587072:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4953us (5957us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016109.143080:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10608 00000100:00100000:0.0:1734016109.150326:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.150452:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333587200 00000100:00100000:3.0:1734016109.150464:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333587200 00000100:00100000:3.0:1734016109.152920:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10609 00000100:00100000:3.0:1734016109.152932:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333587200:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016109.152959:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016109.152983:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27114e22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e52b4 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016109.153053:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335253504:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016109.153685:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016109.155895:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335253504:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016109.155938:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27114e22 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52b4 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.155952:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27114e22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52b4 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.156017:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df58c0, rc 0) 00000100:00100000:3.0:1734016109.156083:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333587200:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3152us (5767us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016109.156092:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10609 00000100:00100000:0.0:1734016109.163226:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.163410:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333587328 00000100:00100000:3.0:1734016109.163427:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333587328 00000100:00100000:3.0:1734016109.165135:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10610 00000100:00100000:3.0:1734016109.165147:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333587328:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016109.165185:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016109.165208:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114e29 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e52bb expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.165252:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114d9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4169728->4222975) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5252 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.165261:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016109.165263:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016109.165266:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114e29 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52bb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.165303:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114d9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4169728->4222975) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5252 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.165316:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114d9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4169728->4222975) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5252 expref: 8 pid: 7683 timeout: 476 lvb_type: 0 00000100:00100000:3.0:1734016109.165330:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335253632:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016109.165425:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016109.172790:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016109.172930:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333587456 00000100:00100000:2.0:1734016109.172939:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333587456 00010000:00010000:2.0:1734016109.172972:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114d9d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4169728->4222975) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5252 expref: 9 pid: 7683 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1734016109.172999:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2906 00000100:00100000:2.0:1734016109.173004:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333587456:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016109.173019:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016109.173039:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114d9d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4169728->4222975) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5252 expref: 9 pid: 7683 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1734016109.173053:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114d9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4169728->4222975) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5252 expref: 9 pid: 7683 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1734016109.173087:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016109.173089:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016109.173096:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114e29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 679936->684031) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52bb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.173103:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114e29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 679936->684031) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52bb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.173139:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114e29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 679936->684031) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52bb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016109.173150:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335253760:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016109.173208:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e180 going to sleep for 11 seconds 00010000:00010000:3.0:1734016109.174432:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114d9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4169728->4222975) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5252 expref: 9 pid: 7683 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1734016109.174501:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335253760:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016109.174515:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016109.174572:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333587456:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1566us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016109.174579:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2906 00000100:00100000:3.0:1734016109.175213:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335253632:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016109.175250:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114e29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 679936->684031) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52bb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.175260:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016109.175285:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333587328:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10140us (12083us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016109.175294:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10610 00000100:00100000:0.0:1734016109.178549:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.178645:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333587712 00000100:00100000:3.0:1734016109.178655:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333587712 00002000:00100000:3.0:1734016109.178703:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (679936->684031) req@ffff880075446a00 x1818247333587712/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016109.178713:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075446a00 with x1818247333587712 ext(679936->684031) 00002000:00010000:3.0:1734016109.178718:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075446a00 00000100:00100000:3.0:1734016109.178788:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8338 00000100:00100000:3.0:1734016109.178795:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333587712:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016109.180156:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333587712:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1357us (1615us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016109.180164:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8338 00002000:00100000:3.0:1734016109.180172:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (679936->684031) req@ffff880075446a00 x1818247333587712/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016109.180178:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075446a00 with x1818247333587712 ext(679936->684031) 00002000:00010000:3.0:1734016109.180181:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075446a00 00000100:00100000:0.0:1734016109.182105:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.182340:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333587968 00000100:00100000:3.0:1734016109.182349:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333587968 00002000:00100000:3.0:1734016109.182418:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (675840->679935) req@ffff880075445c00 x1818247333587968/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016109.182427:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075445c00 with x1818247333587968 ext(675840->679935) 00002000:00010000:3.0:1734016109.182432:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075445c00 00000100:00100000:3.0:1734016109.182471:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8339 00000100:00100000:3.0:1734016109.182480:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333587968:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016109.185030:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333587968:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 2538us (2915us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016109.185043:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8339 00002000:00100000:3.0:1734016109.185059:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (675840->679935) req@ffff880075445c00 x1818247333587968/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016109.185077:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075445c00 with x1818247333587968 ext(675840->679935) 00002000:00010000:3.0:1734016109.185083:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075445c00 00000100:00100000:0.0:1734016109.185770:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.185855:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333588224 00000100:00100000:3.0:1734016109.185863:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333588224 00002000:00100000:3.0:1734016109.185891:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (671744->675839) req@ffff880075447b80 x1818247333588224/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016109.185899:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075447b80 with x1818247333588224 ext(671744->675839) 00002000:00010000:3.0:1734016109.185902:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075447b80 00000100:00100000:3.0:1734016109.187123:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8340 00000100:00100000:3.0:1734016109.187131:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333588224:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016109.187333:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333588224:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 203us (1564us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016109.187339:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8340 00002000:00100000:3.0:1734016109.187343:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (671744->675839) req@ffff880075447b80 x1818247333588224/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016109.187349:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075447b80 with x1818247333588224 ext(671744->675839) 00002000:00010000:3.0:1734016109.187351:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075447b80 00000100:00100000:0.0:1734016109.192486:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.193955:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333588352 00000100:00100000:3.0:1734016109.193970:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333588352 00000100:00100000:3.0:1734016109.195646:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2116 00000100:00100000:3.0:1734016109.195661:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+33:9668:x1818247333588352:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016109.195701:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016109.195727:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114e30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e52c2 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.195860:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27114e37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016109.195877:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27114e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016109.195890:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27114e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:3.0:1734016109.195921:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 2533165 00000004:00200000:3.0:1734016109.195925:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016109.195944:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27114e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016109.195971:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114e30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52c2 expref: 35 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.196008:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27114e37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52c2 expref: 34 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.196017:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016109.196020:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016109.196022:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016109.196107:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+34:9668:x1818247333588352:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 449us (3631us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016109.196118:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2116 00000100:00100000:0.0:1734016109.200305:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.200672:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333588480 00000100:00100000:3.0:1734016109.200684:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333588480 00000100:00100000:3.0:1734016109.204013:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10611 00000100:00100000:3.0:1734016109.204034:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333588480:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016109.204076:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016109.204106:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114e3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e52c9 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.204147:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016109.204150:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016109.204162:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114e3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52c9 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.204185:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114e3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52c9 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.204199:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4b40, rc 0) 00000100:00100000:3.0:1734016109.204293:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333588480:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 264us (4005us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016109.204299:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10611 00000100:00100000:0.0:1734016109.211369:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.211517:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333588736 00000100:00100000:3.0:1734016109.211532:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333588736 00000100:00100000:3.0:1734016109.211641:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8341 00000100:00100000:3.0:1734016109.211651:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333588736:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:3.0:1734016109.211712:0:14005:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114e45 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.211737:0:14005:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114e29 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 679936->684031) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52bb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.211747:0:14005:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114e3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52c9 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.211754:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016109.211756:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016109.211759:0:14005:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114e45 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2187264->2232319] (req 2187264->2232319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.211836:0:14005:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114e3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52c9 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.211852:0:14005:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114e3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52c9 expref: 8 pid: 8216 timeout: 476 lvb_type: 1 00000100:00100000:3.0:1734016109.211866:0:14005:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14005:1818247335253888:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016109.211950:0:14005:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114e29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 679936->684031) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52bb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.211957:0:14005:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114e29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 679936->684031) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52bb expref: 6 pid: 8216 timeout: 476 lvb_type: 0 00000100:00100000:3.0:1734016109.211965:0:14005:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14005:1818247335254016:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016109.211991:0:14005:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016109.219911:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.219965:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.220219:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333588992 00000100:00100000:1.0:1734016109.220228:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333588992 00010000:00010000:1.0:1734016109.220271:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114e29 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 679936->684031) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52bb expref: 7 pid: 8216 timeout: 476 lvb_type: 0 00000100:00100000:1.0:1734016109.220312:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333588864 00000100:00100000:1.0:1734016109.220314:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333588864 00010000:00010000:1.0:1734016109.220324:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114e3e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52c9 expref: 9 pid: 8216 timeout: 476 lvb_type: 1 00000100:00100000:1.0:1734016109.220342:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2907 00000100:00100000:1.0:1734016109.220349:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333588992:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016109.220363:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016109.220389:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114e29 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 679936->684031) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52bb expref: 7 pid: 8216 timeout: 476 lvb_type: 0 00010000:00010000:1.0:1734016109.220400:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114e29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 679936->684031) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52bb expref: 7 pid: 8216 timeout: 476 lvb_type: 0 00010000:00010000:1.0:1734016109.220433:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016109.220484:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333588992:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 134us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016109.220491:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2907 00000100:00100000:1.0:1734016109.220511:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2908 00000100:00100000:1.0:1734016109.220515:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333588864:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016109.220523:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016109.220529:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114e3e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52c9 expref: 9 pid: 8216 timeout: 476 lvb_type: 1 00010000:00010000:1.0:1734016109.220539:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114e3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52c9 expref: 9 pid: 8216 timeout: 476 lvb_type: 1 00010000:00010000:1.0:1734016109.220551:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016109.220553:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016109.220558:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114e45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [2187264->2232319] (req 2187264->2232319) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016109.220567:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114e45 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [2187264->2232319] (req 2187264->2232319) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016109.220585:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016109.220596:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333588864:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 81us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016109.220601:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2908 00010000:00010000:3.0:1734016109.221710:0:14005:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114e3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52c9 expref: 8 pid: 8216 timeout: 476 lvb_type: 1 00000100:00100000:3.0:1734016109.221741:0:14005:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14005:1818247335253888:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016109.221753:0:14005:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27114e29 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 679936->684031) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52bb expref: 6 pid: 8216 timeout: 476 lvb_type: 0 00000100:00100000:3.0:1734016109.221761:0:14005:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14005:1818247335254016:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016109.221785:0:14005:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114e45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2187264->2232319] (req 2187264->2232319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.221793:0:14005:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114e45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2187264->2232319] (req 2187264->2232319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.222176:0:14005:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114e45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2187264->2232319] (req 2187264->2232319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1734016109.229344:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969318 is committed 00000001:00080000:2.0:1734016109.229383:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969317 is committed 00002000:00010000:3.0:1734016109.229763:0:14005:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 480 -> 568 00010000:00010000:3.0:1734016109.229779:0:14005:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114e45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2187264->2232319] (req 2187264->2232319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.229790:0:14005:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114e45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2187264->2232319] (req 2187264->2232319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.229797:0:14005:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114e45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2187264->2232319] (req 2187264->2232319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.229868:0:14005:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4900 already unused, calling callback (ffffffffa080e100) 00010000:00010000:3.0:1734016109.229872:0:14005:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114e45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2187264->2232319] (req 2187264->2232319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.229880:0:14005:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114e45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2187264->2232319] (req 2187264->2232319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.229900:0:14005:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114e45 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2187264->2232319] (req 2187264->2232319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.229907:0:14005:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27114e45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2187264->2232319] (req 2187264->2232319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016109.230003:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333588736:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 18346us (18643us total) trans 4294969318 rc 0/0 00000100:00100000:3.0:1734016109.230015:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8341 00000100:00100000:0.0:1734016109.234138:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.234453:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333589120 00000100:00100000:3.0:1734016109.234466:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333589120 00000100:00100000:3.0:1734016109.234525:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10612 00000100:00100000:3.0:1734016109.234533:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333589120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016109.234561:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016109.234594:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27114e4c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e52d0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1734016109.234624:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 2533165, mtime: 0x675afc6d, atime: 0x675afc6d, ctime: 0x675afc6d, blocks: 0x238 00010000:00010000:3.0:1734016109.234652:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016109.234656:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016109.234665:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27114e4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52d0 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.234684:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27114e4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52d0 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.234696:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4480, rc 0) 00000100:00100000:3.0:1734016109.234765:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333589120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 232us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016109.234772:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10612 00000100:00100000:0.0:1734016109.238092:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016109.238320:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333589248 00000100:00100000:2.0:1734016109.238335:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333589248 00000100:00100000:2.0:1734016109.238427:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10613 00000100:00100000:2.0:1734016109.238437:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333589248:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016109.238466:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016109.238494:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114e53 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e52d7 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.238530:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016109.238532:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016109.238543:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114e53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52d7 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016109.238564:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114e53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52d7 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016109.238577:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016109.238638:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333589248:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 203us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016109.238645:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10613 00000100:00100000:2.0:1734016109.240886:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.240968:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333589376 00000100:00100000:3.0:1734016109.240979:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333589376 00000100:00100000:3.0:1734016109.241030:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10614 00000100:00100000:3.0:1734016109.241038:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333589376:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016109.241075:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016109.241099:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114e5a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e52de expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.241133:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27114e4c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52d0 expref: 5 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.241141:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114e53 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52d7 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.241145:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016109.241147:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016109.241150:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114e5a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [724992->782335] (req 724992->782335) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52de expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.241181:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114e53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52d7 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.241192:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114e53 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52d7 expref: 8 pid: 7683 timeout: 476 lvb_type: 1 00000100:00100000:3.0:1734016109.241203:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335254144:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016109.241274:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27114e4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52d0 expref: 5 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.241282:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27114e4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52d0 expref: 5 pid: 8216 timeout: 476 lvb_type: 1 00000100:00100000:3.0:1734016109.241291:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335254272:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016109.241309:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016109.244524:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335254144:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016109.245666:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.246122:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333589504 00000100:00100000:0.0:1734016109.246135:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333589504 00010000:00010000:0.0:1734016109.246185:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114e53 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52d7 expref: 9 pid: 7683 timeout: 476 lvb_type: 1 00000100:00100000:0.0:1734016109.246244:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2909 00000100:00100000:0.0:1734016109.246253:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333589504:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016109.246279:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016109.246308:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114e53 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52d7 expref: 9 pid: 7683 timeout: 476 lvb_type: 1 00010000:00010000:0.0:1734016109.246321:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114e53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52d7 expref: 9 pid: 7683 timeout: 476 lvb_type: 1 00010000:00010000:0.0:1734016109.246352:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114e53 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52d7 expref: 9 pid: 7683 timeout: 476 lvb_type: 1 00010000:00010000:0.0:1734016109.246396:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016109.246458:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333589504:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 206us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016109.246467:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2909 00000100:00100000:3.0:1734016109.247109:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335254272:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016109.247150:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114e5a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [724992->782335] (req 724992->782335) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52de expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.247163:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016109.247197:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333589376:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6160us (6396us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016109.247208:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10614 00000100:00100000:2.0:1734016109.249615:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.249969:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333589632 00000100:00100000:3.0:1734016109.249984:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333589632 00010000:00010000:3.0:1734016109.250034:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27114e4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52d0 expref: 6 pid: 8216 timeout: 476 lvb_type: 1 00000100:00100000:3.0:1734016109.250231:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2910 00000100:00100000:3.0:1734016109.250239:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7809c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333589632:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016109.250259:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016109.250285:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27114e4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52d0 expref: 6 pid: 8216 timeout: 476 lvb_type: 1 00010000:00010000:3.0:1734016109.250298:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27114e4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52d0 expref: 6 pid: 8216 timeout: 476 lvb_type: 1 00010000:00010000:3.0:1734016109.250328:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27114e4c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52d0 expref: 6 pid: 8216 timeout: 476 lvb_type: 1 00010000:00010000:3.0:1734016109.250650:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016109.250652:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016109.250660:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114e5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->782335) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52de expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.250668:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114e5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->782335) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52de expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.250712:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114e5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->782335) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52de expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016109.250727:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335254400:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016109.251331:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016109.253780:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335254400:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016109.253845:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016109.253906:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7809c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333589632:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3665us (4305us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016109.253919:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2910 00000100:00100000:0.0:1734016109.254609:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.255342:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333589760 00000100:00100000:3.0:1734016109.255348:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333589760 00000100:00100000:3.0:1734016109.255547:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10615 00000100:00100000:3.0:1734016109.255553:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333589760:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016109.255763:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 2533165 -> 2533165 00002000:00010000:3.0:1734016109.255766:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016109 -> 1734016109 00002000:00010000:3.0:1734016109.255767:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016109 -> 1734016109 00002000:00010000:3.0:1734016109.255769:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016109 -> 1734016109 00002000:00010000:3.0:1734016109.255771:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 568 -> 672 00000100:00100000:3.0:1734016109.256462:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333589760:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 906us (1852us total) trans 4294969319 rc 0/0 00000100:00100000:3.0:1734016109.256471:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10615 00000100:00100000:0.0:1734016109.260980:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.261092:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333590016 00000100:00100000:1.0:1734016109.261104:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333590016 00000100:00100000:1.0:1734016109.261253:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2117 00000100:00100000:1.0:1734016109.261262:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333590016:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016109.261327:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016109.261366:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27114e0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e529f expref: 16 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016109.261629:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016109.261635:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016109.261847:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114e61 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.261862:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27114e37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52c2 expref: 33 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016109.261870:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114e61 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.261906:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27114e37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52c2 expref: 33 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016109.261921:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27114e37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52c2 expref: 33 pid: 13956 timeout: 476 lvb_type: 0 00000100:00100000:1.0:1734016109.261934:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335254528:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016109.262528:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016109.265772:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.266104:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335254528:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016109.266136:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114e61 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016109.266192:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333590144 00000100:00100000:3.0:1734016109.266201:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333590144 00010000:00010000:3.0:1734016109.266232:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27114e37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52c2 expref: 34 pid: 13956 timeout: 476 lvb_type: 0 00000100:00100000:3.0:1734016109.266264:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2911 00000100:00100000:3.0:1734016109.266271:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+34:1981:x1818247333590144:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016109.266287:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016109.266293:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27114e37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52c2 expref: 34 pid: 13956 timeout: 476 lvb_type: 0 00010000:00010000:3.0:1734016109.266302:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27114e37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52c2 expref: 34 pid: 13956 timeout: 476 lvb_type: 0 00010000:00010000:3.0:1734016109.266332:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27114e37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52c2 expref: 34 pid: 13956 timeout: 476 lvb_type: 0 00010000:00010000:3.0:1734016109.266353:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016109.266357:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114e61 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016109.266367:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114e61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016109.266375:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114e61 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016109.266398:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016109.267008:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114e61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.267014:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114e61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:1.0:1734016109.267122:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968662 00000004:00010000:1.0:1734016109.267169:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007345ce00 reply state ffff880075d9c000 transno 4294968663 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114e61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:1.0:1734016109.267180:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016109.267623:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+33:1981:x1818247333590144:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1350us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016109.267632:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2911 00000100:00100000:1.0:1734016109.267678:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:9668:x1818247333590016:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 6417us (6718us total) trans 4294968663 rc 0/0 00000100:00100000:1.0:1734016109.267685:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2117 00000020:00080000:1.0:1734016109.267688:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016109.270625:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016109.270708:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114e61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.270721:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114e61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.270728:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114e61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.270734:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499f3c0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:1.0:1734016109.270738:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114e61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.270744:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114e61 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.270768:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016109.270772:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1734016109.270776:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114e61 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.270782:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27114e61 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016109.270918:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333590272 00000100:00100000:3.0:1734016109.270933:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333590272 00000100:00100000:3.0:1734016109.270984:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10616 00000100:00100000:3.0:1734016109.270992:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333590272:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016109.271018:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016109.271040:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114e68 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e52e5 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.271083:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114e5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->782335) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52de expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.271092:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016109.271094:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016109.271099:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114e68 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52e5 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.271142:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114e5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->782335) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52de expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.271157:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114e5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->782335) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52de expref: 7 pid: 8216 timeout: 476 lvb_type: 0 00000100:00100000:3.0:1734016109.271171:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335254656:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016109.271247:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016109.276973:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016109.277097:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333590400 00000100:00100000:2.0:1734016109.277107:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333590400 00010000:00010000:2.0:1734016109.277145:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114e5a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->782335) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52de expref: 8 pid: 8216 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1734016109.277170:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2912 00000100:00100000:2.0:1734016109.277176:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333590400:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016109.277191:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016109.277209:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114e5a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 724992->782335) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52de expref: 8 pid: 8216 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1734016109.277219:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114e5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 724992->782335) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52de expref: 8 pid: 8216 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1734016109.277243:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016109.277245:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016109.277251:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114e68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52e5 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.277259:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114e68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52e5 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.277290:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114e68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52e5 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016109.277303:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335254784:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016109.277352:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e180 going to sleep for 11 seconds 00010000:00010000:3.0:1734016109.278204:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114e5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 724992->782335) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52de expref: 8 pid: 8216 timeout: 476 lvb_type: 0 00000100:00100000:3.0:1734016109.278232:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335254656:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016109.278255:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114e68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52e5 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.278269:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016109.278308:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333590272:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7317us (7697us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016109.278315:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10616 00000100:00100000:3.0:1734016109.280647:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335254784:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016109.280670:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016109.280721:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333590400:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3544us (3760us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016109.280733:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2912 00000100:00100000:0.0:1734016109.280966:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.281251:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333590528 00000100:00100000:3.0:1734016109.281263:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333590528 00002000:00010000:3.0:1734016109.281298:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (949198->18446744073709551615) 00002000:00100000:3.0:1734016109.281302:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345f480 with x1818247333590528 ext(949198->18446744073709551615) 00002000:00010000:3.0:1734016109.281315:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345f480. 00000100:00100000:1.0:1734016109.281994:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8342 00000100:00100000:1.0:1734016109.282002:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333590528:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016109.283634:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 2533165 -> 949198 00002000:00010000:1.0:1734016109.283641:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016109 -> 1734016109 00002000:00010000:1.0:1734016109.283643:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016109 -> 1734016109 00002000:00010000:1.0:1734016109.283646:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016109 -> 1734016109 00002000:00010000:1.0:1734016109.283648:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 672 -> 336 00000100:00100000:1.0:1734016109.283723:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333590528:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1719us (2756us total) trans 4294969320 rc 0/0 00000100:00100000:1.0:1734016109.283733:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8342 00002000:00010000:1.0:1734016109.283738:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (949198->18446744073709551615) 00002000:00100000:1.0:1734016109.283741:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345f480 with x1818247333590528 ext(949198->18446744073709551615) 00002000:00010000:1.0:1734016109.283746:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345f480. 00000100:00100000:0.0:1734016109.287426:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.295750:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333590656 00000100:00100000:1.0:1734016109.295768:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333590656 00000100:00100000:1.0:1734016109.295854:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2118 00000100:00100000:1.0:1734016109.295861:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+33:9668:x1818247333590656:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016109.295889:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016109.295914:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f180/0x5e3a3adc27114e6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e52ec expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016109.296019:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114e76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.296034:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.296047:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:1.0:1734016109.296093:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 949198 00000004:00200000:1.0:1734016109.296098:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016109.296121:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.296147:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f180/0x5e3a3adc27114e6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52ec expref: 35 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016109.296163:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114e76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52ec expref: 34 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016109.296171:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016109.296173:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016109.296176:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016109.296247:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+34:9668:x1818247333590656:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 387us (8841us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016109.296252:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2118 00000100:00100000:0.0:1734016109.300432:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.300549:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333590784 00000100:00100000:3.0:1734016109.300559:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333590784 00000100:00100000:3.0:1734016109.300615:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10617 00000100:00100000:3.0:1734016109.300623:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333590784:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016109.300644:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016109.300669:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27114e7d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e52f3 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016109.300735:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335254912:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016109.300848:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016109.304190:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335254912:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016109.304249:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27114e7d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52f3 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.304266:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27114e7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52f3 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.304281:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7840, rc 0) 00000100:00100000:3.0:1734016109.304349:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333590784:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3726us (3927us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016109.304361:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10617 00000100:00100000:1.0:1734016109.309793:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.309930:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333590912 00000100:00100000:3.0:1734016109.309940:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333590912 00000100:00100000:3.0:1734016109.309985:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10618 00000100:00100000:3.0:1734016109.309992:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333590912:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016109.310012:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016109.310032:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114e84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e52fa expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016109.310099:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335255040:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016109.311104:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016109.314041:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335255040:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016109.314134:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114e84 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52fa expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.314161:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27114e84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52fa expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.314185:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016109.314304:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333590912:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4306us (4518us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016109.314318:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10618 00000100:00100000:1.0:1734016109.320953:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.322149:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333591168 00000100:00100000:3.0:1734016109.322167:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333591168 00000100:00100000:3.0:1734016109.322245:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8343 00000100:00100000:3.0:1734016109.322253:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333591168:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:3.0:1734016109.322304:0:14005:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27114e8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.322322:0:14005:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114e68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52e5 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.322327:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016109.322330:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016109.322333:0:14005:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27114e8b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.322372:0:14005:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114e68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52e5 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.322383:0:14005:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114e68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52e5 expref: 7 pid: 8216 timeout: 476 lvb_type: 0 00000100:00100000:3.0:1734016109.322398:0:14005:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14005:1818247335255168:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016109.322985:0:14005:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016109.334675:0:14005:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14005:1818247335255168:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016109.334715:0:14005:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27114e8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016109.335400:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.335886:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333591296 00000100:00100000:3.0:1734016109.335893:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333591296 00010000:00010000:3.0:1734016109.335934:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114e68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52e5 expref: 8 pid: 8216 timeout: 476 lvb_type: 0 00000100:00100000:3.0:1734016109.336054:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2913 00000100:00100000:3.0:1734016109.336062:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333591296:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016109.336092:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016109.336120:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114e68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52e5 expref: 8 pid: 8216 timeout: 476 lvb_type: 0 00010000:00010000:3.0:1734016109.336134:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114e68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52e5 expref: 8 pid: 8216 timeout: 476 lvb_type: 0 00010000:00010000:3.0:1734016109.336167:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27114e68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52e5 expref: 8 pid: 8216 timeout: 476 lvb_type: 0 00010000:00010000:3.0:1734016109.336291:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016109.336294:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016109.336299:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27114e8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.336312:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27114e8b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.336348:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016109.336502:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333591296:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 439us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016109.336510:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2913 00010000:00010000:2.0:1734016109.336704:0:14005:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27114e8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.336713:0:14005:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27114e8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016109.342770:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969321 is committed 00000001:00080000:0.0:1734016109.342845:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969319 is committed 00002000:00010000:2.0:1734016109.343043:0:14005:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 949198 -> 1425408 00002000:00010000:2.0:1734016109.343049:0:14005:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 336 -> 344 00010000:00010000:2.0:1734016109.343072:0:14005:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27114e8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.343083:0:14005:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27114e8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.343092:0:14005:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27114e8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.343098:0:14005:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df5440 already unused, calling callback (ffffffffa080e100) 00010000:00010000:2.0:1734016109.343103:0:14005:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27114e8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.343111:0:14005:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27114e8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.343134:0:14005:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27114e8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.343140:0:14005:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27114e8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016109.344704:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333591168:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 22440us (23751us total) trans 4294969321 rc 0/0 00000100:00100000:2.0:1734016109.344717:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8343 00000100:00100000:1.0:1734016109.347744:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.347872:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333591424 00000100:00100000:3.0:1734016109.347887:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333591424 00000100:00100000:3.0:1734016109.347956:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10619 00000100:00100000:3.0:1734016109.347965:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333591424:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016109.347995:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016109.348033:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114e92 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5301 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1734016109.348072:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 1425408, mtime: 0x675afc6d, atime: 0x675afc6d, ctime: 0x675afc6d, blocks: 0x158 00010000:00010000:3.0:1734016109.348100:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016109.348103:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016109.348113:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114e92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5301 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.348132:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114e92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5301 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.348145:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016109.349161:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333591424:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1191us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016109.349170:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10619 00000100:00100000:0.0:1734016109.356402:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.356519:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333591680 00000100:00100000:3.0:1734016109.356529:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333591680 00000100:00100000:3.0:1734016109.358679:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2119 00000100:00100000:3.0:1734016109.358691:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+34:9668:x1818247333591680:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016109.358756:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016109.358785:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114e76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e52ec expref: 34 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.358836:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016109.358840:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016109.359024:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114e99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016109.359036:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114e99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016109.359045:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114e99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:3.0:1734016109.359090:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968664 00000004:00010000:3.0:1734016109.359107:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007345d500 reply state ffff88007570f000 transno 4294968665 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114e99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:3.0:1734016109.359113:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016109.359781:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+36:9668:x1818247333591680:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 1090us (3390us total) trans 4294968665 rc 0/0 00000100:00100000:3.0:1734016109.359788:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2119 00000020:00080000:3.0:1734016109.359794:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016109.362269:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114e99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.362291:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114e99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.362298:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114e99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.362305:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4480 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016109.362310:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114e99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.362319:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114e99 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.362339:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016109.362341:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016109.362345:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114e99 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.362350:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27114e99 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016109.362523:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.362596:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333591808 00000100:00100000:3.0:1734016109.362613:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333591808 00000100:00100000:0.0:1734016109.363468:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10620 00000100:00100000:0.0:1734016109.363480:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88009024c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333591808:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016109.364333:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016109.364357:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114ea0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5308 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.364392:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114e92 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5301 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.364400:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.364404:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.364407:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114ea0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5308 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.364445:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114e92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5301 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.364457:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114e92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5301 expref: 8 pid: 8216 timeout: 476 lvb_type: 1 00000100:00100000:0.0:1734016109.364471:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335255296:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016109.364556:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:1.0:1734016109.368099:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.369136:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335255296:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016109.369174:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114ea0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5308 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.369197:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581d40, rc 0) 00000100:00100000:0.0:1734016109.369264:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88009024c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333591808:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5784us (6745us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016109.369275:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10620 00000100:00100000:3.0:1734016109.369583:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333591936 00000100:00100000:3.0:1734016109.369595:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333591936 00010000:00010000:3.0:1734016109.369635:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114e92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5301 expref: 8 pid: 8216 timeout: 476 lvb_type: 1 00000100:00100000:3.0:1734016109.369671:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2914 00000100:00100000:3.0:1734016109.369679:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333591936:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016109.369703:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016109.369735:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114e92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5301 expref: 8 pid: 8216 timeout: 476 lvb_type: 1 00010000:00010000:3.0:1734016109.369750:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114e92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5301 expref: 8 pid: 8216 timeout: 476 lvb_type: 1 00010000:00010000:3.0:1734016109.369785:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27114e92 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5301 expref: 8 pid: 8216 timeout: 476 lvb_type: 1 00010000:00010000:3.0:1734016109.369821:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016109.369824:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016109.369829:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114ea0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5308 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.369839:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114ea0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5308 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.369873:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114ea0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5308 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016109.369887:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335255424:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016109.369927:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb840 going to sleep for 11 seconds 00000100:00100000:0.0:1734016109.383202:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335255424:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016109.383236:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016109.383345:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333591936:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 13664us (15259us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016109.383359:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2914 00000100:00100000:2.0:1734016109.386694:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.386793:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333592064 00000100:00100000:0.0:1734016109.386825:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333592064 00002000:00010000:0.0:1734016109.386885:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (3759249->18446744073709551615) 00002000:00100000:0.0:1734016109.386892:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b6300 with x1818247333592064 ext(3759249->18446744073709551615) 00002000:00010000:0.0:1734016109.386910:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b6300. 00000100:00100000:0.0:1734016109.386957:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8344 00000100:00100000:0.0:1734016109.386967:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333592064:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016109.387319:0:14005:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 1425408 -> 3759249 00002000:00010000:0.0:1734016109.387322:0:14005:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016109 -> 1734016109 00002000:00010000:0.0:1734016109.387325:0:14005:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016109 -> 1734016109 00002000:00010000:0.0:1734016109.387327:0:14005:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016109 -> 1734016109 00002000:00010000:0.0:1734016109.387329:0:14005:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 344 -> 344 00000100:00100000:0.0:1734016109.387415:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333592064:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 448us (734us total) trans 4294969322 rc 0/0 00000100:00100000:0.0:1734016109.387427:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8344 00002000:00010000:0.0:1734016109.387432:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (3759249->18446744073709551615) 00002000:00100000:0.0:1734016109.387434:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b6300 with x1818247333592064 ext(3759249->18446744073709551615) 00002000:00010000:0.0:1734016109.387439:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b6300. 00000100:00100000:1.0:1734016109.396615:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.396785:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333592192 00000100:00100000:3.0:1734016109.398074:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333592192 00000100:00100000:3.0:1734016109.398202:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2120 00000100:00100000:3.0:1734016109.398212:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+35:9668:x1818247333592192:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016109.398251:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016109.398282:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27114ea7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e530f expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.398422:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114eae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016109.398442:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016109.398457:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:3.0:1734016109.398497:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 3759249 00000004:00200000:3.0:1734016109.398506:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016109.398526:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016109.398559:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27114ea7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e530f expref: 37 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.398591:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e530f expref: 36 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.398605:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016109.398609:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016109.398613:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016109.398715:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+36:9668:x1818247333592192:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 503us (2126us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016109.398725:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2120 00000100:00100000:3.0:1734016109.401199:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.401271:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333592320 00000100:00100000:0.0:1734016109.401286:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333592320 00000100:00100000:0.0:1734016109.401353:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10621 00000100:00100000:0.0:1734016109.401364:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333592320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016109.401393:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016109.401428:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114eb5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5316 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016109.401513:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335255552:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016109.401635:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016109.407531:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335255552:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016109.407580:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114eb5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5316 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.407599:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27114eb5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5316 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.408903:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580900, rc 0) 00000100:00100000:0.0:1734016109.409007:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333592320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7638us (7825us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016109.409019:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10621 00000100:00100000:1.0:1734016109.419915:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.420017:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333592448 00000100:00100000:0.0:1734016109.420031:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333592448 00000100:00100000:0.0:1734016109.420141:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10622 00000100:00100000:0.0:1734016109.420152:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333592448:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016109.420185:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016109.420213:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114ebc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e531d expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.420255:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114ea0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5308 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.420264:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016109.420266:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016109.420270:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114ebc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3661824->3665919] (req 3661824->3665919) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e531d expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.420323:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114ea0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5308 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.420337:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114ea0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5308 expref: 7 pid: 7683 timeout: 476 lvb_type: 0 00000100:00100000:0.0:1734016109.420353:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335255680:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016109.420443:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016109.424910:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335255680:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016109.424954:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114ebc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3661824->3665919] (req 3661824->3665919) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e531d expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.424978:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00000100:00100000:0.0:1734016109.425055:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333592448:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4903us (5261us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016109.425074:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10622 00000100:00100000:1.0:1734016109.425581:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.426261:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333592576 00000100:00100000:0.0:1734016109.426269:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333592576 00010000:00010000:0.0:1734016109.426298:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114ea0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5308 expref: 8 pid: 7683 timeout: 476 lvb_type: 0 00000100:00100000:0.0:1734016109.426398:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2915 00000100:00100000:0.0:1734016109.426405:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333592576:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016109.426419:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016109.426453:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114ea0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5308 expref: 8 pid: 7683 timeout: 476 lvb_type: 0 00010000:00010000:0.0:1734016109.426465:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114ea0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5308 expref: 8 pid: 7683 timeout: 476 lvb_type: 0 00010000:00010000:0.0:1734016109.426521:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27114ea0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5308 expref: 8 pid: 7683 timeout: 476 lvb_type: 0 00010000:00010000:0.0:1734016109.426538:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.426540:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.426548:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114ebc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3661824->3665919) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e531d expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.426558:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114ebc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3661824->3665919) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e531d expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.426598:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114ebc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3661824->3665919) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e531d expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016109.426612:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335255808:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016109.426683:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016109.433228:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.433342:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335255808:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016109.433472:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333592832 00000100:00100000:1.0:1734016109.433482:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333592832 00002000:00100000:1.0:1734016109.433533:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (3661824->3665919) req@ffff8800755b7b80 x1818247333592832/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.433544:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b7b80 with x1818247333592832 ext(3661824->3665919) 00002000:00010000:1.0:1734016109.433549:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b7b80 00000100:00100000:1.0:1734016109.433587:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8345 00000100:00100000:1.0:1734016109.433595:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333592832:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.433791:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333592832:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 196us (577us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.433820:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8345 00002000:00100000:1.0:1734016109.433826:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (3661824->3665919) req@ffff8800755b7b80 x1818247333592832/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.433832:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b7b80 with x1818247333592832 ext(3661824->3665919) 00002000:00010000:1.0:1734016109.433834:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b7b80 00010000:00010000:0.0:1734016109.433984:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016109.434028:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333592576:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7621us (8446us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016109.434037:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2915 00000100:00100000:2.0:1734016109.442298:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.442563:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333593088 00000100:00100000:0.0:1734016109.442578:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333593088 00002000:00100000:0.0:1734016109.442660:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3657728->3661823) req@ffff8800755b7480 x1818247333593088/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.442675:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b7480 with x1818247333593088 ext(3657728->3661823) 00002000:00010000:0.0:1734016109.442683:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b7480 00000100:00100000:0.0:1734016109.442739:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8346 00000100:00100000:0.0:1734016109.442748:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333593088:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016109.443075:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333593088:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 317us (786us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016109.443084:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8346 00002000:00100000:0.0:1734016109.443090:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3657728->3661823) req@ffff8800755b7480 x1818247333593088/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.443099:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b7480 with x1818247333593088 ext(3657728->3661823) 00002000:00010000:0.0:1734016109.443102:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b7480 00000100:00100000:3.0:1734016109.459243:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.459990:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333593344 00000100:00100000:1.0:1734016109.460002:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333593344 00002000:00100000:1.0:1734016109.460056:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (3653632->3657727) req@ffff880075fc6300 x1818247333593344/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.460076:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc6300 with x1818247333593344 ext(3653632->3657727) 00002000:00010000:1.0:1734016109.460083:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc6300 00000100:00100000:1.0:1734016109.460120:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8347 00000100:00100000:1.0:1734016109.460128:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333593344:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.460360:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333593344:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 233us (1135us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.460368:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8347 00002000:00100000:1.0:1734016109.460375:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (3653632->3657727) req@ffff880075fc6300 x1818247333593344/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.460382:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc6300 with x1818247333593344 ext(3653632->3657727) 00002000:00010000:1.0:1734016109.460385:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc6300 00000100:00100000:2.0:1734016109.463262:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.463358:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333593600 00000100:00100000:0.0:1734016109.463371:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333593600 00002000:00100000:0.0:1734016109.463421:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3649536->3653631) req@ffff8800755b4700 x1818247333593600/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.463432:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4700 with x1818247333593600 ext(3649536->3653631) 00002000:00010000:0.0:1734016109.463438:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4700 00000100:00100000:0.0:1734016109.463786:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8348 00000100:00100000:0.0:1734016109.463794:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333593600:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.464139:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333593600:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 343us (889us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.464147:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8348 00002000:00100000:1.0:1734016109.464153:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3649536->3653631) req@ffff8800755b4700 x1818247333593600/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.464160:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4700 with x1818247333593600 ext(3649536->3653631) 00002000:00010000:1.0:1734016109.464163:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4700 00000100:00100000:2.0:1734016109.471158:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.471369:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333593856 00000100:00100000:1.0:1734016109.471383:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333593856 00002000:00100000:1.0:1734016109.471451:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3645440->3649535) req@ffff8800755b4a80 x1818247333593856/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.471463:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4a80 with x1818247333593856 ext(3645440->3649535) 00002000:00010000:1.0:1734016109.471471:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4a80 00000100:00100000:1.0:1734016109.471516:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8349 00000100:00100000:1.0:1734016109.471529:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333593856:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.472365:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333593856:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 834us (1220us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.472374:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8349 00002000:00100000:1.0:1734016109.472381:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3645440->3649535) req@ffff8800755b4a80 x1818247333593856/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.472394:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4a80 with x1818247333593856 ext(3645440->3649535) 00002000:00010000:1.0:1734016109.472397:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4a80 00000100:00100000:3.0:1734016109.475485:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.475613:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333594112 00000100:00100000:1.0:1734016109.475625:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333594112 00002000:00100000:1.0:1734016109.475670:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3641344->3645439) req@ffff880075fc7100 x1818247333594112/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.475680:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7100 with x1818247333594112 ext(3641344->3645439) 00002000:00010000:1.0:1734016109.475686:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc7100 00000100:00100000:1.0:1734016109.476876:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8350 00000100:00100000:1.0:1734016109.476894:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333594112:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.477169:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333594112:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 280us (1695us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.477177:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8350 00002000:00100000:1.0:1734016109.477186:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3641344->3645439) req@ffff880075fc7100 x1818247333594112/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.477194:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7100 with x1818247333594112 ext(3641344->3645439) 00002000:00010000:1.0:1734016109.477200:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc7100 00000100:00100000:2.0:1734016109.482730:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.483081:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333594368 00000100:00100000:0.0:1734016109.483093:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333594368 00002000:00100000:0.0:1734016109.483142:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (3637248->3641343) req@ffff8800755b4380 x1818247333594368/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.483154:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4380 with x1818247333594368 ext(3637248->3641343) 00002000:00010000:0.0:1734016109.483161:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4380 00000100:00100000:0.0:1734016109.483710:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8351 00000100:00100000:0.0:1734016109.483719:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333594368:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016109.484101:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333594368:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 381us (1381us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016109.484109:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8351 00002000:00100000:0.0:1734016109.484116:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (3637248->3641343) req@ffff8800755b4380 x1818247333594368/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.484124:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4380 with x1818247333594368 ext(3637248->3641343) 00002000:00010000:0.0:1734016109.484128:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4380 00000100:00100000:3.0:1734016109.487998:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.488131:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333594624 00000100:00100000:0.0:1734016109.488146:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333594624 00002000:00100000:0.0:1734016109.488213:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (3633152->3637247) req@ffff880075fc6d80 x1818247333594624/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.488224:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc6d80 with x1818247333594624 ext(3633152->3637247) 00002000:00010000:0.0:1734016109.488232:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc6d80 00000100:00100000:0.0:1734016109.488312:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8352 00000100:00100000:0.0:1734016109.488324:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333594624:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016109.489336:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333594624:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1006us (1356us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016109.489350:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8352 00002000:00100000:0.0:1734016109.489360:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (3633152->3637247) req@ffff880075fc6d80 x1818247333594624/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.489367:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc6d80 with x1818247333594624 ext(3633152->3637247) 00002000:00010000:0.0:1734016109.489371:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc6d80 00000100:00100000:3.0:1734016109.494073:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.494703:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333594880 00000100:00100000:0.0:1734016109.494722:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333594880 00002000:00100000:0.0:1734016109.494920:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (3629056->3633151) req@ffff880075fc4000 x1818247333594880/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.494933:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc4000 with x1818247333594880 ext(3629056->3633151) 00002000:00010000:0.0:1734016109.494940:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc4000 00000100:00100000:0.0:1734016109.495140:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8353 00000100:00100000:0.0:1734016109.495150:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333594880:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016109.495438:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333594880:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 287us (1392us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016109.495448:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8353 00002000:00100000:0.0:1734016109.495455:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (3629056->3633151) req@ffff880075fc4000 x1818247333594880/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.495464:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc4000 with x1818247333594880 ext(3629056->3633151) 00002000:00010000:0.0:1734016109.495467:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc4000 00000100:00100000:2.0:1734016109.498528:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.499187:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333595136 00000100:00100000:1.0:1734016109.499198:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333595136 00002000:00100000:1.0:1734016109.499246:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3624960->3629055) req@ffff8800755b5180 x1818247333595136/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.499256:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5180 with x1818247333595136 ext(3624960->3629055) 00002000:00010000:1.0:1734016109.499263:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b5180 00000100:00100000:1.0:1734016109.499493:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8354 00000100:00100000:1.0:1734016109.499501:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333595136:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.499907:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333595136:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 405us (1391us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.499918:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8354 00002000:00100000:1.0:1734016109.499924:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3624960->3629055) req@ffff8800755b5180 x1818247333595136/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.499932:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5180 with x1818247333595136 ext(3624960->3629055) 00002000:00010000:1.0:1734016109.499935:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b5180 00000100:00100000:3.0:1734016109.505335:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.505744:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333595392 00000100:00100000:1.0:1734016109.505760:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333595392 00002000:00100000:1.0:1734016109.506131:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3620864->3624959) req@ffff880075fc4380 x1818247333595392/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.506145:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc4380 with x1818247333595392 ext(3620864->3624959) 00002000:00010000:1.0:1734016109.506151:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc4380 00000100:00100000:1.0:1734016109.506294:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8355 00000100:00100000:1.0:1734016109.506302:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333595392:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.507077:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333595392:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 773us (1758us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.507087:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8355 00002000:00100000:1.0:1734016109.507095:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3620864->3624959) req@ffff880075fc4380 x1818247333595392/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.507103:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc4380 with x1818247333595392 ext(3620864->3624959) 00002000:00010000:1.0:1734016109.507106:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc4380 00010000:00010000:2.0:1734016109.512948:0:8957:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1734016109.513102:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.513171:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333595648 00000100:00100000:1.0:1734016109.513182:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333595648 00002000:00100000:1.0:1734016109.513234:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3616768->3620863) req@ffff880075fc5880 x1818247333595648/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.513246:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc5880 with x1818247333595648 ext(3616768->3620863) 00002000:00010000:1.0:1734016109.513252:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc5880 00000100:00100000:1.0:1734016109.513283:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8356 00000100:00100000:1.0:1734016109.513291:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333595648:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.513507:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333595648:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 214us (413us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.513515:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8356 00002000:00100000:1.0:1734016109.513520:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3616768->3620863) req@ffff880075fc5880 x1818247333595648/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.513527:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc5880 with x1818247333595648 ext(3616768->3620863) 00002000:00010000:1.0:1734016109.513530:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc5880 00000100:00100000:2.0:1734016109.516862:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.517184:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333595904 00000100:00100000:0.0:1734016109.517199:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333595904 00002000:00100000:0.0:1734016109.517268:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (3612672->3616767) req@ffff8800755b6d80 x1818247333595904/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.517286:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b6d80 with x1818247333595904 ext(3612672->3616767) 00002000:00010000:0.0:1734016109.517293:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b6d80 00000100:00100000:0.0:1734016109.517364:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8357 00000100:00100000:0.0:1734016109.517373:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333595904:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016109.517604:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333595904:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 231us (752us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016109.517613:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8357 00002000:00100000:0.0:1734016109.517618:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (3612672->3616767) req@ffff8800755b6d80 x1818247333595904/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.517626:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b6d80 with x1818247333595904 ext(3612672->3616767) 00002000:00010000:0.0:1734016109.517628:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b6d80 00000100:00100000:3.0:1734016109.520737:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.521339:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333596160 00000100:00100000:1.0:1734016109.521351:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333596160 00002000:00100000:1.0:1734016109.521411:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3608576->3612671) req@ffff880075fc5500 x1818247333596160/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.521424:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc5500 with x1818247333596160 ext(3608576->3612671) 00002000:00010000:1.0:1734016109.521430:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc5500 00000100:00100000:1.0:1734016109.521704:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8358 00000100:00100000:1.0:1734016109.521711:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333596160:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.521943:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333596160:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 232us (1223us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.521951:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8358 00002000:00100000:1.0:1734016109.521956:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3608576->3612671) req@ffff880075fc5500 x1818247333596160/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.521962:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc5500 with x1818247333596160 ext(3608576->3612671) 00002000:00010000:1.0:1734016109.521964:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc5500 00000100:00100000:3.0:1734016109.524678:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.524981:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333596288 00000100:00100000:0.0:1734016109.524993:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333596288 00000100:00100000:0.0:1734016109.525042:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10623 00000100:00100000:0.0:1734016109.525049:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333596288:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016109.525077:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016109.525098:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27114ec3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5324 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.525127:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.525129:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.525137:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27114ec3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5324 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.525152:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27114ec3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5324 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.525167:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582d00, rc 0) 00000100:00100000:0.0:1734016109.525236:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333596288:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 187us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016109.525242:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10623 00000100:00100000:2.0:1734016109.530405:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.530918:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333596544 00000100:00100000:0.0:1734016109.530932:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333596544 00000100:00100000:0.0:1734016109.531541:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8359 00000100:00100000:0.0:1734016109.531551:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333596544:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:0.0:1734016109.531606:0:7688:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114eca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.531628:0:7688:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114ebc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3661824->3665919) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e531d expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.531636:0:7688:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27114ec3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5324 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.531644:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.531647:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.531650:0:7688:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114eca lrc: 5/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7409664->7458815] (req 7409664->7458815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.531691:0:7688:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27114ec3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5324 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.531706:0:7688:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27114ec3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5324 expref: 7 pid: 7683 timeout: 476 lvb_type: 1 00000100:00100000:0.0:1734016109.531722:0:7688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335255936:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016109.531869:0:7688:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114ebc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3661824->3665919) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e531d expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.531878:0:7688:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114ebc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3661824->3665919) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e531d expref: 6 pid: 7683 timeout: 476 lvb_type: 0 00000100:00100000:0.0:1734016109.531886:0:7688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335256064:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016109.531905:0:7688:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016109.536584:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.536829:0:7688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335255936:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016109.537541:0:7688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335256064:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016109.537575:0:7688:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114eca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7409664->7458815] (req 7409664->7458815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016109.537660:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333596672 00000100:00100000:1.0:1734016109.537669:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333596672 00010000:00010000:1.0:1734016109.537705:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27114ec3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5324 expref: 8 pid: 7683 timeout: 476 lvb_type: 1 00000100:00100000:1.0:1734016109.537744:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2916 00000100:00100000:1.0:1734016109.537752:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333596672:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016109.537770:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016109.537795:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27114ec3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5324 expref: 8 pid: 7683 timeout: 476 lvb_type: 1 00010000:00010000:1.0:1734016109.537820:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27114ec3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5324 expref: 8 pid: 7683 timeout: 476 lvb_type: 1 00010000:00010000:1.0:1734016109.537853:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27114ec3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5324 expref: 8 pid: 7683 timeout: 476 lvb_type: 1 00010000:00010000:1.0:1734016109.537895:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016109.537958:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333596672:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 206us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016109.537970:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2916 00000100:00100000:3.0:1734016109.538851:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016109.538909:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333596800 00000100:00100000:2.0:1734016109.538913:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333596800 00010000:00010000:2.0:1734016109.538930:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114ebc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3661824->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e531d expref: 7 pid: 7683 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1734016109.538948:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2917 00000100:00100000:2.0:1734016109.538951:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a780bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333596800:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016109.538960:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016109.538970:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114ebc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3661824->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e531d expref: 7 pid: 7683 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1734016109.538980:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114ebc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3661824->3665919) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e531d expref: 7 pid: 7683 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1734016109.538993:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114ebc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3661824->3665919) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e531d expref: 7 pid: 7683 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1734016109.539005:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016109.539007:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016109.539011:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114eca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7409664->7458815] (req 7409664->7458815) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.539019:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114eca lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7409664->7458815] (req 7409664->7458815) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.539036:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016109.539073:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a780bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333596800:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 121us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016109.539080:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2917 00010000:00010000:0.0:1734016109.539178:0:7688:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114eca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7409664->7458815] (req 7409664->7458815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.539186:0:7688:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114eca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7409664->7458815] (req 7409664->7458815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1734016109.547733:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969323 is committed 00000001:00080000:2.0:1734016109.547756:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969322 is committed 00002000:00010000:0.0:1734016109.547880:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 3759249 -> 7458816 00002000:00010000:0.0:1734016109.547885:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016109 -> 1734016110 00002000:00010000:0.0:1734016109.547888:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016109 -> 1734016110 00002000:00010000:0.0:1734016109.547890:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 344 -> 440 00010000:00010000:0.0:1734016109.547905:0:7688:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114eca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7409664->7458815] (req 7409664->7458815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.547919:0:7688:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114eca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7409664->7458815] (req 7409664->7458815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.547926:0:7688:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114eca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7409664->7458815] (req 7409664->7458815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.547933:0:7688:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7582f40 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016109.547936:0:7688:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114eca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7409664->7458815] (req 7409664->7458815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.547944:0:7688:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114eca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7409664->7458815] (req 7409664->7458815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.547965:0:7688:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114eca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7409664->7458815] (req 7409664->7458815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.547971:0:7688:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27114eca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7409664->7458815] (req 7409664->7458815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016109.548948:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333596544:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 17390us (18549us total) trans 4294969323 rc 0/0 00000100:00100000:0.0:1734016109.548961:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8359 00000100:00100000:3.0:1734016109.552617:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.552744:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333596928 00000100:00100000:1.0:1734016109.552758:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333596928 00000100:00100000:1.0:1734016109.552837:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2121 00000100:00100000:1.0:1734016109.552845:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:9668:x1818247333596928:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016109.552878:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016109.552900:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114ed1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e532b expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016109.553251:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27114ed8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.553269:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27114ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.553282:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27114ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:1.0:1734016109.553310:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 3759249 00000004:00200000:1.0:1734016109.553315:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016109.553339:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27114ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.553363:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27114ed1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e532b expref: 19 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016109.553429:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27114ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e532b expref: 18 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016109.553437:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016109.553441:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016109.553445:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016109.553517:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:9668:x1818247333596928:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 672us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016109.553524:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2121 00000100:00100000:3.0:1734016109.557237:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.557337:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333597056 00000100:00100000:0.0:1734016109.557349:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333597056 00000100:00100000:0.0:1734016109.557430:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10624 00000100:00100000:0.0:1734016109.557440:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333597056:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016109.557471:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016109.557502:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114edf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5332 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016109.557535:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 7458816, mtime: 0x675afc6e, atime: 0x675afc6d, ctime: 0x675afc6e, blocks: 0x1b8 00010000:00010000:0.0:1734016109.557564:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.557567:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.557577:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114edf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5332 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.557595:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114edf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5332 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.557608:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00000100:00100000:0.0:1734016109.557684:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333597056:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 245us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016109.557692:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10624 00000100:00100000:2.0:1734016109.562786:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.562919:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333597184 00000100:00100000:0.0:1734016109.562935:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333597184 00000100:00100000:0.0:1734016109.562997:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10625 00000100:00100000:0.0:1734016109.563007:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333597184:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016109.563035:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016109.563075:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114ee6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5339 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.563108:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.563110:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.563118:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114ee6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5339 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.563134:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114ee6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5339 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.563145:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:0.0:1734016109.563211:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333597184:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 207us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016109.563219:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10625 00000100:00100000:3.0:1734016109.565174:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.565243:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333597440 00000100:00100000:0.0:1734016109.565254:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333597440 00000100:00100000:0.0:1734016109.565424:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8360 00000100:00100000:0.0:1734016109.565431:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333597440:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:0.0:1734016109.565473:0:7688:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114eed lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.565486:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.565488:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.565493:0:7688:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114eed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [4116480->4161535] (req 4116480->4161535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.565505:0:7688:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114eed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [4116480->4161535] (req 4116480->4161535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.571371:0:7688:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114eed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [4116480->4161535] (req 4116480->4161535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.571391:0:7688:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114eed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [4116480->4161535] (req 4116480->4161535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.571401:0:7688:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114eed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [4116480->4161535] (req 4116480->4161535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.571410:0:7688:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581200 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016109.571414:0:7688:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114eed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [4116480->4161535] (req 4116480->4161535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.571424:0:7688:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114eed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [4116480->4161535] (req 4116480->4161535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.571448:0:7688:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114eed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [4116480->4161535] (req 4116480->4161535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.571455:0:7688:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114eed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [4116480->4161535] (req 4116480->4161535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016109.571656:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333597440:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 6216us (6486us total) trans 0 rc 45056/45056 00000100:00100000:0.0:1734016109.571670:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8360 00000100:00100000:3.0:1734016109.574622:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.574719:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333597696 00000100:00100000:0.0:1734016109.574733:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333597696 00000100:00100000:0.0:1734016109.575119:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8361 00000100:00100000:0.0:1734016109.575130:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333597696:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:0.0:1734016109.575205:0:7688:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114ef4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.575241:0:7688:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114edf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5332 expref: 5 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.575250:0:7688:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114ee6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5339 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.575260:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.575263:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.575267:0:7688:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114ef4 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7614464->7647231] (req 7614464->7647231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.575325:0:7688:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114ee6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5339 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.575345:0:7688:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114ee6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5339 expref: 7 pid: 7683 timeout: 476 lvb_type: 1 00000100:00100000:0.0:1734016109.575368:0:7688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335256192:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016109.575481:0:7688:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114edf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5332 expref: 5 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.575489:0:7688:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114edf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5332 expref: 5 pid: 8216 timeout: 476 lvb_type: 1 00000100:00100000:0.0:1734016109.575499:0:7688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335256320:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016109.575523:0:7688:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016109.580979:0:7688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335256192:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016109.580992:0:7688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335256320:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016109.581035:0:7688:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114ef4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7614464->7647231] (req 7614464->7647231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016109.581977:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.582042:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.582150:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333597952 00000100:00100000:1.0:1734016109.582162:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333597952 00010000:00010000:1.0:1734016109.582207:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114edf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5332 expref: 6 pid: 8216 timeout: 476 lvb_type: 1 00000100:00100000:1.0:1734016109.582565:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333597824 00000100:00100000:1.0:1734016109.582569:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333597824 00010000:00010000:1.0:1734016109.582582:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114ee6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5339 expref: 8 pid: 7683 timeout: 476 lvb_type: 1 00000100:00100000:2.0:1734016109.582618:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2918 00000100:00100000:2.0:1734016109.582629:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333597952:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016109.582651:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016109.582682:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114edf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5332 expref: 6 pid: 8216 timeout: 476 lvb_type: 1 00010000:00010000:2.0:1734016109.582694:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114edf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5332 expref: 6 pid: 8216 timeout: 476 lvb_type: 1 00010000:00010000:2.0:1734016109.582724:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27114edf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5332 expref: 6 pid: 8216 timeout: 476 lvb_type: 1 00000100:00100000:1.0:1734016109.582780:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2919 00000100:00100000:1.0:1734016109.582785:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333597824:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016109.582793:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016109.582824:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114ee6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5339 expref: 8 pid: 7683 timeout: 476 lvb_type: 1 00010000:00010000:1.0:1734016109.582833:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114ee6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5339 expref: 8 pid: 7683 timeout: 476 lvb_type: 1 00010000:00010000:1.0:1734016109.582845:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114ee6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5339 expref: 8 pid: 7683 timeout: 476 lvb_type: 1 00010000:00010000:2.0:1734016109.583384:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016109.583387:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016109.583393:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114ef4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7614464->7647231] (req 7614464->7647231) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.583404:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114ef4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7614464->7647231] (req 7614464->7647231) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016109.583458:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016109.583523:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333597824:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 736us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016109.583530:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2919 00010000:00010000:2.0:1734016109.584286:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016109.584323:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333597952:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1694us (2354us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016109.584336:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2918 00010000:00010000:0.0:1734016109.585206:0:7688:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114ef4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7614464->7647231] (req 7614464->7647231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.585220:0:7688:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114ef4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7614464->7647231] (req 7614464->7647231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1734016109.589972:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969324 is committed 00002000:00010000:0.0:1734016109.590117:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7458816 -> 7647232 00002000:00010000:0.0:1734016109.590124:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 440 -> 504 00010000:00010000:0.0:1734016109.590142:0:7688:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114ef4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7614464->7647231] (req 7614464->7647231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.590158:0:7688:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114ef4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7614464->7647231] (req 7614464->7647231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.590168:0:7688:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114ef4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7614464->7647231] (req 7614464->7647231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.590175:0:7688:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581440 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016109.590180:0:7688:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114ef4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7614464->7647231] (req 7614464->7647231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.590195:0:7688:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114ef4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7614464->7647231] (req 7614464->7647231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.590220:0:7688:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114ef4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7614464->7647231] (req 7614464->7647231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.590227:0:7688:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27114ef4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7614464->7647231] (req 7614464->7647231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016109.590383:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333597696:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 15244us (15770us total) trans 4294969324 rc 0/0 00000100:00100000:0.0:1734016109.590395:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8361 00000100:00100000:3.0:1734016109.593441:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016109.593602:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333598080 00000100:00100000:2.0:1734016109.593624:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333598080 00000100:00100000:2.0:1734016109.593916:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10626 00000100:00100000:2.0:1734016109.593927:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333598080:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016109.593965:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016109.594006:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114efb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5340 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1734016109.594046:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 7647232, mtime: 0x675afc6e, atime: 0x675afc6d, ctime: 0x675afc6e, blocks: 0x1f8 00010000:00010000:2.0:1734016109.594096:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016109.594100:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016109.594112:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114efb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5340 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016109.594132:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114efb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5340 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016109.594149:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016109.594227:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333598080:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 301us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016109.594235:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10626 00000100:00100000:3.0:1734016109.597535:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.597730:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333598208 00000100:00100000:0.0:1734016109.597748:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333598208 00000100:00100000:0.0:1734016109.597865:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10627 00000100:00100000:0.0:1734016109.597875:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333598208:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016109.597908:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016109.597937:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114f02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5347 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.597979:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.597983:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.597994:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114f02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5347 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.598015:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114f02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5347 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.598034:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:0.0:1734016109.598125:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333598208:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 250us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016109.598133:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10627 00000100:00100000:3.0:1734016109.602590:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.603960:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333598464 00000100:00100000:0.0:1734016109.603977:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333598464 00002000:00100000:0.0:1734016109.604052:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2195456->2199551) req@ffff880075447480 x1818247333598464/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.604076:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075447480 with x1818247333598464 ext(2195456->2199551) 00002000:00010000:0.0:1734016109.604082:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075447480 00000100:00100000:0.0:1734016109.604112:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8362 00000100:00100000:0.0:1734016109.604120:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333598464:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016109.605150:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333598464:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1020us (2564us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016109.605163:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8362 00002000:00100000:0.0:1734016109.605172:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2195456->2199551) req@ffff880075447480 x1818247333598464/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.605181:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075447480 with x1818247333598464 ext(2195456->2199551) 00002000:00010000:0.0:1734016109.605185:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075447480 00000100:00100000:3.0:1734016109.608727:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.608855:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333598720 00000100:00100000:0.0:1734016109.608872:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333598720 00002000:00100000:0.0:1734016109.608936:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2191360->2195455) req@ffff880075444e00 x1818247333598720/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.608954:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075444e00 with x1818247333598720 ext(2191360->2195455) 00002000:00010000:0.0:1734016109.608962:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075444e00 00000100:00100000:0.0:1734016109.609004:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8363 00000100:00100000:0.0:1734016109.609012:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333598720:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016109.609271:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333598720:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 259us (563us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016109.609278:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8363 00002000:00100000:0.0:1734016109.609284:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2191360->2195455) req@ffff880075444e00 x1818247333598720/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.609290:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075444e00 with x1818247333598720 ext(2191360->2195455) 00002000:00010000:0.0:1734016109.609292:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075444e00 00000100:00100000:3.0:1734016109.611739:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.611984:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333598976 00000100:00100000:0.0:1734016109.611995:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333598976 00002000:00100000:0.0:1734016109.612054:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2187264->2191359) req@ffff880075444380 x1818247333598976/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.612076:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075444380 with x1818247333598976 ext(2187264->2191359) 00002000:00010000:0.0:1734016109.612081:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075444380 00000100:00100000:0.0:1734016109.612219:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8364 00000100:00100000:0.0:1734016109.612227:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333598976:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016109.612479:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333598976:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 251us (751us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016109.612487:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8364 00002000:00100000:0.0:1734016109.612493:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2187264->2191359) req@ffff880075444380 x1818247333598976/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.612500:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075444380 with x1818247333598976 ext(2187264->2191359) 00002000:00010000:0.0:1734016109.612503:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075444380 00000100:00100000:3.0:1734016109.617030:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.617321:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333599232 00000100:00100000:0.0:1734016109.617332:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333599232 00002000:00100000:0.0:1734016109.617380:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2183168->2187263) req@ffff880075445880 x1818247333599232/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.617390:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075445880 with x1818247333599232 ext(2183168->2187263) 00002000:00010000:0.0:1734016109.617396:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075445880 00000100:00100000:0.0:1734016109.617431:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8365 00000100:00100000:0.0:1734016109.617437:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333599232:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016109.617644:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333599232:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 206us (629us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016109.617651:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8365 00002000:00100000:0.0:1734016109.617656:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2183168->2187263) req@ffff880075445880 x1818247333599232/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.617662:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075445880 with x1818247333599232 ext(2183168->2187263) 00002000:00010000:0.0:1734016109.617665:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075445880 00000100:00100000:3.0:1734016109.620989:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.621113:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333599488 00000100:00100000:1.0:1734016109.621125:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333599488 00002000:00100000:1.0:1734016109.621192:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2179072->2183167) req@ffff880075445180 x1818247333599488/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.621206:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075445180 with x1818247333599488 ext(2179072->2183167) 00002000:00010000:1.0:1734016109.621215:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075445180 00000100:00100000:1.0:1734016109.621253:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8366 00000100:00100000:1.0:1734016109.621262:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333599488:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.621611:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333599488:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 347us (634us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.621623:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8366 00002000:00100000:1.0:1734016109.621630:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2179072->2183167) req@ffff880075445180 x1818247333599488/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.621638:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075445180 with x1818247333599488 ext(2179072->2183167) 00002000:00010000:1.0:1734016109.621641:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075445180 00000100:00100000:3.0:1734016109.624257:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.624608:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333599744 00000100:00100000:1.0:1734016109.624623:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333599744 00002000:00100000:1.0:1734016109.624684:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2174976->2179071) req@ffff880075445f80 x1818247333599744/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.624697:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075445f80 with x1818247333599744 ext(2174976->2179071) 00002000:00010000:1.0:1734016109.624704:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075445f80 00000100:00100000:1.0:1734016109.625270:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8367 00000100:00100000:1.0:1734016109.625281:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333599744:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.625564:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333599744:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 283us (1333us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.625573:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8367 00002000:00100000:1.0:1734016109.625579:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2174976->2179071) req@ffff880075445f80 x1818247333599744/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.625589:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075445f80 with x1818247333599744 ext(2174976->2179071) 00002000:00010000:1.0:1734016109.625593:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075445f80 00000100:00100000:3.0:1734016109.629559:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.630761:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333600000 00000100:00100000:1.0:1734016109.630774:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333600000 00002000:00100000:1.0:1734016109.630849:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2170880->2174975) req@ffff880075877100 x1818247333600000/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.630859:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075877100 with x1818247333600000 ext(2170880->2174975) 00002000:00010000:1.0:1734016109.630865:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075877100 00000100:00100000:1.0:1734016109.631783:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8368 00000100:00100000:1.0:1734016109.631794:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333600000:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.632124:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333600000:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 327us (2577us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.632133:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8368 00002000:00100000:1.0:1734016109.632142:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2170880->2174975) req@ffff880075877100 x1818247333600000/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.632151:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075877100 with x1818247333600000 ext(2170880->2174975) 00002000:00010000:1.0:1734016109.632155:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075877100 00000100:00100000:3.0:1734016109.640907:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.641011:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333600256 00000100:00100000:0.0:1734016109.641026:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333600256 00002000:00100000:0.0:1734016109.641105:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2166784->2170879) req@ffff880075877480 x1818247333600256/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.641120:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075877480 with x1818247333600256 ext(2166784->2170879) 00002000:00010000:0.0:1734016109.641127:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075877480 00000100:00100000:0.0:1734016109.641183:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8369 00000100:00100000:0.0:1734016109.641192:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333600256:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016109.641798:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333600256:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 603us (904us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016109.642121:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8369 00002000:00100000:0.0:1734016109.642131:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2166784->2170879) req@ffff880075877480 x1818247333600256/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.642140:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075877480 with x1818247333600256 ext(2166784->2170879) 00002000:00010000:0.0:1734016109.642145:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075877480 00000100:00100000:3.0:1734016109.648429:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.648518:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333600512 00000100:00100000:0.0:1734016109.648529:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333600512 00002000:00100000:0.0:1734016109.648586:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2162688->2166783) req@ffff880075876680 x1818247333600512/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.648597:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075876680 with x1818247333600512 ext(2162688->2166783) 00002000:00010000:0.0:1734016109.648602:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075876680 00000100:00100000:0.0:1734016109.649095:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8370 00000100:00100000:0.0:1734016109.649105:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333600512:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016109.649788:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333600512:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 681us (1371us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016109.649798:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8370 00002000:00100000:0.0:1734016109.649861:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2162688->2166783) req@ffff880075876680 x1818247333600512/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.649869:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075876680 with x1818247333600512 ext(2162688->2166783) 00002000:00010000:0.0:1734016109.649873:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075876680 00000100:00100000:3.0:1734016109.657461:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.657929:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333600768 00000100:00100000:0.0:1734016109.657940:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333600768 00002000:00100000:0.0:1734016109.658000:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2158592->2162687) req@ffff880075875c00 x1818247333600768/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.658012:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075875c00 with x1818247333600768 ext(2158592->2162687) 00002000:00010000:0.0:1734016109.658018:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075875c00 00000100:00100000:0.0:1734016109.658055:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8371 00000100:00100000:0.0:1734016109.658073:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333600768:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016109.658312:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333600768:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 239us (866us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016109.658320:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8371 00002000:00100000:0.0:1734016109.658328:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (2158592->2162687) req@ffff880075875c00 x1818247333600768/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.658336:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075875c00 with x1818247333600768 ext(2158592->2162687) 00002000:00010000:0.0:1734016109.658339:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075875c00 00000100:00100000:3.0:1734016109.670037:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016109.670196:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333600896 00000100:00100000:2.0:1734016109.670214:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333600896 00000100:00100000:2.0:1734016109.670289:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10628 00000100:00100000:2.0:1734016109.670300:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333600896:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016109.670342:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016109.670376:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114f09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e534e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.670431:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114efb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5340 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016109.670441:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114f02 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5347 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016109.670449:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016109.670452:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016109.670457:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114f09 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [6246400->6275071] (req 6246400->6275071) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e534e expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.670502:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114f02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5347 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016109.670520:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114f02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5347 expref: 6 pid: 7683 timeout: 476 lvb_type: 1 00000100:00100000:2.0:1734016109.670535:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335256448:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016109.671433:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114efb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5340 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016109.671447:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114efb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5340 expref: 7 pid: 8216 timeout: 476 lvb_type: 1 00000100:00100000:2.0:1734016109.671465:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335256576:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016109.677731:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016109.677789:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335256448:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016109.681361:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.686086:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.686320:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335256576:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016109.686360:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114f09 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [6246400->6275071] (req 6246400->6275071) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e534e expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016109.686385:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:3.0:1734016109.686438:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333600896:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 16140us (16418us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016109.686449:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10628 00000100:00100000:1.0:1734016109.686728:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333601024 00000100:00100000:1.0:1734016109.686736:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333601024 00010000:00010000:1.0:1734016109.686768:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114f02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5347 expref: 7 pid: 7683 timeout: 476 lvb_type: 1 00000100:00100000:1.0:1734016109.686791:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333601152 00000100:00100000:1.0:1734016109.686793:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333601152 00010000:00010000:1.0:1734016109.686830:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114efb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5340 expref: 7 pid: 8216 timeout: 476 lvb_type: 1 00000100:00100000:1.0:1734016109.686846:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2920 00000100:00100000:1.0:1734016109.686851:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333601024:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016109.686865:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016109.686885:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114f02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5347 expref: 7 pid: 7683 timeout: 476 lvb_type: 1 00010000:00010000:1.0:1734016109.686895:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114f02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5347 expref: 7 pid: 7683 timeout: 476 lvb_type: 1 00010000:00010000:1.0:1734016109.686916:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27114f02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5347 expref: 7 pid: 7683 timeout: 476 lvb_type: 1 00010000:00010000:1.0:1734016109.686932:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016109.686964:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333601024:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 112us (5620us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016109.686970:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2920 00000100:00100000:1.0:1734016109.686983:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2921 00000100:00100000:1.0:1734016109.686987:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333601152:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016109.686993:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016109.686999:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114efb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5340 expref: 7 pid: 8216 timeout: 476 lvb_type: 1 00010000:00010000:1.0:1734016109.687009:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114efb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5340 expref: 7 pid: 8216 timeout: 476 lvb_type: 1 00010000:00010000:1.0:1734016109.687021:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114efb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5340 expref: 7 pid: 8216 timeout: 476 lvb_type: 1 00010000:00010000:1.0:1734016109.687029:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016109.687031:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016109.687038:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114f09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6246400->6275071) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e534e expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016109.687048:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114f09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6246400->6275071) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e534e expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016109.687257:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114f09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6246400->6275071) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e534e expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016109.687274:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335256704:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016109.687325:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016109.694135:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335256704:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016109.694174:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016109.694277:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333601152:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7286us (8201us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016109.694291:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2921 00000100:00100000:0.0:1734016109.696411:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.697133:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333601280 00000100:00100000:3.0:1734016109.697158:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333601280 00000100:00100000:3.0:1734016109.697237:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10629 00000100:00100000:3.0:1734016109.697249:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333601280:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016109.697751:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7647232 -> 7647232 00002000:00010000:3.0:1734016109.697755:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016110 -> 1734016110 00002000:00010000:3.0:1734016109.697758:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016109 -> 1734016109 00002000:00010000:3.0:1734016109.697760:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016110 -> 1734016110 00002000:00010000:3.0:1734016109.697763:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 504 -> 504 00000100:00100000:3.0:1734016109.706422:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333601280:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 9155us (10001us total) trans 4294969325 rc 0/0 00000100:00100000:3.0:1734016109.706443:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10629 00000100:00100000:3.0:1734016109.713043:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.713166:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333601536 00000100:00100000:1.0:1734016109.713178:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333601536 00002000:00100000:1.0:1734016109.713230:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1552384->1556479) req@ffff880075877b80 x1818247333601536/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.713241:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075877b80 with x1818247333601536 ext(1552384->1556479) 00002000:00010000:1.0:1734016109.713247:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075877b80 00000100:00100000:1.0:1734016109.713271:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8372 00000100:00100000:1.0:1734016109.713278:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333601536:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.714478:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333601536:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1190us (1440us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.714491:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8372 00002000:00100000:1.0:1734016109.714503:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1552384->1556479) req@ffff880075877b80 x1818247333601536/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.714511:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075877b80 with x1818247333601536 ext(1552384->1556479) 00002000:00010000:1.0:1734016109.714516:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075877b80 00000100:00100000:2.0:1734016109.721903:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.725406:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333601792 00000100:00100000:1.0:1734016109.725424:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333601792 00002000:00100000:1.0:1734016109.725495:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1548288->1552383) req@ffff8800755b5c00 x1818247333601792/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.725505:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5c00 with x1818247333601792 ext(1548288->1552383) 00002000:00010000:1.0:1734016109.725511:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b5c00 00000100:00100000:1.0:1734016109.725552:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8373 00000100:00100000:1.0:1734016109.725558:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333601792:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.726306:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333601792:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 743us (4420us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.726316:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8373 00002000:00100000:1.0:1734016109.726323:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1548288->1552383) req@ffff8800755b5c00 x1818247333601792/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.726331:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5c00 with x1818247333601792 ext(1548288->1552383) 00002000:00010000:1.0:1734016109.726335:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b5c00 00000100:00100000:2.0:1734016109.740019:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.740140:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333602048 00000100:00100000:0.0:1734016109.740155:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333602048 00002000:00100000:0.0:1734016109.740225:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (1544192->1548287) req@ffff8800755b7100 x1818247333602048/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.740240:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b7100 with x1818247333602048 ext(1544192->1548287) 00002000:00010000:0.0:1734016109.740249:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b7100 00000100:00100000:0.0:1734016109.740305:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8374 00000100:00100000:0.0:1734016109.740317:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333602048:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016109.740683:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333602048:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 365us (685us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016109.740693:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8374 00002000:00100000:0.0:1734016109.740700:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (1544192->1548287) req@ffff8800755b7100 x1818247333602048/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.740708:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b7100 with x1818247333602048 ext(1544192->1548287) 00002000:00010000:0.0:1734016109.740712:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b7100 00000100:00100000:3.0:1734016109.751005:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.751124:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333602304 00000100:00100000:1.0:1734016109.751140:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333602304 00002000:00100000:1.0:1734016109.751194:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1540096->1544191) req@ffff880075875f80 x1818247333602304/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.751205:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075875f80 with x1818247333602304 ext(1540096->1544191) 00002000:00010000:1.0:1734016109.751211:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075875f80 00000100:00100000:1.0:1734016109.751236:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8375 00000100:00100000:1.0:1734016109.751242:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333602304:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.752047:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333602304:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 802us (1059us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.752056:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8375 00002000:00100000:1.0:1734016109.752072:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1540096->1544191) req@ffff880075875f80 x1818247333602304/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.752080:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075875f80 with x1818247333602304 ext(1540096->1544191) 00002000:00010000:1.0:1734016109.752083:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075875f80 00000100:00100000:2.0:1734016109.760417:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.760528:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333602560 00000100:00100000:1.0:1734016109.760540:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333602560 00002000:00100000:1.0:1734016109.760592:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1536000->1540095) req@ffff8800755b5880 x1818247333602560/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.760604:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5880 with x1818247333602560 ext(1536000->1540095) 00002000:00010000:1.0:1734016109.760611:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b5880 00000100:00100000:1.0:1734016109.760638:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8376 00000100:00100000:1.0:1734016109.760648:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333602560:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.762396:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333602560:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1724us (1973us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.762419:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8376 00002000:00100000:1.0:1734016109.762438:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1536000->1540095) req@ffff8800755b5880 x1818247333602560/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.762452:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5880 with x1818247333602560 ext(1536000->1540095) 00002000:00010000:1.0:1734016109.762463:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b5880 00000100:00100000:2.0:1734016109.770527:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.771238:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333602816 00000100:00100000:1.0:1734016109.771254:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333602816 00002000:00100000:1.0:1734016109.771329:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1531904->1535999) req@ffff8800755b5f80 x1818247333602816/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.771342:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5f80 with x1818247333602816 ext(1531904->1535999) 00002000:00010000:1.0:1734016109.771350:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b5f80 00000100:00100000:1.0:1734016109.771396:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8377 00000100:00100000:1.0:1734016109.771404:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333602816:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.771697:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333602816:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 293us (1184us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.771710:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8377 00002000:00100000:1.0:1734016109.771716:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1531904->1535999) req@ffff8800755b5f80 x1818247333602816/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.771722:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5f80 with x1818247333602816 ext(1531904->1535999) 00002000:00010000:1.0:1734016109.771726:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b5f80 00000100:00100000:3.0:1734016109.775714:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.775852:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333603072 00000100:00100000:0.0:1734016109.775864:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333603072 00002000:00100000:0.0:1734016109.775915:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (1527808->1531903) req@ffff880075876300 x1818247333603072/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.775925:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075876300 with x1818247333603072 ext(1527808->1531903) 00002000:00010000:0.0:1734016109.775932:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075876300 00000100:00100000:0.0:1734016109.775968:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8378 00000100:00100000:0.0:1734016109.775976:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333603072:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016109.776244:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333603072:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 265us (546us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016109.776252:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8378 00002000:00100000:0.0:1734016109.776260:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (1527808->1531903) req@ffff880075876300 x1818247333603072/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.776266:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075876300 with x1818247333603072 ext(1527808->1531903) 00002000:00010000:0.0:1734016109.776269:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075876300 00000100:00100000:2.0:1734016109.784908:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.785695:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333603328 00000100:00100000:1.0:1734016109.785712:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333603328 00002000:00100000:1.0:1734016109.785777:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1523712->1527807) req@ffff8800755b6a00 x1818247333603328/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.785790:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b6a00 with x1818247333603328 ext(1523712->1527807) 00002000:00010000:1.0:1734016109.785827:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b6a00 00000100:00100000:1.0:1734016109.785874:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8379 00000100:00100000:1.0:1734016109.785884:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333603328:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.786178:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333603328:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 292us (1284us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.786189:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8379 00002000:00100000:1.0:1734016109.786195:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1523712->1527807) req@ffff8800755b6a00 x1818247333603328/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.786203:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b6a00 with x1818247333603328 ext(1523712->1527807) 00002000:00010000:1.0:1734016109.786206:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b6a00 00000100:00100000:3.0:1734016109.800715:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.800968:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333603584 00000100:00100000:0.0:1734016109.800979:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333603584 00002000:00100000:0.0:1734016109.801029:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (1519616->1523711) req@ffff880075874a80 x1818247333603584/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.801041:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075874a80 with x1818247333603584 ext(1519616->1523711) 00002000:00010000:0.0:1734016109.801046:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075874a80 00000100:00100000:0.0:1734016109.801087:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8380 00000100:00100000:0.0:1734016109.801092:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333603584:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016109.801340:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333603584:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 246us (643us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016109.801347:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8380 00002000:00100000:0.0:1734016109.801353:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (1519616->1523711) req@ffff880075874a80 x1818247333603584/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.801360:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075874a80 with x1818247333603584 ext(1519616->1523711) 00002000:00010000:0.0:1734016109.801362:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075874a80 00000100:00100000:3.0:1734016109.807114:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.807372:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333603840 00000100:00100000:1.0:1734016109.807389:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333603840 00002000:00100000:1.0:1734016109.807613:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1515520->1519615) req@ffff880073bbca80 x1818247333603840/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.807632:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbca80 with x1818247333603840 ext(1515520->1519615) 00002000:00010000:1.0:1734016109.807639:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbca80 00000100:00100000:1.0:1734016109.808248:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8381 00000100:00100000:1.0:1734016109.808259:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333603840:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.808551:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333603840:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 292us (1458us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.808560:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8381 00002000:00100000:1.0:1734016109.808566:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1515520->1519615) req@ffff880073bbca80 x1818247333603840/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.808573:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbca80 with x1818247333603840 ext(1515520->1519615) 00002000:00010000:1.0:1734016109.808576:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbca80 00000100:00100000:2.0:1734016109.813255:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.813361:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333604096 00000100:00100000:0.0:1734016109.813372:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333604096 00002000:00100000:0.0:1734016109.813426:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (1511424->1515519) req@ffff8800a78cf100 x1818247333604096/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.813439:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cf100 with x1818247333604096 ext(1511424->1515519) 00002000:00010000:0.0:1734016109.813445:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cf100 00000100:00100000:0.0:1734016109.813573:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8382 00000100:00100000:0.0:1734016109.813582:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333604096:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016109.813871:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333604096:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 288us (634us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016109.813882:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8382 00002000:00100000:0.0:1734016109.813887:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (1511424->1515519) req@ffff8800a78cf100 x1818247333604096/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.813894:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cf100 with x1818247333604096 ext(1511424->1515519) 00002000:00010000:0.0:1734016109.813896:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cf100 00000100:00100000:3.0:1734016109.817983:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.818590:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333604352 00000100:00100000:1.0:1734016109.818603:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333604352 00002000:00100000:1.0:1734016109.818670:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1507328->1511423) req@ffff880073bbd500 x1818247333604352/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.818683:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbd500 with x1818247333604352 ext(1507328->1511423) 00002000:00010000:1.0:1734016109.818692:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbd500 00000100:00100000:1.0:1734016109.818740:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8383 00000100:00100000:1.0:1734016109.818749:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333604352:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016109.819035:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333604352:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 285us (1071us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016109.819043:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8383 00002000:00100000:1.0:1734016109.819050:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1507328->1511423) req@ffff880073bbd500 x1818247333604352/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.819068:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbd500 with x1818247333604352 ext(1507328->1511423) 00002000:00010000:1.0:1734016109.819071:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbd500 00000100:00100000:3.0:1734016109.824349:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.824456:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333604608 00000100:00100000:0.0:1734016109.824470:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333604608 00002000:00100000:0.0:1734016109.824529:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (1503232->1507327) req@ffff880073bbf800 x1818247333604608/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.824540:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbf800 with x1818247333604608 ext(1503232->1507327) 00002000:00010000:0.0:1734016109.824547:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbf800 00000100:00100000:0.0:1734016109.824585:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8384 00000100:00100000:0.0:1734016109.824592:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333604608:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016109.824829:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333604608:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 207us (466us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016109.824840:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8384 00002000:00100000:0.0:1734016109.824846:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (1503232->1507327) req@ffff880073bbf800 x1818247333604608/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/4536 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.824853:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbf800 with x1818247333604608 ext(1503232->1507327) 00002000:00010000:0.0:1734016109.824855:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbf800 00000100:00100000:2.0:1734016109.832558:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.833084:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333604736 00000100:00100000:1.0:1734016109.833100:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333604736 00002000:00100000:1.0:1734016109.833175:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (1503232->1556479) req@ffff8800a78cce00 x1818247333604736/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/0 e 0 to 0 dl 1734016120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016109.833187:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cce00 with x1818247333604736 ext(1503232->1556479) 00002000:00010000:1.0:1734016109.833194:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cce00 00000100:00100000:0.0:1734016109.834914:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8385 00000100:00100000:0.0:1734016109.834930:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333604736:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016109.845468:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333604736:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 10518us (12904us total) trans 4294969326 rc 0/0 00000100:00100000:0.0:1734016109.845488:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8385 00002000:00100000:0.0:1734016109.845509:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (1503232->1556479) req@ffff8800a78cce00 x1818247333604736/t4294969326(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:70/0 lens 488/448 e 0 to 0 dl 1734016120 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016109.845521:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cce00 with x1818247333604736 ext(1503232->1556479) 00002000:00010000:0.0:1734016109.845531:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cce00 00000100:00100000:3.0:1734016109.854877:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.855261:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333604864 00000100:00100000:1.0:1734016109.855273:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333604864 00000100:00100000:1.0:1734016109.855333:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2122 00000100:00100000:1.0:1734016109.855342:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:9668:x1818247333604864:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:1.0:1734016109.855499:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:9668:x1818247333604864:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 158us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016109.855505:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2122 00000100:00100000:3.0:1734016109.858456:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.858552:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333604992 00000100:00100000:0.0:1734016109.858563:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333604992 00000100:00100000:0.0:1734016109.858621:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10630 00000100:00100000:0.0:1734016109.858629:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333604992:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:3.0:1734016109.862489:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969326 is committed 00000100:00100000:0.0:1734016109.862724:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333604992:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 4087us (4271us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016109.862737:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10630 00000100:00100000:2.0:1734016109.867149:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.867203:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333605120 00000100:00100000:0.0:1734016109.867213:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333605120 00000100:00100000:0.0:1734016109.867255:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10631 00000100:00100000:0.0:1734016109.867261:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333605120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016109.867285:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016109.867305:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114f10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5355 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016109.867369:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335256832:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016109.867446:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00002000:00010000:0.0:1734016109.869764:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016109 -> 1734016110 00002000:00010000:0.0:1734016109.869774:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 504 -> 608 00000100:00100000:0.0:1734016109.869797:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335256832:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016109.869946:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114f10 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5355 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.869963:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27114f10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5355 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.869978:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581200, rc 0) 00000100:00100000:0.0:1734016109.870309:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333605120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3042us (3166us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016109.870319:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10631 00000100:00100000:3.0:1734016109.873506:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.873595:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333605248 00000100:00100000:0.0:1734016109.873608:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333605248 00000100:00100000:0.0:1734016109.873730:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10632 00000100:00100000:0.0:1734016109.873739:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333605248:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016109.873769:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016109.873795:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114f17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e535c expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016109.874220:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335256960:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016109.874328:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016109.878476:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335256960:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016109.878519:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114f17 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e535c expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.878535:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27114f17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e535c expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016109.878561:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75818c0, rc 0) 00000100:00100000:0.0:1734016109.878622:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333605248:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4883us (5131us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016109.878632:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10632 00000100:00100000:3.0:1734016109.885019:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.885881:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333605504 00000100:00100000:0.0:1734016109.885897:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333605504 00000100:00100000:0.0:1734016109.885981:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2123 00000100:00100000:0.0:1734016109.885993:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:9668:x1818247333605504:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016109.886102:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016109.886153:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27114ed8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e532b expref: 18 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.886201:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016109.886209:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016109.886486:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016109.886503:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114eae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e530f expref: 35 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.886512:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f1e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016109.886561:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e530f expref: 35 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.886579:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114eae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e530f expref: 35 pid: 13956 timeout: 477 lvb_type: 0 00000100:00100000:0.0:1734016109.886596:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335257088:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016109.886718:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016109.893924:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.894087:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335257088:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016109.894123:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016109.894221:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333605632 00000100:00100000:1.0:1734016109.894232:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333605632 00010000:00010000:1.0:1734016109.894275:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114eae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e530f expref: 36 pid: 13956 timeout: 477 lvb_type: 0 00000100:00100000:1.0:1734016109.894318:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2922 00000100:00100000:1.0:1734016109.894327:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+36:1981:x1818247333605632:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016109.894351:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016109.894359:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114eae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e530f expref: 36 pid: 13956 timeout: 477 lvb_type: 0 00010000:00010000:1.0:1734016109.894379:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e530f expref: 36 pid: 13956 timeout: 477 lvb_type: 0 00010000:00010000:1.0:1734016109.894413:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27114eae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e530f expref: 36 pid: 13956 timeout: 477 lvb_type: 0 00010000:00010000:1.0:1734016109.894445:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016109.894450:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016109.894463:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016109.894473:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f1e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016109.894497:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016109.894561:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+35:1981:x1818247333605632:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 234us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016109.894569:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2922 00010000:00010000:0.0:1734016109.895303:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016109.895312:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:0.0:1734016109.895451:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968666 00000004:00010000:0.0:1734016109.895526:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880073bbdf80 reply state ffff880075a25000 transno 4294968667 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016109.895535:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016109.895649:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:9668:x1818247333605504:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 9661us (10652us total) trans 4294968667 rc 0/0 00000100:00100000:0.0:1734016109.895658:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2123 00000020:00080000:0.0:1734016109.895662:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1734016109.899407:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016109.899693:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016109.899704:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016109.899711:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016109.899717:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a75821c0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:1.0:1734016109.899722:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016109.899731:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016109.899752:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016109.899754:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1734016109.899759:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016109.899764:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016109.900225:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333605760 00000100:00100000:0.0:1734016109.900237:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333605760 00002000:00010000:0.0:1734016109.900281:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (4042027->18446744073709551615) 00002000:00100000:0.0:1734016109.900285:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbed80 with x1818247333605760 ext(4042027->18446744073709551615) 00002000:00010000:0.0:1734016109.900296:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbed80. 00000100:00100000:0.0:1734016109.900991:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8386 00000100:00100000:0.0:1734016109.901002:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333605760:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016109.901585:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7647232 -> 4042027 00002000:00010000:0.0:1734016109.901588:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016110 -> 1734016110 00002000:00010000:0.0:1734016109.901591:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016110 -> 1734016109 00002000:00010000:0.0:1734016109.901593:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016110 -> 1734016110 00002000:00010000:0.0:1734016109.901595:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 608 -> 448 00000100:00100000:0.0:1734016109.901677:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333605760:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 676us (2284us total) trans 4294969327 rc 0/0 00000100:00100000:0.0:1734016109.901686:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8386 00002000:00010000:0.0:1734016109.901690:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (4042027->18446744073709551615) 00002000:00100000:0.0:1734016109.901695:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbed80 with x1818247333605760 ext(4042027->18446744073709551615) 00002000:00010000:0.0:1734016109.901701:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbed80. 00000100:00100000:3.0:1734016109.904994:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.905399:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333605888 00000100:00100000:0.0:1734016109.905411:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333605888 00000100:00100000:0.0:1734016109.905474:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2124 00000100:00100000:0.0:1734016109.905483:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+35:9668:x1818247333605888:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016109.905514:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016109.905540:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27114f25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5363 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.905656:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27114f2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016109.905674:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27114f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016109.905688:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27114f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016109.905716:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 4042027 00000004:00200000:0.0:1734016109.905719:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016109.905734:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27114f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016109.905755:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27114f25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5363 expref: 37 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.905772:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27114f2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5363 expref: 36 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.905778:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016109.905780:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016109.905783:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:0.0:1734016109.905885:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+36:9668:x1818247333605888:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 403us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016109.905892:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2124 00000100:00100000:0.0:1734016109.912741:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016109.913742:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333606016 00000100:00100000:2.0:1734016109.913755:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333606016 00000100:00100000:2.0:1734016109.913837:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10633 00000100:00100000:2.0:1734016109.913846:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333606016:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016109.913868:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016109.913887:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114f33 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e536a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016109.913947:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335257216:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016109.914006:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016109.921186:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335257216:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016109.921241:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114f33 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e536a expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016109.921264:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114f33 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e536a expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016109.921301:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016109.921375:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333606016:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7528us (8643us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016109.921385:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10633 00000100:00100000:2.0:1734016109.924744:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.924838:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333606144 00000100:00100000:3.0:1734016109.924850:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333606144 00000100:00100000:3.0:1734016109.924908:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10634 00000100:00100000:3.0:1734016109.924916:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333606144:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016109.924941:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016109.924964:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114f3a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5371 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016109.925038:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335257344:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016109.925135:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016109.927769:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335257344:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016109.927867:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114f3a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5371 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.927884:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27114f3a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5371 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016109.927913:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4b40, rc 0) 00000100:00100000:3.0:1734016109.927986:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333606144:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3068us (3249us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016109.927999:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10634 00000100:00100000:2.0:1734016109.934759:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016109.935613:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333606272 00000100:00100000:3.0:1734016109.935627:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333606272 00000100:00100000:3.0:1734016109.935723:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10635 00000100:00100000:3.0:1734016109.935732:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333606272:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016109.936154:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 4042027 -> 4042027 00002000:00010000:3.0:1734016109.936158:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016110 -> 1734016110 00002000:00010000:3.0:1734016109.936160:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016109 -> 1734016109 00002000:00010000:3.0:1734016109.936161:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016110 -> 1734016110 00002000:00010000:3.0:1734016109.936163:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 448 -> 448 00000100:00100000:2.0:1734016109.937397:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333606272:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1654us (2639us total) trans 4294969328 rc 0/0 00000100:00100000:2.0:1734016109.937409:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10635 00000100:00100000:2.0:1734016109.942379:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.943885:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333606400 00000100:00100000:1.0:1734016109.943897:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333606400 00000100:00100000:0.0:1734016109.944475:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2125 00000100:00100000:0.0:1734016109.944485:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:9668:x1818247333606400:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016109.944521:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016109.944546:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27114f41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5378 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.944656:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016109.944673:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016109.944684:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:0.0:1734016109.944710:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 4042027 00000004:00200000:0.0:1734016109.944714:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016109.944732:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016109.944754:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27114f41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5378 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.944788:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5378 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.944797:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016109.944817:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016109.944820:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:0.0:1734016109.945511:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:9668:x1818247333606400:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1021us (3138us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016109.945520:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2125 00000100:00100000:0.0:1734016109.950259:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016109.950506:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333606656 00000100:00100000:2.0:1734016109.950519:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333606656 00000100:00100000:2.0:1734016109.950615:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2126 00000100:00100000:2.0:1734016109.950623:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:9668:x1818247333606656:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016109.950683:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016109.950711:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27114f48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5378 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.951120:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016109.951125:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016109.951317:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.951339:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27114f2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5363 expref: 35 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.951346:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f4f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.951386:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27114f2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5363 expref: 35 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.951401:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27114f2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5363 expref: 35 pid: 13956 timeout: 477 lvb_type: 0 00000100:00100000:2.0:1734016109.951415:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335257472:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016109.951628:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016109.954357:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016109.954535:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335257472:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016109.954562:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016109.954631:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333606784 00000100:00100000:0.0:1734016109.954638:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333606784 00010000:00010000:0.0:1734016109.954670:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27114f2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5363 expref: 36 pid: 13956 timeout: 477 lvb_type: 0 00000100:00100000:0.0:1734016109.954711:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2923 00000100:00100000:0.0:1734016109.954718:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+36:1981:x1818247333606784:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016109.954737:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016109.954744:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27114f2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5363 expref: 36 pid: 13956 timeout: 477 lvb_type: 0 00010000:00010000:0.0:1734016109.954756:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27114f2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5363 expref: 36 pid: 13956 timeout: 477 lvb_type: 0 00010000:00010000:0.0:1734016109.954779:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27114f2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5363 expref: 36 pid: 13956 timeout: 477 lvb_type: 0 00010000:00010000:0.0:1734016109.954838:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016109.954843:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016109.954852:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016109.954861:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f4f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016109.954881:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016109.954924:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+35:1981:x1818247333606784:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 205us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016109.954930:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2923 00010000:00010000:2.0:1734016109.955293:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.955299:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:2.0:1734016109.955400:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968668 00000004:00010000:2.0:1734016109.955444:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800750d1500 reply state ffff880075cc4000 transno 4294968669 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016109.955452:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016109.955531:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:9668:x1818247333606656:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 4907us (5285us total) trans 4294968669 rc 0/0 00000100:00100000:2.0:1734016109.955538:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2126 00000020:00080000:2.0:1734016109.955542:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016109.956936:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.956950:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.956956:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.956961:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcb40 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016109.956965:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.956972:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f4f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.956986:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016109.956989:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016109.956992:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f4f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.956997:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f4f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016109.957075:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016109.957124:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333606912 00000100:00100000:2.0:1734016109.957132:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333606912 00002000:00010000:2.0:1734016109.957182:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (8700975->18446744073709551615) 00002000:00100000:2.0:1734016109.957187:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d3800 with x1818247333606912 ext(8700975->18446744073709551615) 00002000:00010000:2.0:1734016109.957196:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d3800. 00000100:00100000:2.0:1734016109.957227:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8387 00000100:00100000:2.0:1734016109.957236:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333606912:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016109.957429:0:14005:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 4042027 -> 8700975 00002000:00010000:2.0:1734016109.957432:0:14005:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016110 -> 1734016110 00002000:00010000:2.0:1734016109.957434:0:14005:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016109 -> 1734016109 00002000:00010000:2.0:1734016109.957435:0:14005:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016110 -> 1734016110 00002000:00010000:2.0:1734016109.957437:0:14005:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 448 -> 448 00000100:00100000:2.0:1734016109.957485:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333606912:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 250us (412us total) trans 4294969329 rc 0/0 00000100:00100000:2.0:1734016109.957492:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8387 00002000:00010000:2.0:1734016109.957495:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (8700975->18446744073709551615) 00002000:00100000:2.0:1734016109.957498:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d3800 with x1818247333606912 ext(8700975->18446744073709551615) 00002000:00010000:2.0:1734016109.957501:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d3800. 00000100:00100000:0.0:1734016109.959949:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016109.960358:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333607040 00000100:00100000:2.0:1734016109.960568:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333607040 00000100:00100000:2.0:1734016109.960647:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2127 00000100:00100000:2.0:1734016109.960655:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:9668:x1818247333607040:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016109.960697:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016109.960729:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27114f56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e537f expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.960891:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27114f5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.960906:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27114f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.960917:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27114f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:2.0:1734016109.960946:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 8700975 00000004:00200000:2.0:1734016109.960951:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016109.960975:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27114f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016109.960999:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27114f56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e537f expref: 23 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.961016:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27114f5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e537f expref: 22 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.961025:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016109.961027:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016109.961032:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd680, rc 0) 00000100:00100000:2.0:1734016109.961114:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:9668:x1818247333607040:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 460us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016109.961120:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2127 00000100:00100000:0.0:1734016109.964202:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016109.964293:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333607296 00000100:00100000:2.0:1734016109.964303:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333607296 00000100:00100000:2.0:1734016109.964347:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2128 00000100:00100000:2.0:1734016109.964354:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+35:9668:x1818247333607296:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016109.964577:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27114f64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016109.964593:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27114f5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e537f expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.964600:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27114f64 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016109.964635:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27114f5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e537f expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.964649:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27114f5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e537f expref: 21 pid: 13956 timeout: 477 lvb_type: 0 00000100:00100000:2.0:1734016109.964662:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335257600:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016109.964744:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016109.967472:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335257600:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016109.967504:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27114f64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016109.968208:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016109.968383:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333607424 00000100:00100000:1.0:1734016109.968392:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333607424 00010000:00010000:1.0:1734016109.968434:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27114f5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e537f expref: 22 pid: 13956 timeout: 477 lvb_type: 0 00000100:00100000:1.0:1734016109.968467:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2924 00000100:00100000:1.0:1734016109.968474:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7809850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:1981:x1818247333607424:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016109.968499:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016109.968507:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27114f5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e537f expref: 22 pid: 13956 timeout: 477 lvb_type: 0 00010000:00010000:1.0:1734016109.968520:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27114f5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e537f expref: 22 pid: 13956 timeout: 477 lvb_type: 0 00010000:00010000:1.0:1734016109.968547:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27114f5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e537f expref: 22 pid: 13956 timeout: 477 lvb_type: 0 00010000:00010000:1.0:1734016109.968585:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016109.968589:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27114f64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.968600:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27114f64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.968608:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27114f64 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.968640:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016109.968691:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7809850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:1981:x1818247333607424:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 216us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016109.968698:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2924 00010000:00010000:3.0:1734016109.968997:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27114f64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016109.969005:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27114f64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:3.0:1734016109.969123:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968670 00000004:00010000:3.0:1734016109.969170:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800750d1c00 reply state ffff880075cc6000 transno 4294968671 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27114f64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016109.969177:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016109.969258:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+38:9668:x1818247333607296:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 4904us (5066us total) trans 4294968671 rc 0/0 00000100:00100000:3.0:1734016109.969265:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2128 00000020:00080000:3.0:1734016109.969269:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1734016109.971966:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27114f64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.971985:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27114f64 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.971991:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27114f64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.971996:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd440 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:1.0:1734016109.972000:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27114f64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.972007:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27114f64 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.972025:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016109.972029:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1734016109.972033:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27114f64 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016109.972037:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27114f64 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016109.972551:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016109.973851:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333607552 00000100:00100000:2.0:1734016109.973868:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333607552 00000100:00100000:2.0:1734016109.974287:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10636 00000100:00100000:2.0:1734016109.974298:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333607552:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016109.974319:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016109.974343:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114f6b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5386 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.974375:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114f09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6246400->6275071) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e534e expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.974383:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016109.974385:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016109.974387:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114f6b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5386 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.974426:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114f09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6246400->6275071) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e534e expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.974437:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114f09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6246400->6275071) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e534e expref: 8 pid: 8216 timeout: 477 lvb_type: 0 00000100:00100000:2.0:1734016109.974451:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335257728:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016109.974538:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016109.976328:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335257728:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016109.976367:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114f6b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5386 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016109.976384:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016109.976450:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333607552:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2152us (3905us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016109.976461:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10636 00000100:00100000:1.0:1734016109.978526:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016109.978586:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333607680 00000100:00100000:0.0:1734016109.978596:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333607680 00010000:00010000:0.0:1734016109.978633:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114f09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6246400->6275071) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e534e expref: 9 pid: 8216 timeout: 477 lvb_type: 0 00000100:00100000:0.0:1734016109.978658:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2925 00000100:00100000:0.0:1734016109.978664:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333607680:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016109.978681:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016109.978704:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114f09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6246400->6275071) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e534e expref: 9 pid: 8216 timeout: 477 lvb_type: 0 00010000:00010000:0.0:1734016109.978718:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114f09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6246400->6275071) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e534e expref: 9 pid: 8216 timeout: 477 lvb_type: 0 00010000:00010000:0.0:1734016109.978744:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114f09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6246400->6275071) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e534e expref: 9 pid: 8216 timeout: 477 lvb_type: 0 00010000:00010000:0.0:1734016109.978773:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.978775:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016109.978780:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114f6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5386 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.978789:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114f6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5386 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016109.978847:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114f6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5386 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016109.978860:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335257856:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016109.978923:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016110.015205:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.015861:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335257856:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016110.015886:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016110.015944:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333607680:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 37277us (37427us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016110.015958:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2925 00000100:00100000:3.0:1734016110.016241:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333607808 00000100:00100000:3.0:1734016110.016249:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333607808 00002000:00010000:3.0:1734016110.016284:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (10343365->18446744073709551615) 00002000:00100000:3.0:1734016110.016289:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d0380 with x1818247333607808 ext(10343365->18446744073709551615) 00002000:00010000:3.0:1734016110.016300:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d0380. 00000100:00100000:3.0:1734016110.016319:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8388 00000100:00100000:3.0:1734016110.016325:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333607808:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016110.016568:0:14005:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8700975 -> 10343365 00002000:00010000:3.0:1734016110.016571:0:14005:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016110 -> 1734016110 00002000:00010000:3.0:1734016110.016574:0:14005:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016109 -> 1734016109 00002000:00010000:3.0:1734016110.016575:0:14005:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016110 -> 1734016110 00002000:00010000:3.0:1734016110.016577:0:14005:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 448 -> 448 00000100:00100000:3.0:1734016110.016608:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333607808:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 283us (1416us total) trans 4294969330 rc 0/0 00000100:00100000:3.0:1734016110.016614:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8388 00002000:00010000:3.0:1734016110.016617:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (10343365->18446744073709551615) 00002000:00100000:3.0:1734016110.016619:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d0380 with x1818247333607808 ext(10343365->18446744073709551615) 00002000:00010000:3.0:1734016110.016624:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d0380. 00000100:00100000:0.0:1734016110.044136:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016110.044317:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333607936 00000100:00100000:3.0:1734016110.044332:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333607936 00000100:00100000:3.0:1734016110.044394:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2129 00000100:00100000:3.0:1734016110.044403:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+37:9668:x1818247333607936:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016110.044438:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016110.044466:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114f72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e538d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.044595:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016110.044614:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016110.044628:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016110.044656:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 10343365 00000004:00200000:3.0:1734016110.044662:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016110.044682:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016110.044707:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27114f72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e538d expref: 39 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.044751:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e538d expref: 38 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.044760:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016110.044762:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016110.044766:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df58c0, rc 0) 00000100:00100000:3.0:1734016110.044861:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+38:9668:x1818247333607936:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 459us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016110.044870:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2129 00000100:00100000:0.0:1734016110.050141:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.050212:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333608064 00000100:00100000:2.0:1734016110.050222:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333608064 00000100:00080000:1.0:1734016110.050750:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016080 00000100:00100000:2.0:1734016110.050779:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10637 00000100:00100000:2.0:1734016110.050787:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333608064:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016110.050839:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016110.050859:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114f80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5394 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016110.050921:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335257984:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016110.050981:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016110.052106:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335257984:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016110.052132:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114f80 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5394 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.052146:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27114f80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5394 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.052160:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016110.052200:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333608064:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1413us (2070us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016110.052207:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10637 00000100:00100000:0.0:1734016110.055189:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.055399:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333608320 00000100:00100000:2.0:1734016110.055409:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333608320 00000100:00100000:2.0:1734016110.055477:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8389 00000100:00100000:2.0:1734016110.055484:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333608320:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:2.0:1734016110.055547:0:7688:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f87 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.055565:0:7688:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114f6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5386 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.055572:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016110.055575:0:7688:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016110.055578:0:7688:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f87 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5267456->5283839] (req 5267456->5283839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.055613:0:7688:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114f6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5386 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.055625:0:7688:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114f6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5386 expref: 7 pid: 8216 timeout: 477 lvb_type: 0 00000100:00100000:2.0:1734016110.055638:0:7688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335258112:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016110.055708:0:7688:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016110.062375:0:7688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:7688:1818247335258112:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016110.062423:0:7688:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f87 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5267456->5283839] (req 5267456->5283839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016110.062651:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.062744:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333608448 00000100:00100000:1.0:1734016110.062754:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333608448 00010000:00010000:1.0:1734016110.062811:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114f6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5386 expref: 8 pid: 8216 timeout: 477 lvb_type: 0 00000100:00100000:1.0:1734016110.062853:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2926 00000100:00100000:1.0:1734016110.062861:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333608448:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016110.062877:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016110.062899:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114f6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5386 expref: 8 pid: 8216 timeout: 477 lvb_type: 0 00010000:00010000:1.0:1734016110.062911:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114f6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5386 expref: 8 pid: 8216 timeout: 477 lvb_type: 0 00010000:00010000:1.0:1734016110.062941:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27114f6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5386 expref: 8 pid: 8216 timeout: 477 lvb_type: 0 00010000:00010000:1.0:1734016110.062968:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016110.062971:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016110.062975:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f87 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5267456->5283839] (req 5267456->5283839) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.062984:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f87 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5267456->5283839] (req 5267456->5283839) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.063010:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016110.063051:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333608448:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 189us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016110.063066:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2926 00010000:00010000:3.0:1734016110.063233:0:7688:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f87 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5267456->5283839] (req 5267456->5283839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.063242:0:7688:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f87 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5267456->5283839] (req 5267456->5283839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.063408:0:7688:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f87 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5267456->5283839] (req 5267456->5283839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.063414:0:7688:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f87 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5267456->5283839] (req 5267456->5283839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.063420:0:7688:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5267456->5283839] (req 5267456->5283839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.063426:0:7688:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcb40 already unused, calling callback (ffffffffa080e100) 00010000:00010000:3.0:1734016110.063429:0:7688:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5267456->5283839] (req 5267456->5283839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.063437:0:7688:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f87 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5267456->5283839] (req 5267456->5283839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.063446:0:7688:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f87 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5267456->5283839] (req 5267456->5283839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.063456:0:7688:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27114f87 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5267456->5283839] (req 5267456->5283839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7688 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016110.063502:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333608320:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 8018us (8327us total) trans 0 rc 16384/16384 00000100:00100000:3.0:1734016110.063511:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8389 00000100:00100000:0.0:1734016110.070679:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.072451:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333608576 00000100:00100000:2.0:1734016110.072464:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333608576 00000100:00100000:2.0:1734016110.072519:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10638 00000100:00100000:2.0:1734016110.072531:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333608576:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016110.072551:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016110.072575:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114f8e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e539b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1734016110.072596:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 10343365, mtime: 0x675afc6e, atime: 0x675afc6d, ctime: 0x675afc6e, blocks: 0x1c0 00010000:00010000:2.0:1734016110.072617:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016110.072619:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016110.072628:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114f8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e539b expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.072643:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114f8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e539b expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.072656:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016110.073853:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333608576:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1319us (3179us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016110.073864:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10638 00000100:00100000:0.0:1734016110.089588:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016110.090649:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016110.090705:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016110.090750:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333608832 00000100:00100000:0.0:1734016110.090759:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333608832 00002000:00100000:0.0:1734016110.090827:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff8800750d1180 x1818247333608832/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 488/0 e 0 to 0 dl 1734016121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016110.090837:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d1180 with x1818247333608832 ext(0->4194303) 00002000:00010000:0.0:1734016110.090842:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d1180 00000100:00100000:0.0:1734016110.090865:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333609088 00000100:00100000:0.0:1734016110.090867:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333609088 00002000:00100000:0.0:1734016110.090877:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8388608->10346495) req@ffff88007345c380 x1818247333609088/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 488/0 e 0 to 0 dl 1734016121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016110.090883:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345c380 with x1818247333609088 ext(8388608->10346495) 00002000:00010000:0.0:1734016110.090885:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345c380 00000100:00100000:0.0:1734016110.090892:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333608960 00000100:00100000:0.0:1734016110.090894:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333608960 00002000:00100000:0.0:1734016110.090901:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (4194304->8388607) req@ffff88007345e300 x1818247333608960/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 488/0 e 0 to 0 dl 1734016121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016110.090907:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345e300 with x1818247333608960 ext(4194304->8388607) 00002000:00010000:0.0:1734016110.090910:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345e300 00000100:00100000:0.0:1734016110.090918:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8390 00000100:00100000:0.0:1734016110.090925:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333608832:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016110.091612:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8391 00000100:00100000:2.0:1734016110.091619:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333609088:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016110.093344:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8392 00000100:00100000:1.0:1734016110.093359:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333608960:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016110.154703:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333608960:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 61330us (63981us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1734016110.154720:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8392 00002000:00100000:0.0:1734016110.154737:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (4194304->8388607) req@ffff88007345e300 x1818247333608960/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 488/440 e 0 to 0 dl 1734016121 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016110.154748:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345e300 with x1818247333608960 ext(4194304->8388607) 00002000:00010000:0.0:1734016110.154756:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345e300 00000100:00100000:3.0:1734016110.174783:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333609088:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 83145us (84119us total) trans 0 rc 1957888/1957888 00000100:00100000:3.0:1734016110.174823:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8391 00002000:00100000:3.0:1734016110.174840:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (8388608->10346495) req@ffff88007345c380 x1818247333609088/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 488/440 e 0 to 0 dl 1734016121 ref 1 fl Complete:/200/0 rc 1957888/1957888 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016110.174851:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345c380 with x1818247333609088 ext(8388608->10346495) 00002000:00010000:3.0:1734016110.174858:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345c380 00000100:00100000:2.0:1734016110.204492:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333608832:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 113552us (114900us total) trans 0 rc 4194304/4194304 00000100:00100000:2.0:1734016110.204507:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8390 00002000:00100000:2.0:1734016110.204520:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff8800750d1180 x1818247333608832/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 488/440 e 0 to 0 dl 1734016121 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016110.204528:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d1180 with x1818247333608832 ext(0->4194303) 00002000:00010000:2.0:1734016110.204534:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d1180 00000100:00100000:1.0:1734016110.230189:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.230294:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333609344 00000100:00100000:2.0:1734016110.230307:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333609344 00000100:00100000:2.0:1734016110.230357:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10639 00000100:00100000:2.0:1734016110.230365:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333609344:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016110.230389:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016110.230412:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114f95 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e53a2 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.230446:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114f8e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e539b expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.230453:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016110.230455:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016110.230458:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114f95 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53a2 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.230491:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114f8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e539b expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.230504:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114f8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e539b expref: 9 pid: 8216 timeout: 477 lvb_type: 1 00000100:00100000:2.0:1734016110.230516:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335258240:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016110.230588:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016110.234723:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335258240:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016110.234760:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114f95 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53a2 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.234780:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016110.234869:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:9668:x1818247333609344:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4502us (4691us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016110.234878:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10639 00000100:00100000:0.0:1734016110.255410:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.255534:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333609472 00000100:00100000:2.0:1734016110.255545:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333609472 00010000:00010000:2.0:1734016110.255584:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114f8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e539b expref: 9 pid: 8216 timeout: 477 lvb_type: 1 00000100:00100000:2.0:1734016110.255628:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2927 00000100:00100000:2.0:1734016110.255635:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333609472:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016110.255654:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016110.255679:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114f8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e539b expref: 9 pid: 8216 timeout: 477 lvb_type: 1 00010000:00010000:2.0:1734016110.255693:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114f8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e539b expref: 9 pid: 8216 timeout: 477 lvb_type: 1 00010000:00010000:2.0:1734016110.255718:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27114f8e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e539b expref: 9 pid: 8216 timeout: 477 lvb_type: 1 00010000:00010000:2.0:1734016110.255746:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016110.255749:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016110.255757:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114f95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 937984->942079) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53a2 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.255766:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114f95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 937984->942079) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53a2 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.255825:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114f95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 937984->942079) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53a2 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016110.255837:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78ced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335258368:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016110.255893:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016110.268677:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78ced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335258368:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016110.268723:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016110.268848:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333609472:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 13210us (13448us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016110.268865:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2927 00000100:00100000:2.0:1734016110.277963:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016110.278062:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333609728 00000100:00100000:0.0:1734016110.278077:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333609728 00002000:00100000:0.0:1734016110.278131:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (937984->942079) req@ffff8800a78ced80 x1818247333609728/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 488/0 e 0 to 0 dl 1734016121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016110.278142:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78ced80 with x1818247333609728 ext(937984->942079) 00002000:00010000:0.0:1734016110.278148:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78ced80 00000100:00100000:0.0:1734016110.278187:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8393 00000100:00100000:0.0:1734016110.278195:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333609728:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016110.281287:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333609728:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 3068us (3314us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016110.281307:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8393 00002000:00100000:0.0:1734016110.281328:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (937984->942079) req@ffff8800a78ced80 x1818247333609728/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 488/4536 e 0 to 0 dl 1734016121 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016110.281345:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78ced80 with x1818247333609728 ext(937984->942079) 00002000:00010000:0.0:1734016110.281353:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78ced80 00000100:00100000:0.0:1734016110.288579:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.304793:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333609856 00000100:00100000:2.0:1734016110.304832:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333609856 00002000:00100000:2.0:1734016110.304915:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (937984->942079) req@ffff88007345c700 x1818247333609856/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 4584/0 e 0 to 0 dl 1734016121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016110.304928:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345c700 with x1818247333609856 ext(937984->942079) 00002000:00010000:2.0:1734016110.304936:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345c700 00000100:00100000:2.0:1734016110.304987:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8394 00000100:00100000:2.0:1734016110.304998:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333609856:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016110.306186:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333609856:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1185us (17621us total) trans 4294969331 rc 0/0 00000100:00100000:2.0:1734016110.306198:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8394 00002000:00100000:2.0:1734016110.306206:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (937984->942079) req@ffff88007345c700 x1818247333609856/t4294969331(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 4584/448 e 0 to 0 dl 1734016121 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016110.306213:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345c700 with x1818247333609856 ext(937984->942079) 00002000:00010000:2.0:1734016110.306217:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345c700 00000100:00100000:1.0:1734016110.308317:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016110.308414:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333609984 00000100:00100000:0.0:1734016110.308425:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333609984 00000100:00100000:0.0:1734016110.308495:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2130 00000100:00100000:0.0:1734016110.308505:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+38:9668:x1818247333609984:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:0.0:1734016110.308694:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+38:9668:x1818247333609984:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 191us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016110.308702:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2130 00000100:00100000:0.0:1734016110.310728:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.310869:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333610112 00000100:00100000:2.0:1734016110.310880:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333610112 00000100:00100000:2.0:1734016110.310941:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10640 00000100:00100000:2.0:1734016110.310951:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333610112:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:3.0:1734016110.312554:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969331 is committed 00000001:00080000:3.0:1734016110.312575:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969329 is committed 00000100:00100000:2.0:1734016110.312848:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333610112:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 1890us (2129us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016110.312861:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10640 00000100:00100000:0.0:1734016110.314947:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016110.315070:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333610240 00000100:00100000:3.0:1734016110.315081:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333610240 00000100:00100000:3.0:1734016110.315146:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2131 00000100:00100000:3.0:1734016110.315155:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:9668:x1818247333610240:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016110.315183:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016110.315212:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27114f9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e53a9 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.315345:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27114fa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016110.315369:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27114fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016110.315383:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27114fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016110.315413:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 10343365 00000004:00200000:3.0:1734016110.315420:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016110.315444:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27114fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016110.315471:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27114f9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53a9 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.315515:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27114fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53a9 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.315524:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016110.315526:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016110.315530:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016110.315586:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:9668:x1818247333610240:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 431us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016110.315592:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2131 00000100:00100000:1.0:1734016110.318013:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.318156:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333610368 00000100:00100000:2.0:1734016110.318171:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333610368 00000100:00100000:2.0:1734016110.318237:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10641 00000100:00100000:2.0:1734016110.318247:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333610368:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016110.318278:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016110.318308:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114faa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e53b0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016110.318387:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335258496:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016110.318479:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e600 going to sleep for 11 seconds 00002000:00010000:2.0:1734016110.321560:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016109 -> 1734016110 00002000:00010000:2.0:1734016110.321570:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 448 -> 456 00000100:00100000:2.0:1734016110.321596:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335258496:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016110.321632:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114faa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53b0 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.321646:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114faa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53b0 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.321672:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016110.321730:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333610368:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3483us (3735us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016110.321742:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10641 00000100:00100000:0.0:1734016110.325941:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.326066:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333610496 00000100:00100000:2.0:1734016110.326076:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333610496 00000100:00100000:2.0:1734016110.326129:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10642 00000100:00100000:2.0:1734016110.326137:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333610496:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016110.326161:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016110.326186:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114fb1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e53b7 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016110.326245:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335258624:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016110.328439:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016110.340355:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335258624:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016110.340413:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114fb1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53b7 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.340430:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114fb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53b7 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.340450:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016110.340749:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333610496:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 14608us (14821us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016110.340762:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10642 00000100:00100000:3.0:1734016110.347955:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.348109:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333610624 00000100:00100000:2.0:1734016110.348121:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333610624 00000100:00100000:2.0:1734016110.348189:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10643 00000100:00100000:2.0:1734016110.348198:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333610624:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016110.348221:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016110.348242:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114fb8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e53be expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016110.348302:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335258752:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016110.348373:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016110.350699:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335258752:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016110.350734:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114fb8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53be expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.350747:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114fb8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53be expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.350771:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016110.350848:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333610624:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2650us (2914us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016110.350857:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10643 00000100:00100000:1.0:1734016110.355407:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.355506:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333610880 00000100:00100000:2.0:1734016110.355518:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333610880 00000100:00100000:2.0:1734016110.355653:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8395 00000100:00100000:2.0:1734016110.355662:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333610880:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:2.0:1734016110.355709:0:7687:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114fbf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.355729:0:7687:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114f95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 937984->942079) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53a2 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.355737:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016110.355739:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016110.355742:0:7687:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114fbf lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [897024->950271] (req 897024->950271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.355774:0:7687:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114f95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 937984->942079) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53a2 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.355786:0:7687:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114f95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 937984->942079) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53a2 expref: 6 pid: 8216 timeout: 477 lvb_type: 0 00000100:00100000:2.0:1734016110.355815:0:7687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335258880:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016110.358123:0:7687:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e600 going to sleep for 11 seconds 00000100:00100000:3.0:1734016110.363464:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016110.363543:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333611008 00000100:00100000:0.0:1734016110.363554:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333611008 00010000:00010000:0.0:1734016110.363595:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114f95 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 937984->942079) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53a2 expref: 7 pid: 8216 timeout: 477 lvb_type: 0 00000100:00100000:0.0:1734016110.363648:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2928 00000100:00100000:0.0:1734016110.363655:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333611008:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016110.363667:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016110.363689:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114f95 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 937984->942079) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53a2 expref: 7 pid: 8216 timeout: 477 lvb_type: 0 00010000:00010000:0.0:1734016110.363700:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114f95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 937984->942079) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53a2 expref: 7 pid: 8216 timeout: 477 lvb_type: 0 00010000:00010000:0.0:1734016110.363726:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016110.363729:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016110.363733:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114fbf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [897024->950271] (req 897024->950271) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016110.363741:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114fbf lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [897024->950271] (req 897024->950271) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016110.363758:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016110.363841:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333611008:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 186us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016110.363846:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2928 00010000:00010000:2.0:1734016110.365117:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27114f95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 937984->942079) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53a2 expref: 6 pid: 8216 timeout: 477 lvb_type: 0 00000100:00100000:2.0:1734016110.365155:0:7687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335258880:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016110.365185:0:7687:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114fbf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [897024->950271] (req 897024->950271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.365195:0:7687:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114fbf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [897024->950271] (req 897024->950271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.365201:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114fbf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [897024->950271] (req 897024->950271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.376729:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114fbf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [897024->950271] (req 897024->950271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.376753:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114fbf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [897024->950271] (req 897024->950271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.376763:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114fbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [897024->950271] (req 897024->950271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.376771:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc900 already unused, calling callback (ffffffffa080e100) 00010000:00010000:2.0:1734016110.376775:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114fbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [897024->950271] (req 897024->950271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.376784:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114fbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [897024->950271] (req 897024->950271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.376846:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114fbf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [897024->950271] (req 897024->950271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.376853:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27114fbf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [897024->950271] (req 897024->950271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016110.376996:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333610880:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 21326us (21595us total) trans 0 rc 53248/53248 00000100:00100000:2.0:1734016110.377010:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8395 00000100:00100000:1.0:1734016110.383437:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.384427:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333611136 00000100:00100000:2.0:1734016110.384442:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333611136 00000100:00100000:2.0:1734016110.384514:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10644 00000100:00100000:2.0:1734016110.384522:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333611136:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016110.384551:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016110.384577:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114fc6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e53c5 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1734016110.384604:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 10343365, mtime: 0x675afc6e, atime: 0x675afc6d, ctime: 0x675afc6e, blocks: 0x1c8 00010000:00010000:2.0:1734016110.384635:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016110.384638:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016110.384648:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114fc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53c5 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.384666:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114fc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53c5 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.384677:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016110.384751:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333611136:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 229us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016110.384758:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10644 00000100:00100000:1.0:1734016110.398365:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016110.398460:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333611264 00000100:00100000:0.0:1734016110.398472:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333611264 00000100:00100000:0.0:1734016110.398536:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10645 00000100:00100000:0.0:1734016110.398545:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333611264:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016110.398569:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016110.398592:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114fcd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e53cc expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016110.398620:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016110.398622:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016110.398631:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114fcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53cc expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016110.398646:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114fcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53cc expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016110.398663:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581680, rc 0) 00000100:00100000:0.0:1734016110.398724:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333611264:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 180us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016110.398730:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10645 00000100:00100000:3.0:1734016110.412306:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.412416:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333611392 00000100:00100000:2.0:1734016110.412426:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333611392 00000100:00100000:2.0:1734016110.412480:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10646 00000100:00100000:2.0:1734016110.412487:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333611392:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016110.412508:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016110.412529:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114fd4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e53d3 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.412568:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114fc6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53c5 expref: 5 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.412576:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114fcd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53cc expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.412581:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016110.412583:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016110.412586:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114fd4 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7819264->7872511] (req 7819264->7872511) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53d3 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.412615:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114fcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53cc expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.412627:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114fcd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53cc expref: 8 pid: 7683 timeout: 477 lvb_type: 1 00000100:00100000:2.0:1734016110.412639:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335259008:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016110.412721:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114fc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53c5 expref: 5 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.412729:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114fc6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53c5 expref: 5 pid: 8216 timeout: 477 lvb_type: 1 00000100:00100000:2.0:1734016110.412737:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335259136:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016110.412753:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e600 going to sleep for 11 seconds 00000100:00100000:1.0:1734016110.419996:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.420035:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016110.420120:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333611648 00000100:00100000:0.0:1734016110.420130:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333611648 00010000:00010000:0.0:1734016110.420169:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114fc6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53c5 expref: 6 pid: 8216 timeout: 477 lvb_type: 1 00000100:00100000:0.0:1734016110.420206:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333611520 00000100:00100000:0.0:1734016110.420208:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333611520 00010000:00010000:0.0:1734016110.420219:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114fcd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53cc expref: 9 pid: 7683 timeout: 477 lvb_type: 1 00000100:00100000:0.0:1734016110.420236:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2929 00000100:00100000:0.0:1734016110.420244:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333611648:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016110.420262:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016110.420287:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114fc6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53c5 expref: 6 pid: 8216 timeout: 477 lvb_type: 1 00010000:00010000:0.0:1734016110.420298:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114fc6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53c5 expref: 6 pid: 8216 timeout: 477 lvb_type: 1 00010000:00010000:0.0:1734016110.420329:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016110.421210:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335259008:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016110.421225:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27114fc6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53c5 expref: 6 pid: 8216 timeout: 477 lvb_type: 1 00000100:00100000:2.0:1734016110.421248:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335259136:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016110.421282:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114fd4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7819264->7872511] (req 7819264->7872511) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53d3 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.421294:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:1.0:1734016110.422415:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2930 00000100:00100000:1.0:1734016110.422428:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333611520:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016110.422447:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016110.422475:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114fcd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53cc expref: 9 pid: 7683 timeout: 477 lvb_type: 1 00010000:00010000:1.0:1734016110.422488:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114fcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53cc expref: 9 pid: 7683 timeout: 477 lvb_type: 1 00010000:00010000:1.0:1734016110.422511:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27114fcd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53cc expref: 9 pid: 7683 timeout: 477 lvb_type: 1 00010000:00010000:1.0:1734016110.422530:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016110.422532:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016110.422538:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7819264->7872511) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53d3 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.422547:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114fd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7819264->7872511) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53d3 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.422580:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114fd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7819264->7872511) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53d3 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016110.422592:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335259264:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016110.422685:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333611648:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 2439us (2698us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016110.422694:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2929 00000100:00100000:2.0:1734016110.422848:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333611392:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10359us (10553us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016110.422855:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10646 00000100:00100000:1.0:1734016110.423721:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016110.426244:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.426358:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335259264:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016110.426384:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016110.426443:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333611520:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4017us (6406us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016110.426456:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2930 00000100:00100000:3.0:1734016110.426559:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333611776 00000100:00100000:3.0:1734016110.426567:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333611776 00000100:00100000:3.0:1734016110.426614:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10647 00000100:00100000:3.0:1734016110.426625:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333611776:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016110.427071:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10343365 -> 10343365 00002000:00010000:3.0:1734016110.427075:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016110 -> 1734016110 00002000:00010000:3.0:1734016110.427077:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016109 -> 1734016109 00002000:00010000:3.0:1734016110.427079:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016110 -> 1734016110 00002000:00010000:3.0:1734016110.427081:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 456 -> 456 00000100:00100000:3.0:1734016110.427155:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333611776:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 533us (922us total) trans 4294969332 rc 0/0 00000100:00100000:3.0:1734016110.427161:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10647 00000100:00100000:1.0:1734016110.429645:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016110.429720:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333611904 00000100:00100000:0.0:1734016110.429732:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333611904 00000100:00100000:0.0:1734016110.429794:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10648 00000100:00100000:0.0:1734016110.429835:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333611904:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016110.429865:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016110.429891:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27114fdb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e53da expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016110.429967:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335259392:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016110.430044:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eee40 going to sleep for 11 seconds 00002000:00010000:0.0:1734016110.432256:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016109 -> 1734016110 00000100:00100000:0.0:1734016110.432289:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335259392:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016110.432335:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27114fdb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53da expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016110.432351:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27114fdb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53da expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016110.432374:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:0.0:1734016110.432429:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333611904:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2626us (2796us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016110.432439:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10648 00000100:00100000:1.0:1734016110.441992:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016110.442101:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333612032 00000100:00100000:0.0:1734016110.442113:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333612032 00000100:00100000:0.0:1734016110.442175:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10649 00000100:00100000:0.0:1734016110.442183:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333612032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016110.442211:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016110.442235:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27114fe2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e53e1 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016110.442313:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335259520:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016110.442407:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eee40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016110.448708:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335259520:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016110.448757:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27114fe2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53e1 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016110.448773:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27114fe2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53e1 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016110.448839:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016110.448904:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333612032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6720us (6923us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016110.448916:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10649 00000100:00100000:2.0:1734016110.458608:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016110.458880:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333612288 00000100:00100000:0.0:1734016110.458895:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333612288 00000100:00100000:0.0:1734016110.461609:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8396 00000100:00100000:0.0:1734016110.461630:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333612288:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:0.0:1734016110.461691:0:7687:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114fe9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016110.461717:0:7687:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7819264->7872511) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53d3 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016110.461724:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016110.461726:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016110.461729:0:7687:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114fe9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6168576->6217727] (req 6168576->6217727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016110.461766:0:7687:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114fd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7819264->7872511) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53d3 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016110.461779:0:7687:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114fd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7819264->7872511) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53d3 expref: 7 pid: 8216 timeout: 477 lvb_type: 0 00000100:00100000:0.0:1734016110.461792:0:7687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335259648:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016110.461891:0:7687:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eee40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016110.464145:0:7687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335259648:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016110.464178:0:7687:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114fe9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6168576->6217727] (req 6168576->6217727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016110.468345:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016110.468491:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333612416 00000100:00100000:0.0:1734016110.468503:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333612416 00010000:00010000:0.0:1734016110.468551:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114fd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7819264->7872511) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53d3 expref: 8 pid: 8216 timeout: 477 lvb_type: 0 00000100:00100000:0.0:1734016110.468603:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2931 00000100:00100000:0.0:1734016110.468613:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a780a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333612416:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016110.468632:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016110.468663:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114fd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7819264->7872511) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53d3 expref: 8 pid: 8216 timeout: 477 lvb_type: 0 00010000:00010000:0.0:1734016110.468676:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114fd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7819264->7872511) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53d3 expref: 8 pid: 8216 timeout: 477 lvb_type: 0 00010000:00010000:0.0:1734016110.468709:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27114fd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7819264->7872511) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53d3 expref: 8 pid: 8216 timeout: 477 lvb_type: 0 00010000:00010000:0.0:1734016110.469726:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016110.469731:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016110.469738:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6168576->6217727] (req 6168576->6217727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016110.469748:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114fe9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6168576->6217727] (req 6168576->6217727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016110.469789:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016110.469846:0:7687:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6168576->6217727] (req 6168576->6217727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.469855:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6168576->6217727] (req 6168576->6217727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016110.469870:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a780a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333612416:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1255us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016110.469879:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2931 00000001:00080000:2.0:1734016110.475995:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969333 is committed 00000001:00080000:2.0:1734016110.476010:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969332 is committed 00002000:00010000:3.0:1734016110.476127:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 456 -> 552 00010000:00010000:3.0:1734016110.476144:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6168576->6217727] (req 6168576->6217727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.476155:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6168576->6217727] (req 6168576->6217727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.476164:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114fe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6168576->6217727] (req 6168576->6217727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.476171:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581b00 already unused, calling callback (ffffffffa080e100) 00010000:00010000:3.0:1734016110.476175:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114fe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6168576->6217727] (req 6168576->6217727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.476183:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114fe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6168576->6217727] (req 6168576->6217727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.476203:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114fe9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6168576->6217727] (req 6168576->6217727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.476213:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27114fe9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6168576->6217727] (req 6168576->6217727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016110.476330:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333612288:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 14699us (17731us total) trans 4294969333 rc 0/0 00000100:00100000:3.0:1734016110.476342:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8396 00000100:00100000:1.0:1734016110.479199:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016110.479302:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333612544 00000100:00100000:0.0:1734016110.479315:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333612544 00000100:00100000:0.0:1734016110.479375:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10650 00000100:00100000:0.0:1734016110.479383:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333612544:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016110.479407:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016110.479432:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27114ff0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e53e8 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016110.479458:0:7683:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 10343365, mtime: 0x675afc6e, atime: 0x675afc6e, ctime: 0x675afc6e, blocks: 0x228 00010000:00010000:0.0:1734016110.479484:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016110.479486:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016110.479494:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27114ff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53e8 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016110.479510:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27114ff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53e8 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016110.479522:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016110.479582:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333612544:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 199us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016110.479589:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10650 00000100:00100000:2.0:1734016110.481691:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016110.481778:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333612672 00000100:00100000:3.0:1734016110.481787:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333612672 00000100:00100000:3.0:1734016110.481935:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10651 00000100:00100000:3.0:1734016110.481944:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333612672:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016110.481966:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016110.481986:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114ff7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e53ef expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.482010:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016110.482013:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016110.482021:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114ff7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53ef expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016110.482037:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114ff7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53ef expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016110.482055:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016110.482115:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333612672:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 171us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016110.482122:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10651 00000100:00100000:0.0:1734016110.484535:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016110.485229:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333612800 00000100:00100000:3.0:1734016110.485240:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333612800 00000100:00100000:3.0:1734016110.485354:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10652 00000100:00100000:3.0:1734016110.485363:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333612800:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016110.485386:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016110.485406:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27114ffe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e53f6 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.485439:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27114ff0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53e8 expref: 5 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016110.485447:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114ff7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53ef expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016110.485453:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016110.485455:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016110.485458:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27114ffe lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7319552->7352319] (req 7319552->7352319) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53f6 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.485488:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114ff7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53ef expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016110.485500:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114ff7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53ef expref: 8 pid: 8216 timeout: 477 lvb_type: 1 00000100:00100000:3.0:1734016110.485512:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e604e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335259776:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016110.485599:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27114ff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53e8 expref: 5 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016110.485608:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27114ff0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53e8 expref: 5 pid: 7683 timeout: 477 lvb_type: 1 00000100:00100000:3.0:1734016110.485616:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e605f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335259904:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016110.485633:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016110.487318:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e604e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335259776:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016110.487330:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e605f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335259904:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016110.487358:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27114ffe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7319552->7352319] (req 7319552->7352319) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53f6 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016110.487374:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7a80, rc 0) 00000100:00100000:3.0:1734016110.487409:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333612800:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2046us (2886us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016110.487417:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10652 00000100:00100000:0.0:1734016110.487717:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.487873:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333612928 00000100:00100000:1.0:1734016110.487880:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333612928 00010000:00010000:1.0:1734016110.487906:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27114ff0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53e8 expref: 6 pid: 7683 timeout: 477 lvb_type: 1 00000100:00100000:1.0:1734016110.487941:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2932 00000100:00100000:1.0:1734016110.487948:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333612928:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016110.487963:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016110.487984:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27114ff0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53e8 expref: 6 pid: 7683 timeout: 477 lvb_type: 1 00010000:00010000:1.0:1734016110.487994:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27114ff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53e8 expref: 6 pid: 7683 timeout: 477 lvb_type: 1 00010000:00010000:1.0:1734016110.488025:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27114ff0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53e8 expref: 6 pid: 7683 timeout: 477 lvb_type: 1 00010000:00010000:1.0:1734016110.488058:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016110.488075:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.488079:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333612928:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 132us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016110.488085:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2932 00000100:00100000:1.0:1734016110.488099:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333613056 00000100:00100000:1.0:1734016110.488101:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333613056 00010000:00010000:1.0:1734016110.488109:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114ff7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53ef expref: 8 pid: 8216 timeout: 477 lvb_type: 1 00000100:00100000:1.0:1734016110.488123:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2933 00000100:00100000:1.0:1734016110.488127:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333613056:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016110.488135:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016110.488141:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114ff7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53ef expref: 8 pid: 8216 timeout: 477 lvb_type: 1 00010000:00010000:1.0:1734016110.488149:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114ff7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53ef expref: 8 pid: 8216 timeout: 477 lvb_type: 1 00010000:00010000:1.0:1734016110.488160:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27114ff7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53ef expref: 8 pid: 8216 timeout: 477 lvb_type: 1 00010000:00010000:1.0:1734016110.488168:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016110.488170:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016110.488176:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27114ffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7319552->7352319) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53f6 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.488185:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27114ffe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7319552->7352319) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53f6 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.488217:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27114ffe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7319552->7352319) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53f6 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016110.488230:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075608000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335260032:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016110.488388:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016110.490042:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.490155:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075608000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335260032:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016110.490174:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016110.490206:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333613056:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 2077us (2131us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016110.490214:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2933 00000100:00100000:3.0:1734016110.490385:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333613184 00000100:00100000:3.0:1734016110.490392:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333613184 00000100:00100000:3.0:1734016110.490426:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10653 00000100:00100000:3.0:1734016110.490432:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333613184:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016110.490675:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10343365 -> 10343365 00002000:00010000:3.0:1734016110.490679:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016110 -> 1734016110 00002000:00010000:3.0:1734016110.490680:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016110 -> 1734016110 00002000:00010000:3.0:1734016110.490682:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016110 -> 1734016110 00002000:00010000:3.0:1734016110.490684:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 552 -> 616 00000100:00100000:3.0:1734016110.490705:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333613184:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 272us (670us total) trans 4294969334 rc 0/0 00000100:00100000:3.0:1734016110.490712:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10653 00000100:00100000:2.0:1734016110.502604:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.502771:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333613312 00000100:00100000:1.0:1734016110.502785:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333613312 00000100:00100000:1.0:1734016110.503099:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10654 00000100:00100000:1.0:1734016110.503107:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333613312:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016110.503134:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016110.503162:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27115005 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e53fd expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016110.503237:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075608000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335260160:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016110.503326:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016110.509281:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075608000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335260160:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016110.509321:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27115005 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53fd expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016110.509336:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27115005 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53fd expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016110.509364:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016110.509419:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333613312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6312us (6827us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016110.510271:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10654 00010000:00010000:2.0:1734016110.515285:0:6468:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1734016110.515668:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.516015:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333613440 00000100:00100000:1.0:1734016110.516032:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333613440 00000100:00100000:1.0:1734016110.518429:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10655 00000100:00100000:1.0:1734016110.518443:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333613440:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016110.518471:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016110.518492:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc2711500c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5404 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016110.518556:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075608000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335260288:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016110.518636:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016110.525882:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075608000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335260288:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016110.525932:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc2711500c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5404 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016110.525951:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc2711500c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5404 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016110.526128:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016110.526361:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333613440:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7920us (10707us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016110.526371:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10655 00000100:00100000:2.0:1734016110.534112:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.534343:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333613568 00000100:00100000:1.0:1734016110.534354:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333613568 00000100:00100000:1.0:1734016110.534405:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10656 00000100:00100000:1.0:1734016110.534412:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333613568:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016110.534439:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016110.534458:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27115013 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e540b expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016110.534526:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075608000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335260416:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016110.534592:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016110.545561:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075608000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335260416:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016110.545611:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27115013 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e540b expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016110.545627:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27115013 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e540b expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016110.545661:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016110.545727:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333613568:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11312us (11624us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016110.545737:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10656 00000100:00100000:2.0:1734016110.550016:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.550134:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333613696 00000100:00100000:1.0:1734016110.550146:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333613696 00000100:00100000:1.0:1734016110.550203:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10657 00000100:00100000:1.0:1734016110.550213:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333613696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016110.550239:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016110.550261:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc2711501a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5412 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.550297:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27114ffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7319552->7352319) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53f6 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.550311:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016110.550313:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016110.550317:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc2711501a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7499776->7503871] (req 7499776->7503871) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5412 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.550353:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27114ffe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7319552->7352319) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53f6 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.550367:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27114ffe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7319552->7352319) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53f6 expref: 7 pid: 8216 timeout: 477 lvb_type: 0 00000100:00100000:1.0:1734016110.550380:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075608000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335260544:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016110.550456:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016110.556435:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075608000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335260544:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016110.556481:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc2711501a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7499776->7503871] (req 7499776->7503871) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5412 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.556507:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499eac0, rc 0) 00000100:00100000:1.0:1734016110.556602:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333613696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6387us (6602us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016110.556614:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10657 00000100:00100000:2.0:1734016110.558795:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.559488:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333613824 00000100:00100000:1.0:1734016110.559499:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333613824 00010000:00010000:1.0:1734016110.559543:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27114ffe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7319552->7352319) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53f6 expref: 8 pid: 8216 timeout: 477 lvb_type: 0 00000100:00100000:1.0:1734016110.559579:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2934 00000100:00100000:1.0:1734016110.559589:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333613824:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016110.559607:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016110.559630:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27114ffe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7319552->7352319) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53f6 expref: 8 pid: 8216 timeout: 477 lvb_type: 0 00010000:00010000:1.0:1734016110.559642:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27114ffe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7319552->7352319) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53f6 expref: 8 pid: 8216 timeout: 477 lvb_type: 0 00010000:00010000:1.0:1734016110.559668:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27114ffe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7319552->7352319) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53f6 expref: 8 pid: 8216 timeout: 477 lvb_type: 0 00010000:00010000:1.0:1734016110.560727:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016110.560732:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016110.560746:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc2711501a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7499776->7503871) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5412 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.560757:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc2711501a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7499776->7503871) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5412 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.560825:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc2711501a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7499776->7503871) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5412 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016110.560840:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075608000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335260672:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016110.561253:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016110.572396:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075608000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335260672:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016110.572431:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016110.572505:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333613824:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 12915us (13715us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016110.572519:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2934 00000100:00100000:0.0:1734016110.621744:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016110.621791:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.621860:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333614080 00000100:00100000:2.0:1734016110.621871:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333614080 00000100:00100000:0.0:1734016110.621877:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00002000:00100000:2.0:1734016110.621929:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (0->7503871) req@ffff8800750c0380 x1818247333614080/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:71/0 lens 504/0 e 0 to 0 dl 1734016121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016110.621940:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0380 with x1818247333614080 ext(0->7503871) 00002000:00010000:2.0:1734016110.621946:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c0380 00000100:00100000:2.0:1734016110.621968:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333614336 00000100:00100000:2.0:1734016110.621970:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333614336 00002000:00100000:2.0:1734016110.621980:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (8388608->10346495) req@ffff8800750c0700 x1818247333614336/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:71/0 lens 488/0 e 0 to 0 dl 1734016121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016110.621987:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0700 with x1818247333614336 ext(8388608->10346495) 00002000:00010000:2.0:1734016110.621991:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c0700 00000100:00100000:2.0:1734016110.621998:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333614208 00000100:00100000:2.0:1734016110.622000:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333614208 00002000:00100000:2.0:1734016110.622007:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8388607) req@ffff8800750c2300 x1818247333614208/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:71/0 lens 504/0 e 0 to 0 dl 1734016121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016110.622018:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c2300 with x1818247333614208 ext(4190208->8388607) 00002000:00010000:2.0:1734016110.622021:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c2300 00000100:00100000:2.0:1734016110.622029:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8397 00000100:00100000:2.0:1734016110.622035:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333614080:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016110.622923:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8398 00000100:00100000:0.0:1734016110.622934:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333614336:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016110.626166:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8399 00000100:00100000:1.0:1734016110.626183:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333614208:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016110.660317:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333614336:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 37369us (38511us total) trans 0 rc 1957888/1957888 00000100:00100000:0.0:1734016110.660337:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8398 00002000:00100000:0.0:1734016110.660353:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8388608->10346495) req@ffff8800750c0700 x1818247333614336/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:71/0 lens 488/440 e 0 to 0 dl 1734016121 ref 1 fl Complete:/200/0 rc 1957888/1957888 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016110.660363:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0700 with x1818247333614336 ext(8388608->10346495) 00002000:00010000:0.0:1734016110.660371:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c0700 00000100:00100000:2.0:1734016110.690077:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333614080:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 68027us (68332us total) trans 0 rc 4194304/4194304 00000100:00100000:2.0:1734016110.690094:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8397 00002000:00100000:2.0:1734016110.690109:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (0->7503871) req@ffff8800750c0380 x1818247333614080/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:71/0 lens 504/440 e 0 to 0 dl 1734016121 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016110.690119:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0380 with x1818247333614080 ext(0->7503871) 00002000:00010000:2.0:1734016110.690126:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c0380 00000100:00100000:0.0:1734016110.718158:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333614208:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 91966us (96266us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1734016110.718173:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8399 00002000:00100000:0.0:1734016110.718187:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8388607) req@ffff8800750c2300 x1818247333614208/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:71/0 lens 504/440 e 0 to 0 dl 1734016121 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016110.718196:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c2300 with x1818247333614208 ext(4190208->8388607) 00002000:00010000:0.0:1734016110.718203:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c2300 00000100:00100000:1.0:1734016110.746319:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016110.746746:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333614592 00000100:00100000:0.0:1734016110.746760:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333614592 00002000:00100000:0.0:1734016110.746854:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7450624->7503871) req@ffff880075608000 x1818247333614592/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:71/0 lens 488/0 e 0 to 0 dl 1734016121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016110.746864:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075608000 with x1818247333614592 ext(7450624->7503871) 00002000:00010000:0.0:1734016110.746870:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075608000 00000100:00100000:0.0:1734016110.746903:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8400 00000100:00100000:0.0:1734016110.746910:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333614592:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016110.755337:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333614592:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 8407us (9023us total) trans 4294969335 rc 0/0 00000100:00100000:1.0:1734016110.755355:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8400 00002000:00100000:1.0:1734016110.755372:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7450624->7503871) req@ffff880075608000 x1818247333614592/t4294969335(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:71/0 lens 488/448 e 0 to 0 dl 1734016121 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016110.755381:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075608000 with x1818247333614592 ext(7450624->7503871) 00002000:00010000:1.0:1734016110.755389:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075608000 00000100:00100000:3.0:1734016110.756950:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016110.757027:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333614720 00000100:00100000:0.0:1734016110.757049:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333614720 00000100:00100000:0.0:1734016110.757106:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2132 00000100:00100000:0.0:1734016110.757115:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:9668:x1818247333614720:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:0.0:1734016110.757268:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:9668:x1818247333614720:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 154us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016110.757275:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2132 00000100:00100000:2.0:1734016110.763795:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.764300:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333614848 00000100:00100000:1.0:1734016110.764314:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333614848 00000100:00100000:1.0:1734016110.764383:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10658 00000100:00100000:1.0:1734016110.764395:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333614848:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016110.767232:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969335 is committed 00000001:00080000:0.0:1734016110.767253:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969334 is committed 00000100:00100000:1.0:1734016110.767656:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333614848:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 3253us (3867us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016110.767671:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10658 00000100:00100000:1.0:1734016110.776744:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.776904:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333614976 00000100:00100000:2.0:1734016110.776918:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333614976 00000100:00100000:2.0:1734016110.776973:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10659 00000100:00100000:2.0:1734016110.776983:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333614976:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016110.777011:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016110.777050:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115021 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5419 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016110.777126:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335260800:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016110.777207:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00002000:00010000:2.0:1734016110.782925:0:7683:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime: 1734016110 -> 1734016111 00002000:00010000:2.0:1734016110.782937:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016110 -> 1734016111 00002000:00010000:2.0:1734016110.782941:0:7683:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016110 -> 1734016111 00002000:00010000:2.0:1734016110.782943:0:7683:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 616 -> 720 00000100:00100000:2.0:1734016110.782977:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335260800:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016110.783034:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115021 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5419 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.783064:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115021 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5419 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.783112:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016110.783224:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333614976:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6242us (6500us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016110.783236:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10659 00000100:00100000:3.0:1734016110.785280:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.786098:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333615104 00000100:00100000:2.0:1734016110.786112:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333615104 00000100:00100000:2.0:1734016110.786185:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10660 00000100:00100000:2.0:1734016110.786194:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333615104:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016110.786219:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016110.786240:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115028 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5420 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016110.786311:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335260928:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016110.786405:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016110.790270:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335260928:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016110.790316:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115028 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5420 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.790337:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115028 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5420 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.790354:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016110.790426:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333615104:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4231us (5156us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016110.790436:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10660 00000100:00100000:3.0:1734016110.793955:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.794182:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333615360 00000100:00100000:1.0:1734016110.794194:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333615360 00000100:00100000:1.0:1734016110.794274:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8401 00000100:00100000:1.0:1734016110.794282:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333615360:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:1.0:1734016110.794326:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711502f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.794348:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc2711501a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7499776->7503871) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5412 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.794355:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016110.794357:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016110.794360:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711502f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3256320->3268607] (req 3256320->3268607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.794402:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc2711501a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7499776->7503871) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5412 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.794416:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc2711501a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7499776->7503871) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5412 expref: 5 pid: 7683 timeout: 477 lvb_type: 0 00000100:00100000:1.0:1734016110.794431:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335261056:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016110.794497:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016110.798375:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335261056:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016110.798415:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711502f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3256320->3268607] (req 3256320->3268607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016110.817729:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.818224:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333615488 00000100:00100000:1.0:1734016110.818236:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333615488 00010000:00010000:1.0:1734016110.818282:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc2711501a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7499776->7503871) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5412 expref: 6 pid: 7683 timeout: 477 lvb_type: 0 00000100:00100000:1.0:1734016110.818339:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2935 00000100:00100000:1.0:1734016110.818348:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333615488:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016110.818368:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016110.818397:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc2711501a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7499776->7503871) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5412 expref: 6 pid: 7683 timeout: 477 lvb_type: 0 00010000:00010000:1.0:1734016110.818412:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc2711501a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7499776->7503871) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5412 expref: 6 pid: 7683 timeout: 477 lvb_type: 0 00010000:00010000:1.0:1734016110.818445:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc2711501a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7499776->7503871) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5412 expref: 6 pid: 7683 timeout: 477 lvb_type: 0 00010000:00010000:1.0:1734016110.818481:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016110.818484:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016110.818489:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711502f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3256320->3268607] (req 3256320->3268607) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.818499:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711502f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3256320->3268607] (req 3256320->3268607) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.818534:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016110.818600:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333615488:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 251us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016110.818615:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2935 00010000:00010000:1.0:1734016110.818649:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711502f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3256320->3268607] (req 3256320->3268607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.818657:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711502f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3256320->3268607] (req 3256320->3268607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016110.823026:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969336 is committed 00002000:00010000:1.0:1734016110.823203:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 720 -> 744 00010000:00010000:1.0:1734016110.823224:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711502f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3256320->3268607] (req 3256320->3268607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.823237:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711502f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3256320->3268607] (req 3256320->3268607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.823246:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711502f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3256320->3268607] (req 3256320->3268607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.823254:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499dd40 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016110.823259:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711502f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3256320->3268607] (req 3256320->3268607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.823268:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711502f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3256320->3268607] (req 3256320->3268607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.823294:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711502f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3256320->3268607] (req 3256320->3268607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.823300:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711502f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3256320->3268607] (req 3256320->3268607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016110.824120:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333615360:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 29831us (30171us total) trans 4294969336 rc 0/0 00000100:00100000:1.0:1734016110.824133:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8401 00000100:00100000:3.0:1734016110.833682:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.835215:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333615616 00000100:00100000:2.0:1734016110.835232:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333615616 00000100:00100000:2.0:1734016110.835317:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10661 00000100:00100000:2.0:1734016110.835326:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333615616:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016110.835355:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016110.835383:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115036 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5427 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1734016110.835414:0:7683:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 10343365, mtime: 0x675afc6f, atime: 0x675afc6f, ctime: 0x675afc6f, blocks: 0x2e8 00010000:00010000:2.0:1734016110.835439:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016110.835441:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016110.835450:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115036 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5427 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.835469:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115036 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5427 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016110.835481:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016110.835553:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333615616:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 227us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016110.835559:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10661 00000100:00100000:3.0:1734016110.838911:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.839139:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333615744 00000100:00100000:1.0:1734016110.839149:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333615744 00000100:00100000:1.0:1734016110.839206:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10662 00000100:00100000:1.0:1734016110.839213:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333615744:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016110.839235:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016110.839258:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711503d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e542e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.839366:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115036 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5427 expref: 5 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016110.839386:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016110.839389:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016110.839397:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711503d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7122944->7159807] (req 7122944->7159807) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e542e expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.839444:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115036 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5427 expref: 5 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016110.839458:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115036 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5427 expref: 5 pid: 7683 timeout: 477 lvb_type: 1 00000100:00100000:1.0:1734016110.839472:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335261184:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016110.839557:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016110.842305:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335261184:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016110.842339:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711503d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7122944->7159807] (req 7122944->7159807) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e542e expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.842356:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016110.842436:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333615744:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3222us (3647us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016110.842447:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10662 00000100:00100000:3.0:1734016110.852845:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016110.852931:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333615872 00000100:00100000:0.0:1734016110.852940:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333615872 00010000:00010000:0.0:1734016110.852970:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115036 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5427 expref: 6 pid: 7683 timeout: 477 lvb_type: 1 00000100:00100000:0.0:1734016110.853007:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2936 00000100:00100000:0.0:1734016110.853012:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333615872:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016110.853024:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016110.853076:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115036 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5427 expref: 6 pid: 7683 timeout: 477 lvb_type: 1 00010000:00010000:0.0:1734016110.853088:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115036 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5427 expref: 6 pid: 7683 timeout: 477 lvb_type: 1 00010000:00010000:0.0:1734016110.853107:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115036 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5427 expref: 6 pid: 7683 timeout: 477 lvb_type: 1 00010000:00010000:0.0:1734016110.853134:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016110.853136:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016110.853144:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711503d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7122944->7159807) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e542e expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016110.853153:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711503d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7122944->7159807) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e542e expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016110.853189:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711503d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7122944->7159807) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e542e expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016110.853202:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335261312:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016110.853263:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016110.859590:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335261312:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016110.859613:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016110.859668:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333615872:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6654us (6871us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016110.859679:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2936 00000100:00100000:0.0:1734016110.863437:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.863553:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333616000 00000100:00100000:1.0:1734016110.863562:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333616000 00000100:00100000:1.0:1734016110.863617:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10663 00000100:00100000:1.0:1734016110.863627:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333616000:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016110.864202:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10343365 -> 10343365 00002000:00010000:1.0:1734016110.864205:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016111 -> 1734016111 00002000:00010000:1.0:1734016110.864207:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016111 -> 1734016111 00002000:00010000:1.0:1734016110.864209:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016111 -> 1734016111 00002000:00010000:1.0:1734016110.864211:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 744 -> 744 00000100:00100000:1.0:1734016110.864301:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333616000:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 674us (875us total) trans 4294969337 rc 0/0 00000100:00100000:1.0:1734016110.864310:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10663 00000100:00100000:3.0:1734016110.876997:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.877944:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333616256 00000100:00100000:1.0:1734016110.877956:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333616256 00002000:00100000:1.0:1734016110.878006:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3063808->3067903) req@ffff880075e50e00 x1818247333616256/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 488/0 e 0 to 0 dl 1734016121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016110.878017:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50e00 with x1818247333616256 ext(3063808->3067903) 00002000:00010000:1.0:1734016110.878022:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e50e00 00000100:00100000:1.0:1734016110.878422:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8402 00000100:00100000:1.0:1734016110.878429:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333616256:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016110.878789:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333616256:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 357us (1798us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016110.878795:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8402 00002000:00100000:1.0:1734016110.878830:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3063808->3067903) req@ffff880075e50e00 x1818247333616256/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 488/4536 e 0 to 0 dl 1734016121 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016110.878838:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50e00 with x1818247333616256 ext(3063808->3067903) 00002000:00010000:1.0:1734016110.878842:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e50e00 00000100:00100000:2.0:1734016110.893115:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.893850:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333616512 00000100:00100000:1.0:1734016110.893866:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333616512 00002000:00100000:1.0:1734016110.893922:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3059712->3063807) req@ffff8800749e9500 x1818247333616512/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 488/0 e 0 to 0 dl 1734016121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016110.893932:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e9500 with x1818247333616512 ext(3059712->3063807) 00002000:00010000:1.0:1734016110.893938:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e9500 00000100:00100000:1.0:1734016110.893967:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8403 00000100:00100000:1.0:1734016110.893973:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333616512:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016110.895030:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333616512:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1050us (1921us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016110.895048:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8403 00002000:00100000:1.0:1734016110.895057:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3059712->3063807) req@ffff8800749e9500 x1818247333616512/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 488/4536 e 0 to 0 dl 1734016121 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016110.895064:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e9500 with x1818247333616512 ext(3059712->3063807) 00002000:00010000:1.0:1734016110.895068:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e9500 00000100:00100000:0.0:1734016110.902189:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.902302:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333616768 00000100:00100000:1.0:1734016110.902312:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333616768 00002000:00100000:1.0:1734016110.902355:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3055616->3059711) req@ffff8800750c2d80 x1818247333616768/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 488/0 e 0 to 0 dl 1734016121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016110.902364:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c2d80 with x1818247333616768 ext(3055616->3059711) 00002000:00010000:1.0:1734016110.902369:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c2d80 00000100:00100000:1.0:1734016110.902401:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8404 00000100:00100000:1.0:1734016110.902407:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333616768:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016110.902591:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333616768:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 182us (408us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016110.902599:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8404 00002000:00100000:1.0:1734016110.902607:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3055616->3059711) req@ffff8800750c2d80 x1818247333616768/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 488/4536 e 0 to 0 dl 1734016121 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016110.902615:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c2d80 with x1818247333616768 ext(3055616->3059711) 00002000:00010000:1.0:1734016110.902618:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c2d80 00000100:00100000:3.0:1734016110.914476:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.914670:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333617024 00000100:00100000:2.0:1734016110.914684:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333617024 00002000:00100000:2.0:1734016110.914741:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3051520->3055615) req@ffff880075e50a80 x1818247333617024/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 488/0 e 0 to 0 dl 1734016121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016110.914752:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50a80 with x1818247333617024 ext(3051520->3055615) 00002000:00010000:2.0:1734016110.914759:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e50a80 00000100:00100000:2.0:1734016110.914866:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8405 00000100:00100000:2.0:1734016110.914875:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333617024:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016110.915127:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333617024:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 252us (662us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016110.915134:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8405 00002000:00100000:2.0:1734016110.915140:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3051520->3055615) req@ffff880075e50a80 x1818247333617024/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 488/4536 e 0 to 0 dl 1734016121 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016110.915148:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50a80 with x1818247333617024 ext(3051520->3055615) 00002000:00010000:2.0:1734016110.915152:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e50a80 00000100:00100000:3.0:1734016110.929187:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.929293:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333617280 00000100:00100000:1.0:1734016110.929301:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333617280 00002000:00100000:1.0:1734016110.929348:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3047424->3051519) req@ffff880075e51c00 x1818247333617280/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 488/0 e 0 to 0 dl 1734016121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016110.929359:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e51c00 with x1818247333617280 ext(3047424->3051519) 00002000:00010000:1.0:1734016110.929364:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e51c00 00000100:00100000:1.0:1734016110.929398:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8406 00000100:00100000:1.0:1734016110.929405:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333617280:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016110.929557:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333617280:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 151us (380us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016110.929568:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8406 00002000:00100000:1.0:1734016110.929573:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3047424->3051519) req@ffff880075e51c00 x1818247333617280/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:71/0 lens 488/4536 e 0 to 0 dl 1734016121 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016110.929580:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e51c00 with x1818247333617280 ext(3047424->3051519) 00002000:00010000:1.0:1734016110.929583:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e51c00 00000100:00100000:0.0:1734016110.933928:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.934003:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333617408 00000100:00100000:1.0:1734016110.934013:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333617408 00000100:00100000:1.0:1734016110.934085:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10664 00000100:00100000:1.0:1734016110.934092:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333617408:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016110.934113:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016110.934130:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27115044 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5435 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.934161:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711503d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7122944->7159807) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e542e expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.934169:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016110.934171:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016110.934174:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27115044 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1261568->1290239] (req 1261568->1290239) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5435 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.934206:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711503d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7122944->7159807) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e542e expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016110.934217:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711503d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7122944->7159807) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e542e expref: 7 pid: 8216 timeout: 478 lvb_type: 0 00000100:00100000:1.0:1734016110.934235:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335261440:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016110.934308:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016110.940564:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016110.940613:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333617536 00000100:00100000:0.0:1734016110.940621:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333617536 00010000:00010000:0.0:1734016110.940655:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711503d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7122944->7159807) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e542e expref: 8 pid: 8216 timeout: 478 lvb_type: 0 00000100:00100000:1.0:1734016110.940667:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335261440:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016110.940697:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27115044 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1261568->1290239] (req 1261568->1290239) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5435 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016110.940698:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2937 00000100:00100000:0.0:1734016110.940704:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333617536:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016110.940711:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499eac0, rc 0) 00010000:00010000:0.0:1734016110.940716:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016110.940738:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711503d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7122944->7159807) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e542e expref: 8 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:0.0:1734016110.940753:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711503d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7122944->7159807) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e542e expref: 8 pid: 8216 timeout: 478 lvb_type: 0 00000100:00100000:1.0:1734016110.940759:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333617408:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6668us (6840us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016110.940766:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10664 00010000:00010000:0.0:1734016110.940777:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711503d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7122944->7159807) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e542e expref: 8 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:0.0:1734016110.940835:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016110.940837:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016110.940845:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27115044 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1290239) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5435 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016110.940853:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27115044 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1290239) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5435 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016110.940880:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27115044 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1290239) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5435 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016110.940892:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335261568:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016110.940925:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016110.950200:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335261568:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016110.950237:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016110.950292:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333617536:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9585us (9735us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016110.950302:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2937 00000100:00100000:0.0:1734016110.965395:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016110.966349:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333617664 00000100:00100000:1.0:1734016110.966363:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333617664 00000100:00100000:1.0:1734016110.966429:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10665 00000100:00100000:1.0:1734016110.966436:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88009024c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333617664:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016110.966660:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10343365 -> 10343365 00002000:00010000:1.0:1734016110.966663:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016111 -> 1734016111 00002000:00010000:1.0:1734016110.966665:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016111 -> 1734016111 00002000:00010000:1.0:1734016110.966667:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016111 -> 1734016111 00002000:00010000:1.0:1734016110.966668:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 744 -> 744 00000100:00100000:1.0:1734016110.966763:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88009024c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333617664:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 327us (1381us total) trans 4294969338 rc 0/0 00000100:00100000:1.0:1734016110.966769:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10665 00000100:00100000:3.0:1734016110.971189:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.973012:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333617792 00000100:00100000:2.0:1734016110.973027:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333617792 00000100:00100000:2.0:1734016110.973117:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10666 00000100:00100000:2.0:1734016110.973124:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333617792:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016110.973143:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016110.973165:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711504b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e543c expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016110.973227:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335261696:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016110.975151:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016110.978890:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335261696:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016110.978930:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711504b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e543c expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016110.978946:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711504b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e543c expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016110.979432:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:0.0:1734016110.980402:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333617792:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7271us (9216us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016110.980413:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10666 00000100:00100000:0.0:1734016110.985454:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016110.985959:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333618048 00000100:00100000:2.0:1734016110.985969:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333618048 00000100:00100000:2.0:1734016110.986639:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8407 00000100:00100000:2.0:1734016110.986646:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333618048:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:2.0:1734016110.986679:0:14005:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115052 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.986693:0:14005:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27115044 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1290239) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5435 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.986699:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016110.986701:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016110.986703:0:14005:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115052 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [9011200->9068543] (req 9011200->9068543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.986730:0:14005:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27115044 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1290239) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5435 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016110.986741:0:14005:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27115044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1290239) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5435 expref: 6 pid: 8216 timeout: 478 lvb_type: 0 00000100:00100000:2.0:1734016110.986755:0:14005:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14005:1818247335261824:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016110.987256:0:14005:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016110.992007:0:14005:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14005:1818247335261824:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016110.992055:0:14005:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115052 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [9011200->9068543] (req 9011200->9068543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016111.001378:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.002454:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333618176 00000100:00100000:2.0:1734016111.002466:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333618176 00010000:00010000:2.0:1734016111.002501:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27115044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5435 expref: 7 pid: 8216 timeout: 478 lvb_type: 0 00000100:00100000:2.0:1734016111.002539:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2938 00000100:00100000:2.0:1734016111.002545:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a780b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333618176:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016111.002556:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016111.002579:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27115044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5435 expref: 7 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:2.0:1734016111.002590:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27115044 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->1290239) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5435 expref: 7 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:2.0:1734016111.002616:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27115044 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->1290239) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5435 expref: 7 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:2.0:1734016111.002650:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016111.002652:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016111.002656:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115052 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [9011200->9068543] (req 9011200->9068543) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.002664:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115052 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [9011200->9068543] (req 9011200->9068543) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.002690:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016111.002758:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a780b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333618176:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 211us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016111.002765:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2938 00010000:00010000:2.0:1734016111.002887:0:14005:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115052 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9011200->9068543] (req 9011200->9068543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.002895:0:14005:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115052 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9011200->9068543] (req 9011200->9068543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.014528:0:14005:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115052 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9011200->9068543] (req 9011200->9068543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.014545:0:14005:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115052 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9011200->9068543] (req 9011200->9068543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.014553:0:14005:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115052 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9011200->9068543] (req 9011200->9068543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.014559:0:14005:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc480 already unused, calling callback (ffffffffa080e100) 00010000:00010000:2.0:1734016111.014563:0:14005:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115052 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9011200->9068543] (req 9011200->9068543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.014570:0:14005:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115052 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9011200->9068543] (req 9011200->9068543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.014586:0:14005:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115052 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9011200->9068543] (req 9011200->9068543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.014591:0:14005:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115052 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9011200->9068543] (req 9011200->9068543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016111.015635:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333618048:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 28982us (30182us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1734016111.015647:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8407 00000100:00100000:0.0:1734016111.033047:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.033158:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333618304 00000100:00100000:2.0:1734016111.033171:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333618304 00000100:00100000:2.0:1734016111.033240:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10667 00000100:00100000:2.0:1734016111.033247:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333618304:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016111.033263:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016111.033280:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115059 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5443 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1734016111.033302:0:7683:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 10343365, mtime: 0x675afc6f, atime: 0x675afc6f, ctime: 0x675afc6f, blocks: 0x2e8 00010000:00010000:2.0:1734016111.033319:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016111.033321:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016111.033327:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5443 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016111.033340:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5443 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016111.033350:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd440, rc 0) 00000100:00100000:2.0:1734016111.033420:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333618304:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 172us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016111.033425:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10667 00000100:00100000:0.0:1734016111.043296:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.043410:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333618432 00000100:00100000:1.0:1734016111.043421:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333618432 00000100:00100000:1.0:1734016111.043511:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10668 00000100:00100000:1.0:1734016111.043521:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333618432:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016111.043546:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016111.043570:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27115060 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e544a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016111.043603:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115059 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5443 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016111.043610:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016111.043612:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016111.043616:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27115060 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4485120->4538367] (req 4485120->4538367) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e544a expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016111.043656:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5443 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016111.043672:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115059 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5443 expref: 6 pid: 7683 timeout: 478 lvb_type: 1 00000100:00100000:1.0:1734016111.043685:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335261952:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016111.043763:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fb40 going to sleep for 11 seconds 00000100:00080000:2.0:1734016111.044130:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016081 00000100:00100000:1.0:1734016111.048951:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335261952:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016111.048987:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27115060 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4485120->4538367] (req 4485120->4538367) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e544a expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016111.049013:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016111.049092:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333618432:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5572us (5809us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016111.049103:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10668 00000100:00100000:0.0:1734016111.049925:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.050217:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333618560 00000100:00100000:1.0:1734016111.050227:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333618560 00010000:00010000:1.0:1734016111.050256:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115059 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5443 expref: 7 pid: 7683 timeout: 478 lvb_type: 1 00000100:00100000:1.0:1734016111.050782:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2939 00000100:00100000:1.0:1734016111.050791:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333618560:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016111.050839:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016111.051381:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115059 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5443 expref: 7 pid: 7683 timeout: 478 lvb_type: 1 00010000:00010000:1.0:1734016111.051397:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5443 expref: 7 pid: 7683 timeout: 478 lvb_type: 1 00010000:00010000:1.0:1734016111.051422:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115059 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5443 expref: 7 pid: 7683 timeout: 478 lvb_type: 1 00010000:00010000:1.0:1734016111.051604:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016111.051607:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016111.051615:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27115060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4485120->4538367) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e544a expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016111.051630:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27115060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4485120->4538367) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e544a expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016111.051668:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27115060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4485120->4538367) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e544a expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016111.051680:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335262080:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016111.051748:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016111.059873:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335262080:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016111.059900:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016111.059955:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333618560:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9164us (10032us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016111.059970:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2939 00000100:00100000:0.0:1734016111.060945:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.061454:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333618688 00000100:00100000:1.0:1734016111.061464:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333618688 00000100:00100000:1.0:1734016111.061516:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10669 00000100:00100000:1.0:1734016111.061524:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333618688:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016111.061791:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10343365 -> 10343365 00002000:00010000:1.0:1734016111.061794:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016111 -> 1734016111 00002000:00010000:1.0:1734016111.061796:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016111 -> 1734016111 00002000:00010000:1.0:1734016111.061833:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016111 -> 1734016111 00002000:00010000:1.0:1734016111.061836:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 744 -> 744 00000100:00100000:0.0:1734016111.062426:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333618688:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 900us (1481us total) trans 4294969339 rc 0/0 00000100:00100000:0.0:1734016111.062434:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10669 00000100:00100000:0.0:1734016111.066196:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.067819:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333618816 00000100:00100000:2.0:1734016111.067837:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333618816 00000100:00100000:2.0:1734016111.067908:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10670 00000100:00100000:2.0:1734016111.067918:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333618816:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016111.067954:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016111.067984:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27115067 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5451 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016111.068079:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335262208:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016111.068177:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016111.072489:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.072544:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.072586:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.072752:0:6475:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333618944 00000100:00100000:2.0:1734016111.072763:0:6475:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333618944 00000100:00100000:2.0:1734016111.072850:0:6475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 322 00000100:00100000:2.0:1734016111.072858:0:6475:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7612c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99867e87-1bc2-4e49-bd45-a757ae2fdd76+12:1981:x1818247333618944:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1734016111.072975:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333619072 00000100:00100000:3.0:1734016111.072979:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333619072 00000100:00100000:3.0:1734016111.073014:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 216 00000100:00100000:3.0:1734016111.073019:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+38:1981:x1818247333619072:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1734016111.073187:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333619200 00000100:00100000:1.0:1734016111.073192:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333619200 00000100:00100000:1.0:1734016111.073224:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 154 00000100:00100000:1.0:1734016111.073228:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333619200:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1734016111.073777:0:6475:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7612c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99867e87-1bc2-4e49-bd45-a757ae2fdd76+12:1981:x1818247333618944:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 917us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016111.073787:0:6475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 322 00000100:00080000:2.0:1734016111.073851:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016081 00000100:00080000:2.0:1734016111.073855:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016081 00000100:00080000:2.0:1734016111.073857:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016081 00000100:00100000:3.0:1734016111.073934:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+38:1981:x1818247333619072:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 912us (1458us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016111.073940:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 216 00000100:00100000:1.0:1734016111.075265:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333619200:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 2030us (2672us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016111.075277:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 154 00000100:00100000:3.0:1734016111.075425:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335262208:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016111.075474:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27115067 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5451 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016111.075503:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27115067 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5451 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016111.075536:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd680, rc 0) 00000100:00100000:3.0:1734016111.075579:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333618816:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7663us (9399us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016111.075586:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10670 00000100:00100000:0.0:1734016111.081945:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.082067:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333619328 00000100:00100000:3.0:1734016111.082079:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333619328 00000100:00100000:3.0:1734016111.082288:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10671 00000100:00100000:3.0:1734016111.082297:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333619328:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016111.082324:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016111.082346:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc2711506e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5458 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016111.082419:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335262336:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016111.082700:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016111.091725:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335262336:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016111.091774:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc2711506e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5458 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016111.091791:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc2711506e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5458 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016111.091936:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7a80, rc 0) 00000100:00100000:3.0:1734016111.092156:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333619328:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9857us (10222us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016111.092167:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10671 00000100:00100000:0.0:1734016111.094247:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.095194:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333619584 00000100:00100000:3.0:1734016111.095205:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333619584 00000100:00100000:3.0:1734016111.096001:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2133 00000100:00100000:3.0:1734016111.096009:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:9668:x1818247333619584:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016111.096081:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016111.096117:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27114fa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e53a9 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1734016111.097063:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016081 00010000:00010000:3.0:1734016111.098937:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016111.098949:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016111.099214:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27115075 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016111.099237:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114f79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e538d expref: 37 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016111.099245:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27115075 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016111.099295:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e538d expref: 37 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016111.099314:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114f79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e538d expref: 37 pid: 6478 timeout: 478 lvb_type: 0 00000100:00100000:3.0:1734016111.099330:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335262464:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016111.099429:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016111.105319:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335262464:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016111.105357:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27115075 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016111.106296:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.107619:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333619712 00000100:00100000:1.0:1734016111.107637:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333619712 00010000:00010000:1.0:1734016111.107711:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114f79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e538d expref: 38 pid: 6478 timeout: 478 lvb_type: 0 00000100:00100000:1.0:1734016111.108291:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2940 00000100:00100000:1.0:1734016111.108303:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+38:1981:x1818247333619712:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016111.108328:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016111.108336:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114f79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e538d expref: 38 pid: 6478 timeout: 478 lvb_type: 0 00010000:00010000:1.0:1734016111.108352:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e538d expref: 38 pid: 6478 timeout: 478 lvb_type: 0 00010000:00010000:1.0:1734016111.108386:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27114f79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e538d expref: 38 pid: 6478 timeout: 478 lvb_type: 0 00010000:00010000:1.0:1734016111.108423:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016111.108429:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27115075 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016111.108441:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27115075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016111.108454:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27115075 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016111.108482:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016111.108559:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+37:1981:x1818247333619712:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 257us (2265us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016111.108568:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2940 00010000:00010000:0.0:1734016111.110758:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27115075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016111.110775:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27115075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:0.0:1734016111.111377:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968672 00000004:00010000:0.0:1734016111.111435:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800750c1500 reply state ffff880075708000 transno 4294968673 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27115075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016111.111443:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016111.111559:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:9668:x1818247333619584:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 15545us (17316us total) trans 4294968673 rc 0/0 00000100:00100000:0.0:1734016111.111570:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2133 00000020:00080000:0.0:1734016111.111577:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016111.114689:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27115075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016111.114707:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27115075 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016111.114714:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27115075 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016111.114719:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df73c0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016111.114725:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27115075 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016111.114733:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27115075 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016111.114752:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016111.114755:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016111.114759:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27115075 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016111.114764:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27115075 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016111.115325:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.115426:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333619840 00000100:00100000:3.0:1734016111.115439:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333619840 00000100:00100000:3.0:1734016111.115531:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10672 00000100:00100000:3.0:1734016111.115541:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333619840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016111.115566:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016111.115587:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc2711507c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e545f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016111.115617:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27115060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4485120->4538367) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e544a expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016111.115624:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016111.115626:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016111.115630:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc2711507c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e545f expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016111.115669:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27115060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4485120->4538367) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e544a expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016111.115683:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27115060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4485120->4538367) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e544a expref: 8 pid: 8216 timeout: 478 lvb_type: 0 00000100:00100000:3.0:1734016111.115699:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335262592:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016111.116602:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016111.120898:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335262592:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016111.120953:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc2711507c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e545f expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016111.120980:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4b40, rc 0) 00000100:00100000:3.0:1734016111.121076:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333619840:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5534us (5754us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016111.121090:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10672 00000100:00100000:0.0:1734016111.121610:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.121924:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333619968 00000100:00100000:3.0:1734016111.121935:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333619968 00010000:00010000:3.0:1734016111.121970:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27115060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4485120->4538367) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e544a expref: 9 pid: 8216 timeout: 478 lvb_type: 0 00000100:00100000:3.0:1734016111.122553:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2941 00000100:00100000:3.0:1734016111.122562:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333619968:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016111.122580:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016111.122605:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27115060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4485120->4538367) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e544a expref: 9 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:3.0:1734016111.122618:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27115060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4485120->4538367) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e544a expref: 9 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:3.0:1734016111.122653:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27115060 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4485120->4538367) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e544a expref: 9 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:3.0:1734016111.122689:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016111.122692:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016111.122698:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc2711507c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e545f expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016111.122707:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc2711507c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e545f expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016111.122751:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc2711507c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e545f expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016111.122767:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e51f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335262720:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016111.122917:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016111.137152:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e51f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335262720:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016111.137185:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016111.137270:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333619968:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 14706us (15661us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016111.137282:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2941 00000100:00100000:0.0:1734016111.140387:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.148369:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333620096 00000100:00100000:2.0:1734016111.148382:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333620096 00002000:00010000:2.0:1734016111.148424:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (140255->18446744073709551615) 00002000:00100000:2.0:1734016111.148428:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d2d80 with x1818247333620096 ext(140255->18446744073709551615) 00002000:00010000:2.0:1734016111.148440:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d2d80. 00000100:00100000:2.0:1734016111.148498:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8408 00000100:00100000:2.0:1734016111.148506:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333620096:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016111.162998:0:14005:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10343365 -> 140255 00002000:00010000:3.0:1734016111.163006:0:14005:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016111 -> 1734016111 00002000:00010000:3.0:1734016111.163008:0:14005:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016111 -> 1734016111 00002000:00010000:3.0:1734016111.163009:0:14005:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016111 -> 1734016111 00002000:00010000:3.0:1734016111.163012:0:14005:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 744 -> 192 00000100:00100000:3.0:1734016111.163103:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333620096:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 14591us (22719us total) trans 4294969340 rc 0/0 00000100:00100000:3.0:1734016111.163114:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8408 00002000:00010000:3.0:1734016111.163120:0:14005:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (140255->18446744073709551615) 00002000:00100000:3.0:1734016111.163123:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d2d80 with x1818247333620096 ext(140255->18446744073709551615) 00002000:00010000:3.0:1734016111.163128:0:14005:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d2d80. 00000100:00100000:0.0:1734016111.175080:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.175162:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333620224 00000100:00100000:2.0:1734016111.175170:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333620224 00000100:00100000:2.0:1734016111.175210:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2134 00000100:00100000:2.0:1734016111.175217:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:9668:x1818247333620224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016111.175238:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016111.175259:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115083 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5466 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.175343:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711508a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016111.175358:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711508a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016111.175370:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711508a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016111.175393:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 140255 00000004:00200000:2.0:1734016111.175396:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016111.175409:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711508a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016111.175430:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115083 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5466 expref: 25 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.175463:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711508a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5466 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.175470:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016111.175473:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016111.175476:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd440, rc 0) 00000100:00100000:2.0:1734016111.175528:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:9668:x1818247333620224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 311us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016111.175534:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2134 00000100:00100000:0.0:1734016111.181929:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.183652:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333620352 00000100:00100000:3.0:1734016111.183671:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333620352 00000100:00100000:3.0:1734016111.183756:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10673 00000100:00100000:3.0:1734016111.183766:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333620352:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016111.183832:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016111.183854:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27115091 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e546d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016111.183934:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335262848:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016111.184050:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016111.195892:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335262848:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016111.195940:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27115091 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e546d expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016111.195956:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27115091 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e546d expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016111.195986:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df58c0, rc 0) 00000100:00100000:2.0:1734016111.196152:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333620352:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12372us (14219us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016111.196165:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10673 00000100:00100000:0.0:1734016111.200135:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.200234:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333620480 00000100:00100000:2.0:1734016111.200243:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333620480 00000100:00100000:2.0:1734016111.200362:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10674 00000100:00100000:2.0:1734016111.200371:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333620480:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016111.200399:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016111.200419:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115098 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5474 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.200449:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc2711507c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e545f expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.200456:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016111.200458:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016111.200461:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115098 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5474 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.200493:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc2711507c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e545f expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.200504:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc2711507c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e545f expref: 7 pid: 8216 timeout: 478 lvb_type: 0 00000100:00100000:2.0:1734016111.200516:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335262976:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016111.201287:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016111.206605:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335262976:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016111.206644:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115098 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5474 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.206664:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016111.206727:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:9668:x1818247333620480:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6357us (6603us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016111.206738:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10674 00000100:00100000:0.0:1734016111.207058:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.207223:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333620608 00000100:00100000:3.0:1734016111.207234:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333620608 00010000:00010000:3.0:1734016111.207266:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc2711507c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e545f expref: 8 pid: 8216 timeout: 478 lvb_type: 0 00000100:00100000:3.0:1734016111.207304:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2942 00000100:00100000:3.0:1734016111.207312:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333620608:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016111.207331:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016111.207358:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc2711507c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e545f expref: 8 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:3.0:1734016111.207369:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc2711507c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e545f expref: 8 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:3.0:1734016111.207394:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc2711507c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e545f expref: 8 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:3.0:1734016111.207409:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016111.207412:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016111.207419:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115098 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 126976->131071) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5474 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016111.207427:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115098 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 126976->131071) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5474 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016111.207460:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115098 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 126976->131071) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5474 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016111.207475:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e51f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335263104:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016111.207535:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb840 going to sleep for 11 seconds 00000100:00100000:2.0:1734016111.213070:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e51f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335263104:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016111.213096:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016111.213137:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333620608:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5825us (6080us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016111.213148:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2942 00000100:00100000:1.0:1734016111.215079:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.215185:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333620864 00000100:00100000:3.0:1734016111.215193:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333620864 00002000:00100000:3.0:1734016111.215234:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (0->143359) req@ffff880073ad4700 x1818247333620864/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.215244:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4700 with x1818247333620864 ext(0->143359) 00002000:00010000:3.0:1734016111.215249:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4700 00000100:00100000:3.0:1734016111.215268:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8409 00000100:00100000:3.0:1734016111.215275:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333620864:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016111.223168:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333620864:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 7884us (8088us total) trans 0 rc 143360/143360 00000100:00100000:3.0:1734016111.223180:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8409 00002000:00100000:3.0:1734016111.223190:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (0->143359) req@ffff880073ad4700 x1818247333620864/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:72/0 lens 488/440 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 143360/143360 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.223199:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4700 with x1818247333620864 ext(0->143359) 00002000:00010000:3.0:1734016111.223205:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4700 00000100:00100000:0.0:1734016111.234933:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.235868:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333620992 00000100:00100000:2.0:1734016111.235883:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333620992 00000100:00100000:2.0:1734016111.235959:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10675 00000100:00100000:2.0:1734016111.235968:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333620992:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016111.235991:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016111.236013:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711509f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e547b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.236049:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016111.236051:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016111.236058:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711509f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e547b expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016111.236074:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711509f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e547b expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016111.236084:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016111.236155:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333620992:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 189us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016111.236161:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10675 00000100:00100000:0.0:1734016111.241778:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.242066:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333621120 00000100:00100000:2.0:1734016111.242078:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333621120 00000100:00100000:2.0:1734016111.242157:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2135 00000100:00100000:2.0:1734016111.242167:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+37:9668:x1818247333621120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016111.242198:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016111.242225:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271150a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5482 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.242349:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271150ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016111.242365:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271150ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016111.242378:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271150ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:2.0:1734016111.242405:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 140255 00000004:00200000:2.0:1734016111.242409:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016111.242428:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271150ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016111.242452:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271150a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5482 expref: 39 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.242476:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271150ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5482 expref: 38 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.242485:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016111.242487:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016111.242491:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016111.242548:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+38:9668:x1818247333621120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 382us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016111.242555:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2135 00000100:00100000:0.0:1734016111.255064:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.255216:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333621376 00000100:00100000:3.0:1734016111.255227:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333621376 00000100:00100000:1.0:1734016111.256609:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8410 00000100:00100000:1.0:1734016111.256619:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333621376:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:1.0:1734016111.256667:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271150b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016111.256689:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115098 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 126976->131071) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5474 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016111.256699:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711509f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e547b expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016111.256706:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016111.256708:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016111.256711:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271150b4 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [6959104->7020543] (req 6959104->7020543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016111.256748:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711509f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e547b expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016111.256766:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711509f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e547b expref: 7 pid: 8216 timeout: 478 lvb_type: 1 00000100:00100000:1.0:1734016111.256779:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335263232:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016111.258684:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115098 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 126976->131071) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5474 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016111.258708:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115098 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 126976->131071) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5474 expref: 9 pid: 8216 timeout: 478 lvb_type: 0 00000100:00100000:1.0:1734016111.258726:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335263360:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016111.258791:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016111.262586:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335263232:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016111.263080:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335263360:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016111.263119:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271150b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [6959104->7020543] (req 6959104->7020543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016111.263582:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.263616:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.263688:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333621504 00000100:00100000:2.0:1734016111.263697:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333621504 00010000:00010000:2.0:1734016111.263739:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711509f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e547b expref: 8 pid: 8216 timeout: 478 lvb_type: 1 00000100:00100000:2.0:1734016111.263792:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333621632 00000100:00100000:2.0:1734016111.263794:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333621632 00010000:00010000:2.0:1734016111.263832:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115098 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 126976->131071) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5474 expref: 10 pid: 8216 timeout: 478 lvb_type: 0 00000100:00100000:2.0:1734016111.263850:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2943 00000100:00100000:2.0:1734016111.263860:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333621504:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016111.263885:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016111.263918:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711509f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e547b expref: 8 pid: 8216 timeout: 478 lvb_type: 1 00010000:00010000:2.0:1734016111.263930:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711509f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e547b expref: 8 pid: 8216 timeout: 478 lvb_type: 1 00010000:00010000:2.0:1734016111.263965:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711509f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e547b expref: 8 pid: 8216 timeout: 478 lvb_type: 1 00010000:00010000:2.0:1734016111.263991:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016111.264056:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333621504:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 197us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016111.264065:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2943 00000100:00100000:2.0:1734016111.264081:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2944 00000100:00100000:2.0:1734016111.264084:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333621632:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016111.264095:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016111.264102:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115098 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 126976->131071) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5474 expref: 10 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:2.0:1734016111.264111:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115098 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 126976->131071) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5474 expref: 10 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:2.0:1734016111.264125:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115098 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 126976->131071) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5474 expref: 10 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:2.0:1734016111.264134:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016111.264136:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016111.264142:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271150b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6959104->7020543] (req 6959104->7020543) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.264152:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271150b4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6959104->7020543] (req 6959104->7020543) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.264174:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016111.264191:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333621632:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 105us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016111.264197:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2944 00010000:00010000:1.0:1734016111.264524:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271150b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6959104->7020543] (req 6959104->7020543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016111.264533:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271150b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6959104->7020543] (req 6959104->7020543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016111.323883:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969341 is committed 00000001:00080000:0.0:1734016111.323918:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969340 is committed 00002000:00010000:1.0:1734016111.324026:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 140255 -> 7020544 00002000:00010000:1.0:1734016111.324045:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 192 -> 312 00010000:00010000:1.0:1734016111.324060:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271150b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6959104->7020543] (req 6959104->7020543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016111.324072:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271150b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6959104->7020543] (req 6959104->7020543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016111.324079:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271150b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6959104->7020543] (req 6959104->7020543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016111.324084:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499c900 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016111.324088:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271150b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6959104->7020543] (req 6959104->7020543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016111.324095:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271150b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6959104->7020543] (req 6959104->7020543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016111.324114:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271150b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6959104->7020543] (req 6959104->7020543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016111.324118:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271150b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6959104->7020543] (req 6959104->7020543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016111.324224:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333621376:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 67601us (69168us total) trans 4294969341 rc 0/0 00000100:00100000:1.0:1734016111.324234:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8410 00000100:00100000:2.0:1734016111.329417:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.329533:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333621760 00000100:00100000:1.0:1734016111.329548:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333621760 00000100:00100000:1.0:1734016111.329618:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10676 00000100:00100000:1.0:1734016111.329626:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333621760:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016111.329643:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016111.329663:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271150bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5489 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016111.329682:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 7020544, mtime: 0x675afc6f, atime: 0x675afc6f, ctime: 0x675afc6f, blocks: 0x138 00010000:00010000:1.0:1734016111.329698:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016111.329700:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016111.329707:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271150bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5489 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016111.329720:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271150bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5489 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016111.329730:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016111.329792:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333621760:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 165us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016111.329829:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10676 00000100:00100000:0.0:1734016111.334984:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.338159:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333621888 00000100:00100000:1.0:1734016111.338179:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333621888 00000100:00100000:1.0:1734016111.338262:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10677 00000100:00100000:1.0:1734016111.338270:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333621888:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016111.338299:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016111.338330:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271150c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5490 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016111.338361:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016111.338365:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016111.338376:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271150c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5490 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016111.338395:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271150c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5490 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016111.338405:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016111.338496:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333621888:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 225us (3526us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016111.338503:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10677 00000100:00100000:0.0:1734016111.350981:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.351109:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333622016 00000100:00100000:2.0:1734016111.351121:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333622016 00000100:00100000:2.0:1734016111.351187:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10678 00000100:00100000:2.0:1734016111.351195:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333622016:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016111.351219:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016111.351244:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271150c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5497 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.351285:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271150bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5489 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016111.351294:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271150c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5490 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016111.351301:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016111.351304:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016111.351308:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271150c9 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2486272->2490367] (req 2486272->2490367) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5497 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.351344:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271150c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5490 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016111.351360:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271150c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5490 expref: 7 pid: 7684 timeout: 478 lvb_type: 1 00000100:00100000:2.0:1734016111.351375:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335263488:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016111.351461:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271150bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5489 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016111.351475:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271150bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5489 expref: 6 pid: 7684 timeout: 478 lvb_type: 1 00000100:00100000:2.0:1734016111.351484:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335263616:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016111.351503:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016111.353197:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335263488:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016111.353212:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335263616:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016111.353240:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271150c9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2486272->2490367] (req 2486272->2490367) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5497 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.353259:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016111.353319:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333622016:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2124us (2353us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016111.353331:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10678 00000100:00100000:0.0:1734016111.358613:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.358673:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.358771:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333622272 00000100:00100000:3.0:1734016111.358781:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333622272 00010000:00010000:3.0:1734016111.358847:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271150bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5489 expref: 7 pid: 7684 timeout: 478 lvb_type: 1 00000100:00100000:3.0:1734016111.358883:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333622144 00000100:00100000:3.0:1734016111.358886:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333622144 00010000:00010000:3.0:1734016111.358896:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271150c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5490 expref: 7 pid: 7684 timeout: 478 lvb_type: 1 00000100:00100000:3.0:1734016111.358913:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2945 00000100:00100000:3.0:1734016111.358920:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a780b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333622272:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016111.358934:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016111.358955:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271150bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5489 expref: 7 pid: 7684 timeout: 478 lvb_type: 1 00010000:00010000:3.0:1734016111.358966:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271150bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5489 expref: 7 pid: 7684 timeout: 478 lvb_type: 1 00010000:00010000:3.0:1734016111.358990:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271150bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5489 expref: 7 pid: 7684 timeout: 478 lvb_type: 1 00010000:00010000:3.0:1734016111.359011:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016111.359065:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a780b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333622272:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 144us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016111.359072:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2945 00000100:00100000:3.0:1734016111.359113:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2946 00000100:00100000:3.0:1734016111.359117:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333622144:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016111.359123:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016111.359129:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271150c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5490 expref: 7 pid: 7684 timeout: 478 lvb_type: 1 00010000:00010000:3.0:1734016111.359138:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271150c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5490 expref: 7 pid: 7684 timeout: 478 lvb_type: 1 00010000:00010000:3.0:1734016111.359153:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271150c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5490 expref: 7 pid: 7684 timeout: 478 lvb_type: 1 00010000:00010000:3.0:1734016111.359161:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016111.359163:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016111.359169:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271150c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2490367) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5497 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016111.359178:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271150c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2490367) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5497 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016111.359210:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271150c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2490367) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5497 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016111.359221:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e53b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335263744:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016111.359248:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016111.361046:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e53b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335263744:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016111.361068:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016111.361102:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333622144:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1982us (2427us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016111.361112:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2946 00000100:00100000:3.0:1734016111.361554:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.361622:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333622528 00000100:00100000:1.0:1734016111.361629:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333622528 00002000:00100000:1.0:1734016111.361665:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2486272->2490367) req@ffff880075e53b80 x1818247333622528/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.361675:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e53b80 with x1818247333622528 ext(2486272->2490367) 00002000:00010000:1.0:1734016111.361680:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e53b80 00000100:00100000:1.0:1734016111.361706:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8411 00000100:00100000:1.0:1734016111.361712:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333622528:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016111.361897:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333622528:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 184us (344us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016111.361904:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8411 00002000:00100000:1.0:1734016111.361909:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2486272->2490367) req@ffff880075e53b80 x1818247333622528/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.361916:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e53b80 with x1818247333622528 ext(2486272->2490367) 00002000:00010000:1.0:1734016111.361919:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e53b80 00000100:00100000:0.0:1734016111.364374:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.364474:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333622784 00000100:00100000:3.0:1734016111.364483:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333622784 00002000:00100000:3.0:1734016111.364526:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2482176->2486271) req@ffff88012b15d880 x1818247333622784/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.364542:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15d880 with x1818247333622784 ext(2482176->2486271) 00002000:00010000:3.0:1734016111.364547:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15d880 00000100:00100000:3.0:1734016111.364582:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8412 00000100:00100000:3.0:1734016111.364588:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333622784:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016111.364941:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333622784:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 352us (576us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016111.364948:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8412 00002000:00100000:3.0:1734016111.364954:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2482176->2486271) req@ffff88012b15d880 x1818247333622784/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.364961:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15d880 with x1818247333622784 ext(2482176->2486271) 00002000:00010000:3.0:1734016111.364964:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15d880 00000100:00100000:0.0:1734016111.369719:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.370339:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333623040 00000100:00100000:3.0:1734016111.370355:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333623040 00002000:00100000:3.0:1734016111.370411:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2478080->2482175) req@ffff88012b15ce00 x1818247333623040/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.370423:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15ce00 with x1818247333623040 ext(2478080->2482175) 00002000:00010000:3.0:1734016111.370429:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15ce00 00000100:00100000:3.0:1734016111.370479:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8413 00000100:00100000:3.0:1734016111.370487:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333623040:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016111.370744:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333623040:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 256us (1033us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016111.370753:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8413 00002000:00100000:3.0:1734016111.370760:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2478080->2482175) req@ffff88012b15ce00 x1818247333623040/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.370770:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15ce00 with x1818247333623040 ext(2478080->2482175) 00002000:00010000:3.0:1734016111.370773:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15ce00 00000100:00100000:2.0:1734016111.376920:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.377118:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333623296 00000100:00100000:3.0:1734016111.377134:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333623296 00002000:00100000:3.0:1734016111.377197:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2473984->2478079) req@ffff8800749e8e00 x1818247333623296/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.377210:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e8e00 with x1818247333623296 ext(2473984->2478079) 00002000:00010000:3.0:1734016111.377218:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e8e00 00000100:00100000:3.0:1734016111.377258:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8414 00000100:00100000:3.0:1734016111.377265:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333623296:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016111.377609:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333623296:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 342us (702us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016111.377617:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8414 00002000:00100000:3.0:1734016111.377623:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2473984->2478079) req@ffff8800749e8e00 x1818247333623296/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.377629:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e8e00 with x1818247333623296 ext(2473984->2478079) 00002000:00010000:3.0:1734016111.377632:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e8e00 00000100:00100000:0.0:1734016111.383299:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.383418:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333623552 00000100:00100000:3.0:1734016111.383429:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333623552 00002000:00100000:3.0:1734016111.383481:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2469888->2473983) req@ffff88012b15d180 x1818247333623552/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.383493:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15d180 with x1818247333623552 ext(2469888->2473983) 00002000:00010000:3.0:1734016111.383499:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15d180 00000100:00100000:3.0:1734016111.383540:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8415 00000100:00100000:3.0:1734016111.383547:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333623552:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016111.387486:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333623552:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 3916us (4177us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016111.387502:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8415 00002000:00100000:3.0:1734016111.387518:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2469888->2473983) req@ffff88012b15d180 x1818247333623552/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.387528:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15d180 with x1818247333623552 ext(2469888->2473983) 00002000:00010000:3.0:1734016111.387533:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15d180 00000100:00100000:0.0:1734016111.396906:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.397534:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333623808 00000100:00100000:3.0:1734016111.397548:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333623808 00002000:00100000:3.0:1734016111.397619:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2465792->2469887) req@ffff88012b15f800 x1818247333623808/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.397630:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15f800 with x1818247333623808 ext(2465792->2469887) 00002000:00010000:3.0:1734016111.397637:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15f800 00000100:00100000:3.0:1734016111.401491:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8416 00000100:00100000:3.0:1734016111.401512:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333623808:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016111.401824:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333623808:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 316us (4940us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016111.401833:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8416 00002000:00100000:3.0:1734016111.401843:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2465792->2469887) req@ffff88012b15f800 x1818247333623808/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.401854:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15f800 with x1818247333623808 ext(2465792->2469887) 00002000:00010000:3.0:1734016111.401860:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15f800 00000100:00100000:2.0:1734016111.409977:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.411915:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333624064 00000100:00100000:3.0:1734016111.411936:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333624064 00002000:00100000:3.0:1734016111.411998:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2461696->2465791) req@ffff8800749e9f80 x1818247333624064/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.412009:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e9f80 with x1818247333624064 ext(2461696->2465791) 00002000:00010000:3.0:1734016111.412016:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e9f80 00000100:00100000:1.0:1734016111.413787:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8417 00000100:00100000:1.0:1734016111.413813:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333624064:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016111.414098:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333624064:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 298us (4145us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016111.414106:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8417 00002000:00100000:1.0:1734016111.414116:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2461696->2465791) req@ffff8800749e9f80 x1818247333624064/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.414124:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e9f80 with x1818247333624064 ext(2461696->2465791) 00002000:00010000:1.0:1734016111.414130:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e9f80 00000100:00100000:0.0:1734016111.421161:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.421505:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333624320 00000100:00100000:3.0:1734016111.421516:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333624320 00002000:00100000:3.0:1734016111.421571:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2457600->2461695) req@ffff88012b15ca80 x1818247333624320/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.421583:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15ca80 with x1818247333624320 ext(2457600->2461695) 00002000:00010000:3.0:1734016111.421590:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15ca80 00000100:00100000:3.0:1734016111.421886:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8418 00000100:00100000:3.0:1734016111.421897:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333624320:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016111.422206:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333624320:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 310us (1057us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016111.422213:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8418 00002000:00100000:3.0:1734016111.422219:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2457600->2461695) req@ffff88012b15ca80 x1818247333624320/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.422227:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15ca80 with x1818247333624320 ext(2457600->2461695) 00002000:00010000:3.0:1734016111.422231:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15ca80 00000100:00100000:0.0:1734016111.425317:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.425595:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333624576 00000100:00100000:1.0:1734016111.425605:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333624576 00002000:00100000:1.0:1734016111.425653:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2453504->2457599) req@ffff88012b15ed80 x1818247333624576/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.425664:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15ed80 with x1818247333624576 ext(2453504->2457599) 00002000:00010000:1.0:1734016111.425670:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15ed80 00000100:00100000:1.0:1734016111.425710:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8419 00000100:00100000:1.0:1734016111.425717:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333624576:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016111.425955:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333624576:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 237us (647us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016111.425963:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8419 00002000:00100000:1.0:1734016111.425968:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2453504->2457599) req@ffff88012b15ed80 x1818247333624576/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.425975:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15ed80 with x1818247333624576 ext(2453504->2457599) 00002000:00010000:1.0:1734016111.425978:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15ed80 00000100:00100000:2.0:1734016111.428270:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.428331:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333624832 00000100:00100000:3.0:1734016111.428339:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333624832 00002000:00100000:3.0:1734016111.428381:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2449408->2453503) req@ffff8800749e8000 x1818247333624832/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.428395:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e8000 with x1818247333624832 ext(2449408->2453503) 00002000:00010000:3.0:1734016111.428402:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e8000 00000100:00100000:3.0:1734016111.428654:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8420 00000100:00100000:3.0:1734016111.428662:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333624832:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016111.428899:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333624832:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 235us (638us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016111.428907:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8420 00002000:00100000:3.0:1734016111.428913:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2449408->2453503) req@ffff8800749e8000 x1818247333624832/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.428920:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e8000 with x1818247333624832 ext(2449408->2453503) 00002000:00010000:3.0:1734016111.428922:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e8000 00000100:00100000:0.0:1734016111.430356:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.430447:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333625088 00000100:00100000:3.0:1734016111.430455:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333625088 00002000:00100000:3.0:1734016111.430491:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2445312->2449407) req@ffff88012b15e300 x1818247333625088/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.430498:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15e300 with x1818247333625088 ext(2445312->2449407) 00002000:00010000:3.0:1734016111.430502:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15e300 00000100:00100000:3.0:1734016111.430526:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8421 00000100:00100000:3.0:1734016111.430531:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333625088:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016111.430664:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333625088:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 132us (314us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016111.430670:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8421 00002000:00100000:3.0:1734016111.430676:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2445312->2449407) req@ffff88012b15e300 x1818247333625088/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.430684:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15e300 with x1818247333625088 ext(2445312->2449407) 00002000:00010000:3.0:1734016111.430686:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15e300 00000100:00100000:0.0:1734016111.432715:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.432899:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333625344 00000100:00100000:1.0:1734016111.432908:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333625344 00002000:00100000:1.0:1734016111.432948:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2441216->2445311) req@ffff88012b15ea00 x1818247333625344/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.432958:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15ea00 with x1818247333625344 ext(2441216->2445311) 00002000:00010000:1.0:1734016111.432963:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15ea00 00000100:00100000:1.0:1734016111.432996:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8422 00000100:00100000:1.0:1734016111.433004:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333625344:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016111.433192:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333625344:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 187us (487us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016111.433201:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8422 00002000:00100000:1.0:1734016111.433207:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2441216->2445311) req@ffff88012b15ea00 x1818247333625344/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.433213:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15ea00 with x1818247333625344 ext(2441216->2445311) 00002000:00010000:1.0:1734016111.433216:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15ea00 00000100:00100000:2.0:1734016111.436188:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.436281:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333625600 00000100:00100000:3.0:1734016111.436292:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333625600 00002000:00100000:3.0:1734016111.436368:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2437120->2441215) req@ffff8800749ebb80 x1818247333625600/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.436378:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ebb80 with x1818247333625600 ext(2437120->2441215) 00002000:00010000:3.0:1734016111.436388:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ebb80 00000100:00100000:3.0:1734016111.436429:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8423 00000100:00100000:3.0:1734016111.436437:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333625600:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016111.436656:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333625600:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 218us (480us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016111.436664:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8423 00002000:00100000:3.0:1734016111.436670:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2437120->2441215) req@ffff8800749ebb80 x1818247333625600/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.436678:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ebb80 with x1818247333625600 ext(2437120->2441215) 00002000:00010000:3.0:1734016111.436681:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ebb80 00000100:00100000:0.0:1734016111.442183:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.442445:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333625856 00000100:00100000:1.0:1734016111.442459:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333625856 00002000:00100000:1.0:1734016111.442521:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2433024->2437119) req@ffff88012b15c000 x1818247333625856/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.442533:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15c000 with x1818247333625856 ext(2433024->2437119) 00002000:00010000:1.0:1734016111.442540:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15c000 00000100:00100000:1.0:1734016111.442582:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8424 00000100:00100000:1.0:1734016111.442593:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333625856:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016111.442847:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333625856:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 256us (677us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016111.442856:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8424 00002000:00100000:1.0:1734016111.442863:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2433024->2437119) req@ffff88012b15c000 x1818247333625856/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.442870:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15c000 with x1818247333625856 ext(2433024->2437119) 00002000:00010000:1.0:1734016111.442873:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15c000 00000100:00100000:0.0:1734016111.446857:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.447072:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333626112 00000100:00100000:3.0:1734016111.447084:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333626112 00002000:00100000:3.0:1734016111.447128:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2428928->2433023) req@ffff88012b15fb80 x1818247333626112/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.447138:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15fb80 with x1818247333626112 ext(2428928->2433023) 00002000:00010000:3.0:1734016111.447143:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15fb80 00000100:00100000:3.0:1734016111.447910:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8425 00000100:00100000:3.0:1734016111.447920:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333626112:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016111.448186:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333626112:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 266us (1339us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016111.448195:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8425 00002000:00100000:3.0:1734016111.448203:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2428928->2433023) req@ffff88012b15fb80 x1818247333626112/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.448211:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15fb80 with x1818247333626112 ext(2428928->2433023) 00002000:00010000:3.0:1734016111.448215:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15fb80 00000100:00100000:2.0:1734016111.453684:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.453917:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333626240 00000100:00100000:1.0:1734016111.453931:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333626240 00002000:00100000:1.0:1734016111.453999:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2428928->2490367) req@ffff8800749e8700 x1818247333626240/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.454012:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e8700 with x1818247333626240 ext(2428928->2490367) 00002000:00010000:1.0:1734016111.454019:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e8700 00000100:00100000:1.0:1734016111.454064:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8426 00000100:00100000:1.0:1734016111.454074:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333626240:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016111.458427:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333626240:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4337us (4744us total) trans 4294969342 rc 0/0 00000100:00100000:1.0:1734016111.458448:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8426 00002000:00100000:1.0:1734016111.458467:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2428928->2490367) req@ffff8800749e8700 x1818247333626240/t4294969342(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/448 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.458478:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749e8700 with x1818247333626240 ext(2428928->2490367) 00002000:00010000:1.0:1734016111.458485:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749e8700 00000100:00100000:0.0:1734016111.460951:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.461067:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333626368 00000100:00100000:2.0:1734016111.461077:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333626368 00000100:00100000:2.0:1734016111.461127:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2136 00000100:00100000:2.0:1734016111.461136:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:9668:x1818247333626368:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:2.0:1734016111.461631:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:9668:x1818247333626368:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 495us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016111.461638:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2136 00000100:00100000:0.0:1734016111.463687:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.463791:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333626496 00000100:00100000:2.0:1734016111.463833:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333626496 00000100:00100000:2.0:1734016111.463879:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10679 00000100:00100000:2.0:1734016111.463885:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333626496:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016111.471406:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969342 is committed 00000100:00100000:2.0:1734016111.471981:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333626496:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 8087us (8294us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016111.471994:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10679 00000100:00100000:0.0:1734016111.475714:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.475850:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333626752 00000100:00100000:1.0:1734016111.475864:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333626752 00002000:00100000:1.0:1734016111.475923:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2985984->2990079) req@ffff88012e718380 x1818247333626752/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.475938:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e718380 with x1818247333626752 ext(2985984->2990079) 00002000:00010000:1.0:1734016111.475945:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e718380 00000100:00100000:1.0:1734016111.475978:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8427 00000100:00100000:1.0:1734016111.475986:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333626752:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016111.476205:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333626752:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 219us (506us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016111.476214:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8427 00002000:00100000:1.0:1734016111.476220:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2985984->2990079) req@ffff88012e718380 x1818247333626752/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.476227:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e718380 with x1818247333626752 ext(2985984->2990079) 00002000:00010000:1.0:1734016111.476229:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e718380 00000100:00100000:0.0:1734016111.479669:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.479918:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333627008 00000100:00100000:3.0:1734016111.479931:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333627008 00002000:00100000:3.0:1734016111.479998:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2981888->2985983) req@ffff88012e719880 x1818247333627008/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.480009:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e719880 with x1818247333627008 ext(2981888->2985983) 00002000:00010000:3.0:1734016111.480015:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e719880 00000100:00100000:3.0:1734016111.480062:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8428 00000100:00100000:3.0:1734016111.480069:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333627008:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016111.480292:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333627008:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 221us (643us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016111.480299:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8428 00002000:00100000:3.0:1734016111.480304:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2981888->2985983) req@ffff88012e719880 x1818247333627008/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.480310:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e719880 with x1818247333627008 ext(2981888->2985983) 00002000:00010000:3.0:1734016111.480313:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e719880 00000100:00100000:0.0:1734016111.483962:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.484076:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333627264 00000100:00100000:1.0:1734016111.484091:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333627264 00002000:00100000:1.0:1734016111.484164:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2977792->2981887) req@ffff88012e718000 x1818247333627264/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.484175:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e718000 with x1818247333627264 ext(2977792->2981887) 00002000:00010000:1.0:1734016111.484181:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e718000 00000100:00100000:1.0:1734016111.484231:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8429 00000100:00100000:1.0:1734016111.484238:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333627264:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016111.484500:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333627264:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 260us (551us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016111.484509:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8429 00002000:00100000:1.0:1734016111.484515:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2977792->2981887) req@ffff88012e718000 x1818247333627264/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.484522:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e718000 with x1818247333627264 ext(2977792->2981887) 00002000:00010000:1.0:1734016111.484525:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e718000 00000100:00100000:0.0:1734016111.487234:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.487429:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333627520 00000100:00100000:3.0:1734016111.487445:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333627520 00002000:00100000:3.0:1734016111.487503:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2973696->2977791) req@ffff88012e718a80 x1818247333627520/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.487514:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e718a80 with x1818247333627520 ext(2973696->2977791) 00002000:00010000:3.0:1734016111.487521:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e718a80 00000100:00100000:3.0:1734016111.487562:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8430 00000100:00100000:3.0:1734016111.487572:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333627520:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016111.487888:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333627520:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 318us (666us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016111.487897:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8430 00002000:00100000:3.0:1734016111.487903:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2973696->2977791) req@ffff88012e718a80 x1818247333627520/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.487910:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e718a80 with x1818247333627520 ext(2973696->2977791) 00002000:00010000:3.0:1734016111.487913:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e718a80 00000100:00100000:0.0:1734016111.492649:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.492750:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333627776 00000100:00100000:1.0:1734016111.492760:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333627776 00002000:00100000:1.0:1734016111.492875:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2969600->2973695) req@ffff88012e718700 x1818247333627776/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.492885:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e718700 with x1818247333627776 ext(2969600->2973695) 00002000:00010000:1.0:1734016111.492891:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e718700 00000100:00100000:1.0:1734016111.492922:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8431 00000100:00100000:1.0:1734016111.492930:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333627776:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016111.493130:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333627776:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 200us (491us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016111.493137:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8431 00002000:00100000:1.0:1734016111.493143:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2969600->2973695) req@ffff88012e718700 x1818247333627776/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.493149:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e718700 with x1818247333627776 ext(2969600->2973695) 00002000:00010000:1.0:1734016111.493152:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e718700 00000100:00100000:0.0:1734016111.497518:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.497636:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333628032 00000100:00100000:3.0:1734016111.497646:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333628032 00002000:00100000:3.0:1734016111.497710:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2965504->2969599) req@ffff88012e71a300 x1818247333628032/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.497723:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71a300 with x1818247333628032 ext(2965504->2969599) 00002000:00010000:3.0:1734016111.497729:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e71a300 00000100:00100000:3.0:1734016111.497772:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8432 00000100:00100000:3.0:1734016111.497780:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333628032:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016111.498087:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333628032:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 305us (584us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016111.498097:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8432 00002000:00100000:3.0:1734016111.498103:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2965504->2969599) req@ffff88012e71a300 x1818247333628032/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.498110:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71a300 with x1818247333628032 ext(2965504->2969599) 00002000:00010000:3.0:1734016111.498112:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e71a300 00000100:00100000:0.0:1734016111.501797:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.502110:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333628288 00000100:00100000:1.0:1734016111.502123:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333628288 00002000:00100000:1.0:1734016111.502189:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2961408->2965503) req@ffff88012e71a680 x1818247333628288/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.502201:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71a680 with x1818247333628288 ext(2961408->2965503) 00002000:00010000:1.0:1734016111.502207:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e71a680 00000100:00100000:1.0:1734016111.502247:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8433 00000100:00100000:1.0:1734016111.502258:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333628288:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016111.502550:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333628288:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 293us (776us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016111.502559:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8433 00002000:00100000:1.0:1734016111.502565:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2961408->2965503) req@ffff88012e71a680 x1818247333628288/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.502572:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71a680 with x1818247333628288 ext(2961408->2965503) 00002000:00010000:1.0:1734016111.502575:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e71a680 00000100:00100000:0.0:1734016111.506037:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.506495:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333628544 00000100:00100000:3.0:1734016111.506506:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333628544 00002000:00100000:3.0:1734016111.506555:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2957312->2961407) req@ffff88012e71ad80 x1818247333628544/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.506565:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71ad80 with x1818247333628544 ext(2957312->2961407) 00002000:00010000:3.0:1734016111.506571:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e71ad80 00000100:00100000:3.0:1734016111.506695:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8434 00000100:00100000:3.0:1734016111.506703:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333628544:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016111.507084:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333628544:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 380us (1069us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016111.507093:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8434 00002000:00100000:3.0:1734016111.507099:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2957312->2961407) req@ffff88012e71ad80 x1818247333628544/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.507106:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71ad80 with x1818247333628544 ext(2957312->2961407) 00002000:00010000:3.0:1734016111.507109:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e71ad80 00000100:00100000:0.0:1734016111.510587:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.510779:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333628800 00000100:00100000:3.0:1734016111.510853:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333628800 00002000:00100000:3.0:1734016111.510951:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2953216->2957311) req@ffff88012e719180 x1818247333628800/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.510976:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e719180 with x1818247333628800 ext(2953216->2957311) 00002000:00010000:3.0:1734016111.510985:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e719180 00000100:00100000:3.0:1734016111.511578:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8435 00000100:00100000:3.0:1734016111.511590:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333628800:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016111.512001:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333628800:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 411us (1441us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016111.512015:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8435 00002000:00100000:3.0:1734016111.512024:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2953216->2957311) req@ffff88012e719180 x1818247333628800/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.512044:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e719180 with x1818247333628800 ext(2953216->2957311) 00002000:00010000:3.0:1734016111.512047:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e719180 00000100:00100000:0.0:1734016111.515202:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.515949:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333629056 00000100:00100000:1.0:1734016111.515961:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333629056 00002000:00100000:1.0:1734016111.516040:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2949120->2953215) req@ffff8800749aed80 x1818247333629056/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.516052:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749aed80 with x1818247333629056 ext(2949120->2953215) 00002000:00010000:1.0:1734016111.516058:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749aed80 00000100:00100000:3.0:1734016111.516179:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8436 00000100:00100000:3.0:1734016111.516191:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333629056:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016111.516479:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333629056:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 289us (1288us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016111.516488:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8436 00002000:00100000:3.0:1734016111.516494:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2949120->2953215) req@ffff8800749aed80 x1818247333629056/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.516501:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749aed80 with x1818247333629056 ext(2949120->2953215) 00002000:00010000:3.0:1734016111.516504:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749aed80 00010000:00010000:2.0:1734016111.516998:0:8958:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1734016111.519757:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.519863:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333629312 00000100:00100000:3.0:1734016111.519874:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333629312 00002000:00100000:3.0:1734016111.519920:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2945024->2949119) req@ffff8800749ac700 x1818247333629312/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.519930:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ac700 with x1818247333629312 ext(2945024->2949119) 00002000:00010000:3.0:1734016111.519936:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ac700 00000100:00100000:3.0:1734016111.519959:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8437 00000100:00100000:3.0:1734016111.519966:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333629312:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016111.520977:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333629312:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1004us (1226us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016111.520993:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8437 00002000:00100000:3.0:1734016111.521004:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2945024->2949119) req@ffff8800749ac700 x1818247333629312/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.521012:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ac700 with x1818247333629312 ext(2945024->2949119) 00002000:00010000:3.0:1734016111.521016:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ac700 00000100:00100000:0.0:1734016111.525035:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.525255:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333629568 00000100:00100000:3.0:1734016111.525266:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333629568 00002000:00100000:3.0:1734016111.525326:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2940928->2945023) req@ffff8800749adf80 x1818247333629568/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.525338:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749adf80 with x1818247333629568 ext(2940928->2945023) 00002000:00010000:3.0:1734016111.525346:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749adf80 00000100:00100000:3.0:1734016111.525379:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8438 00000100:00100000:3.0:1734016111.525387:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333629568:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016111.525633:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333629568:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 245us (623us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016111.525642:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8438 00002000:00100000:3.0:1734016111.525650:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (2940928->2945023) req@ffff8800749adf80 x1818247333629568/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016111.525657:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749adf80 with x1818247333629568 ext(2940928->2945023) 00002000:00010000:3.0:1734016111.525659:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749adf80 00000100:00100000:1.0:1734016111.528338:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.528540:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333629696 00000100:00100000:0.0:1734016111.528550:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333629696 00002000:00100000:0.0:1734016111.528605:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2940928->2990079) req@ffff880075fc6a00 x1818247333629696/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016111.528617:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc6a00 with x1818247333629696 ext(2940928->2990079) 00002000:00010000:0.0:1734016111.528623:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc6a00 00000100:00100000:0.0:1734016111.528660:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8439 00000100:00100000:0.0:1734016111.528667:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333629696:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016111.531337:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333629696:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 2653us (2994us total) trans 4294969343 rc 0/0 00000100:00100000:0.0:1734016111.531354:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8439 00002000:00100000:0.0:1734016111.531369:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2940928->2990079) req@ffff880075fc6a00 x1818247333629696/t4294969343(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/448 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016111.531381:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc6a00 with x1818247333629696 ext(2940928->2990079) 00002000:00010000:0.0:1734016111.531388:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc6a00 00000100:00100000:1.0:1734016111.533540:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.533636:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333629824 00000100:00100000:2.0:1734016111.533646:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333629824 00000100:00100000:2.0:1734016111.533692:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10680 00000100:00100000:2.0:1734016111.533699:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333629824:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016111.535156:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969343 is committed 00000100:00100000:0.0:1734016111.535401:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333629824:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 1697us (1866us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016111.535415:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10680 00000100:00100000:1.0:1734016111.538350:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.538437:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333629952 00000100:00100000:0.0:1734016111.538449:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333629952 00000100:00100000:0.0:1734016111.538518:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10681 00000100:00100000:0.0:1734016111.538528:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333629952:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016111.538553:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016111.538576:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271150d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e549e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016111.538657:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335263872:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016111.538753:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00002000:00010000:0.0:1734016111.541748:0:8216:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime: 1734016111 -> 1734016112 00002000:00010000:0.0:1734016111.541760:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016111 -> 1734016112 00002000:00010000:0.0:1734016111.541762:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016111 -> 1734016112 00002000:00010000:0.0:1734016111.541764:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 312 -> 528 00000100:00100000:0.0:1734016111.541797:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335263872:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016111.541868:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271150d0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e549e expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016111.541886:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc271150d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e549e expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016111.542109:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:0.0:1734016111.542308:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333629952:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3779us (3972us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016111.542318:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10681 00000100:00100000:2.0:1734016111.544563:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.544630:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333630080 00000100:00100000:0.0:1734016111.544643:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333630080 00000100:00100000:0.0:1734016111.544716:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10682 00000100:00100000:0.0:1734016111.544725:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333630080:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016111.544755:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016111.544778:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc271150d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e54a5 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016111.544896:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335264000:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016111.544980:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016111.547518:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335264000:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016111.547570:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc271150d7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54a5 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016111.547585:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc271150d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54a5 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016111.547600:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581680, rc 0) 00000100:00100000:0.0:1734016111.547668:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333630080:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2941us (3112us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016111.547678:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10682 00000100:00100000:2.0:1734016111.550081:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.550185:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333630208 00000100:00100000:0.0:1734016111.550199:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333630208 00000100:00100000:0.0:1734016111.550267:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10683 00000100:00100000:0.0:1734016111.550275:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333630208:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016111.550299:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016111.550325:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc271150de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e54ac expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016111.550410:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335264128:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016111.550530:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016111.552878:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335264128:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016111.552919:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc271150de lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54ac expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016111.552933:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc271150de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54ac expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016111.552997:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:0.0:1734016111.553193:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333630208:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2917us (3123us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016111.553203:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10683 00000100:00100000:2.0:1734016111.555160:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.555224:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333630336 00000100:00100000:0.0:1734016111.555234:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333630336 00000100:00100000:0.0:1734016111.555281:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10684 00000100:00100000:0.0:1734016111.555288:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333630336:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016111.555313:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016111.555334:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271150e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e54b3 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016111.555368:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271150c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2490367) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5497 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016111.555375:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016111.555377:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016111.555381:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271150e5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5636096->5640191] (req 5636096->5640191) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54b3 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016111.555416:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271150c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2490367) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5497 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016111.555428:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271150c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2490367) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5497 expref: 5 pid: 8216 timeout: 478 lvb_type: 0 00000100:00100000:0.0:1734016111.555440:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335264256:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016111.555506:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016111.559286:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335264256:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016111.559328:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271150e5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5636096->5640191] (req 5636096->5640191) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54b3 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016111.559351:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:0.0:1734016111.559416:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333630336:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4126us (4262us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016111.559428:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10684 00000100:00100000:2.0:1734016111.560316:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016111.560398:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333630464 00000100:00100000:3.0:1734016111.560407:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333630464 00010000:00010000:3.0:1734016111.560443:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271150c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5497 expref: 6 pid: 8216 timeout: 478 lvb_type: 0 00000100:00100000:3.0:1734016111.561341:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2947 00000100:00100000:3.0:1734016111.561351:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333630464:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016111.561369:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016111.561398:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271150c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2486272->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5497 expref: 6 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:3.0:1734016111.561411:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271150c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2486272->2490367) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5497 expref: 6 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:3.0:1734016111.561438:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271150c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2486272->2490367) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5497 expref: 6 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:3.0:1734016111.561980:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016111.561983:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016111.561994:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271150e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5636096->5640191) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54b3 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016111.562003:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271150e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5636096->5640191) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54b3 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016111.562066:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271150e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5636096->5640191) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54b3 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016111.562083:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075e53480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335264384:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016111.562185:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016111.573778:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075e53480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335264384:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016111.574266:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016111.574664:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333630464:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 13311us (14348us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016111.574677:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2947 00000100:00100000:0.0:1734016111.574965:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.575064:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.575097:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333630720 00000100:00100000:0.0:1734016111.575105:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333630720 00002000:00100000:0.0:1734016111.575159:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (143360->5640191) req@ffff8800749af480 x1818247333630720/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:72/0 lens 504/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016111.575170:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749af480 with x1818247333630720 ext(143360->5640191) 00002000:00010000:0.0:1734016111.575174:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749af480 00000100:00100000:0.0:1734016111.575197:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333630848 00000100:00100000:0.0:1734016111.575200:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333630848 00002000:00100000:0.0:1734016111.575213:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (4333568->7020543) req@ffff8800749af800 x1818247333630848/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:72/0 lens 504/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016111.575220:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749af800 with x1818247333630848 ext(4333568->7020543) 00002000:00010000:0.0:1734016111.575222:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749af800 00000100:00100000:0.0:1734016111.575235:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8440 00000100:00100000:0.0:1734016111.575241:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333630720:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016111.579341:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8441 00000100:00100000:1.0:1734016111.579361:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333630848:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016111.626218:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333630848:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 46844us (51136us total) trans 0 rc 2682880/2682880 00000100:00100000:1.0:1734016111.626235:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8441 00002000:00100000:1.0:1734016111.626253:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (4333568->7020543) req@ffff8800749af800 x1818247333630848/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:72/0 lens 504/440 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 2682880/2682880 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.626264:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749af800 with x1818247333630848 ext(4333568->7020543) 00002000:00010000:1.0:1734016111.626270:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749af800 00000100:00100000:0.0:1734016111.658951:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333630720:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 83693us (83971us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1734016111.658966:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8440 00002000:00100000:0.0:1734016111.658983:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (143360->5640191) req@ffff8800749af480 x1818247333630720/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:72/0 lens 504/440 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016111.658993:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749af480 with x1818247333630720 ext(143360->5640191) 00002000:00010000:0.0:1734016111.658999:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749af480 00000100:00100000:3.0:1734016111.666412:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.666624:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333631104 00000100:00100000:0.0:1734016111.666635:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333631104 00002000:00100000:0.0:1734016111.666684:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (5599232->5640191) req@ffff880075e53480 x1818247333631104/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016111.666693:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e53480 with x1818247333631104 ext(5599232->5640191) 00002000:00010000:0.0:1734016111.666699:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e53480 00000100:00100000:0.0:1734016111.666737:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8442 00000100:00100000:0.0:1734016111.666744:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333631104:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016111.670602:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333631104:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 3844us (4188us total) trans 4294969344 rc 0/0 00000100:00100000:0.0:1734016111.670616:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8442 00002000:00100000:0.0:1734016111.670630:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (5599232->5640191) req@ffff880075e53480 x1818247333631104/t4294969344(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:72/0 lens 488/448 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016111.670638:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e53480 with x1818247333631104 ext(5599232->5640191) 00002000:00010000:0.0:1734016111.670647:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e53480 00000100:00100000:2.0:1734016111.674003:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.674351:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333631232 00000100:00100000:0.0:1734016111.674363:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333631232 00000100:00100000:0.0:1734016111.674679:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10685 00000100:00100000:0.0:1734016111.674688:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333631232:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016111.678424:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969344 is committed 00000100:00100000:3.0:1734016111.679064:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333631232:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 4366us (5061us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016111.679082:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10685 00000100:00100000:3.0:1734016111.683894:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.683980:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333631360 00000100:00100000:0.0:1734016111.683993:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333631360 00000100:00100000:0.0:1734016111.684477:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10686 00000100:00100000:0.0:1734016111.684487:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333631360:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016111.684507:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016111.684526:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc271150ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e54ba expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016111.684585:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335264512:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016111.686253:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00002000:00010000:0.0:1734016111.689860:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 528 -> 608 00000100:00100000:0.0:1734016111.689892:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335264512:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016111.689934:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc271150ec lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54ba expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016111.689955:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc271150ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54ba expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016111.689985:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:0.0:1734016111.690063:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333631360:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5575us (6180us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016111.690073:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10686 00000100:00100000:2.0:1734016111.696536:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.696631:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333631488 00000100:00100000:0.0:1734016111.696644:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333631488 00000100:00100000:1.0:1734016111.697366:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10687 00000100:00100000:1.0:1734016111.697378:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333631488:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016111.697411:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016111.697435:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271150f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e54c1 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016111.697506:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335264640:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016111.697588:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016111.700934:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335264640:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016111.700996:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271150f3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54c1 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016111.701015:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271150f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54c1 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016111.701057:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016111.701132:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333631488:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3754us (4608us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016111.701146:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10687 00000100:00100000:3.0:1734016111.715994:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.716594:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333631744 00000100:00100000:2.0:1734016111.716607:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333631744 00000100:00100000:2.0:1734016111.716671:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2137 00000100:00100000:2.0:1734016111.716679:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+38:9668:x1818247333631744:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016111.716743:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016111.716775:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271150ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5482 expref: 38 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.717396:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016111.717403:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016111.717624:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271150fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016111.717641:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711508a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5466 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.717649:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271150fa lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016111.717692:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711508a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5466 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.717706:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711508a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5466 expref: 23 pid: 6478 timeout: 478 lvb_type: 0 00000100:00100000:2.0:1734016111.717720:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074939f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335264768:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016111.719223:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016111.725776:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074939f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335264768:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016111.725846:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271150fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016111.727176:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.727273:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333631872 00000100:00100000:0.0:1734016111.727287:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333631872 00010000:00010000:0.0:1734016111.727331:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711508a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5466 expref: 24 pid: 6478 timeout: 478 lvb_type: 0 00000100:00100000:0.0:1734016111.727385:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2948 00000100:00100000:0.0:1734016111.727392:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:1981:x1818247333631872:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016111.727420:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016111.727431:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711508a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5466 expref: 24 pid: 6478 timeout: 478 lvb_type: 0 00010000:00010000:0.0:1734016111.727451:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711508a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5466 expref: 24 pid: 6478 timeout: 478 lvb_type: 0 00010000:00010000:0.0:1734016111.727487:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711508a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5466 expref: 24 pid: 6478 timeout: 478 lvb_type: 0 00010000:00010000:0.0:1734016111.727524:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016111.727530:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271150fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016111.727542:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271150fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016111.727552:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271150fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016111.727588:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016111.727665:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:1981:x1818247333631872:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 272us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016111.727674:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2948 00010000:00010000:0.0:1734016111.727703:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271150fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016111.727709:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271150fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:0.0:1734016111.727857:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968674 00000004:00010000:0.0:1734016111.727912:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075e52d80 reply state ffff880075cc7000 transno 4294968675 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271150fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016111.727921:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016111.727996:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+40:9668:x1818247333631744:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 11318us (12013us total) trans 4294968675 rc 0/0 00000100:00100000:0.0:1734016111.728003:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2137 00000020:00080000:0.0:1734016111.728007:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1734016111.735712:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271150fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016111.735733:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271150fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016111.735740:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271150fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016111.735746:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcfc0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:1.0:1734016111.735750:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271150fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016111.735756:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271150fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016111.735777:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016111.735780:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1734016111.735784:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271150fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016111.735788:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271150fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016111.735977:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.736105:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333632000 00000100:00100000:1.0:1734016111.736116:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333632000 00002000:00010000:1.0:1734016111.736156:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (3396576->18446744073709551615) 00002000:00100000:1.0:1734016111.736160:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ac380 with x1818247333632000 ext(3396576->18446744073709551615) 00002000:00010000:1.0:1734016111.736173:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ac380. 00000100:00100000:1.0:1734016111.736208:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8443 00000100:00100000:1.0:1734016111.736216:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333632000:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016111.739252:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7020544 -> 3396576 00002000:00010000:1.0:1734016111.739265:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016112 -> 1734016112 00002000:00010000:1.0:1734016111.739268:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016112 -> 1734016112 00002000:00010000:1.0:1734016111.739270:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016112 -> 1734016112 00002000:00010000:1.0:1734016111.739273:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 608 -> 408 00000100:00100000:1.0:1734016111.739406:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333632000:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 3179us (3424us total) trans 4294969345 rc 0/0 00000100:00100000:1.0:1734016111.739420:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8443 00002000:00010000:1.0:1734016111.739428:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (3396576->18446744073709551615) 00002000:00100000:1.0:1734016111.739432:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ac380 with x1818247333632000 ext(3396576->18446744073709551615) 00002000:00010000:1.0:1734016111.739438:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ac380. 00000100:00100000:2.0:1734016111.751432:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.751526:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333632128 00000100:00100000:0.0:1734016111.751538:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333632128 00000100:00100000:0.0:1734016111.751601:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2138 00000100:00100000:0.0:1734016111.751610:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:9668:x1818247333632128:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016111.751635:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016111.751659:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115101 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e54c8 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016111.751760:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115108 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016111.751775:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016111.751785:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:0.0:1734016111.751852:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 3396576 00000004:00200000:0.0:1734016111.751856:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016111.751885:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016111.751910:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115101 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54c8 expref: 25 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016111.751940:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115108 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54c8 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016111.751949:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016111.751952:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016111.751955:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581200, rc 0) 00000100:00100000:0.0:1734016111.752016:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:9668:x1818247333632128:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 406us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016111.752033:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2138 00000100:00100000:3.0:1734016111.754584:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.754727:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333632256 00000100:00100000:1.0:1734016111.754739:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333632256 00000100:00100000:1.0:1734016111.758857:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10688 00000100:00100000:1.0:1734016111.758880:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333632256:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016111.758907:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016111.758931:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711510f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e54cf expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016111.759007:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335264896:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016111.759115:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:2.0:1734016111.764820:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335264896:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016111.764853:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711510f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54cf expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016111.764870:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711510f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54cf expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016111.764889:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:2.0:1734016111.764943:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333632256:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6067us (10374us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016111.764951:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10688 00000100:00100000:3.0:1734016111.768110:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.768365:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333632384 00000100:00100000:2.0:1734016111.768374:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333632384 00000100:00100000:2.0:1734016111.768411:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10689 00000100:00100000:2.0:1734016111.768418:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333632384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016111.768439:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016111.768456:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115116 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e54d6 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016111.768513:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335265024:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016111.768585:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e180 going to sleep for 11 seconds 00000100:00100000:2.0:1734016111.775005:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335265024:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016111.775057:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115116 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54d6 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016111.775073:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115116 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54d6 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016111.776334:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016111.776441:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333632384:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8015us (8334us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016111.776454:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10689 00000100:00100000:1.0:1734016111.786661:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.786882:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333632640 00000100:00100000:2.0:1734016111.786893:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333632640 00000100:00100000:2.0:1734016111.786942:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2139 00000100:00100000:2.0:1734016111.786949:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:9668:x1818247333632640:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016111.787009:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016111.787050:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115108 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54c8 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.787073:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016111.787078:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016111.787263:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711511d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016111.787278:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711511d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016111.787287:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711511d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:2.0:1734016111.787318:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968676 00000004:00010000:2.0:1734016111.787335:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880073ad5180 reply state ffff88012e168000 transno 4294968677 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711511d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016111.787341:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016111.789590:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+26:9668:x1818247333632640:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 2623us (2921us total) trans 4294968677 rc 0/0 00000100:00100000:2.0:1734016111.789603:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2139 00000020:00080000:2.0:1734016111.789616:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:2.0:1734016111.794882:0:6461:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968677 is committed 00000001:00080000:2.0:1734016111.794904:0:6461:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968675 is committed 00010000:00010000:0.0:1734016111.795039:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711511d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016111.795050:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711511d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016111.795056:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711511d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016111.795062:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd440 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016111.795066:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711511d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016111.795074:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711511d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016111.795092:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016111.795095:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016111.795101:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711511d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016111.795106:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711511d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016111.796100:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.796272:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333632768 00000100:00100000:2.0:1734016111.796281:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333632768 00000100:00100000:2.0:1734016111.796323:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10690 00000100:00100000:2.0:1734016111.796332:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333632768:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016111.796355:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016111.796376:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115124 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e54dd expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.796414:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271150e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5636096->5640191) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54b3 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.796423:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016111.796426:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016111.796430:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115124 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54dd expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.796466:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271150e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5636096->5640191) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54b3 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.796476:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271150e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5636096->5640191) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54b3 expref: 7 pid: 8216 timeout: 478 lvb_type: 0 00000100:00100000:2.0:1734016111.796490:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335265152:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016111.797366:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e180 going to sleep for 11 seconds 00000100:00100000:2.0:1734016111.804104:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335265152:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016111.804143:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115124 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54dd expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016111.804167:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016111.804246:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333632768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7914us (8151us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016111.804256:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10690 00000100:00100000:3.0:1734016111.807031:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.807199:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333632896 00000100:00100000:1.0:1734016111.807212:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333632896 00010000:00010000:1.0:1734016111.807256:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271150e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5636096->5640191) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54b3 expref: 8 pid: 8216 timeout: 478 lvb_type: 0 00000100:00100000:1.0:1734016111.808786:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2949 00000100:00100000:1.0:1734016111.808796:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333632896:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016111.808832:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016111.808858:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271150e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5636096->5640191) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54b3 expref: 8 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:1.0:1734016111.808872:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271150e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5636096->5640191) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54b3 expref: 8 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:1.0:1734016111.808894:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc271150e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5636096->5640191) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54b3 expref: 8 pid: 8216 timeout: 478 lvb_type: 0 00010000:00010000:1.0:1734016111.808934:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016111.808937:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016111.808945:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115124 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54dd expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016111.808954:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115124 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54dd expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016111.808994:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115124 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54dd expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016111.809009:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075447800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335265280:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016111.809096:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016111.840162:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.840309:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333633024 00000100:00100000:2.0:1734016111.840317:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333633024 00002000:00010000:2.0:1734016111.840347:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (7855853->18446744073709551615) 00002000:00100000:2.0:1734016111.840351:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075444000 with x1818247333633024 ext(7855853->18446744073709551615) 00002000:00010000:2.0:1734016111.840361:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075444000. 00000100:00100000:2.0:1734016111.840378:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8444 00000100:00100000:2.0:1734016111.840384:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333633024:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016111.840562:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 3396576 -> 7855853 00002000:00010000:2.0:1734016111.840565:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016112 -> 1734016112 00002000:00010000:2.0:1734016111.840567:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016112 -> 1734016112 00002000:00010000:2.0:1734016111.840569:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016112 -> 1734016112 00002000:00010000:2.0:1734016111.840570:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 408 -> 408 00000100:00100000:0.0:1734016111.840703:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075447800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335265280:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016111.840723:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016111.841688:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333633024:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1298us (1532us total) trans 4294969346 rc 0/0 00000100:00100000:2.0:1734016111.841698:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8444 00002000:00010000:2.0:1734016111.841702:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (7855853->18446744073709551615) 00002000:00100000:2.0:1734016111.841705:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075444000 with x1818247333633024 ext(7855853->18446744073709551615) 00002000:00010000:2.0:1734016111.841711:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075444000. 00000100:00100000:0.0:1734016111.843719:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333632896:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 34909us (36693us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016111.843737:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2949 00000100:00100000:3.0:1734016111.857313:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.858079:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333633280 00000100:00100000:2.0:1734016111.858091:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333633280 00002000:00100000:2.0:1734016111.858137:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7852032->7856127) req@ffff8800750c1c00 x1818247333633280/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016111.858146:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c1c00 with x1818247333633280 ext(7852032->7856127) 00002000:00010000:2.0:1734016111.858153:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c1c00 00000100:00100000:2.0:1734016111.858770:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8445 00000100:00100000:2.0:1734016111.858778:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333633280:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016111.860726:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333633280:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1931us (3406us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016111.860740:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8445 00002000:00100000:2.0:1734016111.860755:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7852032->7856127) req@ffff8800750c1c00 x1818247333633280/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016111.860765:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c1c00 with x1818247333633280 ext(7852032->7856127) 00002000:00010000:2.0:1734016111.860772:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c1c00 00000100:00100000:3.0:1734016111.868283:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.868886:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333633536 00000100:00100000:2.0:1734016111.868897:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333633536 00002000:00100000:2.0:1734016111.868934:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7847936->7852031) req@ffff8800750d0700 x1818247333633536/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016111.868944:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d0700 with x1818247333633536 ext(7847936->7852031) 00002000:00010000:2.0:1734016111.868949:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d0700 00000100:00100000:2.0:1734016111.868978:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8446 00000100:00100000:2.0:1734016111.868984:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333633536:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016111.869150:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333633536:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 166us (878us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016111.869157:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8446 00002000:00100000:2.0:1734016111.869162:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7847936->7852031) req@ffff8800750d0700 x1818247333633536/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016111.869170:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d0700 with x1818247333633536 ext(7847936->7852031) 00002000:00010000:2.0:1734016111.869172:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d0700 00000100:00100000:0.0:1734016111.879946:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.881077:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333633792 00000100:00100000:1.0:1734016111.881088:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333633792 00002000:00100000:1.0:1734016111.881127:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7843840->7847935) req@ffff8800749aca80 x1818247333633792/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.881137:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749aca80 with x1818247333633792 ext(7843840->7847935) 00002000:00010000:1.0:1734016111.881142:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749aca80 00000100:00100000:1.0:1734016111.881175:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8447 00000100:00100000:1.0:1734016111.881182:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333633792:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016111.881343:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333633792:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 161us (1411us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016111.881349:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8447 00002000:00100000:1.0:1734016111.881353:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7843840->7847935) req@ffff8800749aca80 x1818247333633792/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.881359:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749aca80 with x1818247333633792 ext(7843840->7847935) 00002000:00010000:1.0:1734016111.881362:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749aca80 00000100:00100000:3.0:1734016111.891996:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.892135:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333634048 00000100:00100000:2.0:1734016111.892144:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333634048 00002000:00100000:2.0:1734016111.892195:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7839744->7843839) req@ffff8800750d0a80 x1818247333634048/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016111.892207:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d0a80 with x1818247333634048 ext(7839744->7843839) 00002000:00010000:2.0:1734016111.892214:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d0a80 00000100:00100000:1.0:1734016111.893056:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8448 00000100:00100000:1.0:1734016111.893063:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333634048:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016111.895587:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333634048:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 2510us (3587us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016111.895601:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8448 00002000:00100000:1.0:1734016111.895614:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7839744->7843839) req@ffff8800750d0a80 x1818247333634048/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.895627:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d0a80 with x1818247333634048 ext(7839744->7843839) 00002000:00010000:1.0:1734016111.895633:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d0a80 00000100:00100000:3.0:1734016111.900993:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016111.907032:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333634304 00000100:00100000:1.0:1734016111.907051:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333634304 00002000:00100000:1.0:1734016111.907130:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7835648->7839743) req@ffff88007345f100 x1818247333634304/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.907141:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345f100 with x1818247333634304 ext(7835648->7839743) 00002000:00010000:1.0:1734016111.907148:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345f100 00000100:00100000:1.0:1734016111.907202:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8449 00000100:00100000:1.0:1734016111.907210:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333634304:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016111.907491:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333634304:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 280us (6505us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016111.907499:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8449 00002000:00100000:1.0:1734016111.907506:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7835648->7839743) req@ffff88007345f100 x1818247333634304/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/4536 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016111.907513:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345f100 with x1818247333634304 ext(7835648->7839743) 00002000:00010000:1.0:1734016111.907515:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345f100 00000100:00100000:0.0:1734016111.921155:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.921468:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333634432 00000100:00100000:2.0:1734016111.921478:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333634432 00002000:00100000:2.0:1734016111.921517:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7835648->7855852) req@ffff8800a7aacc50 x1818247333634432/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/0 e 0 to 0 dl 1734016122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016111.921527:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7aacc50 with x1818247333634432 ext(7835648->7855852) 00002000:00010000:2.0:1734016111.921532:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7aacc50 00000100:00100000:2.0:1734016111.921646:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8450 00000100:00100000:2.0:1734016111.921654:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333634432:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016111.932058:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333634432:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 10397us (10905us total) trans 4294969347 rc 0/0 00000100:00100000:2.0:1734016111.932068:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8450 00002000:00100000:2.0:1734016111.932079:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7835648->7855852) req@ffff8800a7aacc50 x1818247333634432/t4294969347(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:72/0 lens 488/448 e 0 to 0 dl 1734016122 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016111.932087:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7aacc50 with x1818247333634432 ext(7835648->7855852) 00002000:00010000:2.0:1734016111.932092:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7aacc50 00000100:00100000:3.0:1734016111.934612:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.934912:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333634560 00000100:00100000:0.0:1734016111.934921:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333634560 00000100:00100000:0.0:1734016111.936214:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2140 00000100:00100000:0.0:1734016111.936224:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:9668:x1818247333634560:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:0.0:1734016111.937722:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:9668:x1818247333634560:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 1491us (3112us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016111.937732:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2140 00000100:00100000:0.0:1734016111.944786:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.945065:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333634688 00000100:00100000:2.0:1734016111.945205:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333634688 00000100:00100000:2.0:1734016111.946307:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10691 00000100:00100000:2.0:1734016111.946316:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333634688:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016111.950209:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969347 is committed 00000001:00080000:2.0:1734016111.950236:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969345 is committed 00000100:00100000:0.0:1734016111.950696:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333634688:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 4376us (5916us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016111.950706:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10691 00000100:00100000:3.0:1734016111.956267:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.956328:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333634816 00000100:00100000:0.0:1734016111.956336:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333634816 00000100:00100000:0.0:1734016111.956388:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2141 00000100:00100000:0.0:1734016111.956396:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+13:9668:x1818247333634816:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016111.956420:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016111.956437:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc2711512b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e54e4 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016111.956508:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27115132 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016111.956519:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27115132 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016111.956531:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27115132 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016111.956550:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 7855853 00000004:00200000:0.0:1734016111.956553:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016111.956564:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27115132 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016111.956583:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc2711512b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54e4 expref: 15 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016111.956608:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27115132 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54e4 expref: 14 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016111.956615:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016111.956617:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016111.956619:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:0.0:1734016111.956672:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+14:9668:x1818247333634816:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 277us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016111.956678:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2141 00000100:00100000:2.0:1734016111.965172:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016111.965247:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333634944 00000100:00100000:0.0:1734016111.965257:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333634944 00000100:00100000:0.0:1734016111.965296:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10692 00000100:00100000:0.0:1734016111.965302:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333634944:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016111.965320:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016111.965337:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27115139 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e54eb expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016111.965393:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335265408:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016111.965455:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00002000:00010000:2.0:1734016111.967193:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 408 -> 448 00000100:00100000:2.0:1734016111.967230:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335265408:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016111.967265:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27115139 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54eb expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016111.967278:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27115139 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54eb expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016111.967295:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00000100:00100000:2.0:1734016111.968612:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333634944:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3301us (3441us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016111.968623:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10692 00000100:00100000:3.0:1734016111.976385:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.977124:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333635072 00000100:00100000:2.0:1734016111.977134:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333635072 00000100:00100000:2.0:1734016111.977178:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10693 00000100:00100000:2.0:1734016111.977185:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333635072:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016111.977205:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016111.977223:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115140 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e54f2 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016111.977276:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335265536:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016111.977337:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016111.982875:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335265536:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016111.982909:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115140 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54f2 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016111.982921:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115140 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54f2 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016111.982938:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016111.982988:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333635072:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5802us (6612us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016111.982995:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10693 00000100:00100000:1.0:1734016111.987454:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016111.987552:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333635200 00000100:00100000:2.0:1734016111.987562:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333635200 00000100:00100000:2.0:1734016111.987605:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10694 00000100:00100000:2.0:1734016111.987615:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333635200:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016111.987640:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016111.987663:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115147 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e54f9 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016111.987730:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335265664:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016111.987832:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016111.994690:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335265664:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016111.994727:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115147 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54f9 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016111.994739:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115147 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54f9 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016111.995051:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016111.995658:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333635200:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8043us (8217us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016111.995667:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10694 00000100:00100000:3.0:1734016112.001416:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.001532:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333635328 00000100:00100000:2.0:1734016112.001541:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333635328 00000100:00100000:2.0:1734016112.001614:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10695 00000100:00100000:2.0:1734016112.001620:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333635328:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016112.001636:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016112.001651:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc2711514e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5500 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.001677:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115124 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54dd expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.001688:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016112.001690:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016112.001693:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc2711514e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3608576->3612671] (req 3608576->3612671) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5500 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.001718:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115124 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54dd expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.001727:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115124 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54dd expref: 5 pid: 7684 timeout: 479 lvb_type: 0 00000100:00100000:2.0:1734016112.001737:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335265792:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016112.001794:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016112.003880:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335265792:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016112.003904:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc2711514e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3608576->3612671] (req 3608576->3612671) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5500 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.003916:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd440, rc 0) 00000100:00100000:2.0:1734016112.003956:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333635328:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2335us (2548us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016112.003963:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10695 00000100:00100000:3.0:1734016112.006553:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.006708:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333635456 00000100:00100000:0.0:1734016112.006716:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333635456 00010000:00010000:0.0:1734016112.006788:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115124 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54dd expref: 6 pid: 7684 timeout: 479 lvb_type: 0 00000100:00080000:2.0:1734016112.006895:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016082 00000100:00100000:0.0:1734016112.006969:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2950 00000100:00100000:0.0:1734016112.006975:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333635456:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016112.006988:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016112.007008:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115124 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54dd expref: 6 pid: 7684 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1734016112.007029:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115124 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54dd expref: 6 pid: 7684 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1734016112.007049:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115124 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54dd expref: 6 pid: 7684 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1734016112.007076:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016112.007078:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016112.007084:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc2711514e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3608576->3612671) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5500 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.007091:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc2711514e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3608576->3612671) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5500 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.007123:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc2711514e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3608576->3612671) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5500 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016112.007135:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335265920:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016112.007188:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016112.015484:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335265920:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016112.015505:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016112.015552:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333635456:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 8576us (9006us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016112.015562:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2950 00000100:00100000:1.0:1734016112.025590:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.025696:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333635712 00000100:00100000:2.0:1734016112.025705:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333635712 00002000:00100000:2.0:1734016112.025745:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3608576->7856127) req@ffff880075446300 x1818247333635712/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 504/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.025755:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075446300 with x1818247333635712 ext(3608576->7856127) 00002000:00010000:2.0:1734016112.025761:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075446300 00000100:00100000:2.0:1734016112.025779:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8451 00000100:00100000:2.0:1734016112.025786:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333635712:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016112.050680:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333635712:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 24884us (25090us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1734016112.050691:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8451 00002000:00100000:2.0:1734016112.050703:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3608576->7856127) req@ffff880075446300 x1818247333635712/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 504/440 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 839680/839680 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.050712:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075446300 with x1818247333635712 ext(3608576->7856127) 00002000:00010000:2.0:1734016112.050717:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075446300 00000100:00100000:0.0:1734016112.060407:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.060518:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333635968 00000100:00100000:2.0:1734016112.060528:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333635968 00002000:00100000:2.0:1734016112.060573:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3604480->3608575) req@ffff8800749aea00 x1818247333635968/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.060581:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749aea00 with x1818247333635968 ext(3604480->3608575) 00002000:00010000:2.0:1734016112.060585:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749aea00 00000100:00100000:2.0:1734016112.060624:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8452 00000100:00100000:2.0:1734016112.060630:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333635968:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016112.061167:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333635968:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 535us (772us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016112.061174:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8452 00002000:00100000:2.0:1734016112.061181:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3604480->3608575) req@ffff8800749aea00 x1818247333635968/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.061188:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749aea00 with x1818247333635968 ext(3604480->3608575) 00002000:00010000:2.0:1734016112.061190:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749aea00 00000100:00100000:0.0:1734016112.066156:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016112.066260:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333636224 00000100:00100000:1.0:1734016112.066277:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333636224 00002000:00100000:1.0:1734016112.066316:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3600384->3604479) req@ffff8800749afb80 x1818247333636224/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016112.066325:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749afb80 with x1818247333636224 ext(3600384->3604479) 00002000:00010000:1.0:1734016112.066331:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749afb80 00000100:00100000:1.0:1734016112.066925:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8453 00000100:00100000:1.0:1734016112.066931:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333636224:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016112.067104:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333636224:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 171us (963us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016112.067112:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8453 00002000:00100000:1.0:1734016112.067117:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3600384->3604479) req@ffff8800749afb80 x1818247333636224/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016112.067122:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749afb80 with x1818247333636224 ext(3600384->3604479) 00002000:00010000:1.0:1734016112.067125:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749afb80 00000100:00100000:0.0:1734016112.073389:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.073497:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333636480 00000100:00100000:2.0:1734016112.073509:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333636480 00002000:00100000:2.0:1734016112.073551:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3596288->3600383) req@ffff8800749ae680 x1818247333636480/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.073560:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ae680 with x1818247333636480 ext(3596288->3600383) 00002000:00010000:2.0:1734016112.073566:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ae680 00000100:00100000:2.0:1734016112.073641:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8454 00000100:00100000:2.0:1734016112.073648:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333636480:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016112.073845:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333636480:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 196us (469us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016112.073850:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8454 00002000:00100000:2.0:1734016112.073855:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3596288->3600383) req@ffff8800749ae680 x1818247333636480/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.073861:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ae680 with x1818247333636480 ext(3596288->3600383) 00002000:00010000:2.0:1734016112.073864:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ae680 00000100:00100000:0.0:1734016112.077469:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016112.077605:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333636736 00000100:00100000:1.0:1734016112.077616:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333636736 00002000:00100000:1.0:1734016112.077667:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3592192->3596287) req@ffff8800749adc00 x1818247333636736/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016112.077679:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749adc00 with x1818247333636736 ext(3592192->3596287) 00002000:00010000:1.0:1734016112.077685:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749adc00 00000100:00100000:1.0:1734016112.077724:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8455 00000100:00100000:1.0:1734016112.077732:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333636736:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016112.085580:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333636736:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 7829us (8104us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016112.085597:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8455 00002000:00100000:1.0:1734016112.085615:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3592192->3596287) req@ffff8800749adc00 x1818247333636736/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016112.085625:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749adc00 with x1818247333636736 ext(3592192->3596287) 00002000:00010000:1.0:1734016112.085631:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749adc00 00000100:00100000:0.0:1734016112.114865:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016112.116275:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333636992 00000100:00100000:1.0:1734016112.116289:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333636992 00002000:00100000:1.0:1734016112.116345:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3588096->3592191) req@ffff8800749ac000 x1818247333636992/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016112.116360:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ac000 with x1818247333636992 ext(3588096->3592191) 00002000:00010000:1.0:1734016112.116367:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ac000 00000100:00100000:1.0:1734016112.116407:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8456 00000100:00100000:1.0:1734016112.116414:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333636992:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016112.116636:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333636992:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 221us (1786us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016112.116644:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8456 00002000:00100000:1.0:1734016112.116650:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3588096->3592191) req@ffff8800749ac000 x1818247333636992/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016112.116656:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ac000 with x1818247333636992 ext(3588096->3592191) 00002000:00010000:1.0:1734016112.116659:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ac000 00000100:00100000:0.0:1734016112.128927:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016112.129131:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333637248 00000100:00100000:1.0:1734016112.129145:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333637248 00002000:00100000:1.0:1734016112.129209:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3584000->3588095) req@ffff8800749ae300 x1818247333637248/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016112.129220:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ae300 with x1818247333637248 ext(3584000->3588095) 00002000:00010000:1.0:1734016112.129226:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ae300 00000100:00100000:1.0:1734016112.129273:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8457 00000100:00100000:1.0:1734016112.129280:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333637248:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016112.129502:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333637248:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 220us (588us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016112.129509:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8457 00002000:00100000:1.0:1734016112.129514:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3584000->3588095) req@ffff8800749ae300 x1818247333637248/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016112.129522:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ae300 with x1818247333637248 ext(3584000->3588095) 00002000:00010000:1.0:1734016112.129524:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ae300 00000100:00100000:3.0:1734016112.131055:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3506:1818247335266304:0@lo:400:kworker.0 00000100:00100000:1.0:1734016112.131100:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67a75f73-9674-4938-8c12-63813a36f078:3504:1818247335266048:0@lo:400:kworker.0 00000100:00100000:3.0:1734016112.131118:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1734016112.131147:0:3506:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1734016112.131152:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3506:1818247335266176:0@lo:400:kworker.0 00000100:00100000:1.0:1734016112.131156:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1734016112.131169:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1734016112.131179:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335266688:0@lo:400:kworker.0 00000100:00100000:1.0:1734016112.131181:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3504:1818247335266560:0@lo:400:kworker.0 00000100:00100000:3.0:1734016112.131200:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016112.131206:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016112.131223:0:3504:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1734016112.131227:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335266688 00000100:00100000:1.0:1734016112.131229:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335266432:0@lo:400:kworker.0 00000100:00100000:3.0:1734016112.131233:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335266688 00000100:00100000:1.0:1734016112.131244:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1734016112.131248:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016082 00000100:00100000:1.0:1734016112.131272:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335266304 00000100:00100000:1.0:1734016112.131276:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335266304 00000100:00100000:3.0:1734016112.131280:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335266432 00000100:00100000:3.0:1734016112.131282:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335266432 00000100:00100000:3.0:1734016112.131301:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1734016112.131307:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335266688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016112.131308:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335266176 00000100:00100000:1.0:1734016112.131310:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335266176 00000100:00100000:1.0:1734016112.131321:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335266560 00000100:00100000:1.0:1734016112.131323:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335266560 00000100:00100000:1.0:1734016112.131333:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1734016112.131338:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3506:x1818247335266304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1734016112.131350:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335266688:12345-0@lo:400:kworker.0 Request processed in 42us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016112.131356:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1734016112.131373:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3506:x1818247335266304:12345-0@lo:400:kworker.0 Request processed in 35us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016112.131373:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1734016112.131377:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335266432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016112.131380:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1734016112.131390:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1734016112.131393:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3506:x1818247335266176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1734016112.131402:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335266432:12345-0@lo:400:kworker.0 Request processed in 25us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016112.131406:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1734016112.131412:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3506:x1818247335266176:12345-0@lo:400:kworker.0 Request processed in 18us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016112.131417:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1734016112.131424:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1734016112.131427:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3504:x1818247335266560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1734016112.131436:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3506:1818247335266176:0@lo:400:kworker.0 00000100:00100000:1.0:1734016112.131442:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3504:x1818247335266560:12345-0@lo:400:kworker.0 Request processed in 14us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016112.131445:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335266688:0@lo:400:kworker.0 00000100:00100000:1.0:1734016112.131448:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1734016112.131453:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3506:1818247335266304:0@lo:400:kworker.0 00000100:00080000:1.0:1734016112.131461:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016082 00000100:00080000:1.0:1734016112.131464:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016082 00000100:00100000:1.0:1734016112.131483:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335266432:0@lo:400:kworker.0 00000100:00100000:3.0:1734016112.131484:0:6474:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335266048 00000100:00100000:3.0:1734016112.131487:0:6474:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335266048 00000100:00100000:1.0:1734016112.131492:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3504:1818247335266560:0@lo:400:kworker.0 00000100:00080000:1.0:1734016112.131507:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016082 00000100:00100000:3.0:1734016112.131509:0:6474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1734016112.131512:0:6474:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7612850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a75f73-9674-4938-8c12-63813a36f078+18:3504:x1818247335266048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1734016112.131547:0:6474:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7612850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a75f73-9674-4938-8c12-63813a36f078+18:3504:x1818247335266048:12345-0@lo:400:kworker.0 Request processed in 34us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016112.131552:0:6474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1734016112.131629:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67a75f73-9674-4938-8c12-63813a36f078:3504:1818247335266048:0@lo:400:kworker.0 00000100:00100000:0.0:1734016112.133397:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.133483:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333637504 00000100:00100000:2.0:1734016112.133490:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333637504 00002000:00100000:2.0:1734016112.133532:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3579904->3583999) req@ffff8800749ad880 x1818247333637504/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.133545:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad880 with x1818247333637504 ext(3579904->3583999) 00002000:00010000:2.0:1734016112.133553:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ad880 00000100:00100000:2.0:1734016112.133588:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8458 00000100:00100000:2.0:1734016112.133594:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333637504:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016112.133836:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333637504:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 241us (443us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016112.133843:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8458 00002000:00100000:2.0:1734016112.133849:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3579904->3583999) req@ffff8800749ad880 x1818247333637504/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.133856:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad880 with x1818247333637504 ext(3579904->3583999) 00002000:00010000:2.0:1734016112.133859:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ad880 00000100:00100000:0.0:1734016112.152271:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016112.152412:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333637760 00000100:00100000:1.0:1734016112.152429:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333637760 00002000:00100000:1.0:1734016112.152501:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3575808->3579903) req@ffff8800749af100 x1818247333637760/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016112.152513:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749af100 with x1818247333637760 ext(3575808->3579903) 00002000:00010000:1.0:1734016112.152519:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749af100 00000100:00100000:1.0:1734016112.152569:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8459 00000100:00100000:1.0:1734016112.152577:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333637760:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016112.152862:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333637760:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 284us (600us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016112.152870:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8459 00002000:00100000:1.0:1734016112.152877:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3575808->3579903) req@ffff8800749af100 x1818247333637760/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016112.152889:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749af100 with x1818247333637760 ext(3575808->3579903) 00002000:00010000:1.0:1734016112.152892:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749af100 00000100:00100000:0.0:1734016112.155192:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.155266:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333638016 00000100:00100000:2.0:1734016112.155274:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333638016 00002000:00100000:2.0:1734016112.155305:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3571712->3575807) req@ffff8800749ad500 x1818247333638016/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.155314:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad500 with x1818247333638016 ext(3571712->3575807) 00002000:00010000:2.0:1734016112.155318:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ad500 00000100:00100000:2.0:1734016112.155354:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8460 00000100:00100000:2.0:1734016112.155361:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333638016:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016112.155530:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333638016:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 167us (344us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016112.155537:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8460 00002000:00100000:2.0:1734016112.155542:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3571712->3575807) req@ffff8800749ad500 x1818247333638016/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.155549:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad500 with x1818247333638016 ext(3571712->3575807) 00002000:00010000:2.0:1734016112.155552:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ad500 00000100:00100000:0.0:1734016112.158053:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016112.158154:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333638272 00000100:00100000:1.0:1734016112.158166:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333638272 00002000:00100000:1.0:1734016112.158216:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3567616->3571711) req@ffff8800749aed80 x1818247333638272/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016112.158226:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749aed80 with x1818247333638272 ext(3567616->3571711) 00002000:00010000:1.0:1734016112.158231:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749aed80 00000100:00100000:1.0:1734016112.158271:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8461 00000100:00100000:1.0:1734016112.158277:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333638272:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016112.158484:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333638272:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 205us (438us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016112.158491:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8461 00002000:00100000:1.0:1734016112.158497:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3567616->3571711) req@ffff8800749aed80 x1818247333638272/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016112.158504:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749aed80 with x1818247333638272 ext(3567616->3571711) 00002000:00010000:1.0:1734016112.158507:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749aed80 00000100:00100000:0.0:1734016112.161270:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.161364:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333638400 00000100:00100000:2.0:1734016112.161372:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333638400 00002000:00100000:2.0:1734016112.161407:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3567616->3612671) req@ffff8800749ac700 x1818247333638400/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.161416:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ac700 with x1818247333638400 ext(3567616->3612671) 00002000:00010000:2.0:1734016112.161422:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ac700 00000100:00100000:1.0:1734016112.162955:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8462 00000100:00100000:1.0:1734016112.162964:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333638400:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016112.167830:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333638400:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4855us (6557us total) trans 4294969348 rc 0/0 00000100:00100000:0.0:1734016112.167843:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8462 00002000:00100000:0.0:1734016112.167857:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3567616->3612671) req@ffff8800749ac700 x1818247333638400/t4294969348(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/448 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016112.167866:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ac700 with x1818247333638400 ext(3567616->3612671) 00002000:00010000:0.0:1734016112.167872:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ac700 00000100:00100000:0.0:1734016112.172528:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.172689:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333638528 00000100:00100000:2.0:1734016112.172701:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333638528 00000100:00100000:2.0:1734016112.172777:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2142 00000100:00100000:2.0:1734016112.172784:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+14:9668:x1818247333638528:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:2.0:1734016112.174212:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+14:9668:x1818247333638528:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 1419us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016112.174223:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2142 00000100:00100000:0.0:1734016112.176304:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016112.176439:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333638656 00000100:00100000:3.0:1734016112.176448:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333638656 00000100:00100000:3.0:1734016112.176492:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10696 00000100:00100000:3.0:1734016112.176500:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333638656:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:3.0:1734016112.178521:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969348 is committed 00000100:00100000:2.0:1734016112.181185:0:3505:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1734016112.181206:0:3505:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335266816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1734016112.181272:0:3505:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1734016112.181315:0:7686:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335266816 00000100:00100000:2.0:1734016112.181321:0:7686:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335266816 00000100:00100000:2.0:1734016112.181351:0:7686:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1734016112.181357:0:7686:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335266816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1734016112.181377:0:7686:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 980042304 pending 0 free 3923468288 avail 3691831296 00000100:00100000:2.0:1734016112.181408:0:7686:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335266816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016112.181414:0:7686:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1734016112.181449:0:3505:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335266816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1734016112.185200:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333638656:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 8672us (8874us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016112.185219:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10696 00000100:00100000:0.0:1734016112.186993:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.187118:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333638784 00000100:00100000:2.0:1734016112.187133:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333638784 00000100:00100000:2.0:1734016112.187208:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2143 00000100:00100000:2.0:1734016112.187216:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:9668:x1818247333638784:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016112.187240:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016112.187262:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115155 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5507 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.187370:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711515c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016112.187384:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711515c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016112.187397:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711515c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:2.0:1734016112.187423:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 7855853 00000004:00200000:2.0:1734016112.187427:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016112.187448:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711515c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016112.187473:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115155 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5507 expref: 13 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.187496:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711515c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5507 expref: 12 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.187504:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016112.187508:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016112.187512:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016112.188494:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:9668:x1818247333638784:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1272us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016112.188503:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2143 00000100:00100000:0.0:1734016112.192655:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.194274:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333638912 00000100:00100000:2.0:1734016112.194285:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333638912 00000100:00100000:2.0:1734016112.194473:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10697 00000100:00100000:2.0:1734016112.194480:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333638912:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016112.194498:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016112.194513:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115163 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e550e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016112.194565:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335266944:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016112.194962:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ec00 going to sleep for 11 seconds 00002000:00010000:2.0:1734016112.197829:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 448 -> 536 00000100:00100000:2.0:1734016112.197853:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335266944:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016112.198224:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115163 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e550e expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016112.198237:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115163 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e550e expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016112.198259:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016112.198457:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333638912:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3975us (5809us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016112.198465:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10697 00000100:00100000:0.0:1734016112.200580:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.200728:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333639040 00000100:00100000:2.0:1734016112.200739:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333639040 00000100:00100000:1.0:1734016112.200980:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10698 00000100:00100000:1.0:1734016112.200987:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333639040:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016112.201004:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016112.201030:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711516a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5515 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016112.201085:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075447b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335267072:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016112.201153:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016112.203202:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075447b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335267072:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016112.203230:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711516a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5515 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016112.203242:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711516a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5515 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016112.203630:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016112.203731:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333639040:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2742us (3157us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016112.203741:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10698 00000100:00100000:0.0:1734016112.206386:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.206611:0:6482:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333639296 00000100:00100000:2.0:1734016112.206622:0:6482:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333639296 00000100:00100000:2.0:1734016112.206685:0:6482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 35 00000100:00100000:2.0:1734016112.206692:0:6482:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:9668:x1818247333639296:12345-192.168.201.16@tcp:35:fsx.0 00000100:00100000:2.0:1734016112.207012:0:6482:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c598caf-7141-4c19-8566-0b7731516db9+15:9668:x1818247333639296:12345-192.168.201.16@tcp:35:fsx.0 Request processed in 318us (639us total) trans 4294968678 rc 0/0 00000100:00100000:2.0:1734016112.207031:0:6482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 35 00000100:00100000:2.0:1734016112.212240:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.212319:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333639552 00000100:00100000:0.0:1734016112.212328:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333639552 00000100:00100000:0.0:1734016112.212382:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2144 00000100:00100000:0.0:1734016112.212389:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+15:9668:x1818247333639552:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016112.212412:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016112.212429:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115171 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e551c expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.212492:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115178 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.212504:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.212514:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.212531:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc2711517f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbace3da0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.212537:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc2711517f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbace3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.212542:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc2711517f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbace3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.212622:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27115186 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.212630:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27115186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.212636:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27115186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016112.212646:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 7855853 00010000:00010000:0.0:1734016112.212732:0:13956:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.212738:0:13956:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115178 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.212744:0:13956:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115178 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.212750:0:13956:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7582f40 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016112.212754:0:13956:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115178 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.212761:0:13956:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115178 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.212774:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880073621f00) 00010000:00010000:0.0:1734016112.212777:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016112.212781:0:13956:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115178 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.212785:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115178 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.213740:0:13956:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc2711517f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbace3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.213749:0:13956:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc2711517f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbace3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.213754:0:13956:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc2711517f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbace3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.213758:0:13956:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7582d00 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016112.213761:0:13956:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc2711517f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbace3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.213766:0:13956:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc2711517f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbace3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.213775:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbace3da0 (ffff880073780a00) 00010000:00010000:0.0:1734016112.213777:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016112.213779:0:13956:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc2711517f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbace3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.213782:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc2711517f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbace3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.213855:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115171 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e551c expref: 18 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.213867:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27115186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e551c expref: 17 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.213872:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016112.213874:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016112.213877:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581d40, rc 0) 00000100:00100000:0.0:1734016112.213953:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+17:9668:x1818247333639552:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1563us (1721us total) trans 4294968679 rc 0/0 00000100:00100000:0.0:1734016112.213962:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2144 00000100:00100000:0.0:1734016112.217754:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.218117:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333639808 00000100:00100000:2.0:1734016112.218130:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333639808 00000100:00100000:2.0:1734016112.218183:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2145 00000100:00100000:2.0:1734016112.218189:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+17:9668:x1818247333639808:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016112.218242:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1734016112.218264:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27115186 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e551c expref: 17 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.218301:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27115132 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e54e4 expref: 16 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.218310:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016112.218314:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016112.218450:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115194 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016112.218463:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711515c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5507 expref: 11 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.218469:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115194 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016112.218500:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711515c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5507 expref: 11 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.218512:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711515c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5507 expref: 11 pid: 13956 timeout: 479 lvb_type: 0 00000100:00100000:2.0:1734016112.218526:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335267200:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016112.218588:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016112.222236:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016112.222325:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333639936 00000100:00100000:1.0:1734016112.222333:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333639936 00010000:00010000:1.0:1734016112.222368:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711515c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5507 expref: 12 pid: 13956 timeout: 479 lvb_type: 0 00000100:00100000:0.0:1734016112.222475:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335267200:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016112.222503:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115194 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016112.222597:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2951 00000100:00100000:1.0:1734016112.222606:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247333639936:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016112.222620:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016112.222626:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711515c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5507 expref: 12 pid: 13956 timeout: 479 lvb_type: 0 00010000:00010000:1.0:1734016112.222641:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711515c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5507 expref: 12 pid: 13956 timeout: 479 lvb_type: 0 00010000:00010000:1.0:1734016112.222661:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711515c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5507 expref: 12 pid: 13956 timeout: 479 lvb_type: 0 00010000:00010000:1.0:1734016112.224190:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016112.224199:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115194 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016112.224208:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016112.224214:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115194 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016112.224247:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016112.224314:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333639936:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1704us (2084us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016112.224323:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2951 00010000:00010000:0.0:1734016112.224426:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.224434:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:0.0:1734016112.224539:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968680 00000004:00010000:0.0:1734016112.224590:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880073b9d500 reply state ffff88012e16d000 transno 4294968681 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016112.224598:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016112.224670:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333639808:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 6480us (6930us total) trans 4294968681 rc 0/0 00000100:00100000:0.0:1734016112.224677:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2145 00000020:00080000:0.0:1734016112.224681:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1734016112.235655:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016112.235669:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115194 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016112.235675:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115194 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016112.235681:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc480 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:1.0:1734016112.235684:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115194 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016112.235690:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115194 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016112.235704:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016112.235707:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1734016112.235709:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115194 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016112.235714:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115194 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016112.242508:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.242588:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333640064 00000100:00100000:0.0:1734016112.242598:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333640064 00002000:00010000:0.0:1734016112.242633:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (2510599->18446744073709551615) 00002000:00100000:0.0:1734016112.242639:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007493a300 with x1818247333640064 ext(2510599->18446744073709551615) 00002000:00010000:0.0:1734016112.242649:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007493a300. 00000100:00100000:0.0:1734016112.242674:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8463 00000100:00100000:0.0:1734016112.242681:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333640064:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016112.248192:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7855853 -> 2510599 00002000:00010000:0.0:1734016112.248201:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016112 -> 1734016112 00002000:00010000:0.0:1734016112.248204:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016112 -> 1734016112 00002000:00010000:0.0:1734016112.248205:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016112 -> 1734016112 00002000:00010000:0.0:1734016112.248207:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 536 -> 312 00000100:00100000:0.0:1734016112.254227:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333640064:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 11528us (11711us total) trans 4294969349 rc 0/0 00000100:00100000:0.0:1734016112.254243:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8463 00002000:00010000:0.0:1734016112.254258:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (2510599->18446744073709551615) 00002000:00100000:0.0:1734016112.254262:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007493a300 with x1818247333640064 ext(2510599->18446744073709551615) 00002000:00010000:0.0:1734016112.254274:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007493a300. 00000100:00100000:0.0:1734016112.258664:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.258753:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333640192 00000100:00100000:2.0:1734016112.258764:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333640192 00000100:00100000:2.0:1734016112.258845:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2146 00000100:00100000:2.0:1734016112.258851:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:9668:x1818247333640192:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016112.258869:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016112.258887:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711519b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5523 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.258963:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271151a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016112.258975:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271151a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016112.258983:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271151a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:2.0:1734016112.259006:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 2510599 00000004:00200000:2.0:1734016112.259009:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016112.259038:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271151a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016112.259061:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711519b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5523 expref: 13 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.259077:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271151a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5523 expref: 12 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.259084:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016112.259087:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016112.259089:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016112.259138:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:9668:x1818247333640192:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 286us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016112.259144:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2146 00000100:00100000:0.0:1734016112.265317:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016112.265390:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333640320 00000100:00100000:1.0:1734016112.265399:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333640320 00000100:00100000:1.0:1734016112.265450:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10699 00000100:00100000:1.0:1734016112.265457:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333640320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016112.265474:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016112.265489:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc271151a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e552a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016112.265540:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075447b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335267328:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016112.265601:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016112.273962:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075447b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335267328:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016112.273999:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc271151a9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e552a expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016112.274013:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc271151a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e552a expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016112.274056:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016112.274110:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333640320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8652us (8801us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016112.274118:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10699 00000100:00100000:0.0:1734016112.287559:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016112.287747:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333640448 00000100:00100000:1.0:1734016112.287757:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333640448 00000100:00100000:1.0:1734016112.287840:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10700 00000100:00100000:1.0:1734016112.287847:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333640448:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016112.287863:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016112.287881:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc271151b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5531 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016112.287937:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075447b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335267456:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016112.290783:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016112.297527:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075447b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335267456:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016112.297568:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc271151b0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5531 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016112.297583:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc271151b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5531 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016112.301739:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f180, rc 0) 00000100:00100000:1.0:1734016112.301856:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333640448:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 14001us (14297us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016112.301872:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10700 00000100:00100000:3.0:1734016112.309602:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.309720:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333640704 00000100:00100000:2.0:1734016112.309733:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333640704 00000100:00100000:2.0:1734016112.309787:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2147 00000100:00100000:2.0:1734016112.309840:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:9668:x1818247333640704:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016112.309918:0:7704:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016112.309953:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271151a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5523 expref: 12 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.309989:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016112.309995:0:7704:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016112.310185:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271151b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.310205:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271151b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.310216:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271151b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:2.0:1734016112.310251:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968682 00000004:00010000:2.0:1734016112.310270:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880073bbc380 reply state ffff88012e16f000 transno 4294968683 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271151b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:2.0:1734016112.310277:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016112.310362:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333640704:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 564us (771us total) trans 4294968683 rc 0/0 00000100:00100000:2.0:1734016112.310371:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2147 00000020:00080000:2.0:1734016112.310376:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016112.312910:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016112.313030:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333640832 00000100:00100000:1.0:1734016112.313040:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333640832 00000100:00100000:1.0:1734016112.313085:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10701 00000100:00100000:1.0:1734016112.313092:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333640832:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016112.313112:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016112.313128:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc271151be lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5538 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016112.313158:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc2711514e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3608576->3612671) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5500 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016112.313165:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016112.313167:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016112.313170:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc271151be lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5538 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016112.313199:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc2711514e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3608576->3612671) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5500 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016112.313210:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc2711514e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3608576->3612671) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5500 expref: 7 pid: 7684 timeout: 479 lvb_type: 0 00000100:00100000:1.0:1734016112.313223:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075447b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335267584:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016112.313285:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f240 going to sleep for 11 seconds 00010000:00010000:2.0:1734016112.313493:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271151b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.313502:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271151b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.313508:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271151b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.313513:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd680 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016112.313516:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271151b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.313523:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271151b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.313539:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016112.313542:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016112.313546:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271151b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.313554:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271151b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00000100:00100000:1.0:1734016112.317960:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075447b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335267584:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016112.318000:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc271151be lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5538 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016112.318027:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016112.318073:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333640832:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4980us (5175us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016112.318082:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10701 00000100:00100000:0.0:1734016112.318644:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016112.318744:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333640960 00000100:00100000:1.0:1734016112.318752:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333640960 00010000:00010000:1.0:1734016112.318775:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc2711514e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3608576->3612671) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5500 expref: 8 pid: 7684 timeout: 479 lvb_type: 0 00000100:00100000:1.0:1734016112.318841:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2952 00000100:00100000:1.0:1734016112.318847:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a780b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333640960:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016112.318862:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016112.318887:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc2711514e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3608576->3612671) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5500 expref: 8 pid: 7684 timeout: 479 lvb_type: 0 00010000:00010000:1.0:1734016112.318898:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc2711514e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3608576->3612671) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5500 expref: 8 pid: 7684 timeout: 479 lvb_type: 0 00010000:00010000:1.0:1734016112.318921:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc2711514e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3608576->3612671) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5500 expref: 8 pid: 7684 timeout: 479 lvb_type: 0 00010000:00010000:1.0:1734016112.318939:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016112.318941:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016112.318947:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc271151be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5538 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016112.318958:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc271151be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5538 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016112.318995:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc271151be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5538 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016112.319009:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075447b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335267712:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016112.319058:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016112.322013:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075447b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335267712:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016112.322047:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016112.322128:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a780b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333640960:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3279us (3485us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016112.322139:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2952 00000100:00100000:2.0:1734016112.324456:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.326384:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333641088 00000100:00100000:0.0:1734016112.326403:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333641088 00002000:00010000:0.0:1734016112.326457:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (3320598->18446744073709551615) 00002000:00100000:0.0:1734016112.326464:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074939c00 with x1818247333641088 ext(3320598->18446744073709551615) 00002000:00010000:0.0:1734016112.326478:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074939c00. 00000100:00100000:0.0:1734016112.327849:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8464 00000100:00100000:0.0:1734016112.327860:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333641088:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016112.328146:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 2510599 -> 3320598 00002000:00010000:0.0:1734016112.328150:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016112 -> 1734016112 00002000:00010000:0.0:1734016112.328152:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016112 -> 1734016112 00002000:00010000:0.0:1734016112.328154:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016112 -> 1734016112 00002000:00010000:0.0:1734016112.328156:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 312 -> 312 00000100:00100000:0.0:1734016112.328244:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333641088:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 385us (3794us total) trans 4294969350 rc 0/0 00000100:00100000:0.0:1734016112.328252:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8464 00002000:00010000:0.0:1734016112.328257:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (3320598->18446744073709551615) 00002000:00100000:0.0:1734016112.328261:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074939c00 with x1818247333641088 ext(3320598->18446744073709551615) 00002000:00010000:0.0:1734016112.328268:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074939c00. 00000100:00100000:3.0:1734016112.335745:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.335867:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333641344 00000100:00100000:0.0:1734016112.335885:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333641344 00002000:00100000:0.0:1734016112.335941:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3317760->3321855) req@ffff880073bbd500 x1818247333641344/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016112.335951:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbd500 with x1818247333641344 ext(3317760->3321855) 00002000:00010000:0.0:1734016112.335956:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbd500 00000100:00100000:0.0:1734016112.337410:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8465 00000100:00100000:0.0:1734016112.337423:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333641344:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016112.337693:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333641344:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 271us (1959us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016112.337702:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8465 00002000:00100000:0.0:1734016112.337710:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3317760->3321855) req@ffff880073bbd500 x1818247333641344/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016112.337719:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbd500 with x1818247333641344 ext(3317760->3321855) 00002000:00010000:0.0:1734016112.337725:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbd500 00000100:00100000:1.0:1734016112.347940:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.348160:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333641600 00000100:00100000:2.0:1734016112.348177:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333641600 00002000:00100000:2.0:1734016112.348252:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3313664->3317759) req@ffff880075447b80 x1818247333641600/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.348265:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075447b80 with x1818247333641600 ext(3313664->3317759) 00002000:00010000:2.0:1734016112.348271:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075447b80 00000100:00100000:2.0:1734016112.349818:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8466 00000100:00100000:2.0:1734016112.349831:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333641600:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016112.350105:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333641600:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 274us (2186us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016112.350113:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8466 00002000:00100000:2.0:1734016112.350123:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3313664->3317759) req@ffff880075447b80 x1818247333641600/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.350132:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075447b80 with x1818247333641600 ext(3313664->3317759) 00002000:00010000:2.0:1734016112.350137:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075447b80 00000100:00100000:3.0:1734016112.369702:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.372143:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333641856 00000100:00100000:2.0:1734016112.372155:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333641856 00002000:00100000:2.0:1734016112.372193:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3309568->3313663) req@ffff880073bbf800 x1818247333641856/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.372204:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbf800 with x1818247333641856 ext(3309568->3313663) 00002000:00010000:2.0:1734016112.372210:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbf800 00000100:00100000:2.0:1734016112.372254:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8467 00000100:00100000:2.0:1734016112.372260:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333641856:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016112.372457:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333641856:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 196us (2763us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016112.372465:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8467 00002000:00100000:2.0:1734016112.372470:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3309568->3313663) req@ffff880073bbf800 x1818247333641856/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.372476:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbf800 with x1818247333641856 ext(3309568->3313663) 00002000:00010000:2.0:1734016112.372479:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbf800 00000100:00100000:3.0:1734016112.379213:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.379320:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333642112 00000100:00100000:2.0:1734016112.379331:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333642112 00002000:00100000:2.0:1734016112.379369:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3305472->3309567) req@ffff880073bbed80 x1818247333642112/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.379379:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbed80 with x1818247333642112 ext(3305472->3309567) 00002000:00010000:2.0:1734016112.379384:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbed80 00000100:00100000:2.0:1734016112.379425:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8468 00000100:00100000:2.0:1734016112.379431:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333642112:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016112.379598:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333642112:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 165us (394us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016112.379604:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8468 00002000:00100000:2.0:1734016112.379609:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3305472->3309567) req@ffff880073bbed80 x1818247333642112/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.379616:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbed80 with x1818247333642112 ext(3305472->3309567) 00002000:00010000:2.0:1734016112.379618:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbed80 00000100:00100000:1.0:1734016112.385267:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.385419:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333642368 00000100:00100000:0.0:1734016112.385430:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333642368 00002000:00100000:0.0:1734016112.385491:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3301376->3305471) req@ffff880075447100 x1818247333642368/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016112.385503:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075447100 with x1818247333642368 ext(3301376->3305471) 00002000:00010000:0.0:1734016112.385509:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075447100 00000100:00100000:0.0:1734016112.385559:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8469 00000100:00100000:0.0:1734016112.385567:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333642368:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016112.389447:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333642368:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 3858us (4178us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016112.389466:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8469 00002000:00100000:0.0:1734016112.389483:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3301376->3305471) req@ffff880075447100 x1818247333642368/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016112.389494:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075447100 with x1818247333642368 ext(3301376->3305471) 00002000:00010000:0.0:1734016112.389501:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075447100 00000100:00100000:1.0:1734016112.389720:0:3504:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1734016112.389744:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335267840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1734016112.389848:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1734016112.389934:0:7685:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335267840 00000100:00100000:2.0:1734016112.389947:0:7685:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335267840 00000100:00100000:2.0:1734016112.389999:0:7685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1734016112.390006:0:7685:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335267840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1734016112.390059:0:7685:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 490160704 pending 0 free 3923677184 avail 3692154880 00000100:00100000:2.0:1734016112.390116:0:7685:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335267840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016112.390122:0:7685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1734016112.390202:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335267840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1734016112.406054:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.406243:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333642624 00000100:00100000:0.0:1734016112.406253:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333642624 00002000:00100000:0.0:1734016112.406294:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3297280->3301375) req@ffff880073bbc700 x1818247333642624/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016112.406313:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbc700 with x1818247333642624 ext(3297280->3301375) 00002000:00010000:0.0:1734016112.406319:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbc700 00000100:00100000:0.0:1734016112.406352:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8470 00000100:00100000:0.0:1734016112.406358:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333642624:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016112.406551:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333642624:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 192us (508us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016112.406559:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8470 00002000:00100000:0.0:1734016112.406564:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3297280->3301375) req@ffff880073bbc700 x1818247333642624/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016112.406571:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbc700 with x1818247333642624 ext(3297280->3301375) 00002000:00010000:0.0:1734016112.406574:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbc700 00000100:00100000:3.0:1734016112.422410:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.426169:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333642880 00000100:00100000:0.0:1734016112.426189:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333642880 00002000:00100000:0.0:1734016112.426250:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3293184->3297279) req@ffff880073bbe680 x1818247333642880/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016112.426261:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbe680 with x1818247333642880 ext(3293184->3297279) 00002000:00010000:0.0:1734016112.426267:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbe680 00000100:00100000:0.0:1734016112.426321:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8471 00000100:00100000:0.0:1734016112.426327:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333642880:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016112.426555:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333642880:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 226us (4165us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016112.426562:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8471 00002000:00100000:0.0:1734016112.426568:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3293184->3297279) req@ffff880073bbe680 x1818247333642880/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016112.426575:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbe680 with x1818247333642880 ext(3293184->3297279) 00002000:00010000:0.0:1734016112.426578:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbe680 00000100:00100000:1.0:1734016112.430935:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.431066:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333643136 00000100:00100000:2.0:1734016112.431078:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333643136 00002000:00100000:2.0:1734016112.431126:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3289088->3293183) req@ffff880075444e00 x1818247333643136/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.431136:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075444e00 with x1818247333643136 ext(3289088->3293183) 00002000:00010000:2.0:1734016112.431141:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075444e00 00000100:00100000:2.0:1734016112.431164:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8472 00000100:00100000:2.0:1734016112.431171:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333643136:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016112.431381:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333643136:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 208us (458us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016112.431388:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8472 00002000:00100000:2.0:1734016112.431394:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3289088->3293183) req@ffff880075444e00 x1818247333643136/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.431401:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075444e00 with x1818247333643136 ext(3289088->3293183) 00002000:00010000:2.0:1734016112.431405:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075444e00 00000100:00100000:3.0:1734016112.435673:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.438496:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333643392 00000100:00100000:0.0:1734016112.438515:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333643392 00002000:00100000:0.0:1734016112.438593:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3284992->3289087) req@ffff880073bbfb80 x1818247333643392/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016112.438605:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbfb80 with x1818247333643392 ext(3284992->3289087) 00002000:00010000:0.0:1734016112.438612:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbfb80 00000100:00100000:0.0:1734016112.438666:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8473 00000100:00100000:0.0:1734016112.438675:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333643392:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016112.438997:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333643392:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 321us (3336us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016112.439005:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8473 00002000:00100000:0.0:1734016112.439019:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3284992->3289087) req@ffff880073bbfb80 x1818247333643392/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016112.439027:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbfb80 with x1818247333643392 ext(3284992->3289087) 00002000:00010000:0.0:1734016112.439030:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbfb80 00000100:00100000:3.0:1734016112.466234:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.466401:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333643648 00000100:00100000:2.0:1734016112.466413:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333643648 00002000:00100000:2.0:1734016112.466469:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3280896->3284991) req@ffff88007345f100 x1818247333643648/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.466480:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345f100 with x1818247333643648 ext(3280896->3284991) 00002000:00010000:2.0:1734016112.466486:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345f100 00000100:00100000:2.0:1734016112.466513:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8474 00000100:00100000:2.0:1734016112.466521:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333643648:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016112.470827:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333643648:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 4275us (4575us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016112.470844:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8474 00002000:00100000:2.0:1734016112.470864:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3280896->3284991) req@ffff88007345f100 x1818247333643648/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.470875:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345f100 with x1818247333643648 ext(3280896->3284991) 00002000:00010000:2.0:1734016112.470881:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345f100 00000100:00100000:1.0:1734016112.475932:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.476052:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333643776 00000100:00100000:2.0:1734016112.476068:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333643776 00002000:00100000:2.0:1734016112.476126:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3280896->3320597) req@ffff880075444380 x1818247333643776/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.476137:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075444380 with x1818247333643776 ext(3280896->3320597) 00002000:00010000:2.0:1734016112.476142:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075444380 00000100:00100000:2.0:1734016112.476167:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8475 00000100:00100000:2.0:1734016112.476175:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333643776:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016112.483537:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333643776:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 7343us (7598us total) trans 4294969351 rc 0/0 00000100:00100000:0.0:1734016112.483557:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8475 00002000:00100000:0.0:1734016112.483574:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3280896->3320597) req@ffff880075444380 x1818247333643776/t4294969351(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:73/0 lens 488/448 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016112.483584:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075444380 with x1818247333643776 ext(3280896->3320597) 00002000:00010000:0.0:1734016112.483592:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075444380 00000100:00100000:3.0:1734016112.488323:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.488419:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333643904 00000100:00100000:0.0:1734016112.488430:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333643904 00000100:00100000:0.0:1734016112.488506:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2148 00000100:00100000:0.0:1734016112.488515:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:9668:x1818247333643904:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:0.0:1734016112.488670:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:9668:x1818247333643904:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 155us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016112.488678:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2148 00000100:00100000:1.0:1734016112.501901:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.502260:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333644032 00000100:00100000:2.0:1734016112.502275:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333644032 00000100:00100000:2.0:1734016112.503130:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10702 00000100:00100000:2.0:1734016112.503141:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333644032:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016112.510240:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969351 is committed 00000001:00080000:0.0:1734016112.510272:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969349 is committed 00000100:00100000:2.0:1734016112.510589:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333644032:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 7438us (8695us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016112.510603:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10702 00010000:00010000:2.0:1734016112.519079:0:6469:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1734016112.521692:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.524164:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333644160 00000100:00100000:2.0:1734016112.524188:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333644160 00000100:00100000:2.0:1734016112.524323:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2149 00000100:00100000:2.0:1734016112.524334:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+17:9668:x1818247333644160:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016112.524378:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016112.524409:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271151c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e553f expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.524532:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271151cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.524549:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271151cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.524561:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271151cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:2.0:1734016112.524589:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 3320598 00000004:00200000:2.0:1734016112.524593:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016112.524614:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271151cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.524638:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271151c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e553f expref: 19 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.524678:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271151cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e553f expref: 18 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.524688:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016112.524691:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016112.524696:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016112.525059:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333644160:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 725us (3381us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016112.525067:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2149 00000100:00100000:0.0:1734016112.533289:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.533449:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333644288 00000100:00100000:2.0:1734016112.533469:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333644288 00000100:00100000:2.0:1734016112.533623:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10703 00000100:00100000:2.0:1734016112.533632:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333644288:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016112.533656:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016112.533684:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271151d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5546 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016112.533750:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335267968:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016112.533882:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e540 going to sleep for 11 seconds 00002000:00010000:2.0:1734016112.537433:0:7684:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime: 1734016112 -> 1734016113 00002000:00010000:2.0:1734016112.537447:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016112 -> 1734016113 00002000:00010000:2.0:1734016112.537449:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 312 -> 392 00000100:00100000:2.0:1734016112.537484:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335267968:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016112.537534:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271151d3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5546 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016112.537551:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271151d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5546 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016112.537596:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd680, rc 0) 00000100:00100000:2.0:1734016112.537678:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333644288:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4046us (4396us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016112.537687:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10703 00000100:00100000:0.0:1734016112.540674:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.542724:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333644416 00000100:00100000:2.0:1734016112.542743:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333644416 00000100:00100000:2.0:1734016112.542862:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10704 00000100:00100000:2.0:1734016112.542869:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333644416:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016112.542893:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016112.542920:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc271151da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e554d expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016112.542983:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335268096:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016112.543087:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016112.550177:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335268096:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016112.550214:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc271151da lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e554d expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016112.550228:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc271151da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e554d expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016112.550264:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd440, rc 0) 00000100:00100000:2.0:1734016112.550339:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333644416:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7468us (9677us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016112.550351:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10704 00000100:00100000:1.0:1734016112.556728:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.556859:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333644544 00000100:00100000:2.0:1734016112.556871:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333644544 00000100:00100000:2.0:1734016112.556928:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10705 00000100:00100000:2.0:1734016112.556935:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333644544:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016112.556952:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016112.556971:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271151e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5554 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016112.557036:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335268224:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016112.557113:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016112.570786:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335268224:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016112.570867:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271151e1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5554 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016112.570881:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271151e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5554 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016112.570901:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016112.571221:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333644544:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 14282us (14503us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016112.571232:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10705 00000100:00100000:1.0:1734016112.587760:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.588079:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333644672 00000100:00100000:2.0:1734016112.588095:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333644672 00000100:00100000:2.0:1734016112.588172:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10706 00000100:00100000:2.0:1734016112.588182:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333644672:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016112.588205:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016112.588226:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271151e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e555b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016112.588299:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335268352:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016112.595036:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016112.607498:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335268352:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016112.607544:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271151e8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e555b expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016112.607562:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271151e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e555b expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016112.607598:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016112.607668:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333644672:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 19484us (19912us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016112.607678:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10706 00000100:00100000:1.0:1734016112.614752:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.614853:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333644800 00000100:00100000:2.0:1734016112.614864:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333644800 00000100:00100000:2.0:1734016112.614925:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10707 00000100:00100000:2.0:1734016112.614934:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333644800:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016112.614955:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016112.614976:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271151ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5562 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016112.615053:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335268480:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016112.615129:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016112.632873:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335268480:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016112.632912:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271151ef lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5562 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016112.632927:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271151ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5562 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016112.632956:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016112.633028:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333644800:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 18094us (18287us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016112.633038:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10707 00000100:00100000:1.0:1734016112.638130:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.639202:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333644928 00000100:00100000:2.0:1734016112.639217:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333644928 00000100:00100000:2.0:1734016112.639289:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10708 00000100:00100000:2.0:1734016112.639297:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88009024bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333644928:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016112.639322:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016112.639348:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271151f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5569 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016112.639427:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335268608:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016112.639530:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016112.645600:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335268608:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016112.645643:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271151f6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5569 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016112.645657:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271151f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5569 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016112.645719:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016112.645999:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88009024bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333644928:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6700us (7889us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016112.646017:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10708 00000100:00100000:1.0:1734016112.660624:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.660913:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333645184 00000100:00100000:2.0:1734016112.660924:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333645184 00000100:00100000:2.0:1734016112.661181:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2150 00000100:00100000:2.0:1734016112.661192:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:9668:x1818247333645184:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016112.661519:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271151fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.661539:0:7704:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271151cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e553f expref: 17 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.661547:0:7704:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271151fd lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.661595:0:7704:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271151cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e553f expref: 17 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.661611:0:7704:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271151cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e553f expref: 17 pid: 7704 timeout: 479 lvb_type: 0 00000100:00100000:2.0:1734016112.661631:0:7704:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335268736:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016112.661723:0:7704:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016112.668435:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.668502:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333645312 00000100:00100000:0.0:1734016112.668516:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333645312 00010000:00010000:0.0:1734016112.668549:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271151cc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e553f expref: 18 pid: 7704 timeout: 479 lvb_type: 0 00000100:00100000:0.0:1734016112.668588:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2953 00000100:00100000:0.0:1734016112.668595:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+18:1981:x1818247333645312:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016112.668606:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016112.668612:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271151cc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e553f expref: 18 pid: 7704 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1734016112.668623:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271151cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e553f expref: 18 pid: 7704 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1734016112.668640:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016112.668644:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271151fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016112.668652:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271151fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016112.668658:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271151fd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016112.668674:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016112.668730:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+18:1981:x1818247333645312:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 135us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016112.668737:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2953 00010000:00010000:2.0:1734016112.669517:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271151cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e553f expref: 17 pid: 7704 timeout: 479 lvb_type: 0 00000100:00100000:2.0:1734016112.670820:0:7704:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335268736:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016112.670850:0:7704:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271151fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.670861:0:7704:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271151fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.670865:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271151fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:2.0:1734016112.670953:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968684 00000004:00010000:2.0:1734016112.670995:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075447800 reply state ffff88012e16c000 transno 4294968685 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271151fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:2.0:1734016112.671002:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016112.672650:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333645184:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 11453us (12032us total) trans 4294968685 rc 0/0 00000100:00100000:2.0:1734016112.672659:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2150 00000020:00080000:2.0:1734016112.672664:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1734016112.683153:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.683218:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333645440 00000100:00100000:0.0:1734016112.683231:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333645440 00002000:00010000:0.0:1734016112.683273:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6429576->18446744073709551615) 00002000:00100000:0.0:1734016112.683277:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075445c00 with x1818247333645440 ext(6429576->18446744073709551615) 00002000:00010000:0.0:1734016112.683290:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075445c00. 00000100:00100000:0.0:1734016112.683330:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8476 00000100:00100000:0.0:1734016112.683337:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333645440:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016112.683724:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 3320598 -> 6429576 00002000:00010000:0.0:1734016112.683729:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016113 -> 1734016113 00002000:00010000:0.0:1734016112.683731:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016112 -> 1734016112 00002000:00010000:0.0:1734016112.683733:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016113 -> 1734016113 00002000:00010000:0.0:1734016112.683735:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 392 -> 392 00000100:00100000:0.0:1734016112.683827:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333645440:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 464us (660us total) trans 4294969352 rc 0/0 00000100:00100000:0.0:1734016112.683836:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8476 00002000:00010000:0.0:1734016112.683841:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6429576->18446744073709551615) 00002000:00100000:0.0:1734016112.683843:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075445c00 with x1818247333645440 ext(6429576->18446744073709551615) 00002000:00010000:0.0:1734016112.683847:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075445c00. 00010000:00010000:2.0:1734016112.683861:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271151fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.683880:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271151fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.683891:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271151fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.683896:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcfc0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016112.683900:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271151fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.683906:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271151fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.683922:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016112.683925:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016112.683929:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271151fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.683933:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271151fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016112.687993:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.688253:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333645568 00000100:00100000:2.0:1734016112.688264:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333645568 00000100:00100000:2.0:1734016112.688314:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2151 00000100:00100000:2.0:1734016112.688321:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+17:9668:x1818247333645568:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016112.688341:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016112.688361:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115204 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5570 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.688455:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711520b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.688468:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711520b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.688482:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711520b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:2.0:1734016112.688507:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 6429576 00000004:00200000:2.0:1734016112.688510:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016112.688523:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711520b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016112.688540:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115204 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5570 expref: 19 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.688571:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711520b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5570 expref: 18 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016112.688577:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016112.688580:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016112.688582:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016112.688625:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333645568:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 305us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016112.688631:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2151 00000100:00100000:1.0:1734016112.696635:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.696736:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333645696 00000100:00100000:2.0:1734016112.696748:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333645696 00000100:00100000:2.0:1734016112.696824:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10709 00000100:00100000:2.0:1734016112.696833:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333645696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016112.696861:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016112.696882:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115212 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5577 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016112.696991:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335268864:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016112.697210:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016112.701965:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335268864:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016112.702021:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115212 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5577 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016112.702036:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115212 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5577 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016112.702063:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:0.0:1734016112.702136:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333645696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5303us (5515us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016112.702146:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10709 00000100:00100000:1.0:1734016112.704722:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.704842:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333645824 00000100:00100000:0.0:1734016112.704854:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333645824 00000100:00100000:0.0:1734016112.704916:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10710 00000100:00100000:0.0:1734016112.704925:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333645824:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016112.704949:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016112.704973:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115219 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e557e expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016112.705055:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335268992:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016112.705151:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eed80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016112.713906:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335268992:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016112.713951:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115219 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e557e expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016112.713971:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115219 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e557e expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016112.714530:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580900, rc 0) 00000100:00100000:0.0:1734016112.714639:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333645824:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9712us (9924us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016112.714650:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10710 00000100:00100000:3.0:1734016112.723279:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.723402:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333645952 00000100:00100000:0.0:1734016112.723417:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333645952 00000100:00100000:0.0:1734016112.724170:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10711 00000100:00100000:0.0:1734016112.724179:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333645952:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016112.724207:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016112.724229:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115220 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5585 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016112.724307:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335269120:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016112.724389:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eed80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016112.732352:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335269120:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016112.732399:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115220 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5585 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016112.732416:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115220 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5585 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016112.733091:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580900, rc 0) 00000100:00100000:0.0:1734016112.733613:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333645952:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9430us (10350us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016112.733624:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10711 00000100:00100000:1.0:1734016112.747845:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.747941:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333646080 00000100:00100000:0.0:1734016112.747952:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333646080 00000100:00100000:0.0:1734016112.748018:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10712 00000100:00100000:0.0:1734016112.748027:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333646080:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016112.748047:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016112.748067:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115227 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e558c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.748108:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc271151be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5538 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.748116:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016112.748118:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016112.748121:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115227 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3067904->3071999] (req 3067904->3071999) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e558c expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.748162:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc271151be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5538 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.748177:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc271151be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5538 expref: 6 pid: 7684 timeout: 479 lvb_type: 0 00000100:00100000:0.0:1734016112.748197:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335269248:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016112.748257:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eed80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016112.750634:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335269248:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016112.750680:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115227 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3067904->3071999] (req 3067904->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e558c expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.750695:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:0.0:1734016112.752190:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333646080:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4153us (4345us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016112.752202:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10712 00000100:00100000:1.0:1734016112.759418:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.759909:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333646208 00000100:00100000:0.0:1734016112.759925:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333646208 00010000:00010000:0.0:1734016112.759983:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc271151be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5538 expref: 7 pid: 7684 timeout: 479 lvb_type: 0 00000100:00100000:0.0:1734016112.760051:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2954 00000100:00100000:0.0:1734016112.760062:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333646208:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016112.760083:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016112.760115:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc271151be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5538 expref: 7 pid: 7684 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1734016112.760130:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc271151be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5538 expref: 7 pid: 7684 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1734016112.760174:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc271151be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5538 expref: 7 pid: 7684 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1734016112.760220:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016112.760223:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016112.760231:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115227 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3071999) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e558c expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.760241:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115227 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3071999) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e558c expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.760300:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115227 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e558c expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016112.760317:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335269376:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016112.760427:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eed80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016112.767246:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335269376:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016112.767282:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016112.767371:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333646208:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7309us (7973us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016112.767387:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2954 00000100:00100000:0.0:1734016112.770651:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.771317:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333646464 00000100:00100000:2.0:1734016112.771333:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333646464 00002000:00100000:2.0:1734016112.771397:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3067904->3071999) req@ffff880073b9ea00 x1818247333646464/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.771409:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9ea00 with x1818247333646464 ext(3067904->3071999) 00002000:00010000:2.0:1734016112.771417:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9ea00 00000100:00100000:2.0:1734016112.771454:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8477 00000100:00100000:2.0:1734016112.771464:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333646464:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016112.771763:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333646464:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 300us (1131us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016112.771771:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8477 00002000:00100000:2.0:1734016112.771777:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3067904->3071999) req@ffff880073b9ea00 x1818247333646464/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.771784:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9ea00 with x1818247333646464 ext(3067904->3071999) 00002000:00010000:2.0:1734016112.771787:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9ea00 00000100:00100000:1.0:1734016112.789546:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.792917:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333646720 00000100:00100000:2.0:1734016112.792936:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333646720 00002000:00100000:2.0:1734016112.793020:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3063808->3067903) req@ffff88007560ad80 x1818247333646720/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.793032:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560ad80 with x1818247333646720 ext(3063808->3067903) 00002000:00010000:2.0:1734016112.793039:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560ad80 00000100:00100000:2.0:1734016112.793092:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8478 00000100:00100000:2.0:1734016112.793100:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333646720:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016112.793347:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333646720:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 246us (3815us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016112.793355:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8478 00002000:00100000:2.0:1734016112.793361:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3063808->3067903) req@ffff88007560ad80 x1818247333646720/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/4536 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.793368:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560ad80 with x1818247333646720 ext(3063808->3067903) 00002000:00010000:2.0:1734016112.793371:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560ad80 00000100:00100000:0.0:1734016112.800873:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.801039:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333646976 00000100:00100000:2.0:1734016112.801049:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333646976 00002000:00100000:2.0:1734016112.801101:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3031040->3096575) req@ffff880073b9df80 x1818247333646976/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 504/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.801112:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9df80 with x1818247333646976 ext(3031040->3096575) 00002000:00010000:2.0:1734016112.801118:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9df80 00000100:00100000:2.0:1734016112.801149:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8479 00000100:00100000:2.0:1734016112.801155:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333646976:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016112.820874:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333646976:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 19701us (19997us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1734016112.820894:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8479 00002000:00100000:2.0:1734016112.820914:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3031040->3096575) req@ffff880073b9df80 x1818247333646976/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 504/440 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.820925:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9df80 with x1818247333646976 ext(3031040->3096575) 00002000:00010000:2.0:1734016112.820931:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9df80 00000100:00100000:1.0:1734016112.831154:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.831310:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333647232 00000100:00100000:2.0:1734016112.831322:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333647232 00002000:00100000:2.0:1734016112.831378:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2998272->3031039) req@ffff880075609f80 x1818247333647232/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.831389:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609f80 with x1818247333647232 ext(2998272->3031039) 00002000:00010000:2.0:1734016112.831394:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075609f80 00000100:00100000:2.0:1734016112.832716:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8480 00000100:00100000:2.0:1734016112.832728:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333647232:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016112.839864:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333647232:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 7121us (8707us total) trans 0 rc 32768/32768 00000100:00100000:2.0:1734016112.839880:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8480 00002000:00100000:2.0:1734016112.839896:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2998272->3031039) req@ffff880075609f80 x1818247333647232/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/440 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 32768/32768 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.839905:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609f80 with x1818247333647232 ext(2998272->3031039) 00002000:00010000:2.0:1734016112.839912:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075609f80 00000100:00100000:1.0:1734016112.845726:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016112.845883:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333647360 00000100:00100000:2.0:1734016112.845895:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333647360 00002000:00100000:2.0:1734016112.845962:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3022848->3071999) req@ffff880075609880 x1818247333647360/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/0 e 0 to 0 dl 1734016123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016112.845973:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609880 with x1818247333647360 ext(3022848->3071999) 00002000:00010000:2.0:1734016112.845979:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075609880 00000100:00100000:0.0:1734016112.847145:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8481 00000100:00100000:0.0:1734016112.847157:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333647360:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016112.861178:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333647360:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 14012us (15460us total) trans 4294969353 rc 0/0 00000100:00100000:0.0:1734016112.861192:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8481 00002000:00100000:0.0:1734016112.861205:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3022848->3071999) req@ffff880075609880 x1818247333647360/t4294969353(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:73/0 lens 488/448 e 0 to 0 dl 1734016123 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016112.861214:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609880 with x1818247333647360 ext(3022848->3071999) 00002000:00010000:0.0:1734016112.863191:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075609880 00000100:00100000:1.0:1734016112.873149:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.873234:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333647488 00000100:00100000:0.0:1734016112.873247:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333647488 00000100:00100000:0.0:1734016112.873311:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2152 00000100:00100000:0.0:1734016112.873318:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333647488:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:0.0:1734016112.873449:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333647488:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 131us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016112.873529:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2152 00000100:00100000:1.0:1734016112.879326:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.880577:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333647616 00000100:00100000:0.0:1734016112.880586:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333647616 00000100:00100000:0.0:1734016112.885941:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10713 00000100:00100000:0.0:1734016112.885967:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333647616:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016112.888646:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969353 is committed 00000001:00080000:2.0:1734016112.888669:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969352 is committed 00000100:00100000:0.0:1734016112.889594:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333647616:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 3626us (10270us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016112.889604:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10713 00000100:00100000:1.0:1734016112.903615:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.903694:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333647744 00000100:00100000:0.0:1734016112.903705:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333647744 00000100:00100000:0.0:1734016112.903763:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2153 00000100:00100000:0.0:1734016112.903772:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:9668:x1818247333647744:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016112.903841:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016112.903862:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc2711522e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5593 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.903952:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115235 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.903968:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.903982:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016112.904018:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 6429576 00000004:00200000:0.0:1734016112.904022:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016112.904039:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016112.904063:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc2711522e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5593 expref: 17 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.904102:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5593 expref: 16 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.904110:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016112.904113:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016112.904116:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00000100:00100000:0.0:1734016112.904164:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333647744:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 392us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016112.904170:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2153 00000100:00100000:1.0:1734016112.907341:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.907963:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333647872 00000100:00100000:0.0:1734016112.907975:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333647872 00000100:00100000:0.0:1734016112.908055:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10714 00000100:00100000:0.0:1734016112.908067:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333647872:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016112.908092:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016112.908115:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711523c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e559a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016112.908189:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335269504:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016112.908275:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eed80 going to sleep for 11 seconds 00002000:00010000:0.0:1734016112.912202:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016112 -> 1734016113 00002000:00010000:0.0:1734016112.912220:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 392 -> 488 00000100:00100000:0.0:1734016112.912260:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335269504:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016112.912320:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711523c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e559a expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016112.912342:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711523c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e559a expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016112.912375:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582d00, rc 0) 00000100:00100000:0.0:1734016112.912450:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333647872:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4382us (5116us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016112.912460:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10714 00000100:00100000:1.0:1734016112.919103:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.920339:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333648000 00000100:00100000:0.0:1734016112.920355:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333648000 00000100:00100000:0.0:1734016112.920437:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10715 00000100:00100000:0.0:1734016112.920448:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333648000:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016112.920476:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016112.920503:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27115243 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e55a1 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.920546:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115227 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e558c expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.920554:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016112.920555:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016112.920559:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27115243 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6008832->6057983] (req 6008832->6057983) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55a1 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.920599:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115227 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3071999) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e558c expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.920612:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115227 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3071999) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e558c expref: 6 pid: 7684 timeout: 480 lvb_type: 0 00000100:00100000:0.0:1734016112.920626:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335269632:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016112.920723:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eed80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016112.923003:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335269632:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016112.923050:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27115243 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6008832->6057983] (req 6008832->6057983) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55a1 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.923069:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582f40, rc 0) 00000100:00100000:0.0:1734016112.923128:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333648000:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2680us (4042us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016112.923141:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10715 00000100:00100000:1.0:1734016112.925948:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.926033:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333648128 00000100:00100000:0.0:1734016112.926044:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333648128 00010000:00010000:0.0:1734016112.926081:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115227 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e558c expref: 7 pid: 7684 timeout: 480 lvb_type: 0 00000100:00100000:0.0:1734016112.926129:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2955 00000100:00100000:0.0:1734016112.926136:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333648128:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016112.926154:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016112.926176:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115227 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3067904->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e558c expref: 7 pid: 7684 timeout: 480 lvb_type: 0 00010000:00010000:0.0:1734016112.926188:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115227 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3067904->3071999) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e558c expref: 7 pid: 7684 timeout: 480 lvb_type: 0 00010000:00010000:0.0:1734016112.926218:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115227 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3067904->3071999) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e558c expref: 7 pid: 7684 timeout: 480 lvb_type: 0 00010000:00010000:0.0:1734016112.926250:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016112.926252:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016112.926260:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27115243 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6008832->6057983) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55a1 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.926270:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27115243 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6008832->6057983) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55a1 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.926303:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27115243 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6008832->6057983) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55a1 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016112.926316:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335269760:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016112.926371:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eed80 going to sleep for 11 seconds 00000100:00100000:1.0:1734016112.932563:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.932689:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335269760:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016112.932720:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016112.932774:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333648128:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6637us (6837us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016112.932788:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2955 00000100:00100000:2.0:1734016112.933147:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333648256 00000100:00100000:2.0:1734016112.933157:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333648256 00000100:00100000:2.0:1734016112.933218:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10716 00000100:00100000:2.0:1734016112.933225:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333648256:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016112.933437:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 6429576 -> 6429576 00002000:00010000:2.0:1734016112.933441:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016113 -> 1734016113 00002000:00010000:2.0:1734016112.933443:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016113 -> 1734016112 00002000:00010000:2.0:1734016112.933445:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016113 -> 1734016112 00002000:00010000:2.0:1734016112.933446:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 488 -> 584 00000100:00100000:2.0:1734016112.933507:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333648256:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 282us (957us total) trans 4294969354 rc 0/0 00000100:00100000:2.0:1734016112.933515:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10716 00000100:00100000:1.0:1734016112.943451:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016112.943599:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333648384 00000100:00100000:3.0:1734016112.943613:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333648384 00000100:00100000:3.0:1734016112.944207:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10717 00000100:00100000:3.0:1734016112.944217:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333648384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016112.944240:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016112.944262:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711524a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e55a8 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016112.944333:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335269888:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016112.944413:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb480 going to sleep for 11 seconds 00002000:00010000:3.0:1734016112.946941:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016112 -> 1734016113 00002000:00010000:3.0:1734016112.946950:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016112 -> 1734016113 00000100:00100000:3.0:1734016112.946975:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335269888:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016112.947026:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711524a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55a8 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016112.947042:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711524a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55a8 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016112.947067:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016112.947130:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333648384:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2912us (3697us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016112.947139:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10717 00000100:00100000:0.0:1734016112.954906:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016112.955026:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333648512 00000100:00100000:3.0:1734016112.955036:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333648512 00000100:00100000:3.0:1734016112.955101:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10718 00000100:00100000:3.0:1734016112.955109:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333648512:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016112.955136:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016112.955160:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115251 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e55af expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016112.955228:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335270016:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016112.955310:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016112.963263:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335270016:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016112.963324:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115251 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55af expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016112.963341:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115251 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55af expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016112.964172:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016112.965046:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333648512:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9933us (10147us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016112.965060:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10718 00000100:00100000:1.0:1734016112.975263:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.975357:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333648768 00000100:00100000:0.0:1734016112.975368:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333648768 00000100:00100000:0.0:1734016112.976080:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8482 00000100:00100000:0.0:1734016112.976090:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333648768:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:0.0:1734016112.976144:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115258 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.976167:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27115243 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6008832->6057983) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55a1 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.976173:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016112.976176:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016112.976178:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115258 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8228864->8290303] (req 8228864->8290303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.976219:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27115243 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6008832->6057983) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55a1 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.976236:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27115243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6008832->6057983) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55a1 expref: 7 pid: 7684 timeout: 480 lvb_type: 0 00000100:00100000:0.0:1734016112.976250:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335270144:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016112.977350:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eed80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016112.986258:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335270144:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016112.986294:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115258 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8228864->8290303] (req 8228864->8290303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016112.990525:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016112.990961:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333648896 00000100:00100000:0.0:1734016112.990978:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333648896 00010000:00010000:0.0:1734016112.991034:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27115243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6008832->6057983) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55a1 expref: 8 pid: 7684 timeout: 480 lvb_type: 0 00000100:00100000:0.0:1734016112.992341:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2956 00000100:00100000:0.0:1734016112.992351:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333648896:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016112.992369:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016112.992395:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27115243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6008832->6057983) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55a1 expref: 8 pid: 7684 timeout: 480 lvb_type: 0 00010000:00010000:0.0:1734016112.992411:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27115243 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6008832->6057983) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55a1 expref: 8 pid: 7684 timeout: 480 lvb_type: 0 00010000:00010000:0.0:1734016112.992435:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27115243 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6008832->6057983) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55a1 expref: 8 pid: 7684 timeout: 480 lvb_type: 0 00010000:00010000:0.0:1734016112.992462:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016112.992464:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016112.992469:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115258 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8228864->8290303] (req 8228864->8290303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.992476:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115258 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8228864->8290303] (req 8228864->8290303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.992501:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016112.992549:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333648896:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 199us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016112.992555:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2956 00010000:00010000:0.0:1734016112.992585:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115258 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8228864->8290303] (req 8228864->8290303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016112.992592:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115258 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8228864->8290303] (req 8228864->8290303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1734016113.010266:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969355 is committed 00002000:00010000:0.0:1734016113.010986:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 6429576 -> 8290304 00002000:00010000:0.0:1734016113.010990:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 584 -> 704 00010000:00010000:0.0:1734016113.011001:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115258 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8228864->8290303] (req 8228864->8290303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.011020:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115258 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8228864->8290303] (req 8228864->8290303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.011028:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115258 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8228864->8290303] (req 8228864->8290303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.011036:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581440 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016113.011040:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115258 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8228864->8290303] (req 8228864->8290303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.011047:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115258 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8228864->8290303] (req 8228864->8290303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.011065:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115258 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8228864->8290303] (req 8228864->8290303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.011072:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115258 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8228864->8290303] (req 8228864->8290303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016113.011213:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333648768:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 35118us (35956us total) trans 4294969355 rc 0/0 00000100:00100000:0.0:1734016113.011224:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8482 00000100:00100000:1.0:1734016113.016492:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.016909:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333649024 00000100:00100000:3.0:1734016113.016925:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333649024 00000100:00100000:3.0:1734016113.017013:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10719 00000100:00100000:3.0:1734016113.017025:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333649024:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016113.017053:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016113.017083:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711525f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e55b6 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1734016113.017111:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 8290304, mtime: 0x675afc71, atime: 0x675afc71, ctime: 0x675afc71, blocks: 0x2c0 00010000:00010000:3.0:1734016113.017140:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016113.017142:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016113.017151:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711525f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55b6 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016113.017167:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711525f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55b6 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016113.017179:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016113.017255:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333649024:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 228us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016113.017263:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10719 00000100:00100000:2.0:1734016113.020689:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.020788:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333649280 00000100:00100000:0.0:1734016113.020912:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333649280 00002000:00100000:2.0:1734016113.021042:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3301376->3305471) req@ffff880074939500 x1818247333649280/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.021054:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074939500 with x1818247333649280 ext(3301376->3305471) 00002000:00010000:2.0:1734016113.021061:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074939500 00000100:00100000:2.0:1734016113.021090:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8483 00000100:00100000:2.0:1734016113.021097:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333649280:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016113.021775:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333649280:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 674us (1093us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016113.021784:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8483 00002000:00100000:2.0:1734016113.021789:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3301376->3305471) req@ffff880074939500 x1818247333649280/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.021797:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074939500 with x1818247333649280 ext(3301376->3305471) 00002000:00010000:2.0:1734016113.021831:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074939500 00000100:00100000:1.0:1734016113.024327:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.024594:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333649536 00000100:00100000:2.0:1734016113.024606:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333649536 00002000:00100000:2.0:1734016113.024658:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3297280->3301375) req@ffff880075609500 x1818247333649536/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.024670:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609500 with x1818247333649536 ext(3297280->3301375) 00002000:00010000:2.0:1734016113.024676:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075609500 00000100:00100000:2.0:1734016113.024731:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8484 00000100:00100000:2.0:1734016113.024739:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333649536:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016113.024973:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333649536:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 235us (658us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016113.024981:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8484 00002000:00100000:2.0:1734016113.024987:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3297280->3301375) req@ffff880075609500 x1818247333649536/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.024993:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609500 with x1818247333649536 ext(3297280->3301375) 00002000:00010000:2.0:1734016113.024996:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075609500 00000100:00100000:1.0:1734016113.027869:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.027941:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333649792 00000100:00100000:0.0:1734016113.027952:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333649792 00002000:00100000:0.0:1734016113.027998:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3293184->3297279) req@ffff88012e606a00 x1818247333649792/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016113.028019:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e606a00 with x1818247333649792 ext(3293184->3297279) 00002000:00010000:0.0:1734016113.028025:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e606a00 00000100:00100000:0.0:1734016113.028058:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8485 00000100:00100000:0.0:1734016113.028064:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333649792:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016113.028251:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333649792:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 187us (396us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016113.028259:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8485 00002000:00100000:0.0:1734016113.028265:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3293184->3297279) req@ffff88012e606a00 x1818247333649792/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016113.028271:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e606a00 with x1818247333649792 ext(3293184->3297279) 00002000:00010000:0.0:1734016113.028274:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e606a00 00000100:00100000:3.0:1734016113.038035:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.038778:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333650048 00000100:00100000:2.0:1734016113.038790:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333650048 00002000:00100000:2.0:1734016113.038861:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3289088->3293183) req@ffff88007345fb80 x1818247333650048/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.038871:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345fb80 with x1818247333650048 ext(3289088->3293183) 00002000:00010000:2.0:1734016113.038877:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345fb80 00000100:00100000:2.0:1734016113.039499:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8486 00000100:00100000:2.0:1734016113.039508:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333650048:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016113.041351:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333650048:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1837us (3323us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016113.041364:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8486 00002000:00100000:2.0:1734016113.041374:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3289088->3293183) req@ffff88007345fb80 x1818247333650048/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.041382:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345fb80 with x1818247333650048 ext(3289088->3293183) 00002000:00010000:2.0:1734016113.041389:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345fb80 00000100:00100000:1.0:1734016113.044025:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.044124:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333650304 00000100:00100000:2.0:1734016113.044135:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333650304 00002000:00100000:2.0:1734016113.044191:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3284992->3289087) req@ffff88012e607b80 x1818247333650304/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.044202:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e607b80 with x1818247333650304 ext(3284992->3289087) 00002000:00010000:2.0:1734016113.044209:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e607b80 00000100:00100000:2.0:1734016113.044318:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8487 00000100:00100000:2.0:1734016113.044327:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333650304:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016113.044661:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333650304:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 333us (645us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016113.044669:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8487 00002000:00100000:2.0:1734016113.044675:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3284992->3289087) req@ffff88012e607b80 x1818247333650304/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.044681:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e607b80 with x1818247333650304 ext(3284992->3289087) 00002000:00010000:2.0:1734016113.044684:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e607b80 00000100:00100000:1.0:1734016113.048094:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.048266:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333650560 00000100:00100000:2.0:1734016113.048277:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333650560 00000100:00100000:2.0:1734016113.048347:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2154 00000100:00100000:2.0:1734016113.048355:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333650560:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016113.048420:0:7704:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016113.048456:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115235 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5593 expref: 16 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.048486:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016113.048492:0:7704:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016113.048677:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115266 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.048690:0:7704:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711520b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5570 expref: 17 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.048696:0:7704:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115266 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.048730:0:7704:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711520b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5570 expref: 17 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.048743:0:7704:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711520b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5570 expref: 17 pid: 7704 timeout: 480 lvb_type: 0 00000100:00100000:2.0:1734016113.048754:0:7704:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335270272:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016113.048844:0:7704:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e240 going to sleep for 11 seconds 00000100:00080000:1.0:1734016113.049016:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016083 00000100:00100000:0.0:1734016113.053541:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.053764:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333650688 00000100:00100000:3.0:1734016113.053774:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333650688 00010000:00010000:3.0:1734016113.053845:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711520b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5570 expref: 18 pid: 7704 timeout: 480 lvb_type: 0 00000100:00100000:3.0:1734016113.053870:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2957 00000100:00100000:3.0:1734016113.053877:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247333650688:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016113.053889:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016113.053894:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711520b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5570 expref: 18 pid: 7704 timeout: 480 lvb_type: 0 00010000:00010000:3.0:1734016113.053905:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711520b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5570 expref: 18 pid: 7704 timeout: 480 lvb_type: 0 00010000:00010000:3.0:1734016113.053927:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016113.053932:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115266 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.053941:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115266 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.053947:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115266 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.053964:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016113.054014:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247333650688:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 127us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016113.054020:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2957 00000100:00080000:0.0:1734016113.054217:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016083 00010000:00010000:2.0:1734016113.054324:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711520b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5570 expref: 17 pid: 7704 timeout: 480 lvb_type: 0 00000100:00100000:2.0:1734016113.054689:0:7704:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335270272:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016113.054709:0:7704:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115266 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.054720:0:7704:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115266 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.054725:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115266 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:2.0:1734016113.054840:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968686 00000004:00010000:2.0:1734016113.054887:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012e607480 reply state ffff8800753a1000 transno 4294968687 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115266 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:2.0:1734016113.054894:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016113.054978:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:9668:x1818247333650560:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 6623us (6894us total) trans 4294968687 rc 0/0 00000100:00100000:2.0:1734016113.054985:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2154 00000020:00080000:2.0:1734016113.054989:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016113.057688:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115266 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.057706:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115266 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.057714:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115266 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.057720:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcfc0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016113.057724:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115266 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.057731:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115266 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.057749:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016113.057753:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016113.057757:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115266 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.057762:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115266 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016113.058171:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.058357:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333650816 00000100:00100000:2.0:1734016113.058366:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333650816 00000100:00100000:2.0:1734016113.058659:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10720 00000100:00100000:2.0:1734016113.058667:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333650816:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016113.058688:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016113.058708:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc2711526d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e55bd expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.058736:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711525f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55b6 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.058743:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.058745:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.058749:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc2711526d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55bd expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.058786:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711525f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55b6 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.058817:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711525f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55b6 expref: 7 pid: 8216 timeout: 480 lvb_type: 1 00000100:00100000:2.0:1734016113.058829:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335270400:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016113.058893:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016113.061402:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.061431:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333650944 00000100:00100000:0.0:1734016113.061439:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333650944 00010000:00010000:0.0:1734016113.061469:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711525f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55b6 expref: 8 pid: 8216 timeout: 480 lvb_type: 1 00000100:00100000:0.0:1734016113.061517:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2958 00000100:00100000:0.0:1734016113.061524:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333650944:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016113.061540:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016113.061566:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711525f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55b6 expref: 8 pid: 8216 timeout: 480 lvb_type: 1 00010000:00010000:0.0:1734016113.061579:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711525f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55b6 expref: 8 pid: 8216 timeout: 480 lvb_type: 1 00010000:00010000:0.0:1734016113.061609:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016113.061610:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016113.061616:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc2711526d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55bd expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.061625:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc2711526d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55bd expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.061660:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc2711526d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55bd expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016113.061671:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335270528:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016113.061720:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00010000:00010000:2.0:1734016113.061857:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711525f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55b6 expref: 8 pid: 8216 timeout: 480 lvb_type: 1 00000100:00100000:2.0:1734016113.061873:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335270400:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016113.061896:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc2711526d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55bd expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.061905:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016113.061938:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333650816:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3271us (3772us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016113.061945:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10720 00000100:00100000:1.0:1734016113.065099:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335270528:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016113.065130:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016113.066359:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333650944:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4820us (4950us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016113.066380:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2958 00000100:00100000:0.0:1734016113.067516:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.068339:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333651072 00000100:00100000:2.0:1734016113.068352:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333651072 00002000:00010000:2.0:1734016113.068406:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (10483063->18446744073709551615) 00002000:00100000:2.0:1734016113.068410:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9f800 with x1818247333651072 ext(10483063->18446744073709551615) 00002000:00010000:2.0:1734016113.068422:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9f800. 00000100:00100000:2.0:1734016113.068459:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8488 00000100:00100000:2.0:1734016113.068468:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333651072:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016113.068824:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8290304 -> 10483063 00002000:00010000:2.0:1734016113.068829:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016113 -> 1734016113 00002000:00010000:2.0:1734016113.068831:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016113 -> 1734016113 00002000:00010000:2.0:1734016113.068833:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016113 -> 1734016113 00002000:00010000:2.0:1734016113.068834:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 704 -> 704 00000100:00100000:2.0:1734016113.068910:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333651072:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 441us (1400us total) trans 4294969356 rc 0/0 00000100:00100000:2.0:1734016113.068920:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8488 00002000:00010000:2.0:1734016113.068924:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (10483063->18446744073709551615) 00002000:00100000:2.0:1734016113.068927:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9f800 with x1818247333651072 ext(10483063->18446744073709551615) 00002000:00010000:2.0:1734016113.068931:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9f800. 00000100:00100000:0.0:1734016113.078296:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.081366:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333651328 00000100:00100000:2.0:1734016113.081391:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333651328 00002000:00100000:2.0:1734016113.081470:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (10346496->10485759) req@ffff880073b9d880 x1818247333651328/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.081480:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9d880 with x1818247333651328 ext(10346496->10485759) 00002000:00010000:2.0:1734016113.081500:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9d880 00000100:00100000:2.0:1734016113.081543:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8489 00000100:00100000:2.0:1734016113.081551:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333651328:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016113.093187:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333651328:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 11613us (14880us total) trans 0 rc 139264/139264 00000100:00100000:2.0:1734016113.093212:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8489 00002000:00100000:2.0:1734016113.093233:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (10346496->10485759) req@ffff880073b9d880 x1818247333651328/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/440 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 139264/139264 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.093245:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9d880 with x1818247333651328 ext(10346496->10485759) 00002000:00010000:2.0:1734016113.093254:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9d880 00000100:00100000:0.0:1734016113.096954:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.097082:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333651456 00000100:00100000:2.0:1734016113.097095:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333651456 00002000:00100000:2.0:1734016113.097146:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (10481664->10483062) req@ffff880073b9e680 x1818247333651456/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 1888/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.097156:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9e680 with x1818247333651456 ext(10481664->10483062) 00002000:00010000:2.0:1734016113.097162:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9e680 00000100:00100000:2.0:1734016113.097185:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8490 00000100:00100000:2.0:1734016113.097192:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333651456:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016113.098121:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333651456:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 924us (1178us total) trans 4294969357 rc 0/0 00000100:00100000:0.0:1734016113.098131:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8490 00002000:00100000:0.0:1734016113.098137:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (10481664->10483062) req@ffff880073b9e680 x1818247333651456/t4294969357(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 1888/448 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016113.098145:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9e680 with x1818247333651456 ext(10481664->10483062) 00002000:00010000:0.0:1734016113.098148:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9e680 00000100:00100000:0.0:1734016113.101454:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.101586:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333651584 00000100:00100000:2.0:1734016113.101600:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333651584 00000100:00100000:2.0:1734016113.101664:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2155 00000100:00100000:2.0:1734016113.101673:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:9668:x1818247333651584:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:2.0:1734016113.102501:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:9668:x1818247333651584:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 825us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016113.102512:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2155 00000100:00100000:0.0:1734016113.106956:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.107095:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333651712 00000100:00100000:2.0:1734016113.107108:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333651712 00000100:00100000:2.0:1734016113.107435:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10721 00000100:00100000:2.0:1734016113.107446:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333651712:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016113.109032:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969357 is committed 00000100:00100000:0.0:1734016113.109357:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333651712:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 1907us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016113.109367:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10721 00000100:00100000:0.0:1734016113.112835:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.112966:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333651840 00000100:00100000:2.0:1734016113.112978:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333651840 00000100:00100000:2.0:1734016113.113035:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2156 00000100:00100000:2.0:1734016113.113043:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+17:9668:x1818247333651840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016113.113067:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016113.113090:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115274 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e55c4 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.113185:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711527b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.113197:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711527b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.113209:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711527b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:2.0:1734016113.113233:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 10483063 00000004:00200000:2.0:1734016113.113236:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016113.113250:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711527b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.113269:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115274 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55c4 expref: 19 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.113287:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711527b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55c4 expref: 18 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.113295:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016113.113297:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016113.113301:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016113.113355:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333651840:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 312us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016113.113360:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2156 00000100:00100000:0.0:1734016113.116240:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.116377:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333651968 00000100:00100000:2.0:1734016113.116389:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333651968 00000100:00100000:2.0:1734016113.116471:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10722 00000100:00100000:2.0:1734016113.116480:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333651968:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016113.116504:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016113.116528:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115282 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e55cb expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016113.116606:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335270656:192.168.201.16@tcp:106: 00000100:00080000:0.0:1734016113.116725:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016083 00000100:00100000:2.0:1734016113.117271:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e780 going to sleep for 11 seconds 00002000:00010000:2.0:1734016113.120043:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 704 -> 712 00000100:00100000:2.0:1734016113.120078:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335270656:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016113.120116:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115282 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55cb expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.120133:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115282 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55cb expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.120148:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016113.120200:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333651968:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3720us (3973us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016113.120210:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10722 00000100:00100000:0.0:1734016113.122079:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.122326:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333652096 00000100:00100000:2.0:1734016113.122336:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333652096 00000100:00100000:2.0:1734016113.122452:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10723 00000100:00100000:2.0:1734016113.122460:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333652096:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016113.122481:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016113.122502:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115289 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e55d2 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016113.122564:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335270784:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016113.122632:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016113.124310:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335270784:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016113.124340:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115289 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55d2 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.124353:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115289 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55d2 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.124363:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016113.124403:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333652096:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1943us (2331us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016113.124410:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10723 00000100:00100000:0.0:1734016113.127943:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.128130:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333652224 00000100:00100000:2.0:1734016113.128141:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333652224 00000100:00100000:2.0:1734016113.128196:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10724 00000100:00100000:2.0:1734016113.128204:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333652224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016113.128228:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016113.128249:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115290 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e55d9 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.128286:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc2711526d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55bd expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.128293:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016113.128295:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016113.128299:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115290 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [9256960->9293823] (req 9256960->9293823) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55d9 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.128335:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc2711526d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55bd expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.128353:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc2711526d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55bd expref: 5 pid: 7684 timeout: 480 lvb_type: 0 00000100:00100000:2.0:1734016113.128368:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335270912:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016113.128451:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016113.131534:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335270912:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016113.131577:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115290 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [9256960->9293823] (req 9256960->9293823) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55d9 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.131599:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd440, rc 0) 00000100:00100000:2.0:1734016113.131655:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333652224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3451us (3724us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016113.131667:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10724 00000100:00100000:0.0:1734016113.133514:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016113.133652:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333652352 00000100:00100000:1.0:1734016113.133665:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333652352 00010000:00010000:1.0:1734016113.133711:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc2711526d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55bd expref: 6 pid: 7684 timeout: 480 lvb_type: 0 00000100:00100000:3.0:1734016113.134120:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2959 00000100:00100000:3.0:1734016113.134129:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ba1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333652352:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016113.134148:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016113.134173:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc2711526d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55bd expref: 6 pid: 7684 timeout: 480 lvb_type: 0 00010000:00010000:3.0:1734016113.134184:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc2711526d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55bd expref: 6 pid: 7684 timeout: 480 lvb_type: 0 00010000:00010000:3.0:1734016113.134211:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc2711526d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55bd expref: 6 pid: 7684 timeout: 480 lvb_type: 0 00010000:00010000:3.0:1734016113.134232:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016113.134234:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016113.134241:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115290 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9256960->9293823) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55d9 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.134256:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115290 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9256960->9293823) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55d9 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.134295:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115290 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9256960->9293823) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55d9 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016113.134310:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335271040:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016113.134373:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016113.137436:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.137623:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335271040:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016113.137649:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016113.137695:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ba1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333652352:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3565us (4194us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016113.137705:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2959 00000100:00100000:2.0:1734016113.138100:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333652480 00000100:00100000:2.0:1734016113.138107:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333652480 00000100:00100000:2.0:1734016113.138147:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10725 00000100:00100000:2.0:1734016113.138153:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333652480:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016113.138420:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10483063 -> 10483063 00002000:00010000:2.0:1734016113.138424:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016113 -> 1734016113 00002000:00010000:2.0:1734016113.138426:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016113 -> 1734016113 00002000:00010000:2.0:1734016113.138428:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016113 -> 1734016113 00002000:00010000:2.0:1734016113.138430:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 712 -> 712 00000100:00100000:2.0:1734016113.138503:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333652480:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 350us (1080us total) trans 4294969358 rc 0/0 00000100:00100000:2.0:1734016113.138511:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10725 00000100:00100000:0.0:1734016113.142035:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.142111:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333652608 00000100:00100000:3.0:1734016113.142122:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333652608 00000100:00100000:3.0:1734016113.142181:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10726 00000100:00100000:3.0:1734016113.142189:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333652608:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016113.142211:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016113.142231:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115297 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e55e0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016113.142292:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335271168:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016113.142363:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016113.144691:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335271168:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016113.144729:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115297 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55e0 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016113.144742:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115297 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55e0 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016113.145008:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4480, rc 0) 00000100:00100000:3.0:1734016113.145068:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333652608:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2877us (3043us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016113.145076:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10726 00000100:00100000:0.0:1734016113.147026:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.147156:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333652736 00000100:00100000:3.0:1734016113.147164:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333652736 00000100:00100000:3.0:1734016113.147208:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10727 00000100:00100000:3.0:1734016113.147215:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333652736:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016113.147232:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016113.147250:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711529e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e55e7 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.147277:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115290 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9256960->9293823) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55d9 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.147284:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016113.147286:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016113.147289:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711529e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [9359360->9363455] (req 9359360->9363455) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55e7 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.147314:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115290 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9256960->9293823) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55d9 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.147325:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115290 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9256960->9293823) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55d9 expref: 7 pid: 7684 timeout: 480 lvb_type: 0 00000100:00100000:3.0:1734016113.147338:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335271296:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016113.147383:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016113.150815:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.150909:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335271296:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016113.150944:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711529e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [9359360->9363455] (req 9359360->9363455) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55e7 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.150961:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016113.151016:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333652736:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3800us (3995us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016113.151025:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10727 00000100:00100000:2.0:1734016113.151530:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333652864 00000100:00100000:2.0:1734016113.151538:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333652864 00010000:00010000:2.0:1734016113.151567:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115290 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9256960->9293823) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55d9 expref: 8 pid: 7684 timeout: 480 lvb_type: 0 00000100:00100000:2.0:1734016113.151599:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2960 00000100:00100000:2.0:1734016113.151605:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333652864:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016113.151621:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016113.151647:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115290 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 9256960->9293823) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55d9 expref: 8 pid: 7684 timeout: 480 lvb_type: 0 00010000:00010000:2.0:1734016113.151659:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115290 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 9256960->9293823) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55d9 expref: 8 pid: 7684 timeout: 480 lvb_type: 0 00010000:00010000:2.0:1734016113.151683:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115290 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 9256960->9293823) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55d9 expref: 8 pid: 7684 timeout: 480 lvb_type: 0 00010000:00010000:2.0:1734016113.151699:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.151701:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.151707:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711529e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9359360->9363455) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55e7 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.151716:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711529e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9359360->9363455) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55e7 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.151746:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711529e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9359360->9363455) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55e7 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016113.151760:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335271424:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016113.151821:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e780 going to sleep for 11 seconds 00000100:00100000:0.0:1734016113.154349:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016113.154523:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333653120 00000100:00100000:1.0:1734016113.154530:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333653120 00002000:00100000:1.0:1734016113.154571:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9359360->10485759) req@ffff8800849b4e00 x1818247333653120/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 504/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016113.154581:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b4e00 with x1818247333653120 ext(9359360->10485759) 00002000:00010000:1.0:1734016113.154586:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b4e00 00000100:00100000:1.0:1734016113.154604:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8491 00000100:00100000:1.0:1734016113.154610:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333653120:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016113.154941:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335271424:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016113.154962:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016113.155297:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333652864:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3690us (4505us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016113.155306:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2960 00000100:00100000:1.0:1734016113.157756:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333653120:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 3127us (3399us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1734016113.157771:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8491 00002000:00100000:1.0:1734016113.157785:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9359360->10485759) req@ffff8800849b4e00 x1818247333653120/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 504/440 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016113.157795:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b4e00 with x1818247333653120 ext(9359360->10485759) 00002000:00010000:1.0:1734016113.157878:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b4e00 00000100:00100000:0.0:1734016113.160298:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.160424:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333653376 00000100:00100000:2.0:1734016113.160436:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333653376 00002000:00100000:2.0:1734016113.160482:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9355264->9359359) req@ffff8800849b5f80 x1818247333653376/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.160495:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b5f80 with x1818247333653376 ext(9355264->9359359) 00002000:00010000:2.0:1734016113.160501:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b5f80 00000100:00100000:2.0:1734016113.160523:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8492 00000100:00100000:2.0:1734016113.160529:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333653376:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016113.160754:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333653376:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 224us (469us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016113.160761:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8492 00002000:00100000:2.0:1734016113.160766:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9355264->9359359) req@ffff8800849b5f80 x1818247333653376/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.160774:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b5f80 with x1818247333653376 ext(9355264->9359359) 00002000:00010000:2.0:1734016113.160776:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b5f80 00000100:00100000:0.0:1734016113.162982:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.163212:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333653632 00000100:00100000:2.0:1734016113.163220:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333653632 00002000:00100000:2.0:1734016113.163253:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (9351168->9355263) req@ffff8800849b5500 x1818247333653632/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.163263:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b5500 with x1818247333653632 ext(9351168->9355263) 00002000:00010000:2.0:1734016113.163268:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b5500 00000100:00100000:2.0:1734016113.163555:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8493 00000100:00100000:2.0:1734016113.163560:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333653632:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016113.163871:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333653632:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 309us (895us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016113.163877:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8493 00002000:00100000:2.0:1734016113.163882:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (9351168->9355263) req@ffff8800849b5500 x1818247333653632/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.163890:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b5500 with x1818247333653632 ext(9351168->9355263) 00002000:00010000:2.0:1734016113.163892:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b5500 00000100:00100000:0.0:1734016113.165748:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.165834:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333653888 00000100:00100000:2.0:1734016113.165841:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333653888 00002000:00100000:2.0:1734016113.165878:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (9347072->9351167) req@ffff8800849b5880 x1818247333653888/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.165889:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b5880 with x1818247333653888 ext(9347072->9351167) 00002000:00010000:2.0:1734016113.165893:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b5880 00000100:00100000:2.0:1734016113.165949:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8494 00000100:00100000:2.0:1734016113.165956:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333653888:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016113.167083:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333653888:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1122us (1336us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016113.167091:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8494 00002000:00100000:2.0:1734016113.167098:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (9347072->9351167) req@ffff8800849b5880 x1818247333653888/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.167164:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b5880 with x1818247333653888 ext(9347072->9351167) 00002000:00010000:2.0:1734016113.167169:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b5880 00000100:00100000:0.0:1734016113.169867:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.170132:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333654144 00000100:00100000:2.0:1734016113.170141:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333654144 00002000:00100000:2.0:1734016113.170181:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (9342976->9347071) req@ffff8800849b7100 x1818247333654144/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.170190:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b7100 with x1818247333654144 ext(9342976->9347071) 00002000:00010000:2.0:1734016113.170195:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b7100 00000100:00100000:2.0:1734016113.170214:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8495 00000100:00100000:2.0:1734016113.170221:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333654144:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016113.170391:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333654144:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 170us (534us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016113.170398:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8495 00002000:00100000:2.0:1734016113.170403:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (9342976->9347071) req@ffff8800849b7100 x1818247333654144/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.170410:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b7100 with x1818247333654144 ext(9342976->9347071) 00002000:00010000:2.0:1734016113.170412:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b7100 00000100:00100000:0.0:1734016113.177979:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.179370:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333654272 00000100:00100000:2.0:1734016113.179382:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333654272 00000100:00100000:2.0:1734016113.179442:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2157 00000100:00100000:2.0:1734016113.179449:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:9668:x1818247333654272:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016113.179474:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016113.179495:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271152a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e55ee expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.179729:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271152ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016113.179748:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271152ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016113.179759:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271152ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:2.0:1734016113.179786:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 10483063 00000004:00200000:2.0:1734016113.179790:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016113.179843:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271152ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016113.179867:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271152a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55ee expref: 19 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.179902:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271152ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55ee expref: 18 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.179910:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016113.179913:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016113.179917:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd440, rc 0) 00000100:00100000:2.0:1734016113.179984:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:9668:x1818247333654272:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 534us (2015us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016113.179991:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2157 00000100:00100000:0.0:1734016113.182230:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.182365:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333654400 00000100:00100000:3.0:1734016113.182377:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333654400 00000100:00100000:3.0:1734016113.182786:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10728 00000100:00100000:3.0:1734016113.182794:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333654400:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016113.182853:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016113.182873:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271152b3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e55f5 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.182900:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711529e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9359360->9363455) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55e7 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.182912:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016113.182914:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016113.182917:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271152b3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6586368->6651903] (req 6586368->6651903) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55f5 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.182953:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711529e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9359360->9363455) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55e7 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.182965:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711529e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9359360->9363455) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55e7 expref: 7 pid: 8216 timeout: 480 lvb_type: 0 00000100:00100000:3.0:1734016113.182978:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335271552:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016113.183055:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016113.188177:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335271552:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016113.188219:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271152b3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6586368->6651903] (req 6586368->6651903) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55f5 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.188240:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016113.188290:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333654400:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5496us (6070us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016113.188300:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10728 00000100:00100000:0.0:1734016113.189259:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.189404:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333654528 00000100:00100000:2.0:1734016113.189412:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333654528 00010000:00010000:2.0:1734016113.189441:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711529e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 9359360->9363455) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55e7 expref: 7 pid: 8216 timeout: 480 lvb_type: 0 00000100:00100000:2.0:1734016113.189638:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2961 00000100:00100000:2.0:1734016113.189645:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333654528:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016113.189662:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016113.189683:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711529e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 9359360->9363455) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55e7 expref: 7 pid: 8216 timeout: 480 lvb_type: 0 00010000:00010000:2.0:1734016113.189694:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711529e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 9359360->9363455) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55e7 expref: 7 pid: 8216 timeout: 480 lvb_type: 0 00010000:00010000:2.0:1734016113.189718:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711529e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 9359360->9363455) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55e7 expref: 7 pid: 8216 timeout: 480 lvb_type: 0 00010000:00010000:2.0:1734016113.189742:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.189744:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.189750:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271152b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6586368->6651903) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55f5 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.189758:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271152b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6586368->6651903) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55f5 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.189787:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271152b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6586368->6651903) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55f5 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016113.189818:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335271680:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016113.189856:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016113.193753:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.193863:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333654656 00000100:00100000:3.0:1734016113.193874:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333654656 00000100:00100000:3.0:1734016113.193919:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10729 00000100:00100000:3.0:1734016113.193925:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333654656:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016113.194192:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10483063 -> 10483063 00002000:00010000:3.0:1734016113.194195:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016113 -> 1734016113 00002000:00010000:3.0:1734016113.194197:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016113 -> 1734016113 00002000:00010000:3.0:1734016113.194199:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016113 -> 1734016113 00002000:00010000:3.0:1734016113.194201:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 712 -> 712 00000100:00100000:3.0:1734016113.194304:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333654656:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 377us (561us total) trans 4294969359 rc 0/0 00000100:00100000:3.0:1734016113.194311:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10729 00000100:00100000:2.0:1734016113.194452:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335271680:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016113.194473:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016113.194494:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333654528:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4850us (5240us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016113.194501:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2961 00000100:00100000:0.0:1734016113.197276:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.197542:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333654784 00000100:00100000:2.0:1734016113.197554:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333654784 00000100:00100000:2.0:1734016113.197607:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10730 00000100:00100000:2.0:1734016113.197615:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333654784:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016113.198136:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10483063 -> 10483063 00002000:00010000:2.0:1734016113.198140:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016113 -> 1734016113 00002000:00010000:2.0:1734016113.198143:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016113 -> 1734016113 00002000:00010000:2.0:1734016113.198144:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016113 -> 1734016113 00002000:00010000:2.0:1734016113.198147:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 712 -> 640 00000100:00100000:2.0:1734016113.198968:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333654784:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1351us (1702us total) trans 4294969360 rc 0/0 00000100:00100000:2.0:1734016113.198979:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10730 00000100:00100000:0.0:1734016113.205995:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.206607:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333654912 00000100:00100000:2.0:1734016113.206617:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333654912 00000100:00100000:2.0:1734016113.206670:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10731 00000100:00100000:2.0:1734016113.206678:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333654912:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016113.206699:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016113.206721:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271152ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e55fc expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016113.206789:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335271808:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016113.206897:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016113.210602:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335271808:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016113.210644:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271152ba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55fc expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.210657:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271152ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55fc expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.210686:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016113.211555:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333654912:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4873us (5565us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016113.211566:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10731 00000100:00100000:0.0:1734016113.220456:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.220864:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333655040 00000100:00100000:2.0:1734016113.220876:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333655040 00000100:00100000:2.0:1734016113.220946:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10732 00000100:00100000:2.0:1734016113.221497:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333655040:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016113.221524:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016113.221546:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271152c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5603 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016113.221866:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335271936:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016113.221951:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016113.225868:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335271936:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016113.225922:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271152c1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5603 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.225939:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271152c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5603 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.226013:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016113.226083:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333655040:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4589us (5644us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016113.226094:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10732 00000100:00100000:0.0:1734016113.229783:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.230084:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333655168 00000100:00100000:2.0:1734016113.230095:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333655168 00000100:00100000:2.0:1734016113.230986:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10733 00000100:00100000:2.0:1734016113.230996:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333655168:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016113.231029:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016113.231048:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271152c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e560a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016113.231126:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335272064:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016113.231211:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016113.233494:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335272064:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016113.233538:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271152c8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e560a expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.233553:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271152c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e560a expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.233649:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016113.233707:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333655168:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2711us (3932us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016113.233717:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10733 00000100:00100000:0.0:1734016113.236268:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.236378:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333655296 00000100:00100000:2.0:1734016113.236388:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333655296 00000100:00100000:2.0:1734016113.237024:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10734 00000100:00100000:2.0:1734016113.237033:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333655296:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016113.237056:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016113.237078:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271152cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5611 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016113.237143:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335272192:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016113.237211:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016113.242992:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335272192:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016113.243051:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271152cf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5611 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.243065:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271152cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5611 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.243089:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:0.0:1734016113.243147:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333655296:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6113us (6890us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016113.243156:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10734 00000100:00100000:0.0:1734016113.249389:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.249573:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333655552 00000100:00100000:2.0:1734016113.249583:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333655552 00002000:00100000:2.0:1734016113.249636:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3514368->3518463) req@ffff8800756ed880 x1818247333655552/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.249645:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ed880 with x1818247333655552 ext(3514368->3518463) 00002000:00010000:2.0:1734016113.249651:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ed880 00000100:00100000:2.0:1734016113.249686:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8496 00000100:00100000:2.0:1734016113.249697:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333655552:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016113.250406:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333655552:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 709us (1027us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016113.250417:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8496 00002000:00100000:2.0:1734016113.250422:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3514368->3518463) req@ffff8800756ed880 x1818247333655552/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.250429:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ed880 with x1818247333655552 ext(3514368->3518463) 00002000:00010000:2.0:1734016113.250431:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ed880 00000100:00100000:0.0:1734016113.253734:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.254420:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333655808 00000100:00100000:2.0:1734016113.254430:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333655808 00002000:00100000:2.0:1734016113.254473:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3510272->3514367) req@ffff8800756ee680 x1818247333655808/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.254483:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ee680 with x1818247333655808 ext(3510272->3514367) 00002000:00010000:2.0:1734016113.254489:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ee680 00000100:00100000:2.0:1734016113.254513:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8497 00000100:00100000:2.0:1734016113.254520:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333655808:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016113.256746:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333655808:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 2211us (3009us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016113.256761:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8497 00002000:00100000:2.0:1734016113.256774:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3510272->3514367) req@ffff8800756ee680 x1818247333655808/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.256782:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ee680 with x1818247333655808 ext(3510272->3514367) 00002000:00010000:2.0:1734016113.256789:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ee680 00000100:00100000:0.0:1734016113.261185:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.261307:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333656064 00000100:00100000:2.0:1734016113.261317:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333656064 00002000:00100000:2.0:1734016113.261361:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3506176->3510271) req@ffff8800756ed500 x1818247333656064/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.261377:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ed500 with x1818247333656064 ext(3506176->3510271) 00002000:00010000:2.0:1734016113.261383:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ed500 00000100:00100000:2.0:1734016113.261403:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8498 00000100:00100000:2.0:1734016113.261409:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333656064:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016113.261600:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333656064:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 189us (428us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016113.261606:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8498 00002000:00100000:2.0:1734016113.261611:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3506176->3510271) req@ffff8800756ed500 x1818247333656064/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.261618:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ed500 with x1818247333656064 ext(3506176->3510271) 00002000:00010000:2.0:1734016113.261621:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ed500 00000100:00100000:0.0:1734016113.267440:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.267573:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333656320 00000100:00100000:2.0:1734016113.267584:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333656320 00002000:00100000:2.0:1734016113.267629:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3502080->3506175) req@ffff8800756ef100 x1818247333656320/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.267638:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ef100 with x1818247333656320 ext(3502080->3506175) 00002000:00010000:2.0:1734016113.267644:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ef100 00000100:00100000:2.0:1734016113.267665:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8499 00000100:00100000:2.0:1734016113.267671:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333656320:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016113.267887:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333656320:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 215us (466us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016113.267894:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8499 00002000:00100000:2.0:1734016113.267899:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3502080->3506175) req@ffff8800756ef100 x1818247333656320/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.267906:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ef100 with x1818247333656320 ext(3502080->3506175) 00002000:00010000:2.0:1734016113.267909:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ef100 00000100:00100000:0.0:1734016113.272649:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.273166:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333656448 00000100:00100000:2.0:1734016113.273178:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333656448 00002000:00100000:2.0:1734016113.273227:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3502080->3518463) req@ffff8800756ec380 x1818247333656448/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 16872/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.273238:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ec380 with x1818247333656448 ext(3502080->3518463) 00002000:00010000:2.0:1734016113.273243:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ec380 00000100:00100000:2.0:1734016113.273305:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8500 00000100:00100000:2.0:1734016113.273313:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333656448:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016113.275317:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333656448:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1995us (2671us total) trans 4294969361 rc 0/0 00000100:00100000:3.0:1734016113.275331:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8500 00002000:00100000:3.0:1734016113.275342:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3502080->3518463) req@ffff8800756ec380 x1818247333656448/t4294969361(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 16872/448 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.275352:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ec380 with x1818247333656448 ext(3502080->3518463) 00002000:00010000:3.0:1734016113.275357:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ec380 00000100:00100000:1.0:1734016113.281649:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.281747:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333656576 00000100:00100000:0.0:1734016113.281758:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333656576 00000100:00100000:3.0:1734016113.281897:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10735 00000100:00100000:3.0:1734016113.281907:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333656576:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016113.287277:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969361 is committed 00000001:00080000:0.0:1734016113.287307:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969358 is committed 00000100:00100000:3.0:1734016113.287961:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333656576:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 6043us (6312us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016113.287975:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10735 00000100:00100000:0.0:1734016113.297453:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.297614:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333656704 00000100:00100000:3.0:1734016113.297624:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333656704 00000100:00100000:3.0:1734016113.297675:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10736 00000100:00100000:3.0:1734016113.297682:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333656704:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016113.297705:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016113.297727:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271152d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5618 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016113.297785:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335272320:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016113.297890:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb6c0 going to sleep for 11 seconds 00002000:00010000:3.0:1734016113.299849:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 640 -> 672 00000100:00100000:3.0:1734016113.299871:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335272320:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016113.299897:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271152d6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5618 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016113.299908:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271152d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5618 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016113.299927:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016113.299958:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333656704:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2276us (2518us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016113.299966:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10736 00000100:00100000:1.0:1734016113.302896:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.303043:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333656832 00000100:00100000:3.0:1734016113.303053:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333656832 00000100:00100000:3.0:1734016113.303306:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10737 00000100:00100000:3.0:1734016113.303315:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333656832:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016113.303339:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016113.303359:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc271152dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e561f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016113.303419:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335272448:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016113.303676:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016113.305599:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335272448:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016113.305635:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc271152dd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e561f expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016113.305648:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc271152dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e561f expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016113.305661:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7840, rc 0) 00000100:00100000:3.0:1734016113.305791:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333656832:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2473us (2903us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016113.305835:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10737 00000100:00100000:1.0:1734016113.308647:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.308795:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333657088 00000100:00100000:3.0:1734016113.308840:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333657088 00002000:00100000:3.0:1734016113.308885:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9752576->9756671) req@ffff88012e605c00 x1818247333657088/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.308895:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605c00 with x1818247333657088 ext(9752576->9756671) 00002000:00010000:3.0:1734016113.308901:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e605c00 00000100:00100000:3.0:1734016113.308930:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8501 00000100:00100000:3.0:1734016113.308936:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333657088:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016113.309138:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333657088:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 200us (500us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016113.309148:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8501 00002000:00100000:3.0:1734016113.309153:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9752576->9756671) req@ffff88012e605c00 x1818247333657088/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.309159:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605c00 with x1818247333657088 ext(9752576->9756671) 00002000:00010000:3.0:1734016113.309163:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e605c00 00000100:00100000:1.0:1734016113.313218:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.313468:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333657344 00000100:00100000:3.0:1734016113.313481:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333657344 00002000:00100000:3.0:1734016113.313536:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9748480->9752575) req@ffff88012e605180 x1818247333657344/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.313547:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605180 with x1818247333657344 ext(9748480->9752575) 00002000:00010000:3.0:1734016113.313552:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e605180 00000100:00100000:3.0:1734016113.313577:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8502 00000100:00100000:3.0:1734016113.313584:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333657344:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016113.313784:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333657344:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 199us (582us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016113.313791:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8502 00002000:00100000:3.0:1734016113.313797:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9748480->9752575) req@ffff88012e605180 x1818247333657344/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.313836:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605180 with x1818247333657344 ext(9748480->9752575) 00002000:00010000:3.0:1734016113.313838:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e605180 00000100:00100000:0.0:1734016113.317053:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.317249:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333657600 00000100:00100000:2.0:1734016113.317260:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333657600 00002000:00100000:2.0:1734016113.317313:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (9744384->9748479) req@ffff8800756ec700 x1818247333657600/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.317322:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ec700 with x1818247333657600 ext(9744384->9748479) 00002000:00010000:2.0:1734016113.317327:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ec700 00000100:00100000:2.0:1734016113.317363:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8503 00000100:00100000:2.0:1734016113.317370:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333657600:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016113.317613:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333657600:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 241us (570us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016113.317620:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8503 00002000:00100000:2.0:1734016113.317626:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (9744384->9748479) req@ffff8800756ec700 x1818247333657600/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.317638:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ec700 with x1818247333657600 ext(9744384->9748479) 00002000:00010000:2.0:1734016113.317640:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ec700 00000100:00100000:1.0:1734016113.320996:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.321118:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333657856 00000100:00100000:3.0:1734016113.321129:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333657856 00002000:00100000:3.0:1734016113.321177:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9740288->9744383) req@ffff88012e604a80 x1818247333657856/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.321192:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604a80 with x1818247333657856 ext(9740288->9744383) 00002000:00010000:3.0:1734016113.321197:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e604a80 00000100:00100000:3.0:1734016113.321230:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8504 00000100:00100000:3.0:1734016113.321237:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333657856:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016113.322428:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333657856:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1184us (1437us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016113.322437:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8504 00002000:00100000:3.0:1734016113.322446:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9740288->9744383) req@ffff88012e604a80 x1818247333657856/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.322455:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604a80 with x1818247333657856 ext(9740288->9744383) 00002000:00010000:3.0:1734016113.322459:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e604a80 00000100:00100000:1.0:1734016113.325528:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.325633:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333658112 00000100:00100000:3.0:1734016113.325645:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333658112 00002000:00100000:3.0:1734016113.325698:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9736192->9740287) req@ffff88012e605500 x1818247333658112/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.325708:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605500 with x1818247333658112 ext(9736192->9740287) 00002000:00010000:3.0:1734016113.325713:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e605500 00000100:00100000:3.0:1734016113.325757:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8505 00000100:00100000:3.0:1734016113.325765:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333658112:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016113.326406:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333658112:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 641us (894us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016113.326413:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8505 00002000:00100000:3.0:1734016113.326419:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9736192->9740287) req@ffff88012e605500 x1818247333658112/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.326427:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605500 with x1818247333658112 ext(9736192->9740287) 00002000:00010000:3.0:1734016113.326430:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e605500 00000100:00100000:0.0:1734016113.328906:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.329035:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333658368 00000100:00100000:3.0:1734016113.329045:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333658368 00002000:00100000:3.0:1734016113.329086:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9732096->9736191) req@ffff8800756edf80 x1818247333658368/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.329095:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756edf80 with x1818247333658368 ext(9732096->9736191) 00002000:00010000:3.0:1734016113.329100:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756edf80 00000100:00100000:3.0:1734016113.329130:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8506 00000100:00100000:3.0:1734016113.329137:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333658368:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016113.329322:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333658368:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 184us (426us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016113.329328:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8506 00002000:00100000:3.0:1734016113.329334:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9732096->9736191) req@ffff8800756edf80 x1818247333658368/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.329341:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756edf80 with x1818247333658368 ext(9732096->9736191) 00002000:00010000:3.0:1734016113.329481:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756edf80 00000100:00100000:1.0:1734016113.333545:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.333646:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333658624 00000100:00100000:3.0:1734016113.333657:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333658624 00002000:00100000:3.0:1734016113.333704:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9728000->9732095) req@ffff88012e605880 x1818247333658624/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.333714:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605880 with x1818247333658624 ext(9728000->9732095) 00002000:00010000:3.0:1734016113.333720:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e605880 00000100:00100000:3.0:1734016113.333753:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8507 00000100:00100000:3.0:1734016113.333762:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333658624:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016113.333986:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333658624:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 225us (459us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016113.333993:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8507 00002000:00100000:3.0:1734016113.334011:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9728000->9732095) req@ffff88012e605880 x1818247333658624/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.334018:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605880 with x1818247333658624 ext(9728000->9732095) 00002000:00010000:3.0:1734016113.334021:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e605880 00000100:00100000:1.0:1734016113.340501:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.340779:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333658880 00000100:00100000:3.0:1734016113.340790:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333658880 00002000:00100000:3.0:1734016113.340878:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9723904->9727999) req@ffff88012e607800 x1818247333658880/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.340887:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e607800 with x1818247333658880 ext(9723904->9727999) 00002000:00010000:3.0:1734016113.340893:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e607800 00000100:00100000:3.0:1734016113.340931:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8508 00000100:00100000:3.0:1734016113.340938:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333658880:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016113.341154:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333658880:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 215us (672us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016113.341161:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8508 00002000:00100000:3.0:1734016113.341166:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9723904->9727999) req@ffff88012e607800 x1818247333658880/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.341172:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e607800 with x1818247333658880 ext(9723904->9727999) 00002000:00010000:3.0:1734016113.341175:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e607800 00000100:00100000:0.0:1734016113.349635:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.349747:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333659136 00000100:00100000:2.0:1734016113.349758:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333659136 00002000:00100000:2.0:1734016113.349838:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (9719808->9723903) req@ffff8800756eca80 x1818247333659136/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.349849:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756eca80 with x1818247333659136 ext(9719808->9723903) 00002000:00010000:2.0:1734016113.349854:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756eca80 00000100:00100000:2.0:1734016113.349891:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8509 00000100:00100000:2.0:1734016113.349897:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333659136:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016113.350106:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333659136:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 208us (485us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016113.350115:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8509 00002000:00100000:2.0:1734016113.350120:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (9719808->9723903) req@ffff8800756eca80 x1818247333659136/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.350127:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756eca80 with x1818247333659136 ext(9719808->9723903) 00002000:00010000:2.0:1734016113.350130:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756eca80 00000100:00100000:1.0:1734016113.354701:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.355012:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333659392 00000100:00100000:3.0:1734016113.355024:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333659392 00002000:00100000:3.0:1734016113.355073:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9715712->9719807) req@ffff88012e604700 x1818247333659392/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.355085:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604700 with x1818247333659392 ext(9715712->9719807) 00002000:00010000:3.0:1734016113.355092:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e604700 00000100:00100000:3.0:1734016113.355127:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8510 00000100:00100000:3.0:1734016113.355133:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333659392:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016113.355333:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333659392:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 199us (644us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016113.355341:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8510 00002000:00100000:3.0:1734016113.355346:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9715712->9719807) req@ffff88012e604700 x1818247333659392/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.355353:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604700 with x1818247333659392 ext(9715712->9719807) 00002000:00010000:3.0:1734016113.355355:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e604700 00000100:00100000:1.0:1734016113.363109:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.363424:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333659648 00000100:00100000:2.0:1734016113.363436:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333659648 00002000:00100000:2.0:1734016113.363494:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (9711616->9715711) req@ffff88012e606300 x1818247333659648/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.363505:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e606300 with x1818247333659648 ext(9711616->9715711) 00002000:00010000:2.0:1734016113.363512:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e606300 00000100:00100000:2.0:1734016113.363553:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8511 00000100:00100000:2.0:1734016113.363560:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333659648:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016113.363765:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333659648:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 204us (667us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016113.363772:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8511 00002000:00100000:2.0:1734016113.363778:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (9711616->9715711) req@ffff88012e606300 x1818247333659648/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.363784:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e606300 with x1818247333659648 ext(9711616->9715711) 00002000:00010000:2.0:1734016113.363787:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e606300 00000100:00100000:0.0:1734016113.369901:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.370176:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333659904 00000100:00100000:3.0:1734016113.370189:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333659904 00002000:00100000:3.0:1734016113.370242:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9707520->9711615) req@ffff8800756ef480 x1818247333659904/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.370255:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ef480 with x1818247333659904 ext(9707520->9711615) 00002000:00010000:3.0:1734016113.370263:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ef480 00000100:00100000:3.0:1734016113.370307:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8512 00000100:00100000:3.0:1734016113.370314:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333659904:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016113.375220:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333659904:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 4885us (5316us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016113.375239:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8512 00002000:00100000:3.0:1734016113.375254:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9707520->9711615) req@ffff8800756ef480 x1818247333659904/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.375264:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ef480 with x1818247333659904 ext(9707520->9711615) 00002000:00010000:3.0:1734016113.375272:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ef480 00000100:00100000:1.0:1734016113.380593:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.380703:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333660160 00000100:00100000:3.0:1734016113.380715:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333660160 00002000:00100000:3.0:1734016113.380769:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9703424->9707519) req@ffff88012e604e00 x1818247333660160/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.380781:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604e00 with x1818247333660160 ext(9703424->9707519) 00002000:00010000:3.0:1734016113.380790:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e604e00 00000100:00100000:2.0:1734016113.380979:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8513 00000100:00100000:2.0:1734016113.380989:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333660160:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016113.381198:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333660160:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 209us (617us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016113.381205:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8513 00002000:00100000:2.0:1734016113.381211:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (9703424->9707519) req@ffff88012e604e00 x1818247333660160/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.381217:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604e00 with x1818247333660160 ext(9703424->9707519) 00002000:00010000:2.0:1734016113.381220:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e604e00 00000100:00100000:1.0:1734016113.383629:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.383720:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333660416 00000100:00100000:3.0:1734016113.383730:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333660416 00002000:00100000:3.0:1734016113.383771:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9699328->9703423) req@ffff88012e604380 x1818247333660416/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.383781:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604380 with x1818247333660416 ext(9699328->9703423) 00002000:00010000:3.0:1734016113.383787:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e604380 00000100:00100000:3.0:1734016113.383849:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8514 00000100:00100000:3.0:1734016113.383856:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333660416:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016113.384085:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333660416:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 228us (466us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016113.384092:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8514 00002000:00100000:3.0:1734016113.384099:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (9699328->9703423) req@ffff88012e604380 x1818247333660416/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.384111:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604380 with x1818247333660416 ext(9699328->9703423) 00002000:00010000:3.0:1734016113.384113:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e604380 00000100:00100000:0.0:1734016113.387897:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.388024:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333660544 00000100:00100000:3.0:1734016113.388035:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333660544 00000100:00100000:3.0:1734016113.388606:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10738 00000100:00100000:3.0:1734016113.388613:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333660544:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016113.388635:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016113.388656:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc271152e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5626 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016113.388722:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335272576:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016113.389023:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016113.392403:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335272576:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016113.392443:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc271152e4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5626 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016113.392457:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc271152e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5626 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016113.392623:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7840, rc 0) 00000100:00100000:3.0:1734016113.392688:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333660544:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4073us (4800us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016113.392698:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10738 00000100:00100000:1.0:1734016113.394906:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.395037:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333660672 00000100:00100000:3.0:1734016113.395050:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333660672 00000100:00100000:3.0:1734016113.395166:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10739 00000100:00100000:3.0:1734016113.395173:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333660672:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016113.395196:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016113.395219:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271152eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e562d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016113.395286:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335272704:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016113.395358:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016113.398128:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335272704:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016113.398187:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271152eb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e562d expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016113.398205:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271152eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e562d expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016113.398675:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016113.398749:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333660672:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3574us (3850us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016113.398757:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10739 00000100:00100000:1.0:1734016113.402163:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.402605:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333660800 00000100:00100000:3.0:1734016113.402617:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333660800 00000100:00100000:3.0:1734016113.402935:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10740 00000100:00100000:3.0:1734016113.402943:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333660800:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016113.402966:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016113.402988:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271152f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5634 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016113.403067:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335272832:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016113.403140:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016113.406048:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335272832:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016113.406087:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271152f2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5634 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016113.406103:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271152f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5634 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016113.406323:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016113.406384:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333660800:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3439us (4230us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016113.406393:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10740 00000100:00100000:1.0:1734016113.408425:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.408514:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333660928 00000100:00100000:3.0:1734016113.408522:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333660928 00000100:00100000:3.0:1734016113.408594:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10741 00000100:00100000:3.0:1734016113.408600:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333660928:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016113.408620:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016113.408639:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271152f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e563b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.408673:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271152b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6586368->6651903) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55f5 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.408684:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016113.408687:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016113.408691:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271152f9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [49152->61439] (req 49152->61439) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e563b expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.408719:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271152b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6586368->6651903) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55f5 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.408729:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271152b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6586368->6651903) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55f5 expref: 5 pid: 8216 timeout: 480 lvb_type: 0 00000100:00100000:3.0:1734016113.408742:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335272960:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016113.408793:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016113.412083:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.412175:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333661056 00000100:00100000:2.0:1734016113.412186:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333661056 00010000:00010000:2.0:1734016113.412224:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271152b3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6586368->6651903) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55f5 expref: 6 pid: 8216 timeout: 480 lvb_type: 0 00000100:00100000:2.0:1734016113.412264:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2962 00000100:00100000:2.0:1734016113.412272:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333661056:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016113.412287:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016113.412310:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271152b3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6586368->6651903) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55f5 expref: 6 pid: 8216 timeout: 480 lvb_type: 0 00010000:00010000:2.0:1734016113.412323:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271152b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6586368->6651903) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55f5 expref: 6 pid: 8216 timeout: 480 lvb_type: 0 00010000:00010000:2.0:1734016113.412349:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.412351:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.412358:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271152f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 49152->61439) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e563b expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.412366:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271152f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 49152->61439) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e563b expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.412403:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271152f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 49152->61439) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e563b expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016113.412419:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335273088:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016113.412487:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e180 going to sleep for 11 seconds 00010000:00010000:3.0:1734016113.412574:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271152b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6586368->6651903) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55f5 expref: 6 pid: 8216 timeout: 480 lvb_type: 0 00000100:00100000:3.0:1734016113.412595:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335272960:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016113.412622:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271152f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 49152->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e563b expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.412630:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4480, rc 0) 00000100:00100000:3.0:1734016113.412656:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333660928:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4055us (4239us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016113.412665:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10741 00000100:00100000:1.0:1734016113.417369:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.417508:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335273088:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016113.417532:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016113.417584:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333661056:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5312us (5510us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016113.417596:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2962 00000100:00100000:3.0:1734016113.417708:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333661184 00000100:00100000:3.0:1734016113.417716:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333661184 00000100:00100000:3.0:1734016113.418411:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10742 00000100:00100000:3.0:1734016113.418419:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333661184:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016113.418668:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10483063 -> 10483063 00002000:00010000:3.0:1734016113.418671:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016113 -> 1734016113 00002000:00010000:3.0:1734016113.418673:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016113 -> 1734016113 00002000:00010000:3.0:1734016113.418675:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016113 -> 1734016113 00002000:00010000:3.0:1734016113.418676:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 672 -> 696 00000100:00100000:3.0:1734016113.418703:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333661184:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 285us (1347us total) trans 4294969362 rc 0/0 00000100:00100000:3.0:1734016113.418707:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10742 00000100:00100000:0.0:1734016113.423260:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.423382:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333661312 00000100:00100000:2.0:1734016113.423393:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333661312 00000100:00100000:2.0:1734016113.423451:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10743 00000100:00100000:2.0:1734016113.423458:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333661312:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016113.423481:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016113.423502:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115300 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5642 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016113.423570:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335273216:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016113.423658:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e180 going to sleep for 11 seconds 00000100:00100000:2.0:1734016113.426363:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335273216:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016113.426402:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115300 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5642 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.426417:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115300 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5642 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.426444:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016113.426687:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333661312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3227us (3435us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016113.426697:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10743 00000100:00100000:1.0:1734016113.430021:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.430159:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333661568 00000100:00100000:2.0:1734016113.430170:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333661568 00000100:00100000:2.0:1734016113.430246:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8515 00000100:00100000:2.0:1734016113.430253:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333661568:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:2.0:1734016113.430304:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115307 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.430327:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271152f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 49152->61439) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e563b expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.430333:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016113.430335:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016113.430338:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115307 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.430378:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271152f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 49152->61439) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e563b expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.430390:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271152f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 49152->61439) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e563b expref: 7 pid: 8216 timeout: 480 lvb_type: 0 00000100:00100000:2.0:1734016113.430407:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335273344:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016113.430489:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e180 going to sleep for 11 seconds 00000100:00100000:2.0:1734016113.435203:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335273344:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016113.435235:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115307 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016113.435646:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.435819:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333661696 00000100:00100000:2.0:1734016113.435826:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333661696 00010000:00010000:2.0:1734016113.435857:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271152f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 49152->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e563b expref: 8 pid: 8216 timeout: 480 lvb_type: 0 00000100:00100000:2.0:1734016113.436303:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2963 00000100:00100000:2.0:1734016113.436311:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333661696:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016113.436327:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016113.436352:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271152f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 49152->61439) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e563b expref: 8 pid: 8216 timeout: 480 lvb_type: 0 00010000:00010000:2.0:1734016113.436364:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271152f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 49152->61439) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e563b expref: 8 pid: 8216 timeout: 480 lvb_type: 0 00010000:00010000:2.0:1734016113.436388:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc271152f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 49152->61439) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e563b expref: 8 pid: 8216 timeout: 480 lvb_type: 0 00010000:00010000:2.0:1734016113.436422:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.436425:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.436429:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115307 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.436437:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115307 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.436470:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016113.436745:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115307 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.436754:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115307 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.436877:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115307 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.436885:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115307 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.436893:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115307 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.436899:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd200 already unused, calling callback (ffffffffa080e100) 00010000:00010000:3.0:1734016113.436903:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115307 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.436911:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115307 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.436921:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115307 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.436927:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115307 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016113.437168:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333661696:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 855us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016113.437175:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2963 00000100:00100000:3.0:1734016113.437712:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333661568:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 7457us (7700us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016113.437720:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8515 00000100:00100000:1.0:1734016113.442564:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.442659:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333661824 00000100:00100000:2.0:1734016113.442669:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333661824 00000100:00100000:2.0:1734016113.442977:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10744 00000100:00100000:2.0:1734016113.442984:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333661824:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016113.443013:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016113.443037:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc2711530e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5649 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1734016113.443061:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 10483063, mtime: 0x675afc71, atime: 0x675afc71, ctime: 0x675afc71, blocks: 0x2b8 00010000:00010000:2.0:1734016113.443081:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.443083:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.443092:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc2711530e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5649 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.443107:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc2711530e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5649 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.443118:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016113.443169:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333661824:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 185us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016113.443176:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10744 00000100:00100000:0.0:1734016113.446200:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.446304:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333662080 00000100:00100000:2.0:1734016113.446316:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333662080 00000100:00100000:2.0:1734016113.446923:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2158 00000100:00100000:2.0:1734016113.446932:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:9668:x1818247333662080:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016113.447004:0:7704:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016113.447036:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271152ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55ee expref: 18 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.447597:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016113.447602:0:7704:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016113.447784:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115315 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.447822:0:7704:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711527b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55c4 expref: 17 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.447829:0:7704:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115315 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.448682:0:7704:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711527b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55c4 expref: 17 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.448703:0:7704:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711527b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55c4 expref: 17 pid: 7704 timeout: 480 lvb_type: 0 00000100:00100000:2.0:1734016113.448719:0:7704:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335273472:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016113.449590:0:7704:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016113.453537:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.453659:0:7704:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335273472:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016113.453695:0:7704:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115315 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:3.0:1734016113.453841:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333662208 00000100:00100000:3.0:1734016113.453849:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333662208 00010000:00010000:3.0:1734016113.453885:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711527b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55c4 expref: 18 pid: 7704 timeout: 480 lvb_type: 0 00000100:00100000:3.0:1734016113.453924:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2964 00000100:00100000:3.0:1734016113.453932:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+18:1981:x1818247333662208:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016113.453950:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016113.453957:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711527b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55c4 expref: 18 pid: 7704 timeout: 480 lvb_type: 0 00010000:00010000:3.0:1734016113.453966:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711527b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55c4 expref: 18 pid: 7704 timeout: 480 lvb_type: 0 00010000:00010000:3.0:1734016113.453988:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711527b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e55c4 expref: 18 pid: 7704 timeout: 480 lvb_type: 0 00010000:00010000:3.0:1734016113.454024:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016113.454029:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115315 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.454038:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115315 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.454045:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115315 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.454063:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016113.454118:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+17:1981:x1818247333662208:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 186us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016113.454125:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2964 00010000:00010000:2.0:1734016113.454531:0:7704:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115315 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.454538:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115315 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:2.0:1734016113.454644:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968688 00000004:00010000:2.0:1734016113.454694:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007bd2b100 reply state ffff8800753a7000 transno 4294968689 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115315 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:2.0:1734016113.454702:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016113.454779:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:9668:x1818247333662080:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 7848us (8590us total) trans 4294968689 rc 0/0 00000100:00100000:2.0:1734016113.454787:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2158 00000020:00080000:2.0:1734016113.454792:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016113.458356:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.458396:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333662336 00000100:00100000:0.0:1734016113.458405:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333662336 00000100:00100000:0.0:1734016113.458445:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10745 00000100:00100000:0.0:1734016113.458453:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333662336:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016113.458478:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016113.458503:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc2711531c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5650 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.458534:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc2711530e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5649 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.458541:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016113.458544:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016113.458548:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc2711531c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5650 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.458581:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc2711530e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5649 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.458593:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc2711530e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5649 expref: 7 pid: 7684 timeout: 480 lvb_type: 1 00000100:00100000:0.0:1734016113.458606:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335273600:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016113.458661:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00010000:00010000:3.0:1734016113.459508:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115315 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.459518:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115315 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.459525:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115315 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.459531:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc900 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016113.459534:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115315 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.459540:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115315 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.459557:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016113.459561:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016113.459565:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115315 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.459570:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115315 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016113.463912:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335273600:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016113.463951:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc2711531c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5650 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.463972:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00000100:00100000:0.0:1734016113.464045:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333662336:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5590us (5699us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016113.464054:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10745 00000100:00100000:1.0:1734016113.465201:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.465478:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333662464 00000100:00100000:2.0:1734016113.465488:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333662464 00010000:00010000:2.0:1734016113.465523:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc2711530e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5649 expref: 7 pid: 7684 timeout: 480 lvb_type: 1 00000100:00100000:2.0:1734016113.465563:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2965 00000100:00100000:2.0:1734016113.465570:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333662464:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016113.465586:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016113.465610:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc2711530e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5649 expref: 7 pid: 7684 timeout: 480 lvb_type: 1 00010000:00010000:2.0:1734016113.465623:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc2711530e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5649 expref: 7 pid: 7684 timeout: 480 lvb_type: 1 00010000:00010000:2.0:1734016113.465648:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc2711530e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5649 expref: 7 pid: 7684 timeout: 480 lvb_type: 1 00010000:00010000:2.0:1734016113.465667:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.465670:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.465675:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc2711531c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5650 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.465685:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc2711531c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5650 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.465727:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc2711531c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5650 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016113.465745:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335273728:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016113.465844:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016113.469312:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.469410:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335273728:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016113.469436:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016113.470091:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333662592 00000100:00100000:3.0:1734016113.470100:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333662592 00002000:00010000:3.0:1734016113.470136:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (2324287->18446744073709551615) 00002000:00100000:3.0:1734016113.470141:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074939880 with x1818247333662592 ext(2324287->18446744073709551615) 00002000:00010000:3.0:1734016113.470152:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074939880. 00000100:00100000:3.0:1734016113.470182:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8516 00000100:00100000:3.0:1734016113.470190:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333662592:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016113.471060:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10483063 -> 2324287 00002000:00010000:3.0:1734016113.471065:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016113 -> 1734016114 00002000:00010000:3.0:1734016113.471067:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016113 -> 1734016113 00002000:00010000:3.0:1734016113.471069:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016113 -> 1734016114 00002000:00010000:3.0:1734016113.471071:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 696 -> 144 00000100:00100000:0.0:1734016113.471252:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333662464:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5677us (6051us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016113.471263:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2965 00000100:00100000:3.0:1734016113.472029:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333662592:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1836us (2727us total) trans 4294969363 rc 0/0 00000100:00100000:3.0:1734016113.472038:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8516 00002000:00010000:3.0:1734016113.472043:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (2324287->18446744073709551615) 00002000:00100000:3.0:1734016113.472047:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074939880 with x1818247333662592 ext(2324287->18446744073709551615) 00002000:00010000:3.0:1734016113.472056:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074939880. 00000100:00100000:0.0:1734016113.475301:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.475394:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333662720 00000100:00100000:2.0:1734016113.475403:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333662720 00000100:00100000:2.0:1734016113.475447:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2159 00000100:00100000:2.0:1734016113.475454:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+17:9668:x1818247333662720:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016113.475475:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016113.475495:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115323 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5657 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.475583:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711532a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.475596:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711532a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.475607:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711532a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:2.0:1734016113.475629:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 2324287 00000004:00200000:2.0:1734016113.475632:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016113.475647:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711532a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.475668:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115323 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5657 expref: 19 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.475790:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711532a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5657 expref: 18 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.475798:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016113.475916:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016113.475919:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016113.476132:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333662720:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 677us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016113.476138:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2159 00000100:00100000:1.0:1734016113.480409:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.480486:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333662848 00000100:00100000:0.0:1734016113.480499:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333662848 00000100:00100000:0.0:1734016113.480552:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10746 00000100:00100000:0.0:1734016113.480560:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333662848:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016113.480581:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016113.480599:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27115331 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e565e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016113.480657:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335273856:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016113.480726:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016113.482757:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335273856:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016113.482790:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27115331 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e565e expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.482915:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27115331 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e565e expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.483003:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:0.0:1734016113.483047:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333662848:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2488us (2650us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016113.483056:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10746 00000100:00100000:1.0:1734016113.485451:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.485551:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333662976 00000100:00100000:0.0:1734016113.485561:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333662976 00000100:00100000:0.0:1734016113.485727:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10747 00000100:00100000:0.0:1734016113.485736:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333662976:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016113.485756:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016113.485774:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27115338 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5665 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016113.486032:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335273984:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016113.486101:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016113.487871:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335273984:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016113.487903:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27115338 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5665 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.487918:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27115338 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5665 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.487935:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:0.0:1734016113.487983:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333662976:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2247us (2541us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016113.487993:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10747 00000100:00100000:3.0:1734016113.491210:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.491364:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333663104 00000100:00100000:2.0:1734016113.491375:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333663104 00000100:00100000:2.0:1734016113.491529:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2160 00000100:00100000:2.0:1734016113.491537:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:9668:x1818247333663104:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016113.491563:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016113.491584:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711533f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e566c expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.491674:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115346 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.491688:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.491698:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:2.0:1734016113.491723:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 2324287 00000004:00200000:2.0:1734016113.491727:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016113.491742:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.491762:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711533f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e566c expref: 21 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.491794:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e566c expref: 20 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.492287:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016113.492291:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016113.492294:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd440, rc 0) 00000100:00100000:2.0:1734016113.492440:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:9668:x1818247333663104:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 902us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016113.492447:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2160 00000100:00100000:1.0:1734016113.499486:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.501317:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333663360 00000100:00100000:3.0:1734016113.501331:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333663360 00002000:00100000:3.0:1734016113.501391:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->2326527) req@ffff880075877b80 x1818247333663360/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.501401:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075877b80 with x1818247333663360 ext(0->2326527) 00002000:00010000:3.0:1734016113.501407:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075877b80 00000100:00100000:3.0:1734016113.501448:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8517 00000100:00100000:3.0:1734016113.501457:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333663360:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:2.0:1734016113.522016:0:8957:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1734016113.522642:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333663360:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 21176us (23159us total) trans 0 rc 2326528/2326528 00000100:00100000:3.0:1734016113.522654:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8517 00002000:00100000:3.0:1734016113.522666:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->2326527) req@ffff880075877b80 x1818247333663360/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:74/0 lens 488/440 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 2326528/2326528 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.522675:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075877b80 with x1818247333663360 ext(0->2326527) 00002000:00010000:3.0:1734016113.522681:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075877b80 00000100:00100000:3.0:1734016113.528566:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.528648:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333663616 00000100:00100000:0.0:1734016113.528659:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333663616 00000100:00100000:2.0:1734016113.529825:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8518 00000100:00100000:2.0:1734016113.529838:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333663616:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:2.0:1734016113.529890:0:13914:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711534d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.529911:0:13914:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc2711531c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5650 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.529920:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016113.529923:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016113.529926:0:13914:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711534d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1806336->1847295] (req 1806336->1847295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.529967:0:13914:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc2711531c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5650 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.529979:0:13914:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc2711531c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5650 expref: 7 pid: 8216 timeout: 480 lvb_type: 0 00000100:00100000:2.0:1734016113.530006:0:13914:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335274112:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016113.530102:0:13914:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016113.536337:0:13914:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335274112:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016113.536376:0:13914:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711534d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1806336->1847295] (req 1806336->1847295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016113.537186:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.537556:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333663744 00000100:00100000:0.0:1734016113.537566:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333663744 00010000:00010000:0.0:1734016113.537607:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc2711531c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5650 expref: 8 pid: 8216 timeout: 480 lvb_type: 0 00000100:00100000:0.0:1734016113.537644:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2966 00000100:00100000:0.0:1734016113.537651:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5247c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333663744:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016113.537667:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016113.537689:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc2711531c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5650 expref: 8 pid: 8216 timeout: 480 lvb_type: 0 00010000:00010000:0.0:1734016113.537700:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc2711531c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5650 expref: 8 pid: 8216 timeout: 480 lvb_type: 0 00010000:00010000:0.0:1734016113.537721:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc2711531c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5650 expref: 8 pid: 8216 timeout: 480 lvb_type: 0 00010000:00010000:0.0:1734016113.537753:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016113.537755:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016113.537760:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711534d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1806336->1847295] (req 1806336->1847295) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.537768:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711534d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1806336->1847295] (req 1806336->1847295) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.537791:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016113.537886:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5247c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333663744:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 235us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016113.537892:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2966 00010000:00010000:0.0:1734016113.537955:0:13914:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711534d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1806336->1847295] (req 1806336->1847295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.537963:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711534d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1806336->1847295] (req 1806336->1847295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1734016113.543682:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969364 is committed 00000001:00080000:2.0:1734016113.543720:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969362 is committed 00002000:00010000:0.0:1734016113.543847:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 144 -> 224 00010000:00010000:0.0:1734016113.543863:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711534d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1806336->1847295] (req 1806336->1847295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.543873:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711534d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1806336->1847295] (req 1806336->1847295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.543880:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711534d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1806336->1847295] (req 1806336->1847295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.543886:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcfc0 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016113.543889:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711534d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1806336->1847295] (req 1806336->1847295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.543899:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711534d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1806336->1847295] (req 1806336->1847295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.543918:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711534d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1806336->1847295] (req 1806336->1847295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.543924:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711534d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1806336->1847295] (req 1806336->1847295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016113.546081:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333663616:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 16228us (17511us total) trans 4294969364 rc 0/0 00000100:00100000:0.0:1734016113.546096:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8518 00000100:00100000:1.0:1734016113.552063:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.552150:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333663872 00000100:00100000:0.0:1734016113.552162:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333663872 00000100:00100000:0.0:1734016113.552499:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10748 00000100:00100000:0.0:1734016113.552507:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333663872:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016113.552528:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016113.552550:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115354 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5673 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016113.552575:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 2324287, mtime: 0x675afc72, atime: 0x675afc71, ctime: 0x675afc72, blocks: 0xe0 00010000:00010000:0.0:1734016113.552596:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016113.552598:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016113.552606:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115354 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5673 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.552626:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115354 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5673 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.552639:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581200, rc 0) 00000100:00100000:0.0:1734016113.552686:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333663872:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 180us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016113.552692:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10748 00000100:00100000:3.0:1734016113.560467:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.560882:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333664128 00000100:00100000:2.0:1734016113.560894:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333664128 00000100:00100000:2.0:1734016113.561052:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2161 00000100:00100000:2.0:1734016113.561060:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:9668:x1818247333664128:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016113.561119:0:7704:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016113.561157:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115346 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e566c expref: 20 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.561541:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016113.561547:0:7704:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016113.561716:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711535b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.561732:0:7704:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711532a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5657 expref: 17 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.561738:0:7704:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711535b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.561772:0:7704:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711532a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5657 expref: 17 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.561784:0:7704:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711532a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5657 expref: 17 pid: 7704 timeout: 480 lvb_type: 0 00000100:00100000:2.0:1734016113.562422:0:7704:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335274240:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016113.563031:0:7704:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016113.566648:0:7704:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335274240:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016113.566683:0:7704:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711535b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:3.0:1734016113.567613:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.567707:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333664256 00000100:00100000:0.0:1734016113.567717:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333664256 00010000:00010000:0.0:1734016113.567755:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711532a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5657 expref: 18 pid: 7704 timeout: 480 lvb_type: 0 00000100:00100000:0.0:1734016113.567792:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2967 00000100:00100000:0.0:1734016113.567838:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247333664256:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016113.567854:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016113.567860:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711532a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5657 expref: 18 pid: 7704 timeout: 480 lvb_type: 0 00010000:00010000:0.0:1734016113.567872:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711532a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5657 expref: 18 pid: 7704 timeout: 480 lvb_type: 0 00010000:00010000:0.0:1734016113.567896:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711532a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5657 expref: 18 pid: 7704 timeout: 480 lvb_type: 0 00010000:00010000:0.0:1734016113.567916:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016113.567922:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711535b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016113.567932:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711535b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016113.567939:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711535b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016113.567957:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016113.568018:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+17:1982:x1818247333664256:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 218us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016113.568026:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2967 00010000:00010000:0.0:1734016113.568066:0:7704:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711535b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016113.568071:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711535b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:0.0:1734016113.568180:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968690 00000004:00010000:0.0:1734016113.568229:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007345c380 reply state ffff8800753a4000 transno 4294968691 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711535b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016113.568236:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016113.568308:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:9668:x1818247333664128:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 7249us (7853us total) trans 4294968691 rc 0/0 00000100:00100000:0.0:1734016113.568314:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2161 00000020:00080000:0.0:1734016113.568318:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1734016113.572929:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.573045:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333664384 00000100:00100000:0.0:1734016113.573056:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333664384 00000100:00100000:0.0:1734016113.573105:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10749 00000100:00100000:0.0:1734016113.573113:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333664384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016113.573135:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016113.573158:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115362 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e567a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.573193:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115354 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5673 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.573200:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016113.573202:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016113.573206:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115362 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e567a expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.573240:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115354 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5673 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.573251:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115354 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5673 expref: 6 pid: 8216 timeout: 480 lvb_type: 1 00000100:00100000:0.0:1734016113.573264:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335274368:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016113.573328:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00010000:00010000:2.0:1734016113.573501:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711535b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.573509:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711535b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.573515:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711535b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.573520:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcfc0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016113.573525:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711535b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.573536:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711535b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.573550:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016113.573553:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016113.573556:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711535b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.573560:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711535b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00000100:00100000:1.0:1734016113.576988:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.577055:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335274368:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016113.577092:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115362 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e567a expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.577111:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75818c0, rc 0) 00000100:00100000:0.0:1734016113.577172:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333664384:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4059us (4254us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016113.577182:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10749 00000100:00100000:2.0:1734016113.577355:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333664512 00000100:00100000:2.0:1734016113.577361:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333664512 00010000:00010000:2.0:1734016113.577386:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115354 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5673 expref: 7 pid: 8216 timeout: 480 lvb_type: 1 00000100:00100000:2.0:1734016113.577410:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2968 00000100:00100000:2.0:1734016113.577415:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333664512:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016113.577428:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016113.577449:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115354 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5673 expref: 7 pid: 8216 timeout: 480 lvb_type: 1 00010000:00010000:2.0:1734016113.577459:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115354 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5673 expref: 7 pid: 8216 timeout: 480 lvb_type: 1 00010000:00010000:2.0:1734016113.577480:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115354 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5673 expref: 7 pid: 8216 timeout: 480 lvb_type: 1 00010000:00010000:2.0:1734016113.577497:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.577499:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.577504:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115362 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e567a expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.577512:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e567a expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.577547:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e567a expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016113.577561:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335274496:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016113.577598:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00000100:00100000:1.0:1734016113.582108:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.582289:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335274496:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016113.582316:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016113.582382:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333664512:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4965us (5398us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016113.582393:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2968 00000100:00100000:0.0:1734016113.582466:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333664640 00000100:00100000:0.0:1734016113.582476:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333664640 00002000:00010000:0.0:1734016113.582513:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (4726197->18446744073709551615) 00002000:00100000:0.0:1734016113.582518:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075874700 with x1818247333664640 ext(4726197->18446744073709551615) 00002000:00010000:0.0:1734016113.582529:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075874700. 00000100:00100000:0.0:1734016113.582560:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8519 00000100:00100000:0.0:1734016113.582566:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333664640:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016113.582776:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 2324287 -> 4726197 00002000:00010000:0.0:1734016113.582780:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016114 -> 1734016114 00002000:00010000:0.0:1734016113.582782:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016113 -> 1734016113 00002000:00010000:0.0:1734016113.582784:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016114 -> 1734016114 00002000:00010000:0.0:1734016113.582787:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 224 -> 224 00000100:00100000:0.0:1734016113.582825:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333664640:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 257us (729us total) trans 4294969365 rc 0/0 00000100:00100000:0.0:1734016113.582832:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8519 00002000:00010000:0.0:1734016113.582835:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (4726197->18446744073709551615) 00002000:00100000:0.0:1734016113.582838:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075874700 with x1818247333664640 ext(4726197->18446744073709551615) 00002000:00010000:0.0:1734016113.582841:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075874700. 00000100:00100000:1.0:1734016113.586760:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.586858:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333664768 00000100:00100000:0.0:1734016113.586869:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333664768 00000100:00100000:0.0:1734016113.586926:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2162 00000100:00100000:0.0:1734016113.586935:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+17:9668:x1818247333664768:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016113.586960:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016113.586982:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115369 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5681 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.587095:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115370 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016113.587109:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016113.587120:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:0.0:1734016113.587145:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 4726197 00000004:00200000:0.0:1734016113.587149:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016113.587163:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016113.587186:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115369 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5681 expref: 19 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.587217:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5681 expref: 18 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.587225:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016113.587228:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016113.587230:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:0.0:1734016113.587291:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333664768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 357us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016113.587297:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2162 00000100:00100000:1.0:1734016113.590386:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.590459:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333664896 00000100:00100000:0.0:1734016113.590468:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333664896 00000100:00100000:0.0:1734016113.590519:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10750 00000100:00100000:0.0:1734016113.590527:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333664896:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016113.590548:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016113.590565:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27115377 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5688 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016113.590625:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335274624:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016113.590693:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016113.593350:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335274624:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016113.593398:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27115377 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5688 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.593412:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27115377 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5688 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.593478:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:0.0:1734016113.593540:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333664896:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3012us (3164us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016113.593550:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10750 00000100:00100000:2.0:1734016113.597611:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.597936:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333665024 00000100:00100000:0.0:1734016113.597947:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333665024 00000100:00100000:0.0:1734016113.598009:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10751 00000100:00100000:0.0:1734016113.598016:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333665024:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016113.598038:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016113.598058:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711537e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e568f expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016113.598123:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335274752:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016113.598199:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016113.601181:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335274752:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016113.601228:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711537e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e568f expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.601243:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc2711537e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e568f expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.601514:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581680, rc 0) 00000100:00100000:0.0:1734016113.601591:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333665024:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3573us (3993us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016113.601604:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10751 00000100:00100000:2.0:1734016113.604981:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016113.605224:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333665152 00000100:00100000:1.0:1734016113.605234:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333665152 00000100:00100000:1.0:1734016113.605279:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10752 00000100:00100000:1.0:1734016113.605286:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333665152:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016113.605307:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016113.605325:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115385 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5696 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016113.605388:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075877800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335274880:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016113.605458:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016113.608751:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075877800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335274880:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016113.608793:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115385 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5696 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.608877:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115385 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5696 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.609331:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d8c0, rc 0) 00000100:00100000:1.0:1734016113.609394:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333665152:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4107us (4424us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016113.609403:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10752 00000100:00100000:2.0:1734016113.613308:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016113.613397:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333665280 00000100:00100000:1.0:1734016113.613407:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333665280 00000100:00100000:1.0:1734016113.613481:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10753 00000100:00100000:1.0:1734016113.613489:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88009024b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333665280:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016113.613512:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016113.613534:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc2711538c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e569d expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016113.613600:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075877800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335275008:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016113.613904:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016113.616523:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075877800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335275008:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016113.616567:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc2711538c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e569d expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.616582:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc2711538c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e569d expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.617225:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016113.617296:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88009024b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333665280:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3804us (3999us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016113.617306:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10753 00000100:00100000:3.0:1734016113.620785:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016113.621040:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333665408 00000100:00100000:1.0:1734016113.621055:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333665408 00000100:00100000:1.0:1734016113.621126:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10754 00000100:00100000:1.0:1734016113.621135:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333665408:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016113.621157:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016113.621180:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27115393 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e56a4 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016113.621254:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075876d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335275136:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016113.621325:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016113.623423:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075876d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335275136:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016113.623474:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27115393 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56a4 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.623491:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27115393 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56a4 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.623527:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016113.624133:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333665408:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2996us (3362us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016113.624142:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10754 00000100:00100000:2.0:1734016113.626454:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016113.626568:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333665536 00000100:00100000:1.0:1734016113.626581:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333665536 00000100:00100000:1.0:1734016113.626633:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10755 00000100:00100000:1.0:1734016113.626641:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333665536:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016113.626669:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016113.626695:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc2711539a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e56ab expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.626737:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115362 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e567a expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.626749:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016113.626751:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016113.626754:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc2711539a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5521408->5545983] (req 5521408->5545983) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ab expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.626793:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e567a expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.627090:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e567a expref: 6 pid: 7684 timeout: 480 lvb_type: 0 00000100:00100000:1.0:1734016113.627105:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075876d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335275264:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016113.627500:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016113.630127:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075876d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335275264:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016113.630178:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc2711539a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5521408->5545983] (req 5521408->5545983) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ab expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.630205:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016113.630256:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333665536:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3615us (3813us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016113.630265:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10755 00000100:00100000:2.0:1734016113.631671:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.632021:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333665664 00000100:00100000:3.0:1734016113.632032:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333665664 00010000:00010000:3.0:1734016113.632085:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e567a expref: 7 pid: 7684 timeout: 480 lvb_type: 0 00000100:00100000:3.0:1734016113.632430:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2969 00000100:00100000:3.0:1734016113.632439:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333665664:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016113.632458:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016113.632482:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e567a expref: 7 pid: 7684 timeout: 480 lvb_type: 0 00010000:00010000:3.0:1734016113.632495:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e567a expref: 7 pid: 7684 timeout: 480 lvb_type: 0 00010000:00010000:3.0:1734016113.632520:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115362 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e567a expref: 7 pid: 7684 timeout: 480 lvb_type: 0 00010000:00010000:3.0:1734016113.632552:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016113.632555:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016113.632563:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc2711539a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5521408->5545983) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ab expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.632572:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc2711539a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5521408->5545983) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ab expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.632615:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc2711539a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5521408->5545983) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ab expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016113.632629:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335275392:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016113.633511:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb840 going to sleep for 11 seconds 00000100:00100000:2.0:1734016113.637033:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016113.637143:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333665792 00000100:00100000:1.0:1734016113.637155:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333665792 00000100:00100000:1.0:1734016113.637214:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10756 00000100:00100000:1.0:1734016113.637223:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333665792:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016113.637506:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 4726197 -> 4726197 00002000:00010000:1.0:1734016113.637510:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016114 -> 1734016114 00002000:00010000:1.0:1734016113.637512:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016113 -> 1734016113 00002000:00010000:1.0:1734016113.637514:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016114 -> 1734016113 00002000:00010000:1.0:1734016113.637515:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 224 -> 272 00000100:00100000:1.0:1734016113.637567:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333665792:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 344us (548us total) trans 4294969366 rc 0/0 00000100:00100000:1.0:1734016113.637574:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10756 00000100:00100000:3.0:1734016113.637678:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335275392:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016113.637701:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016113.637723:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333665664:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5285us (6064us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016113.637731:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2969 00000100:00100000:2.0:1734016113.640210:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.640296:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333665920 00000100:00100000:0.0:1734016113.640307:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333665920 00000100:00100000:0.0:1734016113.640366:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2163 00000100:00100000:0.0:1734016113.640376:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:9668:x1818247333665920:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016113.640403:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016113.640427:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc271153a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e56b2 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.640537:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc271153a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016113.640555:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc271153a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016113.640568:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc271153a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016113.640604:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 4726197 00000004:00200000:0.0:1734016113.640609:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016113.640628:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc271153a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016113.640653:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc271153a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56b2 expref: 23 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.640698:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc271153a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56b2 expref: 22 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.640705:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016113.640707:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016113.640710:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016113.640764:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:9668:x1818247333665920:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 389us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016113.640771:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2163 00000100:00100000:2.0:1734016113.644326:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.644408:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333666048 00000100:00100000:0.0:1734016113.644424:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333666048 00000100:00100000:0.0:1734016113.644508:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10757 00000100:00100000:0.0:1734016113.644520:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333666048:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016113.644556:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016113.644587:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc271153af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e56b9 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016113.644686:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335275520:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016113.644785:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00002000:00010000:1.0:1734016113.647151:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016113 -> 1734016114 00000100:00100000:1.0:1734016113.647204:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335275520:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016113.647269:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc271153af lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56b9 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.647294:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc271153af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56b9 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.647342:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581b00, rc 0) 00000100:00100000:1.0:1734016113.647434:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333666048:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2914us (3120us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016113.647447:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10757 00000100:00100000:2.0:1734016113.650666:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016113.650786:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333666176 00000100:00100000:1.0:1734016113.650798:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333666176 00000100:00100000:1.0:1734016113.651623:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10758 00000100:00100000:1.0:1734016113.651634:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333666176:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016113.651661:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016113.651684:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271153b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e56c0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016113.651766:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075876d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335275648:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016113.651892:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016113.654669:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075876d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335275648:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016113.654722:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271153b6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56c0 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.654739:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271153b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56c0 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.654847:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016113.654911:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333666176:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3278us (4266us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016113.654920:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10758 00000100:00100000:0.0:1734016113.658791:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.659013:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333666432 00000100:00100000:2.0:1734016113.659030:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333666432 00000100:00100000:2.0:1734016113.659305:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2164 00000100:00100000:2.0:1734016113.659315:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:9668:x1818247333666432:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016113.659398:0:7704:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016113.659435:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc271153a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56b2 expref: 22 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.659472:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016113.659477:0:7704:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016113.659687:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271153bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.659704:0:7704:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115370 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5681 expref: 17 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.659712:0:7704:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271153bd lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.659750:0:7704:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5681 expref: 17 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.659765:0:7704:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115370 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5681 expref: 17 pid: 7704 timeout: 480 lvb_type: 0 00000100:00100000:2.0:1734016113.659780:0:7704:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335275776:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016113.660737:0:7704:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e780 going to sleep for 11 seconds 00000100:00100000:0.0:1734016113.665469:0:7704:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335275776:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016113.665506:0:7704:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271153bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016113.666965:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.667436:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333666560 00000100:00100000:3.0:1734016113.667449:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333666560 00010000:00010000:3.0:1734016113.667488:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115370 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5681 expref: 18 pid: 7704 timeout: 480 lvb_type: 0 00000100:00100000:3.0:1734016113.667524:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2970 00000100:00100000:3.0:1734016113.667532:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+18:1981:x1818247333666560:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016113.667551:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016113.667557:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115370 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5681 expref: 18 pid: 7704 timeout: 480 lvb_type: 0 00010000:00010000:3.0:1734016113.667569:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5681 expref: 18 pid: 7704 timeout: 480 lvb_type: 0 00010000:00010000:3.0:1734016113.667594:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115370 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5681 expref: 18 pid: 7704 timeout: 480 lvb_type: 0 00010000:00010000:3.0:1734016113.667837:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016113.667842:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271153bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.667852:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271153bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.667860:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271153bd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.668269:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016113.670670:0:7704:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271153bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016113.670693:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271153bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:0.0:1734016113.670855:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968692 00000004:00010000:0.0:1734016113.670919:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007bd28000 reply state ffff8800756f8000 transno 4294968693 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271153bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016113.670927:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016113.671099:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:9668:x1818247333666432:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 11778us (12323us total) trans 4294968693 rc 0/0 00000100:00100000:0.0:1734016113.671110:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2164 00000020:00080000:0.0:1734016113.671117:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1734016113.671254:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+17:1981:x1818247333666560:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3720us (4295us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016113.671264:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2970 00000100:00100000:0.0:1734016113.675544:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1734016113.675640:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271153bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.675657:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271153bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.675668:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271153bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.675676:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbf180 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016113.675682:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271153bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.675692:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271153bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.675718:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016113.675721:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016113.675726:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271153bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016113.675731:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271153bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00000100:00100000:1.0:1734016113.676404:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333666688 00000100:00100000:1.0:1734016113.676424:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333666688 00000100:00100000:1.0:1734016113.676513:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10759 00000100:00100000:1.0:1734016113.676525:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333666688:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016113.676561:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016113.676584:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271153c4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e56c7 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.676635:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc2711539a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5521408->5545983) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ab expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.676650:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016113.676653:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016113.676657:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271153c4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56c7 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.676716:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc2711539a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5521408->5545983) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ab expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.676735:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc2711539a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5521408->5545983) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ab expref: 7 pid: 7684 timeout: 480 lvb_type: 0 00000100:00100000:1.0:1734016113.676750:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075876d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335275904:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016113.677664:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016113.682220:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075876d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335275904:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016113.682267:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271153c4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56c7 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.682287:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016113.682346:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333666688:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5823us (6817us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016113.682357:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10759 00000100:00100000:0.0:1734016113.682798:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.682979:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333666816 00000100:00100000:2.0:1734016113.682987:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333666816 00010000:00010000:2.0:1734016113.683029:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc2711539a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5521408->5545983) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ab expref: 8 pid: 7684 timeout: 480 lvb_type: 0 00000100:00100000:2.0:1734016113.683058:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2971 00000100:00100000:2.0:1734016113.683065:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333666816:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016113.683085:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016113.683111:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc2711539a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5521408->5545983) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ab expref: 8 pid: 7684 timeout: 480 lvb_type: 0 00010000:00010000:2.0:1734016113.683124:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc2711539a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5521408->5545983) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ab expref: 8 pid: 7684 timeout: 480 lvb_type: 0 00010000:00010000:2.0:1734016113.683155:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc2711539a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5521408->5545983) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ab expref: 8 pid: 7684 timeout: 480 lvb_type: 0 00010000:00010000:2.0:1734016113.683173:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.683176:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.683182:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271153c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56c7 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.683193:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271153c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56c7 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.683227:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271153c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56c7 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016113.683241:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335276032:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016113.683291:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016113.688663:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.688764:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333666944 00000100:00100000:2.0:1734016113.688779:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333666944 00002000:00010000:2.0:1734016113.688863:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (5814325->18446744073709551615) 00000100:00100000:3.0:1734016113.689101:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335276032:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016113.689131:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016113.689203:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333666816:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6135us (6405us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016113.689217:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2971 00002000:00100000:2.0:1734016113.689352:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd2a300 with x1818247333666944 ext(5814325->18446744073709551615) 00002000:00010000:2.0:1734016113.689365:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd2a300. 00000100:00100000:2.0:1734016113.689389:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8520 00000100:00100000:2.0:1734016113.689397:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333666944:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016113.689749:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 4726197 -> 5814325 00002000:00010000:2.0:1734016113.689753:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016114 -> 1734016114 00002000:00010000:2.0:1734016113.689757:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016113 -> 1734016113 00002000:00010000:2.0:1734016113.689760:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016114 -> 1734016114 00002000:00010000:2.0:1734016113.689762:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 272 -> 272 00000100:00100000:2.0:1734016113.689793:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333666944:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 395us (1152us total) trans 4294969367 rc 0/0 00000100:00100000:2.0:1734016113.689833:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8520 00002000:00010000:2.0:1734016113.689836:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (5814325->18446744073709551615) 00002000:00100000:2.0:1734016113.689839:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd2a300 with x1818247333666944 ext(5814325->18446744073709551615) 00002000:00010000:2.0:1734016113.689844:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd2a300. 00000100:00100000:0.0:1734016113.693713:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.693851:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333667072 00000100:00100000:2.0:1734016113.693866:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333667072 00000100:00100000:2.0:1734016113.693949:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2165 00000100:00100000:2.0:1734016113.693960:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:9668:x1818247333667072:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016113.694013:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016113.694050:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271153cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e56ce expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.694214:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271153d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.694234:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271153d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.694250:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271153d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:2.0:1734016113.694284:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 5814325 00000004:00200000:2.0:1734016113.694292:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016113.694321:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271153d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016113.694349:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271153cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ce expref: 25 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.695550:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271153d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ce expref: 24 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.695563:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016113.695566:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016113.695569:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016113.695915:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:9668:x1818247333667072:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1954us (2224us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016113.695927:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2165 00000100:00100000:3.0:1734016113.698789:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016113.698954:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333667200 00000100:00100000:1.0:1734016113.698971:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333667200 00000100:00100000:1.0:1734016113.699040:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10760 00000100:00100000:1.0:1734016113.699049:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333667200:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016113.699083:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016113.699108:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc271153d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e56d5 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016113.699194:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075876d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335276160:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016113.699266:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016113.702127:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075876d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335276160:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016113.702187:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc271153d9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56d5 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.702206:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc271153d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56d5 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.702227:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016113.703454:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333667200:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4393us (4670us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016113.703467:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10760 00000100:00100000:0.0:1734016113.706262:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.706365:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333667328 00000100:00100000:2.0:1734016113.706378:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333667328 00000100:00100000:2.0:1734016113.706487:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10761 00000100:00100000:2.0:1734016113.706498:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333667328:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016113.706528:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016113.706555:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271153e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e56dc expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.706598:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271153c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56c7 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.706606:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016113.706608:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016113.706612:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271153e0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1589248->1593343] (req 1589248->1593343) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56dc expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.706655:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271153c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56c7 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.706668:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271153c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56c7 expref: 7 pid: 8216 timeout: 480 lvb_type: 0 00000100:00100000:2.0:1734016113.706681:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335276288:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016113.707072:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016113.710581:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335276288:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016113.710634:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271153e0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1589248->1593343] (req 1589248->1593343) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56dc expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.710663:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:0.0:1734016113.710796:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333667328:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4299us (4547us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016113.710839:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10761 00000100:00100000:2.0:1734016113.711044:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.711839:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333667456 00000100:00100000:3.0:1734016113.711851:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333667456 00010000:00010000:3.0:1734016113.711899:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271153c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56c7 expref: 8 pid: 8216 timeout: 480 lvb_type: 0 00000100:00100000:3.0:1734016113.711937:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2972 00000100:00100000:3.0:1734016113.713329:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074939f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333667456:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016113.713359:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016113.713387:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271153c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56c7 expref: 8 pid: 8216 timeout: 480 lvb_type: 0 00010000:00010000:3.0:1734016113.713402:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271153c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56c7 expref: 8 pid: 8216 timeout: 480 lvb_type: 0 00010000:00010000:3.0:1734016113.713434:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271153c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56c7 expref: 8 pid: 8216 timeout: 480 lvb_type: 0 00010000:00010000:3.0:1734016113.713463:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016113.713466:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016113.713472:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271153e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1593343) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56dc expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.713484:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271153e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1593343) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56dc expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.713526:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271153e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1593343) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56dc expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016113.713541:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335276416:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016113.713626:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016113.717174:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335276416:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016113.717200:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016113.717847:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074939f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333667456:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5899us (6800us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016113.717859:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2972 00000100:00100000:2.0:1734016113.718148:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.718261:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333667712 00000100:00100000:0.0:1734016113.718269:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333667712 00002000:00100000:0.0:1734016113.718306:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1589248->1593343) req@ffff88007493b800 x1818247333667712/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016113.718316:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007493b800 with x1818247333667712 ext(1589248->1593343) 00002000:00010000:0.0:1734016113.718322:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007493b800 00000100:00100000:0.0:1734016113.718338:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8521 00000100:00100000:0.0:1734016113.718344:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333667712:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016113.718506:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333667712:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 161us (359us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016113.718512:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8521 00002000:00100000:0.0:1734016113.718517:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1589248->1593343) req@ffff88007493b800 x1818247333667712/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016113.718524:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007493b800 with x1818247333667712 ext(1589248->1593343) 00002000:00010000:0.0:1734016113.718527:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007493b800 00000100:00100000:2.0:1734016113.722218:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.722669:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333667968 00000100:00100000:3.0:1734016113.722685:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333667968 00002000:00100000:3.0:1734016113.722749:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1585152->1589247) req@ffff880074938000 x1818247333667968/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.722760:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074938000 with x1818247333667968 ext(1585152->1589247) 00002000:00010000:3.0:1734016113.722766:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074938000 00000100:00100000:3.0:1734016113.722849:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8522 00000100:00100000:3.0:1734016113.722859:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333667968:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016113.723196:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333667968:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 337us (992us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016113.723206:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8522 00002000:00100000:3.0:1734016113.723212:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (1585152->1589247) req@ffff880074938000 x1818247333667968/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.723219:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074938000 with x1818247333667968 ext(1585152->1589247) 00002000:00010000:3.0:1734016113.723222:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074938000 00000100:00100000:3.0:1734016113.726218:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.726311:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333668224 00000100:00100000:0.0:1734016113.726322:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333668224 00002000:00100000:0.0:1734016113.726382:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1552384->1617919) req@ffff880075445180 x1818247333668224/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:74/0 lens 504/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016113.726398:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075445180 with x1818247333668224 ext(1552384->1617919) 00002000:00010000:0.0:1734016113.726404:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075445180 00000100:00100000:0.0:1734016113.726441:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8523 00000100:00100000:0.0:1734016113.726448:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333668224:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016113.730608:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333668224:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 4139us (4384us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1734016113.730628:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8523 00002000:00100000:0.0:1734016113.730648:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1552384->1617919) req@ffff880075445180 x1818247333668224/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:74/0 lens 504/440 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016113.730658:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075445180 with x1818247333668224 ext(1552384->1617919) 00002000:00010000:0.0:1734016113.730666:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075445180 00000100:00100000:0.0:1734016113.734293:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.734516:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333668480 00000100:00100000:2.0:1734016113.734528:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333668480 00002000:00100000:2.0:1734016113.734577:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1519616->1552383) req@ffff88007bd2a680 x1818247333668480/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.734589:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd2a680 with x1818247333668480 ext(1519616->1552383) 00002000:00010000:2.0:1734016113.734596:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd2a680 00000100:00100000:2.0:1734016113.734628:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8524 00000100:00100000:2.0:1734016113.734634:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333668480:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016113.739037:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333668480:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 4383us (4738us total) trans 0 rc 32768/32768 00000100:00100000:2.0:1734016113.739054:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8524 00002000:00100000:2.0:1734016113.739075:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1519616->1552383) req@ffff88007bd2a680 x1818247333668480/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:74/0 lens 488/440 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 32768/32768 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.739087:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd2a680 with x1818247333668480 ext(1519616->1552383) 00002000:00010000:2.0:1734016113.739094:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd2a680 00000100:00100000:1.0:1734016113.742436:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.742548:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333668608 00000100:00100000:2.0:1734016113.742559:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333668608 00002000:00100000:2.0:1734016113.742620:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1548288->1593343) req@ffff880075876d80 x1818247333668608/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.742630:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075876d80 with x1818247333668608 ext(1548288->1593343) 00002000:00010000:2.0:1734016113.742636:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075876d80 00000100:00100000:2.0:1734016113.742678:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8525 00000100:00100000:2.0:1734016113.742686:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333668608:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016113.747669:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333668608:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4960us (5226us total) trans 4294969368 rc 0/0 00000100:00100000:2.0:1734016113.747686:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8525 00002000:00100000:2.0:1734016113.747704:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1548288->1593343) req@ffff880075876d80 x1818247333668608/t4294969368(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:74/0 lens 488/448 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016113.747715:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075876d80 with x1818247333668608 ext(1548288->1593343) 00002000:00010000:2.0:1734016113.747723:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075876d80 00000100:00100000:0.0:1734016113.750545:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.750724:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333668736 00000100:00100000:2.0:1734016113.750741:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333668736 00000100:00100000:2.0:1734016113.750947:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10762 00000100:00100000:2.0:1734016113.750960:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333668736:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016113.752705:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969368 is committed 00000001:00080000:2.0:1734016113.752729:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969367 is committed 00000100:00100000:0.0:1734016113.753012:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333668736:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2046us (2481us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016113.753025:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10762 00000100:00100000:3.0:1734016113.757236:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.757310:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333668864 00000100:00100000:0.0:1734016113.757320:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333668864 00000100:00100000:0.0:1734016113.757435:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2166 00000100:00100000:0.0:1734016113.757443:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+17:9668:x1818247333668864:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016113.757469:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016113.757491:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc271153e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e56e3 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.757602:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc271153ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016113.757618:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc271153ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016113.757628:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc271153ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:0.0:1734016113.757654:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 5814325 00000004:00200000:0.0:1734016113.757658:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016113.757676:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc271153ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016113.757697:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc271153e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56e3 expref: 19 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.757711:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc271153ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56e3 expref: 18 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.757719:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016113.757722:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016113.757725:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:0.0:1734016113.757780:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333668864:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 337us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016113.757786:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2166 00000100:00100000:1.0:1734016113.761482:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.761571:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333668992 00000100:00100000:0.0:1734016113.761584:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333668992 00000100:00100000:0.0:1734016113.761645:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10763 00000100:00100000:0.0:1734016113.761652:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333668992:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016113.761934:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 5814325 -> 5814325 00002000:00010000:0.0:1734016113.761937:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016114 -> 1734016114 00002000:00010000:0.0:1734016113.761939:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016113 -> 1734016113 00002000:00010000:0.0:1734016113.761941:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016114 -> 1734016114 00002000:00010000:0.0:1734016113.761943:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 272 -> 360 00000100:00100000:0.0:1734016113.762030:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333668992:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 377us (559us total) trans 4294969369 rc 0/0 00000100:00100000:0.0:1734016113.762036:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10763 00000100:00100000:0.0:1734016113.764452:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.764643:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333669120 00000100:00100000:3.0:1734016113.764657:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333669120 00000100:00100000:3.0:1734016113.764709:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10764 00000100:00100000:3.0:1734016113.764717:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333669120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016113.764745:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016113.764772:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271153f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e56ea expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016113.765170:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335276544:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016113.765504:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016113.768050:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335276544:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016113.768118:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271153f5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ea expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.768135:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271153f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ea expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.768152:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:0.0:1734016113.768601:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333669120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3881us (4160us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016113.768613:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10764 00000100:00100000:1.0:1734016113.771933:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.772034:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333669248 00000100:00100000:0.0:1734016113.772046:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333669248 00000100:00100000:0.0:1734016113.772114:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10765 00000100:00100000:0.0:1734016113.772123:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333669248:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016113.772151:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016113.772176:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271153fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e56f1 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016113.772262:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335276672:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016113.772359:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016113.774555:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335276672:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016113.774617:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271153fc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56f1 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.774638:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271153fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56f1 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.774681:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:2.0:1734016113.774754:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333669248:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2630us (2836us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016113.774767:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10765 00000100:00100000:3.0:1734016113.778976:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016113.779165:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333669504 00000100:00100000:1.0:1734016113.779178:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333669504 00000100:00100000:1.0:1734016113.779261:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2167 00000100:00100000:1.0:1734016113.779273:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333669504:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016113.779374:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016113.779425:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc271153ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56e3 expref: 18 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.779467:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016113.779472:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016113.779744:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27115403 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016113.779766:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271153d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ce expref: 23 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.779776:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27115403 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016113.779848:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271153d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ce expref: 23 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.779865:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271153d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ce expref: 23 pid: 7704 timeout: 480 lvb_type: 0 00000100:00100000:1.0:1734016113.779896:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075874000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335276800:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016113.780004:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016113.783467:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.783708:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333669632 00000100:00100000:3.0:1734016113.783721:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333669632 00010000:00010000:3.0:1734016113.783775:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271153d2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ce expref: 24 pid: 7704 timeout: 480 lvb_type: 0 00000100:00100000:3.0:1734016113.783839:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2973 00000100:00100000:3.0:1734016113.783852:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880129c4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:1982:x1818247333669632:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016113.783884:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016113.783892:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271153d2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ce expref: 24 pid: 7704 timeout: 480 lvb_type: 0 00010000:00010000:3.0:1734016113.783907:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271153d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ce expref: 24 pid: 7704 timeout: 480 lvb_type: 0 00010000:00010000:3.0:1734016113.783936:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016113.783943:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27115403 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016113.783953:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27115403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016113.783960:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27115403 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016113.783980:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016113.784038:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880129c4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:1982:x1818247333669632:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 189us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016113.784044:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2973 00010000:00010000:1.0:1734016113.784313:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271153d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ce expref: 23 pid: 7704 timeout: 480 lvb_type: 0 00000100:00100000:1.0:1734016113.784333:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075874000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335276800:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016113.784362:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27115403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016113.784371:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27115403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016113.784378:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27115403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:1.0:1734016113.784533:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968694 00000004:00010000:1.0:1734016113.784605:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075444000 reply state ffff880075d9b000 transno 4294968695 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27115403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016113.784612:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016113.784702:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333669504:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 5432us (5750us total) trans 4294968695 rc 0/0 00000100:00100000:1.0:1734016113.784708:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2167 00000020:00080000:1.0:1734016113.784714:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016113.787750:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27115403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016113.787770:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27115403 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016113.787778:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27115403 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016113.787785:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499c6c0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016113.787791:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27115403 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016113.787863:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27115403 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016113.788343:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016113.788347:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016113.788354:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27115403 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016113.788360:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27115403 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016113.788849:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.789391:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333669760 00000100:00100000:2.0:1734016113.789409:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333669760 00002000:00010000:2.0:1734016113.789470:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (7735241->18446744073709551615) 00002000:00100000:2.0:1734016113.789477:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075874000 with x1818247333669760 ext(7735241->18446744073709551615) 00002000:00010000:2.0:1734016113.789494:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075874000. 00000100:00100000:2.0:1734016113.789535:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8526 00000100:00100000:2.0:1734016113.789543:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333669760:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016113.789882:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 5814325 -> 7735241 00002000:00010000:2.0:1734016113.789886:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016114 -> 1734016114 00002000:00010000:2.0:1734016113.789888:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016113 -> 1734016113 00002000:00010000:2.0:1734016113.789889:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016114 -> 1734016114 00002000:00010000:2.0:1734016113.789892:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 360 -> 360 00000100:00100000:2.0:1734016113.789953:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333669760:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 410us (1116us total) trans 4294969370 rc 0/0 00000100:00100000:2.0:1734016113.789962:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8526 00002000:00010000:2.0:1734016113.789966:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (7735241->18446744073709551615) 00002000:00100000:2.0:1734016113.789971:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075874000 with x1818247333669760 ext(7735241->18446744073709551615) 00002000:00010000:2.0:1734016113.789975:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075874000. 00000100:00100000:0.0:1734016113.792660:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016113.792783:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333669888 00000100:00100000:1.0:1734016113.792795:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333669888 00000100:00100000:1.0:1734016113.792875:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2168 00000100:00100000:1.0:1734016113.792883:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+19:9668:x1818247333669888:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016113.792910:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016113.792936:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711540a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e56f8 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.793061:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115411 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016113.793079:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115411 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016113.793091:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115411 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:1.0:1734016113.793117:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 7735241 00000004:00200000:1.0:1734016113.793122:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016113.793138:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115411 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016113.793161:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711540a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56f8 expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.793191:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115411 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56f8 expref: 20 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.793200:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016113.793203:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016113.793206:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016113.793257:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333669888:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 374us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016113.793264:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2168 00000100:00100000:2.0:1734016113.796035:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.796150:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333670144 00000100:00100000:3.0:1734016113.796163:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333670144 00000100:00100000:3.0:1734016113.796256:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8527 00000100:00100000:3.0:1734016113.796264:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333670144:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:3.0:1734016113.796322:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115418 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.796348:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271153e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1593343) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56dc expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.796357:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016113.796360:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016113.796363:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115418 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1196032->1220607] (req 1196032->1220607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.796403:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271153e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1593343) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56dc expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.796418:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271153e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1593343) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56dc expref: 8 pid: 8216 timeout: 480 lvb_type: 0 00000100:00100000:3.0:1734016113.796431:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335276928:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016113.796979:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016113.800033:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335276928:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016113.800069:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115418 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1196032->1220607] (req 1196032->1220607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016113.800396:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.800477:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333670272 00000100:00100000:0.0:1734016113.800489:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333670272 00010000:00010000:0.0:1734016113.800536:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271153e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1593343) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56dc expref: 9 pid: 8216 timeout: 480 lvb_type: 0 00000100:00100000:0.0:1734016113.800585:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2974 00000100:00100000:0.0:1734016113.800595:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333670272:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016113.800619:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016113.800649:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271153e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1589248->1593343) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56dc expref: 9 pid: 8216 timeout: 480 lvb_type: 0 00010000:00010000:0.0:1734016113.800660:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271153e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1589248->1593343) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56dc expref: 9 pid: 8216 timeout: 480 lvb_type: 0 00010000:00010000:0.0:1734016113.800697:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271153e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1589248->1593343) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56dc expref: 9 pid: 8216 timeout: 480 lvb_type: 0 00010000:00010000:0.0:1734016113.801611:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016113.801618:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016113.801628:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1196032->1220607] (req 1196032->1220607) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.801648:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115418 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1196032->1220607] (req 1196032->1220607) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.801703:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016113.801867:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1196032->1220607] (req 1196032->1220607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.801879:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1196032->1220607] (req 1196032->1220607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016113.802248:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333670272:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1205us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016113.802264:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2974 00000001:00080000:2.0:1734016113.814091:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969371 is committed 00000001:00080000:2.0:1734016113.814120:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969370 is committed 00002000:00010000:3.0:1734016113.814452:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 360 -> 408 00010000:00010000:3.0:1734016113.814476:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1196032->1220607] (req 1196032->1220607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.814496:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115418 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1196032->1220607] (req 1196032->1220607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.814505:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115418 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1196032->1220607] (req 1196032->1220607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.814514:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4900 already unused, calling callback (ffffffffa080e100) 00010000:00010000:3.0:1734016113.814519:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115418 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1196032->1220607] (req 1196032->1220607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.814529:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115418 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1196032->1220607] (req 1196032->1220607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.814555:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115418 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1196032->1220607] (req 1196032->1220607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.814561:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115418 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1196032->1220607] (req 1196032->1220607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016113.815628:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333670144:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 19348us (19590us total) trans 4294969371 rc 0/0 00000100:00100000:3.0:1734016113.815643:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8527 00000100:00100000:2.0:1734016113.820679:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.820777:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333670400 00000100:00100000:0.0:1734016113.820791:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333670400 00000100:00100000:0.0:1734016113.820897:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10766 00000100:00100000:0.0:1734016113.820906:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333670400:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016113.820936:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016113.820962:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc2711541f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e56ff expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016113.821001:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 7735241, mtime: 0x675afc72, atime: 0x675afc71, ctime: 0x675afc72, blocks: 0x198 00010000:00010000:0.0:1734016113.821025:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016113.821028:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016113.821036:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc2711541f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ff expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.821055:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc2711541f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ff expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.821067:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581b00, rc 0) 00000100:00100000:0.0:1734016113.821112:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333670400:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 208us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016113.821119:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10766 00000100:00100000:2.0:1734016113.827629:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.827734:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333670528 00000100:00100000:0.0:1734016113.827750:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333670528 00000100:00100000:0.0:1734016113.827891:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10767 00000100:00100000:0.0:1734016113.827902:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333670528:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016113.827928:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016113.827959:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115426 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5706 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.828014:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc2711541f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ff expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.828023:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016113.828026:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016113.828031:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115426 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5795840->5799935] (req 5795840->5799935) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5706 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.828078:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc2711541f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ff expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.828094:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc2711541f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ff expref: 8 pid: 7684 timeout: 480 lvb_type: 1 00000100:00100000:0.0:1734016113.828109:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335277056:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016113.828223:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016113.835439:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335277056:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016113.835485:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115426 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5795840->5799935] (req 5795840->5799935) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5706 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.835507:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75818c0, rc 0) 00000100:00100000:0.0:1734016113.835572:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333670528:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7671us (7962us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016113.835582:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10767 00000100:00100000:0.0:1734016113.837710:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.837795:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333670656 00000100:00100000:2.0:1734016113.837817:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333670656 00010000:00010000:2.0:1734016113.837858:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc2711541f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ff expref: 8 pid: 7684 timeout: 480 lvb_type: 1 00000100:00100000:2.0:1734016113.837901:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2975 00000100:00100000:2.0:1734016113.837909:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333670656:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016113.837932:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016113.837956:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc2711541f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ff expref: 8 pid: 7684 timeout: 480 lvb_type: 1 00010000:00010000:2.0:1734016113.837972:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc2711541f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ff expref: 8 pid: 7684 timeout: 480 lvb_type: 1 00010000:00010000:2.0:1734016113.838029:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc2711541f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56ff expref: 8 pid: 7684 timeout: 480 lvb_type: 1 00010000:00010000:2.0:1734016113.838060:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.838063:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016113.838071:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115426 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5795840->5799935) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5706 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.838081:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115426 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5795840->5799935) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5706 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.838116:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115426 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5795840->5799935) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5706 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016113.838131:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335277184:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016113.838204:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016113.848887:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.850140:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335277184:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016113.850180:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016113.850269:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333670656:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 12359us (12570us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016113.850282:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2975 00000100:00100000:3.0:1734016113.850405:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333670912 00000100:00100000:3.0:1734016113.850415:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333670912 00002000:00100000:3.0:1734016113.850471:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5795840->5799935) req@ffff8800749ad180 x1818247333670912/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.850489:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad180 with x1818247333670912 ext(5795840->5799935) 00002000:00010000:3.0:1734016113.850494:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ad180 00000100:00100000:3.0:1734016113.850532:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8528 00000100:00100000:3.0:1734016113.850539:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333670912:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016113.850774:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333670912:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 235us (1911us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016113.850780:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8528 00002000:00100000:3.0:1734016113.850785:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5795840->5799935) req@ffff8800749ad180 x1818247333670912/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.850792:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad180 with x1818247333670912 ext(5795840->5799935) 00002000:00010000:3.0:1734016113.850795:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ad180 00000100:00100000:2.0:1734016113.854097:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.854182:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333671168 00000100:00100000:0.0:1734016113.854199:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333671168 00002000:00100000:0.0:1734016113.854281:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (5791744->5795839) req@ffff8800749af800 x1818247333671168/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:74/0 lens 488/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016113.854293:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749af800 with x1818247333671168 ext(5791744->5795839) 00002000:00010000:0.0:1734016113.854299:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749af800 00000100:00100000:0.0:1734016113.854346:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8529 00000100:00100000:0.0:1734016113.854356:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333671168:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016113.854674:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333671168:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 318us (596us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016113.854683:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8529 00002000:00100000:0.0:1734016113.854690:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (5791744->5795839) req@ffff8800749af800 x1818247333671168/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:74/0 lens 488/4536 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016113.854697:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749af800 with x1818247333671168 ext(5791744->5795839) 00002000:00010000:0.0:1734016113.854700:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749af800 00000100:00100000:0.0:1734016113.859966:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016113.861635:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333671296 00000100:00100000:3.0:1734016113.861659:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333671296 00002000:00100000:3.0:1734016113.861740:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5791744->5799935) req@ffff88007bd2b480 x1818247333671296/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:74/0 lens 8680/0 e 0 to 0 dl 1734016124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.861754:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd2b480 with x1818247333671296 ext(5791744->5799935) 00002000:00010000:3.0:1734016113.861761:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd2b480 00000100:00100000:3.0:1734016113.861812:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8530 00000100:00100000:3.0:1734016113.861821:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333671296:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016113.862932:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333671296:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1104us (2974us total) trans 4294969372 rc 0/0 00000100:00100000:3.0:1734016113.862943:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8530 00002000:00100000:3.0:1734016113.862953:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5791744->5799935) req@ffff88007bd2b480 x1818247333671296/t4294969372(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:74/0 lens 8680/448 e 0 to 0 dl 1734016124 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016113.862964:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd2b480 with x1818247333671296 ext(5791744->5799935) 00002000:00010000:3.0:1734016113.862968:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd2b480 00000100:00100000:0.0:1734016113.865559:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.865717:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333671424 00000100:00100000:2.0:1734016113.865731:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333671424 00000100:00100000:2.0:1734016113.865839:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2169 00000100:00100000:2.0:1734016113.865849:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333671424:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:2.0:1734016113.866020:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333671424:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 172us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016113.866028:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2169 00000100:00100000:2.0:1734016113.868185:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.868693:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333671552 00000100:00100000:0.0:1734016113.868705:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333671552 00000100:00100000:2.0:1734016113.869050:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10768 00000100:00100000:2.0:1734016113.869059:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333671552:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:3.0:1734016113.871296:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969372 is committed 00000100:00100000:2.0:1734016113.872177:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333671552:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 3102us (3990us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016113.872196:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10768 00000100:00100000:0.0:1734016113.875266:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016113.875457:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333671680 00000100:00100000:1.0:1734016113.875477:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333671680 00000100:00100000:1.0:1734016113.875569:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2170 00000100:00100000:1.0:1734016113.875579:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:9668:x1818247333671680:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016113.875619:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016113.875645:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc2711542d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e570d expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.875782:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27115434 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016113.875846:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27115434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016113.875862:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27115434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:1.0:1734016113.875894:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 7735241 00000004:00200000:1.0:1734016113.875898:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016113.875916:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27115434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016113.875942:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc2711542d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e570d expref: 25 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.876686:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27115434 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e570d expref: 24 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.876701:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016113.876703:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016113.876707:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016113.876794:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:9668:x1818247333671680:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1216us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016113.876828:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2170 00000100:00100000:0.0:1734016113.879565:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.879642:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333671808 00000100:00100000:2.0:1734016113.879658:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333671808 00000100:00100000:2.0:1734016113.879715:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10769 00000100:00100000:2.0:1734016113.879723:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333671808:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016113.879749:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016113.879775:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc2711543b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5714 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016113.879871:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335277312:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016113.880189:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ee40 going to sleep for 11 seconds 00002000:00010000:0.0:1734016113.881697:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016113 -> 1734016114 00002000:00010000:0.0:1734016113.881704:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 408 -> 424 00000100:00100000:0.0:1734016113.881727:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335277312:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016113.881764:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc2711543b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5714 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.881778:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc2711543b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5714 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016113.881921:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:0.0:1734016113.882066:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333671808:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2341us (2518us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016113.882075:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10769 00000100:00100000:1.0:1734016113.884751:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.884840:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333671936 00000100:00100000:0.0:1734016113.884849:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333671936 00000100:00100000:0.0:1734016113.884910:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10770 00000100:00100000:0.0:1734016113.884919:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333671936:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016113.884944:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016113.884964:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27115442 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e571b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016113.885036:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335277440:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016113.885100:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eec00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016113.888832:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335277440:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016113.889351:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27115442 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e571b expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.889370:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27115442 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e571b expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.889554:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581680, rc 0) 00000100:00100000:1.0:1734016113.890155:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333671936:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5234us (5414us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016113.890167:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10770 00000100:00100000:3.0:1734016113.892661:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016113.892898:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333672064 00000100:00100000:1.0:1734016113.892915:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333672064 00000100:00100000:1.0:1734016113.893526:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10771 00000100:00100000:1.0:1734016113.893539:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333672064:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016113.893575:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016113.893608:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27115449 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5722 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016113.893698:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075875c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335277568:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016113.893858:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016113.896509:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075875c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335277568:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016113.896552:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27115449 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5722 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.896568:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27115449 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5722 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.896613:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016113.896688:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333672064:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3148us (4046us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016113.896699:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10771 00000100:00100000:0.0:1734016113.900378:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016113.900608:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333672192 00000100:00100000:1.0:1734016113.900626:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333672192 00000100:00100000:1.0:1734016113.900696:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10772 00000100:00100000:1.0:1734016113.900709:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333672192:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016113.900748:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016113.900790:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27115450 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5729 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.900884:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115426 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5795840->5799935) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5706 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.900894:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016113.900899:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016113.900903:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27115450 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8720384->8749055] (req 8720384->8749055) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5729 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.900954:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115426 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5795840->5799935) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5706 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.900973:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115426 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5795840->5799935) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5706 expref: 6 pid: 8216 timeout: 481 lvb_type: 0 00000100:00100000:1.0:1734016113.901000:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075875c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335277696:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016113.901111:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016113.904938:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.905295:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333672320 00000100:00100000:0.0:1734016113.905311:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333672320 00010000:00010000:0.0:1734016113.905376:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115426 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5795840->5799935) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5706 expref: 7 pid: 8216 timeout: 481 lvb_type: 0 00000100:00100000:0.0:1734016113.905445:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2976 00000100:00100000:0.0:1734016113.905455:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333672320:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016113.905477:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016113.905514:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115426 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5795840->5799935) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5706 expref: 7 pid: 8216 timeout: 481 lvb_type: 0 00010000:00010000:0.0:1734016113.905530:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115426 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5795840->5799935) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5706 expref: 7 pid: 8216 timeout: 481 lvb_type: 0 00010000:00010000:0.0:1734016113.905570:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016113.905573:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016113.905581:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27115450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8720384->8749055) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5729 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.905590:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27115450 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8720384->8749055) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5729 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.905637:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27115450 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8720384->8749055) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5729 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016113.905653:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335277824:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016113.905729:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eec00 going to sleep for 11 seconds 00010000:00010000:1.0:1734016113.906185:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115426 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5795840->5799935) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5706 expref: 7 pid: 8216 timeout: 481 lvb_type: 0 00000100:00100000:1.0:1734016113.906217:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075875c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335277696:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016113.906247:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27115450 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8720384->8749055) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5729 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.906264:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016113.906300:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333672192:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5591us (5944us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016113.906309:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10772 00000100:00100000:1.0:1734016113.908698:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335277824:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016113.908719:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016113.910311:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333672320:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4832us (5374us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016113.910334:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2976 00000100:00100000:0.0:1734016113.911113:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016113.911334:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333672448 00000100:00100000:1.0:1734016113.911352:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333672448 00000100:00100000:1.0:1734016113.911572:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10773 00000100:00100000:1.0:1734016113.911580:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333672448:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016113.912087:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7735241 -> 7735241 00002000:00010000:1.0:1734016113.912091:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016114 -> 1734016114 00002000:00010000:1.0:1734016113.912094:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016114 -> 1734016113 00002000:00010000:1.0:1734016113.912096:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016114 -> 1734016113 00002000:00010000:1.0:1734016113.912098:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 424 -> 480 00000100:00100000:1.0:1734016113.912175:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333672448:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 593us (1063us total) trans 4294969373 rc 0/0 00000100:00100000:1.0:1734016113.912183:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10773 00000100:00100000:0.0:1734016113.918457:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016113.918640:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333672704 00000100:00100000:1.0:1734016113.918657:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333672704 00000100:00100000:1.0:1734016113.919171:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2171 00000100:00100000:1.0:1734016113.919191:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333672704:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016113.919314:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016113.919370:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115411 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e56f8 expref: 20 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.920373:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016113.920384:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016113.920776:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27115457 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016113.920878:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27115434 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e570d expref: 23 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.920890:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27115457 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016113.920941:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27115434 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e570d expref: 23 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016113.920962:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27115434 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e570d expref: 23 pid: 13956 timeout: 481 lvb_type: 0 00000100:00100000:1.0:1734016113.920983:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075875c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335277952:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016113.921366:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016113.928573:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075875c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335277952:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016113.928607:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27115457 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016113.931067:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016113.931217:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333672832 00000100:00100000:1.0:1734016113.931234:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333672832 00010000:00010000:1.0:1734016113.931309:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27115434 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e570d expref: 24 pid: 13956 timeout: 481 lvb_type: 0 00000100:00100000:1.0:1734016113.931380:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2977 00000100:00100000:1.0:1734016113.931391:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:1982:x1818247333672832:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016113.931419:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016113.931430:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27115434 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e570d expref: 24 pid: 13956 timeout: 481 lvb_type: 0 00010000:00010000:1.0:1734016113.931447:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27115434 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e570d expref: 24 pid: 13956 timeout: 481 lvb_type: 0 00010000:00010000:1.0:1734016113.931481:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27115434 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e570d expref: 24 pid: 13956 timeout: 481 lvb_type: 0 00010000:00010000:1.0:1734016113.931528:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016113.931535:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27115457 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016113.931547:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27115457 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016113.931556:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27115457 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016113.931584:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016113.931658:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:1982:x1818247333672832:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 268us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016113.931667:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2977 00010000:00010000:0.0:1734016113.932367:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27115457 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016113.932376:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27115457 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:0.0:1734016113.932529:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968696 00000004:00010000:0.0:1734016113.932592:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012e604000 reply state ffff880075d9f000 transno 4294968697 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27115457 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016113.932602:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016113.932727:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+22:9668:x1818247333672704:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 13541us (14290us total) trans 4294968697 rc 0/0 00000100:00100000:0.0:1734016113.932735:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2171 00000020:00080000:0.0:1734016113.932741:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1734016113.935656:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27115457 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016113.935673:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27115457 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016113.935680:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27115457 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016113.935686:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499e400 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016113.935691:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27115457 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016113.935698:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27115457 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016113.935716:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016113.935719:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016113.935723:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27115457 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016113.935727:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27115457 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016113.936245:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.936383:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333672960 00000100:00100000:0.0:1734016113.936396:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333672960 00000100:00100000:0.0:1734016113.936525:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10774 00000100:00100000:0.0:1734016113.936535:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333672960:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016113.936556:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016113.936577:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711545e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5730 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.936617:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27115450 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8720384->8749055) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5729 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.936625:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016113.936628:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016113.936632:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711545e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5730 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.936670:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27115450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8720384->8749055) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5729 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.936686:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27115450 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8720384->8749055) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5729 expref: 6 pid: 7684 timeout: 481 lvb_type: 0 00000100:00100000:0.0:1734016113.936701:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335278080:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016113.937274:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016113.942242:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.942442:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335278080:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016113.942476:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711545e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5730 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.942497:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:0.0:1734016113.942552:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333672960:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6018us (6316us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016113.942562:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10774 00000100:00100000:3.0:1734016113.942644:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333673088 00000100:00100000:3.0:1734016113.942651:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333673088 00010000:00010000:3.0:1734016113.942678:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27115450 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8720384->8749055) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5729 expref: 7 pid: 7684 timeout: 481 lvb_type: 0 00000100:00100000:3.0:1734016113.942710:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2978 00000100:00100000:3.0:1734016113.942715:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333673088:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016113.942728:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016113.942750:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27115450 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8720384->8749055) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5729 expref: 7 pid: 7684 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016113.942760:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27115450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8720384->8749055) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5729 expref: 7 pid: 7684 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016113.942782:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27115450 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8720384->8749055) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5729 expref: 7 pid: 7684 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016113.942796:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016113.942821:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016113.942826:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711545e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5730 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.942833:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711545e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5730 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016113.942861:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711545e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5730 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016113.942872:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335278208:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016113.942903:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016113.945729:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335278208:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016113.945763:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016113.945895:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333673088:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3176us (3671us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016113.945913:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2978 00000100:00100000:2.0:1734016113.946325:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.947214:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333673216 00000100:00100000:0.0:1734016113.947224:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333673216 00002000:00010000:0.0:1734016113.947266:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (8918733->18446744073709551615) 00002000:00100000:0.0:1734016113.947272:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b7b80 with x1818247333673216 ext(8918733->18446744073709551615) 00002000:00010000:0.0:1734016113.947284:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b7b80. 00000100:00100000:0.0:1734016113.947322:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8531 00000100:00100000:0.0:1734016113.947330:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333673216:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016113.947836:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7735241 -> 8918733 00002000:00010000:0.0:1734016113.947840:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016114 -> 1734016114 00002000:00010000:0.0:1734016113.947842:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016113 -> 1734016113 00002000:00010000:0.0:1734016113.947844:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016113 -> 1734016114 00002000:00010000:0.0:1734016113.947846:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 480 -> 480 00000100:00100000:0.0:1734016113.948476:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333673216:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1142us (2150us total) trans 4294969374 rc 0/0 00000100:00100000:0.0:1734016113.948485:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8531 00002000:00010000:0.0:1734016113.948488:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (8918733->18446744073709551615) 00002000:00100000:0.0:1734016113.948491:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b7b80 with x1818247333673216 ext(8918733->18446744073709551615) 00002000:00010000:0.0:1734016113.948496:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b7b80. 00000100:00100000:2.0:1734016113.951048:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.951112:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333673344 00000100:00100000:0.0:1734016113.951122:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333673344 00000100:00100000:0.0:1734016113.951183:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2172 00000100:00100000:0.0:1734016113.951191:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:9668:x1818247333673344:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016113.951214:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016113.951243:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115465 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5737 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.951348:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc2711546c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016113.951362:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc2711546c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016113.951373:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc2711546c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016113.951400:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 8918733 00000004:00200000:0.0:1734016113.951406:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016113.951422:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc2711546c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016113.951443:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115465 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5737 expref: 25 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.951458:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc2711546c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5737 expref: 24 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016113.951466:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016113.951468:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016113.951471:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00000100:00100000:0.0:1734016113.951964:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:9668:x1818247333673344:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 769us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016113.951975:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2172 00000100:00100000:2.0:1734016113.956613:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016113.956693:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333673472 00000100:00100000:0.0:1734016113.956703:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333673472 00000100:00100000:0.0:1734016113.957093:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10775 00000100:00100000:0.0:1734016113.957103:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333673472:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016113.957125:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016113.957148:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27115473 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e573e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016113.957222:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335278336:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016113.957320:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016113.959199:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335278336:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016113.959237:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27115473 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e573e expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.959251:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27115473 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e573e expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.959561:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:2.0:1734016113.959630:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333673472:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2527us (3027us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016113.959643:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10775 00000100:00100000:3.0:1734016113.967104:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.969281:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333673600 00000100:00100000:2.0:1734016113.969304:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333673600 00000100:00100000:2.0:1734016113.969438:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10776 00000100:00100000:2.0:1734016113.969449:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333673600:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016113.969478:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016113.969507:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc2711547a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5745 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016113.969582:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335278464:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016113.974758:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016113.976912:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335278464:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016113.976958:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc2711547a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5745 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.976977:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc2711547a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5745 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016113.977019:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd680, rc 0) 00000100:00100000:2.0:1734016113.977082:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333673600:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7634us (9998us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016113.977094:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10776 00000100:00100000:0.0:1734016113.979158:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.979275:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333673728 00000100:00100000:2.0:1734016113.979287:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333673728 00000100:00100000:2.0:1734016113.979351:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2173 00000100:00100000:2.0:1734016113.979360:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+21:9668:x1818247333673728:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016113.979399:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016113.979430:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115481 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e574c expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.979554:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115488 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016113.979574:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016113.979588:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:2.0:1734016113.979621:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 8918733 00000004:00200000:2.0:1734016113.979627:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016113.979648:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016113.979673:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115481 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e574c expref: 23 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.979692:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115488 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e574c expref: 22 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016113.979702:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016113.979705:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016113.979709:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016113.979786:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+22:9668:x1818247333673728:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 425us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016113.979794:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2173 00000100:00100000:3.0:1734016113.982576:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016113.982680:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333673856 00000100:00100000:2.0:1734016113.982691:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333673856 00000100:00100000:2.0:1734016113.982750:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10777 00000100:00100000:2.0:1734016113.982758:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333673856:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016113.983041:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8918733 -> 8918733 00002000:00010000:2.0:1734016113.983044:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016114 -> 1734016114 00002000:00010000:2.0:1734016113.983046:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016113 -> 1734016113 00002000:00010000:2.0:1734016113.983048:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016114 -> 1734016113 00002000:00010000:2.0:1734016113.983049:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 480 -> 552 00000100:00100000:2.0:1734016113.983098:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333673856:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 341us (538us total) trans 4294969375 rc 0/0 00000100:00100000:2.0:1734016113.983105:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10777 00000100:00100000:3.0:1734016113.985038:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016113.985143:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333673984 00000100:00100000:1.0:1734016113.985152:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333673984 00000100:00100000:1.0:1734016113.985191:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10778 00000100:00100000:1.0:1734016113.985198:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333673984:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016113.985217:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016113.985236:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711548f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5753 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016113.985294:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075875c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335278592:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016113.985359:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00002000:00010000:1.0:1734016113.987325:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016113 -> 1734016114 00000100:00100000:1.0:1734016113.987354:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075875c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335278592:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016113.987389:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711548f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5753 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.987403:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc2711548f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5753 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.987417:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016113.987473:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333673984:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2274us (2445us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016113.987482:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10778 00000100:00100000:2.0:1734016113.994451:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016113.995330:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333674112 00000100:00100000:1.0:1734016113.995348:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333674112 00000100:00100000:1.0:1734016113.995724:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10779 00000100:00100000:1.0:1734016113.995734:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333674112:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016113.995767:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016113.995797:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27115496 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e575a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016113.995907:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075875c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335278720:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016113.996020:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016113.998938:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075875c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335278720:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016113.998998:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27115496 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e575a expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.999015:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27115496 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e575a expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016113.999031:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016113.999500:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333674112:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3763us (5063us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016113.999511:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10779 00000100:00100000:0.0:1734016114.001951:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016114.002127:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333674240 00000100:00100000:1.0:1734016114.002140:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333674240 00000100:00100000:1.0:1734016114.002209:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10780 00000100:00100000:1.0:1734016114.002218:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333674240:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016114.002240:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016114.002261:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc2711549d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5761 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016114.002337:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075875c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335278848:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016114.002402:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00080000:2.0:1734016114.002473:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016084 00000100:00100000:1.0:1734016114.004224:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075875c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335278848:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016114.004264:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc2711549d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5761 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016114.004278:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc2711549d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5761 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016114.004294:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016114.004340:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333674240:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2122us (2399us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016114.004350:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10780 00000100:00100000:2.0:1734016114.009112:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016114.009243:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333674368 00000100:00100000:1.0:1734016114.009255:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333674368 00000100:00100000:1.0:1734016114.009349:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10781 00000100:00100000:1.0:1734016114.009359:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333674368:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016114.009385:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016114.009409:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271154a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5768 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016114.009447:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711545e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5730 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016114.009455:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016114.009457:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016114.009461:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271154a4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1183744->1208319] (req 1183744->1208319) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5768 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016114.009505:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711545e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5730 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016114.009518:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711545e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5730 expref: 8 pid: 8216 timeout: 481 lvb_type: 0 00000100:00100000:1.0:1734016114.009530:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075875c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335278976:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016114.010258:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016114.012287:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075875c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335278976:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016114.012342:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271154a4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1183744->1208319] (req 1183744->1208319) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5768 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016114.012370:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016114.012444:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333674368:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3083us (3347us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016114.012457:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10781 00000100:00100000:2.0:1734016114.013034:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.013224:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333674496 00000100:00100000:3.0:1734016114.013233:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333674496 00010000:00010000:3.0:1734016114.013266:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711545e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5730 expref: 9 pid: 8216 timeout: 481 lvb_type: 0 00000100:00100000:3.0:1734016114.013293:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2979 00000100:00100000:3.0:1734016114.013299:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333674496:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016114.013313:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016114.013333:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711545e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5730 expref: 9 pid: 8216 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016114.013343:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711545e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5730 expref: 9 pid: 8216 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016114.013371:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711545e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5730 expref: 9 pid: 8216 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016114.013401:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.013404:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.013411:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271154a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1208319) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5768 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.013421:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271154a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1208319) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5768 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.013458:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271154a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1208319) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5768 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016114.013469:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335279104:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016114.013510:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016114.016606:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335279104:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016114.016635:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016114.016693:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333674496:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3392us (3658us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016114.016705:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2979 00000100:00100000:0.0:1734016114.018646:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016114.019819:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333674624 00000100:00100000:1.0:1734016114.019836:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333674624 00000100:00100000:1.0:1734016114.019905:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10782 00000100:00100000:1.0:1734016114.019913:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333674624:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016114.020220:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8918733 -> 8918733 00002000:00010000:1.0:1734016114.020223:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016114 -> 1734016114 00002000:00010000:1.0:1734016114.020225:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016113 -> 1734016113 00002000:00010000:1.0:1734016114.020227:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016114 -> 1734016114 00002000:00010000:1.0:1734016114.020230:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 552 -> 576 00000100:00100000:1.0:1734016114.020317:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333674624:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 402us (1685us total) trans 4294969376 rc 0/0 00000100:00100000:1.0:1734016114.020324:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10782 00000100:00100000:2.0:1734016114.023471:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.023982:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333674752 00000100:00100000:3.0:1734016114.024000:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333674752 00000100:00100000:3.0:1734016114.024089:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10783 00000100:00100000:3.0:1734016114.024097:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333674752:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016114.024121:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016114.024147:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271154ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e576f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016114.024226:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335279232:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016114.024919:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016114.027523:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335279232:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016114.027567:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271154ab lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e576f expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.027583:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271154ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e576f expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.027912:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016114.027975:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333674752:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3876us (4516us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016114.027984:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10783 00000100:00100000:0.0:1734016114.030403:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.030583:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333674880 00000100:00100000:3.0:1734016114.030593:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333674880 00000100:00100000:3.0:1734016114.031308:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10784 00000100:00100000:3.0:1734016114.031318:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333674880:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016114.031342:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016114.031363:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271154b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5776 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016114.031431:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335279360:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016114.031511:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016114.034395:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335279360:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016114.034442:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271154b2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5776 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.034458:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271154b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5776 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.034471:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4b40, rc 0) 00000100:00100000:3.0:1734016114.034534:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333674880:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3215us (4142us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016114.034543:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10784 00000100:00100000:2.0:1734016114.048016:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.048069:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016114.048149:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333675136 00000100:00100000:0.0:1734016114.048161:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333675136 00002000:00100000:0.0:1734016114.048212:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2326528->6520831) req@ffff8800755b4e00 x1818247333675136/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016114.048222:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4e00 with x1818247333675136 ext(2326528->6520831) 00002000:00010000:0.0:1734016114.048227:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4e00 00000100:00100000:0.0:1734016114.048257:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333675392 00000100:00100000:0.0:1734016114.048260:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333675392 00002000:00100000:0.0:1734016114.048273:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (6520832->8921087) req@ffff8800755b5c00 x1818247333675392/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016114.048280:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5c00 with x1818247333675392 ext(6520832->8921087) 00002000:00010000:0.0:1734016114.048283:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b5c00 00000100:00100000:0.0:1734016114.048295:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8532 00000100:00100000:0.0:1734016114.048303:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333675136:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016114.050977:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8533 00000100:00100000:2.0:1734016114.051004:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333675392:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016114.088010:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333675392:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 36969us (39899us total) trans 0 rc 2400256/2400256 00000100:00100000:2.0:1734016114.088029:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8533 00002000:00100000:2.0:1734016114.088048:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (6520832->8921087) req@ffff8800755b5c00 x1818247333675392/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/440 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 2400256/2400256 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.088076:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5c00 with x1818247333675392 ext(6520832->8921087) 00002000:00010000:2.0:1734016114.088086:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b5c00 00000100:00100000:3.0:1734016114.136592:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333675136:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 88269us (88570us total) trans 0 rc 4194304/4194304 00000100:00100000:3.0:1734016114.136613:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8532 00002000:00100000:3.0:1734016114.136630:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (2326528->6520831) req@ffff8800755b4e00 x1818247333675136/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/440 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.136640:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4e00 with x1818247333675136 ext(2326528->6520831) 00002000:00010000:3.0:1734016114.136645:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4e00 00000100:00100000:0.0:1734016114.194363:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.196455:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333675520 00000100:00100000:3.0:1734016114.196478:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333675520 00000100:00100000:3.0:1734016114.196594:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10785 00000100:00100000:3.0:1734016114.196607:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333675520:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016114.196645:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016114.196679:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271154b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e577d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016114.196775:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335279488:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016114.196940:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb480 going to sleep for 11 seconds 00002000:00010000:3.0:1734016114.201072:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016113 -> 1734016114 00000100:00100000:3.0:1734016114.201115:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335279488:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016114.201173:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271154b9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e577d expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.201190:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271154b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e577d expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.201237:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df58c0, rc 0) 00000100:00100000:3.0:1734016114.201326:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333675520:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4721us (6981us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016114.201337:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10785 00000100:00100000:2.0:1734016114.204335:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.204488:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333675648 00000100:00100000:3.0:1734016114.204499:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333675648 00000100:00100000:3.0:1734016114.204551:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10786 00000100:00100000:3.0:1734016114.204558:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333675648:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016114.204578:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016114.204598:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271154c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5784 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016114.204652:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335279616:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016114.204719:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016114.206600:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335279616:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016114.206639:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271154c0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5784 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.206655:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271154c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5784 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.206685:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016114.206757:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333675648:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2197us (2439us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016114.206769:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10786 00000100:00100000:2.0:1734016114.210231:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.211935:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333675904 00000100:00100000:3.0:1734016114.211947:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333675904 00002000:00100000:3.0:1734016114.212005:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (311296->315391) req@ffff8800755b5880 x1818247333675904/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.212015:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5880 with x1818247333675904 ext(311296->315391) 00002000:00010000:3.0:1734016114.212020:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b5880 00000100:00100000:3.0:1734016114.212057:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8534 00000100:00100000:3.0:1734016114.212064:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333675904:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016114.212238:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333675904:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 172us (2018us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016114.212246:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8534 00002000:00100000:3.0:1734016114.212252:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (311296->315391) req@ffff8800755b5880 x1818247333675904/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/4536 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.212258:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5880 with x1818247333675904 ext(311296->315391) 00002000:00010000:3.0:1734016114.212261:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b5880 00000100:00100000:0.0:1734016114.215265:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.215363:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333676032 00000100:00100000:3.0:1734016114.215376:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333676032 00000100:00100000:3.0:1734016114.215434:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10787 00000100:00100000:3.0:1734016114.215442:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333676032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016114.215464:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016114.215478:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271154c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e578b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016114.215526:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335279744:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016114.215581:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800734cb840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016114.219937:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335279744:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016114.219972:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271154c7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e578b expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.219995:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271154c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e578b expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.220019:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016114.220075:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333676032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4632us (4822us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016114.220083:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10787 00000100:00100000:0.0:1734016114.222923:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.228076:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333676288 00000100:00100000:2.0:1734016114.228090:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333676288 00000100:00100000:2.0:1734016114.228157:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8535 00000100:00100000:2.0:1734016114.228163:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333676288:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:2.0:1734016114.228200:0:14005:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271154ce lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.228219:0:14005:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271154a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1208319) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5768 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.228226:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016114.228227:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016114.228230:0:14005:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271154ce lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6529024->6582271] (req 6529024->6582271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.228258:0:14005:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271154a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1208319) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5768 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.228268:0:14005:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271154a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1208319) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5768 expref: 7 pid: 7684 timeout: 481 lvb_type: 0 00000100:00100000:2.0:1734016114.228280:0:14005:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14005:1818247335279872:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016114.228371:0:14005:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016114.231626:0:14005:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14005:1818247335279872:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016114.231656:0:14005:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271154ce lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6529024->6582271] (req 6529024->6582271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016114.255063:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.257361:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333676416 00000100:00100000:3.0:1734016114.257374:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333676416 00010000:00010000:3.0:1734016114.257411:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271154a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1208319) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5768 expref: 8 pid: 7684 timeout: 481 lvb_type: 0 00000100:00100000:3.0:1734016114.257460:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2980 00000100:00100000:3.0:1734016114.257467:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b42c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333676416:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016114.257481:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016114.257501:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271154a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1183744->1208319) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5768 expref: 8 pid: 7684 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016114.257514:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271154a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1183744->1208319) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5768 expref: 8 pid: 7684 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016114.257533:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271154a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1183744->1208319) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5768 expref: 8 pid: 7684 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016114.257568:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.257573:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.257578:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271154ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6529024->6582271] (req 6529024->6582271) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.257588:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271154ce lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6529024->6582271] (req 6529024->6582271) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.257615:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016114.257679:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b42c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333676416:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 211us (2626us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016114.257685:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2980 00010000:00010000:3.0:1734016114.257746:0:14005:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271154ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6529024->6582271] (req 6529024->6582271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.257753:0:14005:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271154ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6529024->6582271] (req 6529024->6582271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.268199:0:14005:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271154ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6529024->6582271] (req 6529024->6582271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.268226:0:14005:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271154ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6529024->6582271] (req 6529024->6582271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.268234:0:14005:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271154ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6529024->6582271] (req 6529024->6582271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.268242:0:14005:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc480 already unused, calling callback (ffffffffa080e100) 00010000:00010000:3.0:1734016114.268247:0:14005:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271154ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6529024->6582271] (req 6529024->6582271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.268256:0:14005:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271154ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6529024->6582271] (req 6529024->6582271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.268282:0:14005:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271154ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6529024->6582271] (req 6529024->6582271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.268289:0:14005:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271154ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6529024->6582271] (req 6529024->6582271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016114.268456:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333676288:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 40284us (45533us total) trans 0 rc 53248/53248 00000100:00100000:3.0:1734016114.268468:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8535 00000100:00100000:0.0:1734016114.278920:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.279122:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333676544 00000100:00100000:3.0:1734016114.279139:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333676544 00000100:00100000:3.0:1734016114.279257:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10788 00000100:00100000:3.0:1734016114.279268:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333676544:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016114.279302:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016114.279331:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271154d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5792 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1734016114.279367:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 8918733, mtime: 0x675afc72, atime: 0x675afc71, ctime: 0x675afc72, blocks: 0x240 00010000:00010000:3.0:1734016114.279400:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.279403:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.279412:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271154d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5792 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.279431:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271154d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5792 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.279444:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7a80, rc 0) 00000100:00100000:3.0:1734016114.279506:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333676544:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 239us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016114.279514:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10788 00000100:00100000:0.0:1734016114.290620:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016114.291993:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333676672 00000100:00100000:1.0:1734016114.292006:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333676672 00000100:00100000:1.0:1734016114.292088:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10789 00000100:00100000:1.0:1734016114.292097:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333676672:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016114.292127:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016114.292153:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc271154dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5799 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016114.292187:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016114.292190:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016114.292202:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc271154dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5799 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016114.292226:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc271154dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5799 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016114.292244:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016114.292325:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333676672:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 229us (1726us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016114.292333:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10789 00000100:00100000:0.0:1734016114.297854:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.298120:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333676928 00000100:00100000:3.0:1734016114.298136:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333676928 00000100:00100000:3.0:1734016114.298252:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8536 00000100:00100000:3.0:1734016114.298269:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333676928:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:3.0:1734016114.298337:0:14005:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271154e3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.298359:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.298361:0:14005:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.298368:0:14005:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271154e3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2342912->2379775] (req 2342912->2379775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.298390:0:14005:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271154e3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2342912->2379775] (req 2342912->2379775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.309386:0:14005:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271154e3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2342912->2379775] (req 2342912->2379775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.309407:0:14005:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271154e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2342912->2379775] (req 2342912->2379775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.309415:0:14005:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271154e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2342912->2379775] (req 2342912->2379775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.309423:0:14005:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df7180 already unused, calling callback (ffffffffa080e100) 00010000:00010000:3.0:1734016114.309428:0:14005:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271154e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2342912->2379775] (req 2342912->2379775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.309437:0:14005:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271154e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2342912->2379775] (req 2342912->2379775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.309460:0:14005:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271154e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2342912->2379775] (req 2342912->2379775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.309466:0:14005:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271154e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2342912->2379775] (req 2342912->2379775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14005 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016114.312092:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333676928:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 13807us (14228us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1734016114.312116:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8536 00000100:00100000:0.0:1734016114.318019:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.318188:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333677056 00000100:00100000:3.0:1734016114.318198:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333677056 00000100:00100000:3.0:1734016114.318251:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10790 00000100:00100000:3.0:1734016114.318258:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:9668:x1818247333677056:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016114.318276:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016114.318293:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271154ea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e57a0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.318319:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271154d5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5792 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.318327:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc271154dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5799 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.318333:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.318335:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.318338:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271154ea lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [6987776->7028735] (req 6987776->7028735) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57a0 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.318368:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc271154dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5799 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.318378:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc271154dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5799 expref: 9 pid: 7684 timeout: 481 lvb_type: 1 00000100:00100000:3.0:1734016114.318392:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335280000:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016114.318459:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271154d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5792 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.318467:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271154d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5792 expref: 8 pid: 8216 timeout: 481 lvb_type: 1 00000100:00100000:3.0:1734016114.318476:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335280128:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016114.318494:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016114.321523:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335280000:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016114.321536:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335280128:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016114.321562:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271154ea lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [6987776->7028735] (req 6987776->7028735) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57a0 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.321578:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016114.321620:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:9668:x1818247333677056:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3361us (3609us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016114.321630:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10790 00000100:00100000:0.0:1734016114.324924:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016114.327393:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016114.328031:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333677184 00000100:00100000:1.0:1734016114.328042:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333677184 00010000:00010000:1.0:1734016114.328081:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc271154dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5799 expref: 9 pid: 7684 timeout: 481 lvb_type: 1 00000100:00100000:1.0:1734016114.328133:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2981 00000100:00100000:1.0:1734016114.328142:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333677184:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016114.328159:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016114.328183:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc271154dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5799 expref: 9 pid: 7684 timeout: 481 lvb_type: 1 00010000:00010000:1.0:1734016114.328196:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc271154dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5799 expref: 9 pid: 7684 timeout: 481 lvb_type: 1 00010000:00010000:1.0:1734016114.328219:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc271154dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5799 expref: 9 pid: 7684 timeout: 481 lvb_type: 1 00010000:00010000:1.0:1734016114.328246:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016114.328294:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333677184:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 154us (3383us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016114.328301:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2981 00000100:00100000:3.0:1734016114.329823:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333677312 00000100:00100000:3.0:1734016114.329833:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333677312 00010000:00010000:3.0:1734016114.329863:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271154d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5792 expref: 9 pid: 8216 timeout: 481 lvb_type: 1 00000100:00100000:3.0:1734016114.329895:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2982 00000100:00100000:3.0:1734016114.329902:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333677312:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016114.329914:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016114.329930:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271154d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5792 expref: 9 pid: 8216 timeout: 481 lvb_type: 1 00010000:00010000:3.0:1734016114.329940:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271154d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5792 expref: 9 pid: 8216 timeout: 481 lvb_type: 1 00010000:00010000:3.0:1734016114.329957:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271154d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5792 expref: 9 pid: 8216 timeout: 481 lvb_type: 1 00010000:00010000:3.0:1734016114.330757:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.330760:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.330768:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271154ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6987776->7028735) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57a0 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.330778:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271154ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6987776->7028735) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57a0 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.330842:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271154ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6987776->7028735) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57a0 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016114.330854:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335280256:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016114.330927:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016114.343360:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.343433:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333677440 00000100:00100000:2.0:1734016114.343443:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333677440 00000100:00100000:2.0:1734016114.343483:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10791 00000100:00100000:2.0:1734016114.343490:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333677440:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016114.343698:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8918733 -> 8918733 00002000:00010000:2.0:1734016114.343701:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016114 -> 1734016114 00002000:00010000:2.0:1734016114.343703:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016113 -> 1734016113 00002000:00010000:2.0:1734016114.343704:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016114 -> 1734016114 00002000:00010000:2.0:1734016114.343706:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 576 -> 576 00000100:00100000:2.0:1734016114.343760:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333677440:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 269us (410us total) trans 4294969377 rc 0/0 00000100:00100000:2.0:1734016114.343767:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10791 00000100:00100000:0.0:1734016114.345881:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016114.345958:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333677568 00000100:00100000:1.0:1734016114.345964:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333677568 00000100:00100000:1.0:1734016114.346011:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10792 00000100:00100000:1.0:1734016114.346017:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333677568:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016114.346032:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016114.346047:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc271154f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e57a7 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016114.346097:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075875f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335280384:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016114.346150:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016114.346338:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335280256:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016114.346352:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016114.346380:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333677312:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 16478us (18994us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016114.346387:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2982 00002000:00010000:1.0:1734016114.358316:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016113 -> 1734016114 00000100:00100000:1.0:1734016114.358350:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075875f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335280384:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016114.358395:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc271154f1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57a7 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016114.358413:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc271154f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57a7 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016114.360747:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d8c0, rc 0) 00000100:00100000:1.0:1734016114.360860:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333677568:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 14836us (14979us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016114.360874:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10792 00000100:00100000:0.0:1734016114.374234:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016114.379107:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333677696 00000100:00100000:1.0:1734016114.379124:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333677696 00000100:00100000:1.0:1734016114.379211:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10793 00000100:00100000:1.0:1734016114.379219:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333677696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016114.379241:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016114.379257:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc271154f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e57ae expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016114.379317:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075875f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335280512:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016114.379395:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016114.385056:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075875f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335280512:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016114.385108:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc271154f8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57ae expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016114.385132:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc271154f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57ae expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016114.385172:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016114.385229:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333677696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6008us (11006us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016114.385240:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10793 00000100:00100000:0.0:1734016114.389418:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016114.389535:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333677824 00000100:00100000:1.0:1734016114.389546:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333677824 00000100:00100000:1.0:1734016114.389610:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10794 00000100:00100000:1.0:1734016114.389617:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333677824:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016114.389638:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016114.389656:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc271154ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e57b5 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016114.389720:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075875f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335280640:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016114.389791:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016114.394835:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075875f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335280640:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016114.394878:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc271154ff lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57b5 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016114.394894:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc271154ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57b5 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016114.394928:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f180, rc 0) 00000100:00100000:1.0:1734016114.394977:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333677824:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5358us (5570us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016114.394995:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10794 00000100:00100000:0.0:1734016114.398535:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016114.398828:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333677952 00000100:00100000:1.0:1734016114.398838:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333677952 00000100:00100000:1.0:1734016114.398890:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10795 00000100:00100000:1.0:1734016114.398899:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333677952:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016114.398917:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016114.398932:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27115506 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e57bc expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016114.398961:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271154ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6987776->7028735) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57a0 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016114.398968:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016114.398970:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016114.398973:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27115506 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5255168->5259263] (req 5255168->5259263) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57bc expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016114.399015:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271154ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6987776->7028735) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57a0 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016114.399029:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271154ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6987776->7028735) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57a0 expref: 8 pid: 8216 timeout: 481 lvb_type: 0 00000100:00100000:1.0:1734016114.399046:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075875f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335280768:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016114.399122:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016114.401484:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075875f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335280768:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016114.401526:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27115506 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5255168->5259263] (req 5255168->5259263) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57bc expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016114.401542:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016114.401603:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:9668:x1818247333677952:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2705us (3078us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016114.401611:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10795 00000100:00100000:0.0:1734016114.405380:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.405489:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333678080 00000100:00100000:3.0:1734016114.405499:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333678080 00010000:00010000:3.0:1734016114.405533:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271154ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6987776->7028735) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57a0 expref: 9 pid: 8216 timeout: 481 lvb_type: 0 00000100:00100000:3.0:1734016114.405562:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2983 00000100:00100000:3.0:1734016114.405568:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333678080:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016114.405581:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016114.405601:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271154ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6987776->7028735) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57a0 expref: 9 pid: 8216 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016114.405612:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271154ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6987776->7028735) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57a0 expref: 9 pid: 8216 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016114.405633:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271154ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6987776->7028735) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57a0 expref: 9 pid: 8216 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016114.407585:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.407591:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.407607:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27115506 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5255168->5259263) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57bc expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.407619:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27115506 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5255168->5259263) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57bc expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.407671:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27115506 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5255168->5259263) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57bc expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016114.407690:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335280896:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016114.407779:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016114.415651:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.420162:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335280896:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016114.420189:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016114.420273:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333678080:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 14704us (14904us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016114.420284:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2983 00000100:00100000:2.0:1734016114.421118:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333678336 00000100:00100000:2.0:1734016114.421129:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333678336 00002000:00100000:2.0:1734016114.421164:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (5255168->5259263) req@ffff880073945c00 x1818247333678336/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.421173:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073945c00 with x1818247333678336 ext(5255168->5259263) 00002000:00010000:2.0:1734016114.421178:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073945c00 00000100:00100000:2.0:1734016114.421209:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8537 00000100:00100000:2.0:1734016114.421214:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333678336:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016114.421350:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333678336:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 135us (5716us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016114.421356:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8537 00002000:00100000:2.0:1734016114.421361:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (5255168->5259263) req@ffff880073945c00 x1818247333678336/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 488/4536 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.421367:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073945c00 with x1818247333678336 ext(5255168->5259263) 00002000:00010000:2.0:1734016114.421370:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073945c00 00000100:00100000:1.0:1734016114.429523:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016114.431873:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333678592 00000100:00100000:0.0:1734016114.431885:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333678592 00002000:00100000:0.0:1734016114.431941:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5251072->5255167) req@ffff880075875f80 x1818247333678592/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016114.431952:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075875f80 with x1818247333678592 ext(5251072->5255167) 00002000:00010000:0.0:1734016114.431957:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075875f80 00000100:00100000:0.0:1734016114.432007:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8538 00000100:00100000:0.0:1734016114.432014:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333678592:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016114.432231:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333678592:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 216us (2722us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016114.432239:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8538 00002000:00100000:0.0:1734016114.432247:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (5251072->5255167) req@ffff880075875f80 x1818247333678592/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 488/4536 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016114.432254:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075875f80 with x1818247333678592 ext(5251072->5255167) 00002000:00010000:0.0:1734016114.432256:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075875f80 00000100:00100000:1.0:1734016114.453311:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.453411:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333678848 00000100:00100000:2.0:1734016114.453422:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333678848 00002000:00100000:2.0:1734016114.453466:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (5218304->5283839) req@ffff880075876300 x1818247333678848/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 504/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.453477:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075876300 with x1818247333678848 ext(5218304->5283839) 00002000:00010000:2.0:1734016114.453482:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075876300 00000100:00100000:2.0:1734016114.453514:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8539 00000100:00100000:2.0:1734016114.453521:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333678848:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016114.455917:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333678848:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 2388us (2607us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1734016114.455930:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8539 00002000:00100000:2.0:1734016114.455941:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (5218304->5283839) req@ffff880075876300 x1818247333678848/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 504/440 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.455950:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075876300 with x1818247333678848 ext(5218304->5283839) 00002000:00010000:2.0:1734016114.455956:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075876300 00000100:00100000:1.0:1734016114.459251:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.459365:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333678976 00000100:00100000:2.0:1734016114.459374:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333678976 00000100:00100000:2.0:1734016114.459412:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10796 00000100:00100000:2.0:1734016114.459419:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333678976:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016114.459435:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016114.459452:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711550d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e57c3 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.459472:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016114.459474:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016114.459481:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711550d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57c3 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016114.459492:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711550d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57c3 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016114.459502:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016114.459552:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333678976:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 132us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016114.459557:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10796 00000100:00100000:0.0:1734016114.461797:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.461962:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333679104 00000100:00100000:2.0:1734016114.461971:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333679104 00000100:00100000:2.0:1734016114.462560:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10797 00000100:00100000:2.0:1734016114.462569:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:9668:x1818247333679104:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016114.462587:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016114.462604:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115514 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e57ca expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.462632:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27115506 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5255168->5259263) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57bc expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.462640:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711550d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57c3 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016114.462646:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016114.462647:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016114.462650:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115514 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3403776->3469311] (req 3403776->3469311) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57ca expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.462682:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711550d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57c3 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016114.462694:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711550d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57c3 expref: 8 pid: 7684 timeout: 481 lvb_type: 1 00000100:00100000:2.0:1734016114.462707:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335281024:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016114.462989:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27115506 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5255168->5259263) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57bc expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.462997:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27115506 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5255168->5259263) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57bc expref: 10 pid: 7684 timeout: 481 lvb_type: 0 00000100:00100000:2.0:1734016114.463004:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335281152:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016114.463021:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016114.468116:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016114.468161:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.468263:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335281024:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016114.468277:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335281152:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016114.468303:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115514 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3403776->3469311] (req 3403776->3469311) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57ca expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.468318:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016114.468359:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:9668:x1818247333679104:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5791us (6570us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016114.468368:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10797 00000100:00100000:3.0:1734016114.468447:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333679360 00000100:00100000:3.0:1734016114.468454:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333679360 00010000:00010000:3.0:1734016114.468476:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27115506 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5255168->5259263) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57bc expref: 10 pid: 7684 timeout: 481 lvb_type: 0 00000100:00100000:3.0:1734016114.468504:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333679232 00000100:00100000:3.0:1734016114.468507:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333679232 00010000:00010000:3.0:1734016114.468516:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711550d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57c3 expref: 9 pid: 7684 timeout: 481 lvb_type: 1 00000100:00100000:3.0:1734016114.468531:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2984 00000100:00100000:3.0:1734016114.468536:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333679360:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016114.468548:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016114.468565:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27115506 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5255168->5259263) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57bc expref: 10 pid: 7684 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016114.468573:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27115506 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5255168->5259263) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57bc expref: 10 pid: 7684 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016114.468599:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27115506 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5255168->5259263) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57bc expref: 10 pid: 7684 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016114.468612:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016114.468629:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333679360:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 92us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016114.468634:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2984 00000100:00100000:3.0:1734016114.468645:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2985 00000100:00100000:3.0:1734016114.468649:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333679232:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016114.468655:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016114.468661:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711550d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57c3 expref: 9 pid: 7684 timeout: 481 lvb_type: 1 00010000:00010000:3.0:1734016114.468669:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711550d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57c3 expref: 9 pid: 7684 timeout: 481 lvb_type: 1 00010000:00010000:3.0:1734016114.468680:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711550d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57c3 expref: 9 pid: 7684 timeout: 481 lvb_type: 1 00010000:00010000:3.0:1734016114.468687:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.468689:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.468694:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115514 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3469311) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57ca expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.468701:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115514 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3469311) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57ca expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.468729:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115514 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3469311) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57ca expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016114.468743:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335281280:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016114.468771:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016114.471632:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.471718:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333679488 00000100:00100000:2.0:1734016114.471728:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333679488 00000100:00100000:2.0:1734016114.471768:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10798 00000100:00100000:2.0:1734016114.471777:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88009024b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333679488:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016114.472029:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8918733 -> 8918733 00002000:00010000:2.0:1734016114.472032:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016114 -> 1734016114 00002000:00010000:2.0:1734016114.472034:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016114 -> 1734016113 00002000:00010000:2.0:1734016114.472036:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016114 -> 1734016114 00002000:00010000:2.0:1734016114.472038:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 576 -> 576 00000100:00100000:2.0:1734016114.472072:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88009024b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333679488:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 297us (451us total) trans 4294969378 rc 0/0 00000100:00100000:2.0:1734016114.472078:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10798 00000100:00100000:3.0:1734016114.472288:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335281280:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016114.472301:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016114.472317:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333679232:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3667us (4156us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016114.472323:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2985 00000100:00100000:0.0:1734016114.477026:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.477129:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333679616 00000100:00100000:2.0:1734016114.477138:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333679616 00000100:00100000:2.0:1734016114.477176:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10799 00000100:00100000:2.0:1734016114.477184:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333679616:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016114.477200:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016114.477215:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711551b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e57d1 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016114.477273:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335281408:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016114.477344:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e780 going to sleep for 11 seconds 00002000:00010000:2.0:1734016114.494536:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016113 -> 1734016115 00002000:00010000:2.0:1734016114.494544:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016114 -> 1734016115 00000100:00100000:2.0:1734016114.494564:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335281408:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016114.494601:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711551b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57d1 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016114.494617:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711551b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57d1 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016114.494634:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016114.494691:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333679616:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 17506us (17673us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016114.494701:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10799 00000100:00100000:1.0:1734016114.499099:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.499182:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333679744 00000100:00100000:2.0:1734016114.499191:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333679744 00000100:00100000:2.0:1734016114.499231:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10800 00000100:00100000:2.0:1734016114.499237:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333679744:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016114.499255:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016114.499271:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115522 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e57d8 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016114.499324:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335281536:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016114.499384:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016114.502443:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335281536:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016114.502485:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115522 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57d8 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016114.502497:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115522 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57d8 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016114.502511:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016114.502576:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333679744:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3337us (3488us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016114.502585:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10800 00000100:00100000:1.0:1734016114.506770:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.506901:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333680000 00000100:00100000:2.0:1734016114.506910:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333680000 00002000:00100000:2.0:1734016114.506948:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (7413760->7417855) req@ffff880075876a00 x1818247333680000/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.506958:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075876a00 with x1818247333680000 ext(7413760->7417855) 00002000:00010000:2.0:1734016114.506963:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075876a00 00000100:00100000:2.0:1734016114.506995:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8540 00000100:00100000:2.0:1734016114.507000:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333680000:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016114.507142:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333680000:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 140us (380us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016114.507148:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8540 00002000:00100000:2.0:1734016114.507154:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (7413760->7417855) req@ffff880075876a00 x1818247333680000/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 488/4536 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.507165:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075876a00 with x1818247333680000 ext(7413760->7417855) 00002000:00010000:2.0:1734016114.507168:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075876a00 00000100:00100000:1.0:1734016114.514333:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016114.514437:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333680256 00000100:00100000:0.0:1734016114.514449:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333680256 00002000:00100000:0.0:1734016114.514515:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7409664->7413759) req@ffff880075875500 x1818247333680256/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016114.514527:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075875500 with x1818247333680256 ext(7409664->7413759) 00002000:00010000:0.0:1734016114.514533:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075875500 00000100:00100000:0.0:1734016114.514570:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8541 00000100:00100000:0.0:1734016114.514579:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333680256:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016114.514785:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333680256:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 207us (463us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016114.514791:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8541 00002000:00100000:0.0:1734016114.514796:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (7409664->7413759) req@ffff880075875500 x1818247333680256/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 488/4536 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016114.514840:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075875500 with x1818247333680256 ext(7409664->7413759) 00002000:00010000:0.0:1734016114.514842:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075875500 00000100:00100000:1.0:1734016114.518556:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.519081:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333680512 00000100:00100000:2.0:1734016114.519091:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333680512 00002000:00100000:2.0:1734016114.519133:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (7376896->7442431) req@ffff880075876680 x1818247333680512/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 504/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.519143:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075876680 with x1818247333680512 ext(7376896->7442431) 00002000:00010000:2.0:1734016114.519148:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075876680 00000100:00100000:2.0:1734016114.519751:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8542 00000100:00100000:2.0:1734016114.519759:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333680512:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:2.0:1734016114.522986:0:6468:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1734016114.528070:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333680512:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 8301us (9517us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1734016114.528083:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8542 00002000:00100000:2.0:1734016114.528094:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (7376896->7442431) req@ffff880075876680 x1818247333680512/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 504/440 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.528103:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075876680 with x1818247333680512 ext(7376896->7442431) 00002000:00010000:2.0:1734016114.528108:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075876680 00000100:00100000:1.0:1734016114.537097:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.537341:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333680768 00000100:00100000:2.0:1734016114.537356:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333680768 00002000:00100000:2.0:1734016114.537410:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (7344128->7376895) req@ffff880075875c00 x1818247333680768/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.537420:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075875c00 with x1818247333680768 ext(7344128->7376895) 00002000:00010000:2.0:1734016114.537426:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075875c00 00000100:00100000:2.0:1734016114.537606:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8543 00000100:00100000:2.0:1734016114.537615:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333680768:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016114.544143:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333680768:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 6520us (7052us total) trans 0 rc 32768/32768 00000100:00100000:2.0:1734016114.544156:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8543 00002000:00100000:2.0:1734016114.544167:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (7344128->7376895) req@ffff880075875c00 x1818247333680768/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 488/440 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 32768/32768 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.544176:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075875c00 with x1818247333680768 ext(7344128->7376895) 00002000:00010000:2.0:1734016114.544182:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075875c00 00000100:00100000:1.0:1734016114.550353:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.550991:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333680896 00000100:00100000:2.0:1734016114.550998:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333680896 00002000:00100000:2.0:1734016114.551037:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (7352320->7417855) req@ffff880075874380 x1818247333680896/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.551046:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075874380 with x1818247333680896 ext(7352320->7417855) 00002000:00010000:2.0:1734016114.551051:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075874380 00000100:00100000:2.0:1734016114.551239:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8544 00000100:00100000:2.0:1734016114.551246:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333680896:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016114.558146:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333680896:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 6889us (7791us total) trans 4294969379 rc 0/0 00000100:00100000:0.0:1734016114.558159:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8544 00002000:00100000:0.0:1734016114.558176:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (7352320->7417855) req@ffff880075874380 x1818247333680896/t4294969379(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 488/448 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016114.558185:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075874380 with x1818247333680896 ext(7352320->7417855) 00002000:00010000:0.0:1734016114.558190:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075874380 00000100:00100000:1.0:1734016114.561124:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016114.562044:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333681024 00000100:00100000:0.0:1734016114.562053:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333681024 00000100:00100000:0.0:1734016114.562104:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2174 00000100:00100000:0.0:1734016114.562111:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+22:9668:x1818247333681024:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:0.0:1734016114.562213:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+22:9668:x1818247333681024:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 101us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016114.562219:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2174 00000100:00100000:1.0:1734016114.574866:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.575018:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333681152 00000100:00100000:2.0:1734016114.575027:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333681152 00000100:00100000:2.0:1734016114.575600:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10801 00000100:00100000:2.0:1734016114.575607:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333681152:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:3.0:1734016114.577471:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969379 is committed 00000001:00080000:3.0:1734016114.577483:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969377 is committed 00000100:00100000:2.0:1734016114.577660:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333681152:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2048us (2798us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016114.577670:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10801 00000100:00100000:1.0:1734016114.581957:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016114.582589:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333681408 00000100:00100000:0.0:1734016114.582597:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333681408 00002000:00100000:0.0:1734016114.582636:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3440640->3444735) req@ffff8800756eea00 x1818247333681408/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016114.582645:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756eea00 with x1818247333681408 ext(3440640->3444735) 00002000:00010000:0.0:1734016114.582650:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756eea00 00000100:00100000:0.0:1734016114.582677:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8545 00000100:00100000:0.0:1734016114.582683:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333681408:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016114.582875:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333681408:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 191us (925us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016114.582882:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8545 00002000:00100000:0.0:1734016114.582887:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3440640->3444735) req@ffff8800756eea00 x1818247333681408/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 488/4536 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016114.582898:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756eea00 with x1818247333681408 ext(3440640->3444735) 00002000:00010000:0.0:1734016114.582901:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756eea00 00000100:00100000:1.0:1734016114.588550:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.588643:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333681664 00000100:00100000:2.0:1734016114.588653:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333681664 00002000:00100000:2.0:1734016114.588696:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3436544->3440639) req@ffff8800756ee300 x1818247333681664/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.588706:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ee300 with x1818247333681664 ext(3436544->3440639) 00002000:00010000:2.0:1734016114.588711:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ee300 00000100:00100000:2.0:1734016114.588732:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8546 00000100:00100000:2.0:1734016114.588738:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333681664:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016114.588931:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333681664:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 191us (389us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016114.588938:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8546 00002000:00100000:2.0:1734016114.588944:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (3436544->3440639) req@ffff8800756ee300 x1818247333681664/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 488/4536 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.588950:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ee300 with x1818247333681664 ext(3436544->3440639) 00002000:00010000:2.0:1734016114.588953:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ee300 00000100:00100000:1.0:1734016114.592428:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016114.593224:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333681920 00000100:00100000:0.0:1734016114.593238:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333681920 00002000:00100000:0.0:1734016114.593291:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3403776->3469311) req@ffff8800756eed80 x1818247333681920/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 504/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016114.593303:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756eed80 with x1818247333681920 ext(3403776->3469311) 00002000:00010000:0.0:1734016114.593312:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756eed80 00000100:00100000:0.0:1734016114.593352:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8547 00000100:00100000:0.0:1734016114.593359:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333681920:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016114.596684:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333681920:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 3307us (4250us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1734016114.596701:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8547 00002000:00100000:0.0:1734016114.596717:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3403776->3469311) req@ffff8800756eed80 x1818247333681920/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 504/440 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016114.596727:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756eed80 with x1818247333681920 ext(3403776->3469311) 00002000:00010000:0.0:1734016114.596733:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756eed80 00000100:00100000:1.0:1734016114.599953:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016114.600035:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333682176 00000100:00100000:0.0:1734016114.600044:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333682176 00002000:00100000:0.0:1734016114.600088:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3371008->3403775) req@ffff8800756efb80 x1818247333682176/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016114.600097:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756efb80 with x1818247333682176 ext(3371008->3403775) 00002000:00010000:0.0:1734016114.600102:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756efb80 00000100:00100000:0.0:1734016114.600139:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8548 00000100:00100000:0.0:1734016114.600145:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333682176:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016114.602865:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333682176:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 2707us (2911us total) trans 0 rc 32768/32768 00000100:00100000:0.0:1734016114.602878:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8548 00002000:00100000:0.0:1734016114.602889:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (3371008->3403775) req@ffff8800756efb80 x1818247333682176/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:75/0 lens 488/440 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 32768/32768 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016114.602898:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756efb80 with x1818247333682176 ext(3371008->3403775) 00002000:00010000:0.0:1734016114.602904:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756efb80 00000100:00100000:1.0:1734016114.609304:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.610876:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333682304 00000100:00100000:2.0:1734016114.610887:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333682304 00000100:00100000:2.0:1734016114.611030:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10802 00000100:00100000:2.0:1734016114.611037:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333682304:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016114.611060:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016114.611080:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115529 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e57df expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.611106:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115514 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3469311) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57ca expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.611118:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016114.611120:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016114.611123:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115529 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1744896->1753087] (req 1744896->1753087) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57df expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.611152:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115514 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3469311) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57ca expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.611162:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115514 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3469311) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57ca expref: 6 pid: 8216 timeout: 481 lvb_type: 0 00000100:00100000:2.0:1734016114.611174:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335281664:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016114.611239:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016114.614631:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335281664:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016114.614677:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115529 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1744896->1753087] (req 1744896->1753087) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57df expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.614701:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd440, rc 0) 00000100:00100000:3.0:1734016114.614764:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333682304:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3725us (5468us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016114.614780:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10802 00000100:00100000:0.0:1734016114.616523:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.617186:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333682432 00000100:00100000:3.0:1734016114.617195:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333682432 00010000:00010000:3.0:1734016114.617223:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115514 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->3469311) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57ca expref: 7 pid: 8216 timeout: 481 lvb_type: 0 00000100:00100000:3.0:1734016114.617676:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2986 00000100:00100000:3.0:1734016114.617683:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333682432:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016114.617697:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1734016114.617715:0:7698:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016114 -> 1734016115 00002000:00010000:3.0:1734016114.617719:0:7698:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 576 -> 704 00010000:00010000:3.0:1734016114.617724:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115514 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3403776->3469311) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57ca expref: 7 pid: 8216 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016114.617735:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115514 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3403776->3469311) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57ca expref: 7 pid: 8216 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016114.617755:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115514 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3403776->3469311) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57ca expref: 7 pid: 8216 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016114.617930:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.617932:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.617939:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115529 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->1753087) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57df expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.617947:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115529 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->1753087) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57df expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.617994:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115529 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->1753087) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57df expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016114.618011:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335281792:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016114.618492:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016114.623181:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.623274:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335281792:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016114.623296:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016114.623352:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333682432:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5669us (6834us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016114.623362:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2986 00000100:00100000:0.0:1734016114.623427:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333682560 00000100:00100000:0.0:1734016114.623434:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333682560 00000100:00100000:0.0:1734016114.623473:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10803 00000100:00100000:0.0:1734016114.623478:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333682560:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016114.623641:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8918733 -> 8918733 00002000:00010000:0.0:1734016114.623645:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016115 -> 1734016115 00002000:00010000:0.0:1734016114.623647:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016115 -> 1734016114 00002000:00010000:0.0:1734016114.623649:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016115 -> 1734016115 00002000:00010000:0.0:1734016114.623651:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 704 -> 704 00000100:00100000:0.0:1734016114.623701:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333682560:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 221us (526us total) trans 4294969380 rc 0/0 00000100:00100000:0.0:1734016114.623707:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10803 00000100:00100000:1.0:1734016114.626602:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.626899:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333682688 00000100:00100000:2.0:1734016114.626907:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333682688 00000100:00100000:2.0:1734016114.626949:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10804 00000100:00100000:2.0:1734016114.626956:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333682688:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016114.626972:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016114.626996:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115530 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e57e6 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016114.627045:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335281920:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016114.627105:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ecc0 going to sleep for 11 seconds 00002000:00010000:2.0:1734016114.629095:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016114 -> 1734016115 00000100:00100000:2.0:1734016114.629127:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335281920:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016114.629161:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115530 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57e6 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016114.629175:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115530 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57e6 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016114.629190:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016114.629241:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333682688:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2282us (2644us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016114.629251:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10804 00000100:00100000:0.0:1734016114.632029:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.632167:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333682816 00000100:00100000:2.0:1734016114.632179:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333682816 00000100:00100000:2.0:1734016114.632292:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10805 00000100:00100000:2.0:1734016114.632303:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333682816:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016114.632326:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016114.632346:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115537 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e57ed expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016114.632413:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335282048:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016114.632484:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016114.634602:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335282048:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016114.634633:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115537 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57ed expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.634644:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115537 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57ed expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.634667:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:3.0:1734016114.635189:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333682816:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2886us (3174us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016114.635197:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10805 00000100:00100000:0.0:1734016114.653182:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016114.654034:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.654065:0:14005:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333683200 00000100:00100000:2.0:1734016114.654073:0:14005:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333683200 00002000:00100000:2.0:1734016114.654112:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8388607) req@ffff880073944e00 x1818247333683200/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 504/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.654121:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073944e00 with x1818247333683200 ext(4190208->8388607) 00002000:00010000:2.0:1734016114.654127:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073944e00 00000100:00100000:2.0:1734016114.654160:0:14005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8549 00000100:00100000:2.0:1734016114.654168:0:14005:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333683200:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016114.659666:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.662021:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333683072 00000100:00100000:3.0:1734016114.662033:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333683072 00002000:00100000:3.0:1734016114.662079:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->6520831) req@ffff880073945880 x1818247333683072/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 504/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.662089:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073945880 with x1818247333683072 ext(0->6520831) 00002000:00010000:3.0:1734016114.662094:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073945880 00000100:00100000:3.0:1734016114.662114:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333683328 00000100:00100000:3.0:1734016114.662117:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333683328 00002000:00100000:3.0:1734016114.662129:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8388608->8921087) req@ffff880073946680 x1818247333683328/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.662135:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073946680 with x1818247333683328 ext(8388608->8921087) 00002000:00010000:3.0:1734016114.662137:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073946680 00000100:00100000:3.0:1734016114.662151:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8550 00000100:00100000:3.0:1734016114.662157:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333683072:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016114.670337:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8551 00000100:00100000:3.0:1734016114.670347:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1983:x1818247333683328:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016114.715279:0:14005:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1983:x1818247333683200:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 61098us (62092us total) trans 0 rc 4194304/4194304 00000100:00100000:3.0:1734016114.715292:0:14005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8549 00002000:00100000:3.0:1734016114.715306:0:14005:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8388607) req@ffff880073944e00 x1818247333683200/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 504/440 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.715315:0:14005:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073944e00 with x1818247333683200 ext(4190208->8388607) 00002000:00010000:3.0:1734016114.715320:0:14005:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073944e00 00000100:00100000:3.0:1734016114.731170:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333683072:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 68998us (77123us total) trans 0 rc 4194304/4194304 00000100:00100000:3.0:1734016114.731182:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8550 00002000:00100000:3.0:1734016114.731194:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->6520831) req@ffff880073945880 x1818247333683072/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 504/440 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.731203:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073945880 with x1818247333683072 ext(0->6520831) 00002000:00010000:3.0:1734016114.731211:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073945880 00000100:00100000:3.0:1734016114.737407:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333683328:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 67051us (77739us total) trans 0 rc 532480/532480 00000100:00100000:3.0:1734016114.737419:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8551 00002000:00100000:3.0:1734016114.737430:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8388608->8921087) req@ffff880073946680 x1818247333683328/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/440 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 532480/532480 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.737438:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073946680 with x1818247333683328 ext(8388608->8921087) 00002000:00010000:3.0:1734016114.737445:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073946680 00000100:00100000:0.0:1734016114.747141:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.747242:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333683712 00000100:00100000:3.0:1734016114.747251:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333683712 00000100:00100000:3.0:1734016114.747315:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8552 00000100:00100000:3.0:1734016114.747324:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333683712:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:3.0:1734016114.747358:0:7687:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc2711553e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.747377:0:7687:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115529 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->1753087) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57df expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.747384:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016114.747386:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016114.747388:0:7687:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc2711553e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1863680->1921023] (req 1863680->1921023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.747424:0:7687:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115529 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->1753087) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57df expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.747436:0:7687:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115529 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->1753087) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57df expref: 6 pid: 7684 timeout: 481 lvb_type: 0 00000100:00100000:3.0:1734016114.747450:0:7687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335282176:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016114.748052:0:7687:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92600 going to sleep for 11 seconds 00000100:00100000:3.0:1734016114.756591:0:7687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335282176:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016114.756619:0:7687:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc2711553e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1863680->1921023] (req 1863680->1921023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016114.765108:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.765344:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333683840 00000100:00100000:3.0:1734016114.765352:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333683840 00010000:00010000:3.0:1734016114.765381:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115529 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57df expref: 7 pid: 7684 timeout: 481 lvb_type: 0 00000100:00100000:3.0:1734016114.765415:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2987 00000100:00100000:3.0:1734016114.765421:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b42c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333683840:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016114.765433:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016114.765449:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115529 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1744896->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57df expref: 7 pid: 7684 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016114.765458:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115529 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1744896->1753087) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57df expref: 7 pid: 7684 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016114.765477:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115529 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1744896->1753087) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57df expref: 7 pid: 7684 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1734016114.765507:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.765510:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.765513:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc2711553e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1863680->1921023] (req 1863680->1921023) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.765521:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc2711553e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1863680->1921023] (req 1863680->1921023) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.765687:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016114.765735:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b42c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333683840:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 313us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016114.765741:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2987 00010000:00010000:2.0:1734016114.766175:0:7687:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc2711553e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1863680->1921023] (req 1863680->1921023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.766184:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc2711553e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1863680->1921023] (req 1863680->1921023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1734016114.784457:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969381 is committed 00000001:00080000:3.0:1734016114.784477:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969380 is committed 00002000:00010000:2.0:1734016114.784598:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 704 -> 816 00010000:00010000:2.0:1734016114.784618:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc2711553e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1863680->1921023] (req 1863680->1921023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.784628:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc2711553e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1863680->1921023] (req 1863680->1921023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.784636:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc2711553e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1863680->1921023] (req 1863680->1921023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.784641:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df58c0 already unused, calling callback (ffffffffa080e100) 00010000:00010000:2.0:1734016114.784645:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc2711553e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1863680->1921023] (req 1863680->1921023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.784651:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc2711553e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1863680->1921023] (req 1863680->1921023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.784667:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc2711553e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1863680->1921023] (req 1863680->1921023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016114.784679:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc2711553e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1863680->1921023] (req 1863680->1921023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016114.785408:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333683712:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 38076us (38267us total) trans 4294969381 rc 0/0 00000100:00100000:2.0:1734016114.785421:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8552 00000100:00100000:2.0:1734016114.788729:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.788867:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333683968 00000100:00100000:3.0:1734016114.788875:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333683968 00000100:00100000:3.0:1734016114.788920:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10806 00000100:00100000:3.0:1734016114.788927:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333683968:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016114.788944:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016114.788963:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115545 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e57f4 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1734016114.788994:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 8918733, mtime: 0x675afc73, atime: 0x675afc73, ctime: 0x675afc73, blocks: 0x330 00010000:00010000:3.0:1734016114.789011:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.789013:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.789020:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115545 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57f4 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.789033:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115545 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57f4 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.789048:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4b40, rc 0) 00000100:00100000:3.0:1734016114.791968:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333683968:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3022us (3229us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016114.791993:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10806 00000100:00100000:1.0:1734016114.796580:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.796663:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333684096 00000100:00100000:3.0:1734016114.796672:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333684096 00000100:00100000:3.0:1734016114.796718:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10807 00000100:00100000:3.0:1734016114.796726:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333684096:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016114.796743:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016114.796760:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711554c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e57fb expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.796791:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115545 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57f4 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.796859:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.796862:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.796866:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711554c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7073792->7077887] (req 7073792->7077887) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57fb expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.796901:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115545 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57f4 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.796913:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115545 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57f4 expref: 7 pid: 8216 timeout: 481 lvb_type: 1 00000100:00100000:3.0:1734016114.796930:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335282304:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016114.797020:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016114.801287:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335282304:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016114.801326:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711554c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7073792->7077887] (req 7073792->7077887) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57fb expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.801344:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016114.801658:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333684096:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4929us (5084us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016114.801667:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10807 00000100:00100000:2.0:1734016114.803258:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.803683:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333684224 00000100:00100000:3.0:1734016114.803690:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333684224 00010000:00010000:3.0:1734016114.803716:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115545 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57f4 expref: 7 pid: 8216 timeout: 481 lvb_type: 1 00000100:00100000:3.0:1734016114.803751:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2988 00000100:00100000:3.0:1734016114.803757:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333684224:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016114.803770:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016114.803793:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115545 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57f4 expref: 7 pid: 8216 timeout: 481 lvb_type: 1 00010000:00010000:3.0:1734016114.803826:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115545 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57f4 expref: 7 pid: 8216 timeout: 481 lvb_type: 1 00010000:00010000:3.0:1734016114.803853:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115545 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57f4 expref: 7 pid: 8216 timeout: 481 lvb_type: 1 00010000:00010000:3.0:1734016114.803881:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.803883:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016114.803889:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711554c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7073792->7077887) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57fb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.803898:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711554c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7073792->7077887) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57fb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.803933:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711554c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7073792->7077887) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57fb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016114.803947:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335282432:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016114.804009:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016114.809355:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335282432:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016114.809383:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016114.809443:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333684224:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5684us (6192us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016114.809452:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2988 00000100:00100000:2.0:1734016114.812547:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.812719:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333684480 00000100:00100000:3.0:1734016114.812729:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333684480 00002000:00100000:3.0:1734016114.812767:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7073792->7077887) req@ffff8800755b7100 x1818247333684480/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.812783:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b7100 with x1818247333684480 ext(7073792->7077887) 00002000:00010000:3.0:1734016114.812789:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b7100 00000100:00100000:3.0:1734016114.812832:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8553 00000100:00100000:3.0:1734016114.812838:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333684480:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016114.813002:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333684480:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 163us (463us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016114.813009:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8553 00002000:00100000:3.0:1734016114.813014:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7073792->7077887) req@ffff8800755b7100 x1818247333684480/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/4536 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.813021:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b7100 with x1818247333684480 ext(7073792->7077887) 00002000:00010000:3.0:1734016114.813024:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b7100 00000100:00100000:2.0:1734016114.825271:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016114.825356:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333684736 00000100:00100000:0.0:1734016114.825365:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333684736 00002000:00100000:0.0:1734016114.825407:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7069696->7073791) req@ffff8800755b6a00 x1818247333684736/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016114.825418:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b6a00 with x1818247333684736 ext(7069696->7073791) 00002000:00010000:0.0:1734016114.825425:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b6a00 00000100:00100000:0.0:1734016114.825462:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8554 00000100:00100000:0.0:1734016114.825468:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333684736:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016114.825669:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333684736:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 200us (410us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016114.825677:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8554 00002000:00100000:0.0:1734016114.825683:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7069696->7073791) req@ffff8800755b6a00 x1818247333684736/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/4536 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016114.825689:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b6a00 with x1818247333684736 ext(7069696->7073791) 00002000:00010000:0.0:1734016114.825691:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b6a00 00000100:00100000:1.0:1734016114.830987:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.831088:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333684992 00000100:00100000:3.0:1734016114.831100:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333684992 00002000:00100000:3.0:1734016114.831140:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7065600->7069695) req@ffff88012b132d80 x1818247333684992/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.831150:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b132d80 with x1818247333684992 ext(7065600->7069695) 00002000:00010000:3.0:1734016114.831156:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b132d80 00000100:00100000:3.0:1734016114.831189:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8555 00000100:00100000:3.0:1734016114.831195:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333684992:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016114.831375:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333684992:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 178us (405us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016114.831382:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8555 00002000:00100000:3.0:1734016114.831387:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7065600->7069695) req@ffff88012b132d80 x1818247333684992/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/4536 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.831396:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b132d80 with x1818247333684992 ext(7065600->7069695) 00002000:00010000:3.0:1734016114.831399:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b132d80 00000100:00100000:0.0:1734016114.835199:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.835892:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333685248 00000100:00100000:2.0:1734016114.835901:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333685248 00002000:00100000:2.0:1734016114.835937:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7061504->7065599) req@ffff880073947100 x1818247333685248/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.835946:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073947100 with x1818247333685248 ext(7061504->7065599) 00002000:00010000:2.0:1734016114.835951:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073947100 00000100:00100000:2.0:1734016114.835991:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8556 00000100:00100000:2.0:1734016114.835996:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333685248:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016114.836154:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333685248:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 156us (967us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016114.836160:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8556 00002000:00100000:2.0:1734016114.836166:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7061504->7065599) req@ffff880073947100 x1818247333685248/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/4536 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.836171:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073947100 with x1818247333685248 ext(7061504->7065599) 00002000:00010000:2.0:1734016114.836174:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073947100 00000100:00100000:2.0:1734016114.851746:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.851823:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333685504 00000100:00100000:3.0:1734016114.851833:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333685504 00002000:00100000:3.0:1734016114.851871:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7057408->7061503) req@ffff8800755b5f80 x1818247333685504/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.851881:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5f80 with x1818247333685504 ext(7057408->7061503) 00002000:00010000:3.0:1734016114.851885:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b5f80 00000100:00100000:3.0:1734016114.851910:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8557 00000100:00100000:3.0:1734016114.851916:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333685504:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016114.852069:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333685504:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 152us (331us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016114.852076:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8557 00002000:00100000:3.0:1734016114.852081:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7057408->7061503) req@ffff8800755b5f80 x1818247333685504/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/4536 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.852089:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5f80 with x1818247333685504 ext(7057408->7061503) 00002000:00010000:3.0:1734016114.852092:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b5f80 00000100:00100000:1.0:1734016114.864411:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.864690:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333685760 00000100:00100000:2.0:1734016114.864702:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333685760 00002000:00100000:2.0:1734016114.864745:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7053312->7057407) req@ffff88012b130380 x1818247333685760/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.864754:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b130380 with x1818247333685760 ext(7053312->7057407) 00002000:00010000:2.0:1734016114.864759:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b130380 00000100:00100000:2.0:1734016114.864792:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8558 00000100:00100000:2.0:1734016114.864891:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333685760:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016114.866073:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333685760:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1268us (1667us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016114.866084:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8558 00002000:00100000:2.0:1734016114.866092:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7053312->7057407) req@ffff88012b130380 x1818247333685760/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/4536 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.866101:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b130380 with x1818247333685760 ext(7053312->7057407) 00002000:00010000:2.0:1734016114.866105:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b130380 00000100:00100000:0.0:1734016114.871930:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.872340:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333686016 00000100:00100000:2.0:1734016114.872349:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333686016 00002000:00100000:2.0:1734016114.872398:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7049216->7053311) req@ffff880073946a00 x1818247333686016/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.872409:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073946a00 with x1818247333686016 ext(7049216->7053311) 00002000:00010000:2.0:1734016114.872414:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073946a00 00000100:00100000:2.0:1734016114.872452:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8559 00000100:00100000:2.0:1734016114.872458:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333686016:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016114.874348:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333686016:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1872us (2409us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016114.874360:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8559 00002000:00100000:2.0:1734016114.874375:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7049216->7053311) req@ffff880073946a00 x1818247333686016/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/4536 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.874384:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073946a00 with x1818247333686016 ext(7049216->7053311) 00002000:00010000:2.0:1734016114.874390:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073946a00 00000100:00100000:0.0:1734016114.883749:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.885552:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333686272 00000100:00100000:2.0:1734016114.885562:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333686272 00002000:00100000:2.0:1734016114.885604:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7045120->7049215) req@ffff880073944a80 x1818247333686272/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.885614:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073944a80 with x1818247333686272 ext(7045120->7049215) 00002000:00010000:2.0:1734016114.885620:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073944a80 00000100:00100000:2.0:1734016114.885665:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8560 00000100:00100000:2.0:1734016114.885671:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333686272:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016114.885859:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333686272:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 186us (2116us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016114.885865:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8560 00002000:00100000:2.0:1734016114.885871:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7045120->7049215) req@ffff880073944a80 x1818247333686272/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/4536 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.885878:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073944a80 with x1818247333686272 ext(7045120->7049215) 00002000:00010000:2.0:1734016114.885881:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073944a80 00000100:00100000:1.0:1734016114.890522:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.890638:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333686528 00000100:00100000:3.0:1734016114.890650:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333686528 00002000:00100000:3.0:1734016114.890690:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7041024->7045119) req@ffff88012b131880 x1818247333686528/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.890700:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b131880 with x1818247333686528 ext(7041024->7045119) 00002000:00010000:3.0:1734016114.890707:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b131880 00000100:00100000:3.0:1734016114.890746:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8561 00000100:00100000:3.0:1734016114.890754:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333686528:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016114.890964:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333686528:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 210us (453us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016114.890981:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8561 00002000:00100000:3.0:1734016114.890988:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7041024->7045119) req@ffff88012b131880 x1818247333686528/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/4536 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.890995:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b131880 with x1818247333686528 ext(7041024->7045119) 00002000:00010000:3.0:1734016114.890998:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b131880 00000100:00100000:0.0:1734016114.897014:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.897100:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333686784 00000100:00100000:2.0:1734016114.897108:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333686784 00002000:00100000:2.0:1734016114.897147:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7036928->7041023) req@ffff880073947480 x1818247333686784/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.897157:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073947480 with x1818247333686784 ext(7036928->7041023) 00002000:00010000:2.0:1734016114.897161:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073947480 00000100:00100000:2.0:1734016114.897188:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8562 00000100:00100000:2.0:1734016114.897194:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333686784:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016114.897341:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333686784:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 147us (336us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016114.897347:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8562 00002000:00100000:2.0:1734016114.897352:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7036928->7041023) req@ffff880073947480 x1818247333686784/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/4536 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016114.897359:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073947480 with x1818247333686784 ext(7036928->7041023) 00002000:00010000:2.0:1734016114.897362:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073947480 00000100:00100000:0.0:1734016114.901022:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.901154:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333687040 00000100:00100000:3.0:1734016114.901166:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333687040 00002000:00100000:3.0:1734016114.901218:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7032832->7036927) req@ffff880073944700 x1818247333687040/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.901229:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073944700 with x1818247333687040 ext(7032832->7036927) 00002000:00010000:3.0:1734016114.901234:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073944700 00000100:00100000:3.0:1734016114.902087:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8563 00000100:00100000:3.0:1734016114.902094:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333687040:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016114.902267:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333687040:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 172us (1257us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016114.902275:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8563 00002000:00100000:3.0:1734016114.902283:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7032832->7036927) req@ffff880073944700 x1818247333687040/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/4536 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.902290:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073944700 with x1818247333687040 ext(7032832->7036927) 00002000:00010000:3.0:1734016114.902294:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073944700 00000100:00100000:1.0:1734016114.912496:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.912645:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333687296 00000100:00100000:3.0:1734016114.912662:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333687296 00002000:00100000:3.0:1734016114.912723:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7077888->7081983) req@ffff88012b130e00 x1818247333687296/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.912736:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b130e00 with x1818247333687296 ext(7077888->7081983) 00002000:00010000:3.0:1734016114.912743:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b130e00 00000100:00100000:3.0:1734016114.913430:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8564 00000100:00100000:3.0:1734016114.913439:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333687296:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016114.914456:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333687296:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1013us (1971us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016114.914465:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8564 00002000:00100000:3.0:1734016114.914474:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7077888->7081983) req@ffff88012b130e00 x1818247333687296/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/4536 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.914484:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b130e00 with x1818247333687296 ext(7077888->7081983) 00002000:00010000:3.0:1734016114.914489:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b130e00 00000100:00100000:0.0:1734016114.923645:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.923875:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333687424 00000100:00100000:3.0:1734016114.923891:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333687424 00002000:00100000:3.0:1734016114.923957:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7032832->7081983) req@ffff880073947b80 x1818247333687424/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/0 e 0 to 0 dl 1734016125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.923979:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073947b80 with x1818247333687424 ext(7032832->7081983) 00002000:00010000:3.0:1734016114.923986:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073947b80 00000100:00100000:3.0:1734016114.924031:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8565 00000100:00100000:3.0:1734016114.924041:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333687424:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016114.937944:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333687424:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 13880us (14293us total) trans 4294969382 rc 0/0 00000100:00100000:3.0:1734016114.937967:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8565 00002000:00100000:3.0:1734016114.937991:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7032832->7081983) req@ffff880073947b80 x1818247333687424/t4294969382(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:75/0 lens 488/448 e 0 to 0 dl 1734016125 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016114.938000:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073947b80 with x1818247333687424 ext(7032832->7081983) 00002000:00010000:3.0:1734016114.938006:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073947b80 00000100:00100000:0.0:1734016114.942481:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016114.943567:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333687552 00000100:00100000:2.0:1734016114.943594:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333687552 00000100:00100000:2.0:1734016114.943816:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2175 00000100:00100000:2.0:1734016114.943826:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:9668:x1818247333687552:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:2.0:1734016114.948062:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:9668:x1818247333687552:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 4216us (5569us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016114.948076:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2175 00000100:00100000:1.0:1734016114.950025:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.950369:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333687680 00000100:00100000:3.0:1734016114.950380:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333687680 00000100:00100000:3.0:1734016114.950429:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10808 00000100:00100000:3.0:1734016114.950436:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b132300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333687680:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016114.958058:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969382 is committed 00000100:00100000:3.0:1734016114.960607:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b132300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333687680:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 10151us (10570us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016114.960624:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10808 00000100:00100000:1.0:1734016114.964608:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.964732:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333687808 00000100:00100000:3.0:1734016114.964741:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333687808 00000100:00100000:3.0:1734016114.964789:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10809 00000100:00100000:3.0:1734016114.964796:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333687808:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016114.965260:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8918733 -> 8918733 00002000:00010000:3.0:1734016114.965264:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016115 -> 1734016115 00002000:00010000:3.0:1734016114.965265:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016115 -> 1734016115 00002000:00010000:3.0:1734016114.965268:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016115 -> 1734016114 00002000:00010000:3.0:1734016114.965269:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 816 -> 960 00000100:00100000:3.0:1734016114.965826:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333687808:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1028us (1225us total) trans 4294969383 rc 0/0 00000100:00100000:3.0:1734016114.965834:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10809 00000100:00100000:0.0:1734016114.968990:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.969161:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333687936 00000100:00100000:3.0:1734016114.969169:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333687936 00000100:00100000:3.0:1734016114.969218:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10810 00000100:00100000:3.0:1734016114.969224:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333687936:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016114.969243:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016114.969260:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115553 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5802 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016114.969317:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335282560:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016114.970820:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c920c0 going to sleep for 11 seconds 00002000:00010000:3.0:1734016114.973832:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016114 -> 1734016115 00000100:00100000:3.0:1734016114.973853:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335282560:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016114.973882:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115553 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5802 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.973894:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115553 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5802 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.974132:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016114.974181:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333687936:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4955us (5197us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016114.974189:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10810 00000100:00100000:0.0:1734016114.978270:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.978618:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333688064 00000100:00100000:3.0:1734016114.978628:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333688064 00000100:00100000:3.0:1734016114.978673:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10811 00000100:00100000:3.0:1734016114.978681:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333688064:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016114.978703:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016114.978721:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711555a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5809 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016114.978779:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335282688:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016114.978863:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c920c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016114.981131:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335282688:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016114.981163:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711555a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5809 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.981175:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711555a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5809 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.981236:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016114.982046:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333688064:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3363us (3784us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016114.982054:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10811 00000100:00100000:0.0:1734016114.987560:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.987752:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333688192 00000100:00100000:3.0:1734016114.987761:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333688192 00000100:00100000:3.0:1734016114.987836:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10812 00000100:00100000:3.0:1734016114.987843:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333688192:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016114.987861:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016114.987878:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115561 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5810 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016114.987926:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335282816:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016114.987994:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c920c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016114.994627:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335282816:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016114.994658:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115561 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5810 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.994670:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115561 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5810 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016114.994696:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4480, rc 0) 00000100:00100000:3.0:1734016114.994744:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333688192:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6900us (7192us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016114.994752:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10812 00000100:00100000:0.0:1734016114.999327:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016114.999420:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333688320 00000100:00100000:3.0:1734016114.999428:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333688320 00000100:00100000:3.0:1734016114.999477:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10813 00000100:00100000:3.0:1734016114.999483:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333688320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016114.999498:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016114.999512:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115568 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5817 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.999534:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711554c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7073792->7077887) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57fb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.999541:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016114.999543:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016114.999545:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115568 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7278592->7344127] (req 7278592->7344127) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5817 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.999577:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711554c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7073792->7077887) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57fb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016114.999586:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711554c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7073792->7077887) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57fb expref: 6 pid: 8216 timeout: 482 lvb_type: 0 00000100:00100000:3.0:1734016114.999600:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335282944:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016114.999649:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c920c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016115.004198:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.004477:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335282944:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016115.004506:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115568 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7278592->7344127] (req 7278592->7344127) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5817 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.004521:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:2.0:1734016115.004856:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333688448 00000100:00100000:2.0:1734016115.004863:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333688448 00010000:00010000:2.0:1734016115.004887:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711554c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7073792->7077887) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57fb expref: 7 pid: 8216 timeout: 482 lvb_type: 0 00000100:00100000:2.0:1734016115.005379:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2989 00000100:00100000:2.0:1734016115.005387:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333688448:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016115.005401:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016115.005426:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711554c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7073792->7077887) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57fb expref: 7 pid: 8216 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1734016115.005437:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711554c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7073792->7077887) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57fb expref: 7 pid: 8216 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1734016115.005460:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711554c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7073792->7077887) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e57fb expref: 7 pid: 8216 timeout: 482 lvb_type: 0 00000100:00100000:3.0:1734016115.005536:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333688320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6051us (6214us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016115.005544:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10813 00010000:00010000:2.0:1734016115.006784:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016115.006789:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016115.006797:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115568 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7278592->7344127) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5817 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.006817:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115568 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7278592->7344127) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5817 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.006855:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115568 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7278592->7344127) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5817 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016115.006868:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335283072:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016115.006926:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016115.012339:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335283072:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016115.012363:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016115.012417:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333688448:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7029us (8224us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016115.012428:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2989 00000100:00100000:1.0:1734016115.014659:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.014774:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333688576 00000100:00100000:3.0:1734016115.014784:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333688576 00000100:00100000:3.0:1734016115.014867:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10814 00000100:00100000:3.0:1734016115.014873:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333688576:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016115.015056:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8918733 -> 8918733 00002000:00010000:3.0:1734016115.015060:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016115 -> 1734016115 00002000:00010000:3.0:1734016115.015061:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016115 -> 1734016115 00002000:00010000:3.0:1734016115.015063:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016115 -> 1734016115 00002000:00010000:3.0:1734016115.015065:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 960 -> 1088 00000100:00100000:3.0:1734016115.015118:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333688576:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 243us (467us total) trans 4294969384 rc 0/0 00000100:00100000:3.0:1734016115.015124:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10814 00000100:00080000:2.0:1734016115.015891:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016085 00000100:00100000:0.0:1734016115.018331:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.018551:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333688704 00000100:00100000:1.0:1734016115.018559:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333688704 00000100:00100000:1.0:1734016115.018601:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10815 00000100:00100000:1.0:1734016115.018607:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333688704:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016115.018786:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8918733 -> 8918733 00002000:00010000:1.0:1734016115.018789:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016115 -> 1734016115 00002000:00010000:1.0:1734016115.018791:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016115 -> 1734016115 00002000:00010000:1.0:1734016115.018792:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016115 -> 1734016115 00002000:00010000:1.0:1734016115.018794:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1088 -> 1144 00000100:00100000:1.0:1734016115.018868:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333688704:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 260us (544us total) trans 4294969385 rc 0/0 00000100:00100000:1.0:1734016115.018873:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10815 00000100:00100000:0.0:1734016115.021476:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.021573:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333688832 00000100:00100000:3.0:1734016115.021582:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333688832 00000100:00100000:3.0:1734016115.021664:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10816 00000100:00100000:3.0:1734016115.021671:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333688832:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016115.021689:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016115.021704:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711556f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e581e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016115.021761:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335283200:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016115.021864:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c920c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016115.024980:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335283200:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016115.025013:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711556f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e581e expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.025024:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711556f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e581e expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.025092:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016115.025350:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333688832:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3678us (3880us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016115.025357:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10816 00000100:00100000:0.0:1734016115.028168:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.028267:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333688960 00000100:00100000:3.0:1734016115.028277:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333688960 00000100:00100000:3.0:1734016115.028327:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10817 00000100:00100000:3.0:1734016115.028332:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333688960:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016115.028348:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016115.028363:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115576 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5825 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016115.028413:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335283328:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016115.028477:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c920c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016115.030726:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335283328:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016115.030762:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115576 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5825 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.030775:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115576 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5825 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.030786:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016115.030867:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333688960:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2532us (2706us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016115.030875:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10817 00000100:00100000:0.0:1734016115.035163:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.035601:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333689216 00000100:00100000:3.0:1734016115.035610:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333689216 00000100:00100000:3.0:1734016115.035666:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8566 00000100:00100000:3.0:1734016115.035672:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333689216:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:3.0:1734016115.035702:0:7687:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711557d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.035720:0:7687:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115568 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7278592->7344127) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5817 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.035725:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016115.035727:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016115.035730:0:7687:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711557d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5341184->5349375] (req 5341184->5349375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.035756:0:7687:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115568 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7278592->7344127) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5817 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.035765:0:7687:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115568 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7278592->7344127) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5817 expref: 8 pid: 8216 timeout: 482 lvb_type: 0 00000100:00100000:3.0:1734016115.035779:0:7687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335283456:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016115.036059:0:7687:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c920c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016115.038440:0:7687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075609180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335283456:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016115.038465:0:7687:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711557d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5341184->5349375] (req 5341184->5349375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016115.038995:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.039091:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333689344 00000100:00100000:2.0:1734016115.039097:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333689344 00010000:00010000:2.0:1734016115.039122:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115568 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7278592->7344127) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5817 expref: 9 pid: 8216 timeout: 482 lvb_type: 0 00000100:00100000:2.0:1734016115.039669:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2990 00000100:00100000:2.0:1734016115.039676:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333689344:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016115.039688:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016115.039709:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115568 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7278592->7344127) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5817 expref: 9 pid: 8216 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1734016115.039719:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115568 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7278592->7344127) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5817 expref: 9 pid: 8216 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1734016115.039738:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115568 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7278592->7344127) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5817 expref: 9 pid: 8216 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1734016115.039756:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016115.039758:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016115.039762:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711557d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5341184->5349375] (req 5341184->5349375) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.039774:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711557d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5341184->5349375] (req 5341184->5349375) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.039830:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016115.039873:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333689344:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 196us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016115.039881:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2990 00010000:00010000:3.0:1734016115.040146:0:7687:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711557d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5341184->5349375] (req 5341184->5349375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.040155:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711557d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5341184->5349375] (req 5341184->5349375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016115.043628:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969386 is committed 00000001:00080000:0.0:1734016115.043648:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969385 is committed 00002000:00010000:3.0:1734016115.044173:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1144 -> 1160 00010000:00010000:3.0:1734016115.044187:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711557d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5341184->5349375] (req 5341184->5349375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.044197:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711557d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5341184->5349375] (req 5341184->5349375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.044204:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711557d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5341184->5349375] (req 5341184->5349375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.044209:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df7840 already unused, calling callback (ffffffffa080e100) 00010000:00010000:3.0:1734016115.044212:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711557d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5341184->5349375] (req 5341184->5349375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.044218:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711557d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5341184->5349375] (req 5341184->5349375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.044232:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711557d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5341184->5349375] (req 5341184->5349375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.044237:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711557d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5341184->5349375] (req 5341184->5349375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016115.044779:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333689216:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 9102us (9619us total) trans 4294969386 rc 0/0 00000100:00100000:3.0:1734016115.044788:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8566 00000100:00100000:0.0:1734016115.048264:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.048368:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333689472 00000100:00100000:3.0:1734016115.048376:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333689472 00000100:00100000:3.0:1734016115.048445:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10818 00000100:00100000:3.0:1734016115.048451:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333689472:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016115.048469:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016115.048485:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115584 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e582c expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1734016115.048502:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 8918733, mtime: 0x675afc73, atime: 0x675afc73, ctime: 0x675afc73, blocks: 0x488 00010000:00010000:3.0:1734016115.048522:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.048523:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.048528:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115584 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e582c expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.048539:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115584 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e582c expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.048547:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7840, rc 0) 00000100:00100000:3.0:1734016115.048774:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333689472:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 322us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016115.048779:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10818 00000100:00100000:0.0:1734016115.052133:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.052247:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333689728 00000100:00100000:3.0:1734016115.052255:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333689728 00002000:00100000:3.0:1734016115.052294:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2023424->2027519) req@ffff880075884000 x1818247333689728/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.052303:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075884000 with x1818247333689728 ext(2023424->2027519) 00002000:00010000:3.0:1734016115.052307:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075884000 00000100:00100000:3.0:1734016115.052375:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8567 00000100:00100000:3.0:1734016115.052381:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333689728:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016115.052642:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333689728:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 260us (515us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016115.052648:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8567 00002000:00100000:3.0:1734016115.052652:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2023424->2027519) req@ffff880075884000 x1818247333689728/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.052658:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075884000 with x1818247333689728 ext(2023424->2027519) 00002000:00010000:3.0:1734016115.052660:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075884000 00000100:00100000:1.0:1734016115.055503:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.055841:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333689984 00000100:00100000:3.0:1734016115.055851:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333689984 00002000:00100000:3.0:1734016115.055888:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2019328->2023423) req@ffff88012b133100 x1818247333689984/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.055897:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b133100 with x1818247333689984 ext(2019328->2023423) 00002000:00010000:3.0:1734016115.055902:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b133100 00000100:00100000:3.0:1734016115.056163:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8568 00000100:00100000:3.0:1734016115.056170:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333689984:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016115.056900:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333689984:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 728us (1403us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016115.056907:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8568 00002000:00100000:3.0:1734016115.056913:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2019328->2023423) req@ffff88012b133100 x1818247333689984/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.056920:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b133100 with x1818247333689984 ext(2019328->2023423) 00002000:00010000:3.0:1734016115.056925:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b133100 00000100:00100000:0.0:1734016115.060376:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.061010:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333690240 00000100:00100000:3.0:1734016115.061018:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333690240 00002000:00100000:3.0:1734016115.061056:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2015232->2019327) req@ffff880075886a00 x1818247333690240/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.061064:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075886a00 with x1818247333690240 ext(2015232->2019327) 00002000:00010000:3.0:1734016115.061069:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075886a00 00000100:00100000:3.0:1734016115.061097:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8569 00000100:00100000:3.0:1734016115.061102:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333690240:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016115.061246:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333690240:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 144us (880us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016115.061251:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8569 00002000:00100000:3.0:1734016115.061256:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2015232->2019327) req@ffff880075886a00 x1818247333690240/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.061261:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075886a00 with x1818247333690240 ext(2015232->2019327) 00002000:00010000:3.0:1734016115.061263:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075886a00 00000100:00100000:0.0:1734016115.064311:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.064473:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333690496 00000100:00100000:2.0:1734016115.064480:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333690496 00002000:00100000:2.0:1734016115.064520:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2011136->2015231) req@ffff880075886680 x1818247333690496/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.064528:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075886680 with x1818247333690496 ext(2011136->2015231) 00002000:00010000:2.0:1734016115.064532:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075886680 00000100:00100000:2.0:1734016115.064559:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8570 00000100:00100000:2.0:1734016115.064564:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333690496:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016115.064719:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333690496:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 155us (417us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016115.064724:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8570 00002000:00100000:2.0:1734016115.064728:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2011136->2015231) req@ffff880075886680 x1818247333690496/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.064733:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075886680 with x1818247333690496 ext(2011136->2015231) 00002000:00010000:2.0:1734016115.064735:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075886680 00000100:00100000:1.0:1734016115.067881:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.067995:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333690752 00000100:00100000:3.0:1734016115.068002:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333690752 00002000:00100000:3.0:1734016115.068036:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2007040->2011135) req@ffff88012b132a00 x1818247333690752/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.068043:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b132a00 with x1818247333690752 ext(2007040->2011135) 00002000:00010000:3.0:1734016115.068047:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b132a00 00000100:00100000:3.0:1734016115.068085:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8571 00000100:00100000:3.0:1734016115.068089:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333690752:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016115.068206:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333690752:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 116us (332us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016115.068213:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8571 00002000:00100000:3.0:1734016115.068217:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2007040->2011135) req@ffff88012b132a00 x1818247333690752/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.068222:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b132a00 with x1818247333690752 ext(2007040->2011135) 00002000:00010000:3.0:1734016115.068224:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b132a00 00000100:00100000:0.0:1734016115.071649:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.071853:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333691008 00000100:00100000:2.0:1734016115.071863:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333691008 00002000:00100000:2.0:1734016115.071900:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2002944->2007039) req@ffff880075887800 x1818247333691008/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.071910:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075887800 with x1818247333691008 ext(2002944->2007039) 00002000:00010000:2.0:1734016115.071914:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075887800 00000100:00100000:2.0:1734016115.071944:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8572 00000100:00100000:2.0:1734016115.071950:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333691008:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016115.072119:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333691008:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 167us (479us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016115.072126:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8572 00002000:00100000:2.0:1734016115.072132:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2002944->2007039) req@ffff880075887800 x1818247333691008/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.072139:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075887800 with x1818247333691008 ext(2002944->2007039) 00002000:00010000:2.0:1734016115.072141:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075887800 00000100:00100000:0.0:1734016115.076508:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.076633:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333691136 00000100:00100000:3.0:1734016115.076640:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333691136 00000100:00100000:3.0:1734016115.076745:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10819 00000100:00100000:3.0:1734016115.076750:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333691136:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016115.076764:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016115.076779:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711558b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5833 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.076796:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.076798:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.076824:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711558b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5833 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.076835:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711558b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5833 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.076842:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016115.076891:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333691136:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 141us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016115.076896:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10819 00000100:00100000:1.0:1734016115.084129:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.084248:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333691392 00000100:00100000:3.0:1734016115.084257:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333691392 00000100:00100000:3.0:1734016115.084307:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8573 00000100:00100000:3.0:1734016115.084313:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333691392:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:3.0:1734016115.084343:0:7687:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115592 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.084355:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.084357:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.084361:0:7687:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115592 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5185536->5218303] (req 5185536->5218303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.084370:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115592 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5185536->5218303] (req 5185536->5218303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.090196:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115592 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5185536->5218303] (req 5185536->5218303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.090209:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115592 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5185536->5218303] (req 5185536->5218303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.090216:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115592 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5185536->5218303] (req 5185536->5218303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.090222:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df7cc0 already unused, calling callback (ffffffffa080e100) 00010000:00010000:3.0:1734016115.090225:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115592 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5185536->5218303] (req 5185536->5218303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.090231:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115592 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5185536->5218303] (req 5185536->5218303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.090250:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115592 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5185536->5218303] (req 5185536->5218303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.090256:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115592 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5185536->5218303] (req 5185536->5218303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016115.091009:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333691392:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 6686us (6880us total) trans 0 rc 32768/32768 00000100:00100000:2.0:1734016115.091020:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8573 00000100:00100000:0.0:1734016115.095182:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.095327:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333691648 00000100:00100000:2.0:1734016115.095336:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333691648 00000100:00100000:2.0:1734016115.095389:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8574 00000100:00100000:2.0:1734016115.095394:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333691648:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:2.0:1734016115.095430:0:7687:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115599 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.095441:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016115.095443:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016115.095449:0:7687:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115599 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7114752->7163903] (req 7114752->7163903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.095460:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115599 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7114752->7163903] (req 7114752->7163903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.103875:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115599 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7114752->7163903] (req 7114752->7163903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.103889:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115599 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7114752->7163903] (req 7114752->7163903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.103896:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115599 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7114752->7163903] (req 7114752->7163903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.103901:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd440 already unused, calling callback (ffffffffa080e100) 00010000:00010000:2.0:1734016115.103904:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115599 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7114752->7163903] (req 7114752->7163903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.103909:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115599 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7114752->7163903] (req 7114752->7163903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.103921:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115599 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7114752->7163903] (req 7114752->7163903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.103926:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115599 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7114752->7163903] (req 7114752->7163903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016115.104035:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333691648:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 8636us (8856us total) trans 0 rc 49152/49152 00000100:00100000:2.0:1734016115.104043:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8574 00000100:00100000:2.0:1734016115.110998:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.111188:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333691776 00000100:00100000:1.0:1734016115.111197:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333691776 00000100:00100000:1.0:1734016115.111249:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10820 00000100:00100000:1.0:1734016115.111257:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333691776:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016115.111274:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016115.111292:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271155a0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e583a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.111318:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115584 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e582c expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016115.111325:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711558b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5833 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016115.111330:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016115.111332:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016115.111335:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271155a0 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [10371072->10432511] (req 10371072->10432511) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e583a expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.111368:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711558b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5833 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016115.111379:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711558b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5833 expref: 6 pid: 8216 timeout: 482 lvb_type: 1 00000100:00100000:1.0:1734016115.111391:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b131c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335283584:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016115.111955:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115584 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e582c expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016115.111963:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115584 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e582c expref: 7 pid: 8216 timeout: 482 lvb_type: 1 00000100:00100000:1.0:1734016115.111981:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b131180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335283712:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016115.112002:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016115.120156:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.120432:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b131c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335283584:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016115.120659:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333691904 00000100:00100000:2.0:1734016115.120669:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333691904 00010000:00010000:2.0:1734016115.120721:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711558b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5833 expref: 7 pid: 8216 timeout: 482 lvb_type: 1 00000100:00100000:2.0:1734016115.120771:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2991 00000100:00100000:2.0:1734016115.120780:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333691904:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016115.120798:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016115.120865:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711558b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5833 expref: 7 pid: 8216 timeout: 482 lvb_type: 1 00010000:00010000:2.0:1734016115.120878:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711558b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5833 expref: 7 pid: 8216 timeout: 482 lvb_type: 1 00010000:00010000:2.0:1734016115.120899:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711558b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5833 expref: 7 pid: 8216 timeout: 482 lvb_type: 1 00010000:00010000:2.0:1734016115.120932:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016115.121362:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333691904:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 580us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016115.121371:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2991 00000100:00100000:0.0:1734016115.124494:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.124582:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b131180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335283712:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016115.124620:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271155a0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [10371072->10432511] (req 10371072->10432511) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e583a expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.124641:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016115.124696:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333691776:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 13439us (13706us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016115.124705:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10820 00000100:00100000:2.0:1734016115.124904:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333692032 00000100:00100000:2.0:1734016115.124912:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333692032 00010000:00010000:2.0:1734016115.124937:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115584 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e582c expref: 7 pid: 8216 timeout: 482 lvb_type: 1 00000100:00100000:2.0:1734016115.124980:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2992 00000100:00100000:2.0:1734016115.124985:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333692032:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016115.125001:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016115.125021:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115584 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e582c expref: 7 pid: 8216 timeout: 482 lvb_type: 1 00010000:00010000:2.0:1734016115.125030:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115584 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e582c expref: 7 pid: 8216 timeout: 482 lvb_type: 1 00010000:00010000:2.0:1734016115.125055:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115584 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e582c expref: 7 pid: 8216 timeout: 482 lvb_type: 1 00010000:00010000:2.0:1734016115.125068:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016115.125070:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016115.125078:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271155a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10371072->10432511) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e583a expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.125087:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271155a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10371072->10432511) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e583a expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.125117:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271155a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10371072->10432511) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e583a expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016115.125129:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335283840:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016115.125163:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016115.132901:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335283840:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016115.132923:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016115.132979:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333692032:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7982us (8490us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016115.132988:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2992 00000100:00100000:0.0:1734016115.137054:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.137855:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333692160 00000100:00100000:1.0:1734016115.137867:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333692160 00000100:00100000:1.0:1734016115.137928:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10821 00000100:00100000:1.0:1734016115.137938:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333692160:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016115.138239:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8918733 -> 10429822 00002000:00010000:1.0:1734016115.138243:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016115 -> 1734016115 00002000:00010000:1.0:1734016115.138246:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016115 -> 1734016115 00002000:00010000:1.0:1734016115.138247:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016115 -> 1734016115 00002000:00010000:1.0:1734016115.138250:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1160 -> 1280 00000100:00100000:1.0:1734016115.138326:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333692160:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 388us (1280us total) trans 4294969387 rc 0/0 00000100:00100000:1.0:1734016115.138335:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10821 00000100:00100000:0.0:1734016115.142061:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.142199:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333692416 00000100:00100000:2.0:1734016115.142208:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333692416 00000100:00100000:2.0:1734016115.142488:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2176 00000100:00100000:2.0:1734016115.142494:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:9668:x1818247333692416:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016115.142537:0:7704:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016115.142559:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc2711546c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5737 expref: 24 pid: 13956 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1734016115.142642:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016085 00010000:00010000:2.0:1734016115.142734:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016115.142738:0:7704:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016115.143022:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271155a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.143032:0:7704:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115488 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e574c expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.143037:0:7704:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271155a7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.143061:0:7704:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115488 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e574c expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.143070:0:7704:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115488 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e574c expref: 21 pid: 13956 timeout: 482 lvb_type: 0 00000100:00100000:2.0:1734016115.143085:0:7704:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335283968:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016115.143145:0:7704:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016115.145301:0:7704:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335283968:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016115.145324:0:7704:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271155a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016115.145510:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.145923:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333692544 00000100:00100000:2.0:1734016115.145930:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333692544 00010000:00010000:2.0:1734016115.146510:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115488 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e574c expref: 22 pid: 13956 timeout: 482 lvb_type: 0 00000100:00100000:2.0:1734016115.146545:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2993 00000100:00100000:2.0:1734016115.146552:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+22:1982:x1818247333692544:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016115.146565:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016115.146570:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115488 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e574c expref: 22 pid: 13956 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1734016115.146579:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115488 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e574c expref: 22 pid: 13956 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1734016115.146598:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115488 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e574c expref: 22 pid: 13956 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1734016115.146625:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016115.146629:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271155a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.146641:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271155a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.146647:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271155a7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.146666:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1734016115.147512:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016085 00000100:00100000:2.0:1734016115.147814:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+21:1982:x1818247333692544:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1245us (2288us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016115.147823:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2993 00010000:00010000:2.0:1734016115.147854:0:7704:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271155a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.147860:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271155a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:2.0:1734016115.147933:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968698 00000004:00010000:2.0:1734016115.147985:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075de8e00 reply state ffff8800756fd000 transno 4294968699 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271155a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:2.0:1734016115.147991:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016115.148064:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+26:9668:x1818247333692416:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 5569us (6009us total) trans 4294968699 rc 0/0 00000100:00100000:2.0:1734016115.148071:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2176 00000020:00080000:2.0:1734016115.148075:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016115.151329:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.151479:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333692672 00000100:00100000:3.0:1734016115.151489:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333692672 00002000:00010000:3.0:1734016115.151528:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (492741->18446744073709551615) 00002000:00100000:3.0:1734016115.151532:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075deb800 with x1818247333692672 ext(492741->18446744073709551615) 00002000:00010000:3.0:1734016115.151542:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075deb800. 00000100:00100000:3.0:1734016115.151560:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8575 00000100:00100000:3.0:1734016115.151567:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333692672:12345-192.168.201.16@tcp:10:fsx.0 00010000:00010000:2.0:1734016115.155218:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271155a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.155236:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271155a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.155243:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271155a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.155250:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd200 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016115.155253:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271155a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.155259:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271155a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.155276:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016115.155278:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016115.155282:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271155a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.155286:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271155a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00002000:00010000:3.0:1734016115.158170:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10429822 -> 492741 00002000:00010000:3.0:1734016115.158178:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016115 -> 1734016115 00002000:00010000:3.0:1734016115.158180:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016115 -> 1734016115 00002000:00010000:3.0:1734016115.158182:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016115 -> 1734016115 00002000:00010000:3.0:1734016115.158184:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1280 -> 144 00000100:00100000:0.0:1734016115.162780:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.162888:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333692800 00000100:00100000:2.0:1734016115.162896:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333692800 00000100:00100000:2.0:1734016115.162927:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2177 00000100:00100000:2.0:1734016115.162932:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+25:9668:x1818247333692800:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016115.162952:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016115.162976:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271155ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5841 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.163040:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271155b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.163050:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271155b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.163057:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271155b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:2.0:1734016115.163078:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 492741 00000004:00200000:2.0:1734016115.163081:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016115.163092:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271155b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.163108:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271155ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5841 expref: 27 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.163121:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271155b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5841 expref: 26 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.163126:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016115.163129:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016115.163131:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016115.163176:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+26:9668:x1818247333692800:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 244us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016115.163182:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2177 00000100:00100000:3.0:1734016115.165075:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333692672:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 13498us (13747us total) trans 4294969388 rc 0/0 00000100:00100000:3.0:1734016115.165087:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8575 00002000:00010000:3.0:1734016115.165092:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (492741->18446744073709551615) 00002000:00100000:3.0:1734016115.165096:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075deb800 with x1818247333692672 ext(492741->18446744073709551615) 00002000:00010000:3.0:1734016115.165104:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075deb800. 00000100:00100000:0.0:1734016115.170592:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.170725:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333693056 00000100:00100000:2.0:1734016115.170735:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333693056 00000100:00100000:2.0:1734016115.170775:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2178 00000100:00100000:2.0:1734016115.170783:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+26:9668:x1818247333693056:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016115.170851:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016115.170874:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271155b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5841 expref: 26 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.171554:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016115.171558:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016115.171687:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271155bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016115.171700:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271155bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016115.171709:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271155bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:2.0:1734016115.171738:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968700 00000004:00010000:2.0:1734016115.171755:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075de9180 reply state ffff8800756ff000 transno 4294968701 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271155bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016115.171761:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016115.171866:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+28:9668:x1818247333693056:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 1083us (1284us total) trans 4294968701 rc 0/0 00000100:00100000:2.0:1734016115.171873:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2178 00000020:00080000:2.0:1734016115.171878:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1734016115.175237:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271155bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016115.175250:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271155bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016115.175255:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271155bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016115.175259:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc900 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016115.175262:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271155bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016115.175267:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271155bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016115.175278:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016115.175280:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016115.175283:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271155bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016115.175286:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271155bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016115.176148:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.176429:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333693184 00000100:00100000:3.0:1734016115.176436:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333693184 00002000:00010000:3.0:1734016115.176460:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (8089707->18446744073709551615) 00002000:00100000:3.0:1734016115.176464:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075dea680 with x1818247333693184 ext(8089707->18446744073709551615) 00002000:00010000:3.0:1734016115.176471:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075dea680. 00000100:00100000:3.0:1734016115.176741:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8576 00000100:00100000:3.0:1734016115.176746:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333693184:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016115.176907:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 492741 -> 8089707 00002000:00010000:3.0:1734016115.176910:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016115 -> 1734016115 00002000:00010000:3.0:1734016115.176912:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016115 -> 1734016115 00002000:00010000:3.0:1734016115.176914:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016115 -> 1734016115 00002000:00010000:3.0:1734016115.176915:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 144 -> 144 00000100:00100000:3.0:1734016115.177494:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333693184:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 746us (1350us total) trans 4294969389 rc 0/0 00000100:00100000:3.0:1734016115.177500:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8576 00002000:00010000:3.0:1734016115.177502:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (8089707->18446744073709551615) 00002000:00100000:3.0:1734016115.177504:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075dea680 with x1818247333693184 ext(8089707->18446744073709551615) 00002000:00010000:3.0:1734016115.177507:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075dea680. 00000100:00100000:0.0:1734016115.180880:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.181063:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333693440 00000100:00100000:3.0:1734016115.181072:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333693440 00002000:00100000:3.0:1734016115.181115:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8089600->8093695) req@ffff880075deaa00 x1818247333693440/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.181124:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075deaa00 with x1818247333693440 ext(8089600->8093695) 00002000:00010000:3.0:1734016115.181129:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075deaa00 00000100:00100000:3.0:1734016115.181149:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8577 00000100:00100000:3.0:1734016115.181156:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333693440:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016115.181333:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333693440:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 175us (461us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016115.181340:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8577 00002000:00100000:3.0:1734016115.181346:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8089600->8093695) req@ffff880075deaa00 x1818247333693440/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.181352:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075deaa00 with x1818247333693440 ext(8089600->8093695) 00002000:00010000:3.0:1734016115.181355:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075deaa00 00000100:00100000:0.0:1734016115.186284:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.186419:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333693696 00000100:00100000:2.0:1734016115.186428:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333693696 00002000:00100000:2.0:1734016115.186466:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8085504->8089599) req@ffff880075de8000 x1818247333693696/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.186475:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075de8000 with x1818247333693696 ext(8085504->8089599) 00002000:00010000:2.0:1734016115.186480:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075de8000 00000100:00100000:2.0:1734016115.186510:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8578 00000100:00100000:2.0:1734016115.186517:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333693696:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016115.186667:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333693696:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 150us (392us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016115.186673:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8578 00002000:00100000:2.0:1734016115.186678:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8085504->8089599) req@ffff880075de8000 x1818247333693696/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.186685:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075de8000 with x1818247333693696 ext(8085504->8089599) 00002000:00010000:2.0:1734016115.186687:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075de8000 00000100:00100000:0.0:1734016115.189157:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.189322:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333693952 00000100:00100000:3.0:1734016115.189330:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333693952 00002000:00100000:3.0:1734016115.189366:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8081408->8085503) req@ffff880075de9500 x1818247333693952/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.189375:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075de9500 with x1818247333693952 ext(8081408->8085503) 00002000:00010000:3.0:1734016115.189380:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075de9500 00000100:00100000:3.0:1734016115.189406:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8579 00000100:00100000:3.0:1734016115.189412:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333693952:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016115.189551:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333693952:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 138us (403us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016115.189556:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8579 00002000:00100000:3.0:1734016115.189561:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8081408->8085503) req@ffff880075de9500 x1818247333693952/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.189566:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075de9500 with x1818247333693952 ext(8081408->8085503) 00002000:00010000:3.0:1734016115.189568:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075de9500 00000100:00100000:0.0:1734016115.191911:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.192190:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333694208 00000100:00100000:2.0:1734016115.192198:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333694208 00002000:00100000:2.0:1734016115.192234:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8077312->8081407) req@ffff880075dead80 x1818247333694208/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.192242:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075dead80 with x1818247333694208 ext(8077312->8081407) 00002000:00010000:2.0:1734016115.192246:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075dead80 00000100:00100000:2.0:1734016115.192271:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8580 00000100:00100000:2.0:1734016115.192276:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333694208:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016115.192426:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333694208:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 149us (522us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016115.192432:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8580 00002000:00100000:2.0:1734016115.192437:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8077312->8081407) req@ffff880075dead80 x1818247333694208/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.192443:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075dead80 with x1818247333694208 ext(8077312->8081407) 00002000:00010000:2.0:1734016115.192445:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075dead80 00000100:00100000:0.0:1734016115.195123:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.195757:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333694464 00000100:00100000:3.0:1734016115.195766:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333694464 00002000:00100000:3.0:1734016115.195964:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8073216->8077311) req@ffff880075de9c00 x1818247333694464/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.195982:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075de9c00 with x1818247333694464 ext(8073216->8077311) 00002000:00010000:3.0:1734016115.195988:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075de9c00 00000100:00100000:3.0:1734016115.196290:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8581 00000100:00100000:3.0:1734016115.196297:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333694464:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016115.196476:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333694464:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 179us (1359us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016115.196486:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8581 00002000:00100000:3.0:1734016115.196492:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8073216->8077311) req@ffff880075de9c00 x1818247333694464/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.196499:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075de9c00 with x1818247333694464 ext(8073216->8077311) 00002000:00010000:3.0:1734016115.196501:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075de9c00 00000100:00100000:0.0:1734016115.200424:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.200541:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333694720 00000100:00100000:2.0:1734016115.200551:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333694720 00002000:00100000:2.0:1734016115.200594:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8069120->8073215) req@ffff880075debb80 x1818247333694720/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.200603:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075debb80 with x1818247333694720 ext(8069120->8073215) 00002000:00010000:2.0:1734016115.200609:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075debb80 00000100:00100000:2.0:1734016115.200719:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8582 00000100:00100000:2.0:1734016115.200725:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333694720:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016115.201391:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333694720:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 663us (976us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016115.201398:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8582 00002000:00100000:2.0:1734016115.201405:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8069120->8073215) req@ffff880075debb80 x1818247333694720/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.201412:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075debb80 with x1818247333694720 ext(8069120->8073215) 00002000:00010000:2.0:1734016115.201415:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075debb80 00000100:00100000:0.0:1734016115.205058:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.205168:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333694976 00000100:00100000:2.0:1734016115.205177:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333694976 00002000:00100000:2.0:1734016115.205218:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8065024->8069119) req@ffff880075de8a80 x1818247333694976/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.205227:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075de8a80 with x1818247333694976 ext(8065024->8069119) 00002000:00010000:2.0:1734016115.205231:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075de8a80 00000100:00100000:2.0:1734016115.205449:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8583 00000100:00100000:2.0:1734016115.205456:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333694976:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016115.205783:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333694976:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 325us (733us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016115.205790:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8583 00002000:00100000:2.0:1734016115.205795:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8065024->8069119) req@ffff880075de8a80 x1818247333694976/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.205830:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075de8a80 with x1818247333694976 ext(8065024->8069119) 00002000:00010000:2.0:1734016115.205833:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075de8a80 00000100:00100000:0.0:1734016115.209525:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.209934:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333695232 00000100:00100000:2.0:1734016115.209947:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333695232 00002000:00100000:2.0:1734016115.210018:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8060928->8065023) req@ffff880075dea300 x1818247333695232/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.210030:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075dea300 with x1818247333695232 ext(8060928->8065023) 00002000:00010000:2.0:1734016115.210036:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075dea300 00000100:00100000:2.0:1734016115.210080:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8584 00000100:00100000:2.0:1734016115.210087:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333695232:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016115.210283:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333695232:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 195us (767us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016115.210292:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8584 00002000:00100000:2.0:1734016115.210298:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8060928->8065023) req@ffff880075dea300 x1818247333695232/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.210304:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075dea300 with x1818247333695232 ext(8060928->8065023) 00002000:00010000:2.0:1734016115.210307:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075dea300 00000100:00100000:0.0:1734016115.213562:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.214440:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333695488 00000100:00100000:3.0:1734016115.214450:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333695488 00002000:00100000:3.0:1734016115.214496:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8056832->8060927) req@ffff880073b48a80 x1818247333695488/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.214508:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48a80 with x1818247333695488 ext(8056832->8060927) 00002000:00010000:3.0:1734016115.214514:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b48a80 00000100:00100000:3.0:1734016115.214588:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8585 00000100:00100000:3.0:1734016115.214596:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333695488:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016115.215404:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333695488:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 803us (1848us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016115.215414:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8585 00002000:00100000:3.0:1734016115.215421:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8056832->8060927) req@ffff880073b48a80 x1818247333695488/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.215428:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48a80 with x1818247333695488 ext(8056832->8060927) 00002000:00010000:3.0:1734016115.215433:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b48a80 00000100:00100000:0.0:1734016115.220257:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.220591:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333695744 00000100:00100000:3.0:1734016115.220600:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333695744 00002000:00100000:3.0:1734016115.220645:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8052736->8056831) req@ffff880073b48e00 x1818247333695744/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.220661:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48e00 with x1818247333695744 ext(8052736->8056831) 00002000:00010000:3.0:1734016115.220668:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b48e00 00000100:00100000:3.0:1734016115.221081:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8586 00000100:00100000:3.0:1734016115.221091:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333695744:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016115.221313:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333695744:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 220us (1061us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016115.221322:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8586 00002000:00100000:3.0:1734016115.221328:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8052736->8056831) req@ffff880073b48e00 x1818247333695744/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.221335:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48e00 with x1818247333695744 ext(8052736->8056831) 00002000:00010000:3.0:1734016115.221339:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b48e00 00000100:00100000:0.0:1734016115.225906:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.226043:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333695872 00000100:00100000:2.0:1734016115.226055:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333695872 00002000:00100000:2.0:1734016115.226100:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8052736->8089706) req@ffff880073b49c00 x1818247333695872/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.226109:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b49c00 with x1818247333695872 ext(8052736->8089706) 00002000:00010000:2.0:1734016115.226114:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b49c00 00000100:00100000:2.0:1734016115.226149:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8587 00000100:00100000:2.0:1734016115.226158:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333695872:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016115.230075:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333695872:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 3908us (4168us total) trans 4294969390 rc 0/0 00000100:00100000:0.0:1734016115.230086:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8587 00002000:00100000:0.0:1734016115.230098:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8052736->8089706) req@ffff880073b49c00 x1818247333695872/t4294969390(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/448 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016115.230105:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b49c00 with x1818247333695872 ext(8052736->8089706) 00002000:00010000:0.0:1734016115.230111:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b49c00 00000100:00100000:0.0:1734016115.232920:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.233117:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333696000 00000100:00100000:2.0:1734016115.233129:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333696000 00000100:00100000:2.0:1734016115.233349:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2179 00000100:00100000:2.0:1734016115.233358:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:9668:x1818247333696000:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:2.0:1734016115.233489:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:9668:x1818247333696000:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 132us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016115.233496:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2179 00000100:00100000:0.0:1734016115.235500:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.235683:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333696128 00000100:00100000:3.0:1734016115.235692:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333696128 00000100:00100000:3.0:1734016115.235842:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10822 00000100:00100000:3.0:1734016115.235851:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333696128:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016115.237298:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969390 is committed 00000100:00100000:3.0:1734016115.237533:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333696128:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 1679us (2052us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016115.237545:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10822 00000100:00100000:0.0:1734016115.247552:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.247691:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333696256 00000100:00100000:3.0:1734016115.247702:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333696256 00000100:00100000:2.0:1734016115.249096:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2180 00000100:00100000:2.0:1734016115.249106:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:9668:x1818247333696256:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016115.249141:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016115.249171:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271155c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5848 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.249279:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271155ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.249290:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271155ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.249298:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271155ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:2.0:1734016115.249324:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 8089707 00000004:00200000:2.0:1734016115.249327:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016115.249344:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271155ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.249366:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271155c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5848 expref: 29 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.249400:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271155ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5848 expref: 28 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.249408:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016115.249410:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016115.249412:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016115.249469:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+28:9668:x1818247333696256:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 365us (1929us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016115.249474:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2180 00000100:00100000:1.0:1734016115.258410:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.258499:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333696384 00000100:00100000:3.0:1734016115.258508:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333696384 00000100:00100000:3.0:1734016115.258546:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10823 00000100:00100000:3.0:1734016115.258552:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333696384:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016115.258754:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8089707 -> 8089707 00002000:00010000:3.0:1734016115.258756:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016115 -> 1734016115 00002000:00010000:3.0:1734016115.258758:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016115 -> 1734016115 00002000:00010000:3.0:1734016115.258760:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016115 -> 1734016115 00002000:00010000:3.0:1734016115.258761:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 144 -> 232 00000100:00100000:3.0:1734016115.258838:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333696384:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 285us (436us total) trans 4294969391 rc 0/0 00000100:00100000:3.0:1734016115.258842:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10823 00000100:00100000:0.0:1734016115.261515:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.261644:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333696512 00000100:00100000:1.0:1734016115.261652:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333696512 00000100:00100000:1.0:1734016115.261698:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10824 00000100:00100000:1.0:1734016115.261704:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333696512:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016115.261722:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016115.261736:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271155d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e584f expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016115.261791:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b131c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335284096:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016115.261895:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016115.265478:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b131c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335284096:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016115.265514:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271155d1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e584f expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016115.265526:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271155d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e584f expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016115.265566:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016115.265630:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333696512:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3925us (4122us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016115.265641:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10824 00000100:00100000:0.0:1734016115.268919:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.269164:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333696640 00000100:00100000:1.0:1734016115.269173:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333696640 00000100:00100000:1.0:1734016115.269215:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10825 00000100:00100000:1.0:1734016115.269221:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333696640:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016115.269238:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016115.269256:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271155d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5856 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.269280:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271155a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10371072->10432511) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e583a expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.269286:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016115.269287:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016115.269290:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271155d8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6471680->6475775] (req 6471680->6475775) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5856 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.269319:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271155a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10371072->10432511) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e583a expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.269330:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271155a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10371072->10432511) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e583a expref: 6 pid: 7684 timeout: 482 lvb_type: 0 00000100:00100000:1.0:1734016115.269343:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b131c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335284224:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016115.269401:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016115.273792:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b131c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335284224:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016115.273848:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271155d8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6471680->6475775] (req 6471680->6475775) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5856 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.273868:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016115.273909:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333696640:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4687us (4999us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016115.273917:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10825 00000100:00100000:0.0:1734016115.275170:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.275407:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333696768 00000100:00100000:2.0:1734016115.275417:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333696768 00010000:00010000:2.0:1734016115.275449:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271155a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10371072->10432511) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e583a expref: 7 pid: 7684 timeout: 482 lvb_type: 0 00000100:00100000:2.0:1734016115.275988:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2994 00000100:00100000:2.0:1734016115.275997:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b42c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333696768:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016115.276010:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016115.276029:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271155a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10371072->10432511) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e583a expref: 7 pid: 7684 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1734016115.276041:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271155a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10371072->10432511) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e583a expref: 7 pid: 7684 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1734016115.276061:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271155a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10371072->10432511) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e583a expref: 7 pid: 7684 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1734016115.276433:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016115.276436:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016115.276443:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271155d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5856 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.276450:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271155d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5856 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.276486:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271155d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5856 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016115.276498:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335284352:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016115.276554:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016115.286439:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335284352:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016115.286462:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016115.286519:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b42c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333696768:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 10523us (11358us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016115.286529:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2994 00000100:00100000:0.0:1734016115.297132:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.297234:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333697024 00000100:00100000:2.0:1734016115.297244:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333697024 00002000:00100000:2.0:1734016115.297280:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->6475775) req@ffff880073b49880 x1818247333697024/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 504/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.297289:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b49880 with x1818247333697024 ext(0->6475775) 00002000:00010000:2.0:1734016115.297294:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b49880 00000100:00100000:2.0:1734016115.297326:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8588 00000100:00100000:2.0:1734016115.297332:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333697024:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016115.302085:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.302151:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333697280 00000100:00100000:3.0:1734016115.302162:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333697280 00002000:00100000:3.0:1734016115.302196:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8093695) req@ffff880073b4b800 x1818247333697280/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 504/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.302204:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b4b800 with x1818247333697280 ext(4190208->8093695) 00002000:00010000:3.0:1734016115.302209:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b4b800 00000100:00100000:3.0:1734016115.302225:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8589 00000100:00100000:3.0:1734016115.302231:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333697280:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016115.363497:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333697280:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 61254us (61408us total) trans 0 rc 3899392/3899392 00000100:00100000:3.0:1734016115.363511:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8589 00002000:00100000:3.0:1734016115.363526:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8093695) req@ffff880073b4b800 x1818247333697280/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 504/440 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 3899392/3899392 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.363535:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b4b800 with x1818247333697280 ext(4190208->8093695) 00002000:00010000:3.0:1734016115.363541:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b4b800 00000100:00100000:0.0:1734016115.394072:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333697024:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 96726us (96934us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1734016115.394087:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8588 00002000:00100000:0.0:1734016115.394103:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->6475775) req@ffff880073b49880 x1818247333697024/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 504/440 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016115.394112:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b49880 with x1818247333697024 ext(0->6475775) 00002000:00010000:0.0:1734016115.394118:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b49880 00000100:00100000:1.0:1734016115.403580:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.403661:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333697408 00000100:00100000:0.0:1734016115.403670:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333697408 00002000:00100000:0.0:1734016115.403709:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6459392->6475775) req@ffff88012b131c00 x1818247333697408/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 16872/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016115.403718:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b131c00 with x1818247333697408 ext(6459392->6475775) 00002000:00010000:0.0:1734016115.403724:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b131c00 00000100:00100000:0.0:1734016115.403757:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8590 00000100:00100000:0.0:1734016115.403762:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333697408:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016115.404775:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333697408:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1008us (1201us total) trans 4294969392 rc 0/0 00000100:00100000:1.0:1734016115.404784:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8590 00002000:00100000:1.0:1734016115.404790:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (6459392->6475775) req@ffff88012b131c00 x1818247333697408/t4294969392(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 16872/448 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016115.404797:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b131c00 with x1818247333697408 ext(6459392->6475775) 00002000:00010000:1.0:1734016115.404820:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b131c00 00000100:00100000:0.0:1734016115.409222:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.409908:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333697536 00000100:00100000:1.0:1734016115.409916:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333697536 00000100:00100000:1.0:1734016115.409977:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10826 00000100:00100000:1.0:1734016115.409983:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333697536:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016115.411506:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969392 is committed 00000001:00080000:2.0:1734016115.411519:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969391 is committed 00000100:00100000:1.0:1734016115.412620:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333697536:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2631us (3403us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016115.412630:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10826 00000100:00100000:2.0:1734016115.422292:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.423587:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333697664 00000100:00100000:1.0:1734016115.423599:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333697664 00000100:00100000:1.0:1734016115.423666:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10827 00000100:00100000:1.0:1734016115.423673:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333697664:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016115.423694:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016115.423712:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271155df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e585d expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016115.423767:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335284480:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016115.423882:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00002000:00010000:1.0:1734016115.432588:0:7684:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime: 1734016115 -> 1734016116 00002000:00010000:1.0:1734016115.432601:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016115 -> 1734016116 00002000:00010000:1.0:1734016115.432604:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 232 -> 264 00000100:00100000:1.0:1734016115.432635:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335284480:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016115.432675:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271155df lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e585d expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016115.432693:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271155df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e585d expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016115.432726:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016115.432784:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333697664:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9109us (10503us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016115.432793:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10827 00000100:00100000:0.0:1734016115.438935:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.439066:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333697792 00000100:00100000:1.0:1734016115.439077:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333697792 00000100:00100000:1.0:1734016115.439348:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10828 00000100:00100000:1.0:1734016115.439357:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333697792:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016115.439382:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016115.439407:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc271155e6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5864 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016115.439477:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335284608:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016115.439567:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016115.453467:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335284608:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016115.453500:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc271155e6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5864 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016115.453512:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc271155e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5864 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016115.453537:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016115.453578:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333697792:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 14221us (14651us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016115.453585:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10828 00000100:00100000:2.0:1734016115.457230:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.457316:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333697920 00000100:00100000:1.0:1734016115.457326:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333697920 00000100:00100000:1.0:1734016115.457379:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10829 00000100:00100000:1.0:1734016115.457385:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333697920:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016115.457404:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016115.457424:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271155ed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e586b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.457453:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271155d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5856 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.457464:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016115.457466:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016115.457470:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271155ed lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5373952->5410815] (req 5373952->5410815) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e586b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.457496:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271155d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5856 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.457506:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271155d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5856 expref: 6 pid: 7684 timeout: 482 lvb_type: 0 00000100:00100000:1.0:1734016115.457519:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335284736:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016115.457586:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016115.460710:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335284736:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016115.460752:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271155ed lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5373952->5410815] (req 5373952->5410815) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e586b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.460770:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499eac0, rc 0) 00000100:00100000:1.0:1734016115.460855:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333697920:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3469us (3632us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016115.460863:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10829 00000100:00100000:2.0:1734016115.472313:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.472443:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333698048 00000100:00100000:0.0:1734016115.472451:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333698048 00010000:00010000:0.0:1734016115.472479:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271155d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5856 expref: 7 pid: 7684 timeout: 482 lvb_type: 0 00000100:00100000:0.0:1734016115.472518:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2995 00000100:00100000:0.0:1734016115.472525:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333698048:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016115.472537:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016115.472555:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271155d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5856 expref: 7 pid: 7684 timeout: 482 lvb_type: 0 00010000:00010000:0.0:1734016115.472565:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271155d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5856 expref: 7 pid: 7684 timeout: 482 lvb_type: 0 00010000:00010000:0.0:1734016115.472583:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271155d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6471680->6475775) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5856 expref: 7 pid: 7684 timeout: 482 lvb_type: 0 00010000:00010000:0.0:1734016115.472610:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016115.472613:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016115.472619:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271155ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5373952->5410815) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e586b expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.472626:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271155ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5373952->5410815) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e586b expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.472659:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271155ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5373952->5410815) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e586b expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016115.472672:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335284864:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016115.472735:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016115.479465:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.480104:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b4a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335284864:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016115.480128:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016115.480190:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333698048:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7664us (7885us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016115.480200:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2995 00000100:00100000:1.0:1734016115.481359:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333698176 00000100:00100000:1.0:1734016115.481368:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333698176 00000100:00100000:3.0:1734016115.482463:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10830 00000100:00100000:3.0:1734016115.482473:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333698176:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016115.483680:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8089707 -> 8089707 00002000:00010000:3.0:1734016115.483687:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016116 -> 1734016116 00002000:00010000:3.0:1734016115.483689:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016115 -> 1734016115 00002000:00010000:3.0:1734016115.483691:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016116 -> 1734016116 00002000:00010000:3.0:1734016115.483693:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 264 -> 264 00000100:00100000:3.0:1734016115.485754:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333698176:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 3270us (6287us total) trans 4294969393 rc 0/0 00000100:00100000:3.0:1734016115.485769:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10830 00000100:00100000:3.0:1734016115.490986:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.491642:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333698304 00000100:00100000:0.0:1734016115.491650:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333698304 00000100:00100000:0.0:1734016115.491748:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2181 00000100:00100000:0.0:1734016115.491756:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+21:9668:x1818247333698304:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016115.491775:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016115.491793:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc271155f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5872 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.491895:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc271155fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.491908:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc271155fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.491919:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc271155fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016115.491944:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 8089707 00000004:00200000:0.0:1734016115.491948:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016115.491973:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc271155fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.491995:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc271155f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5872 expref: 23 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.492602:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc271155fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5872 expref: 22 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.492610:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016115.492613:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016115.492615:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:0.0:1734016115.492698:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+22:9668:x1818247333698304:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 942us (1720us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016115.492705:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2181 00000100:00100000:0.0:1734016115.496626:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.497102:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333698432 00000100:00100000:3.0:1734016115.497110:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333698432 00000100:00100000:3.0:1734016115.497578:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10831 00000100:00100000:3.0:1734016115.497586:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333698432:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016115.497607:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016115.497628:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115602 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5879 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016115.497685:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335284992:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016115.497762:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016115.500055:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335284992:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016115.500092:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115602 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5879 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.500105:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115602 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5879 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.500768:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016115.500859:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333698432:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3271us (4242us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016115.500868:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10831 00000100:00100000:2.0:1734016115.504474:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.504654:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333698560 00000100:00100000:3.0:1734016115.504664:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333698560 00000100:00100000:1.0:1734016115.505019:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10832 00000100:00100000:1.0:1734016115.505026:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333698560:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016115.505044:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016115.505060:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27115609 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5880 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016115.505117:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335285120:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016115.505178:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:2.0:1734016115.508224:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335285120:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016115.508265:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27115609 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5880 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016115.508278:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27115609 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5880 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016115.508292:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:2.0:1734016115.509410:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333698560:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4377us (4938us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016115.509421:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10832 00000100:00100000:2.0:1734016115.513256:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.513369:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333698688 00000100:00100000:0.0:1734016115.513380:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333698688 00000100:00100000:0.0:1734016115.513476:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10833 00000100:00100000:0.0:1734016115.513487:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333698688:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016115.513743:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8089707 -> 8089707 00002000:00010000:0.0:1734016115.513746:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016116 -> 1734016116 00002000:00010000:0.0:1734016115.513748:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016115 -> 1734016115 00002000:00010000:0.0:1734016115.513750:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016116 -> 1734016116 00002000:00010000:0.0:1734016115.513752:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 264 -> 264 00000100:00100000:0.0:1734016115.514342:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333698688:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 853us (1098us total) trans 4294969394 rc 0/0 00000100:00100000:0.0:1734016115.514351:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10833 00000100:00100000:3.0:1734016115.518091:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.518163:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333698816 00000100:00100000:0.0:1734016115.518174:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333698816 00000100:00100000:0.0:1734016115.518236:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10834 00000100:00100000:0.0:1734016115.518245:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333698816:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016115.518269:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016115.518287:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115610 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5887 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016115.518344:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335285248:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016115.518429:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016115.522086:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335285248:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016115.522121:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115610 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5887 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016115.522133:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115610 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5887 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016115.522233:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:0.0:1734016115.522398:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333698816:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4154us (4323us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016115.522407:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10834 00010000:00010000:2.0:1734016115.525215:0:8958:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1734016115.526514:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.526690:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333698944 00000100:00100000:0.0:1734016115.526700:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333698944 00000100:00100000:0.0:1734016115.526917:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10835 00000100:00100000:0.0:1734016115.526928:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333698944:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016115.526952:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016115.526981:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27115617 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e588e expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016115.527039:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335285376:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016115.527115:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016115.531513:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335285376:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016115.531564:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27115617 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e588e expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016115.531579:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27115617 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e588e expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016115.531730:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582f40, rc 0) 00000100:00100000:0.0:1734016115.531815:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333698944:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4887us (5311us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016115.531826:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10835 00000100:00100000:0.0:1734016115.536536:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.536601:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333699200 00000100:00100000:0.0:1734016115.536613:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333699200 00000100:00100000:0.0:1734016115.536700:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8591 00000100:00100000:0.0:1734016115.536707:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333699200:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:0.0:1734016115.536747:0:13914:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711561e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.536768:0:13914:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271155ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5373952->5410815) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e586b expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.536775:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016115.536778:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016115.536783:0:13914:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711561e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5451776->5459967] (req 5451776->5459967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.536841:0:13914:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271155ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5373952->5410815) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e586b expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.536853:0:13914:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271155ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5373952->5410815) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e586b expref: 8 pid: 7684 timeout: 482 lvb_type: 0 00000100:00100000:0.0:1734016115.537770:0:13914:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335285504:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016115.537898:0:13914:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016115.540320:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.540414:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333699328 00000100:00100000:1.0:1734016115.540424:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333699328 00010000:00010000:1.0:1734016115.540458:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271155ed lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5373952->5410815) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e586b expref: 9 pid: 7684 timeout: 482 lvb_type: 0 00000100:00100000:1.0:1734016115.540497:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2996 00000100:00100000:1.0:1734016115.540504:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333699328:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016115.540518:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016115.540538:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271155ed lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5373952->5410815) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e586b expref: 9 pid: 7684 timeout: 482 lvb_type: 0 00010000:00010000:1.0:1734016115.540551:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271155ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5373952->5410815) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e586b expref: 9 pid: 7684 timeout: 482 lvb_type: 0 00010000:00010000:1.0:1734016115.540573:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016115.540575:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016115.540579:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711561e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5451776->5459967] (req 5451776->5459967) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.540588:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711561e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [5451776->5459967] (req 5451776->5459967) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.540612:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016115.540658:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333699328:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 154us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016115.540665:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2996 00010000:00010000:0.0:1734016115.540777:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271155ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5373952->5410815) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e586b expref: 8 pid: 7684 timeout: 482 lvb_type: 0 00000100:00100000:0.0:1734016115.540791:0:13914:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335285504:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016115.540842:0:13914:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711561e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5451776->5459967] (req 5451776->5459967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.540850:0:13914:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711561e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5451776->5459967] (req 5451776->5459967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.540856:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711561e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5451776->5459967] (req 5451776->5459967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1734016115.544217:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969395 is committed 00002000:00010000:0.0:1734016115.544332:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 264 -> 280 00010000:00010000:0.0:1734016115.544348:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711561e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5451776->5459967] (req 5451776->5459967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.544361:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711561e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5451776->5459967] (req 5451776->5459967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.544369:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711561e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5451776->5459967] (req 5451776->5459967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.544376:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7582d00 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016115.544381:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711561e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5451776->5459967] (req 5451776->5459967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.544389:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711561e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5451776->5459967] (req 5451776->5459967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.544405:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711561e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5451776->5459967] (req 5451776->5459967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.544410:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc2711561e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5451776->5459967] (req 5451776->5459967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016115.556695:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333699200:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 19977us (20163us total) trans 4294969395 rc 0/0 00000100:00100000:0.0:1734016115.556710:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8591 00000100:00100000:3.0:1734016115.560162:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.560226:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333699456 00000100:00100000:0.0:1734016115.560235:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333699456 00000100:00100000:0.0:1734016115.560480:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10836 00000100:00100000:0.0:1734016115.560487:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333699456:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016115.560508:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016115.560527:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115625 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5895 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016115.560549:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 8089707, mtime: 0x675afc74, atime: 0x675afc73, ctime: 0x675afc74, blocks: 0x118 00010000:00010000:0.0:1734016115.560571:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016115.560574:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016115.560584:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115625 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5895 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016115.560604:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115625 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5895 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016115.560613:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581d40, rc 0) 00000100:00100000:0.0:1734016115.561018:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333699456:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 530us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016115.561025:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10836 00000100:00100000:2.0:1734016115.567084:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.567310:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333699584 00000100:00100000:0.0:1734016115.567321:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333699584 00000100:00100000:0.0:1734016115.567548:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10837 00000100:00100000:0.0:1734016115.567555:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333699584:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016115.567572:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016115.567589:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711562c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e589c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.567611:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016115.567614:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016115.567621:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711562c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e589c expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016115.567633:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711562c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e589c expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016115.567644:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580900, rc 0) 00000100:00100000:0.0:1734016115.567701:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333699584:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 145us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016115.567711:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10837 00000100:00100000:2.0:1734016115.572099:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.572641:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333699712 00000100:00100000:3.0:1734016115.572650:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333699712 00000100:00100000:3.0:1734016115.572702:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10838 00000100:00100000:3.0:1734016115.572709:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333699712:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016115.572725:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016115.572740:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115633 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e58a3 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.572767:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115625 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5895 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.572775:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711562c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e589c expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.572780:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.572781:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.572784:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115633 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7495680->7499775] (req 7495680->7499775) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58a3 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.572836:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711562c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e589c expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.572846:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711562c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e589c expref: 7 pid: 7684 timeout: 482 lvb_type: 1 00000100:00100000:3.0:1734016115.572858:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075608a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335285632:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016115.573481:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115625 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5895 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.573490:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115625 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5895 expref: 6 pid: 7684 timeout: 482 lvb_type: 1 00000100:00100000:3.0:1734016115.573496:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335285760:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016115.573515:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016115.576527:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075608a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335285632:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016115.576540:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335285760:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016115.576568:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115633 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7495680->7499775] (req 7495680->7499775) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58a3 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.576585:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016115.576637:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333699712:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3927us (4546us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016115.576647:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10838 00000100:00100000:2.0:1734016115.578354:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.578396:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.579057:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333699968 00000100:00100000:3.0:1734016115.579066:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333699968 00010000:00010000:3.0:1734016115.579099:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115625 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5895 expref: 7 pid: 7684 timeout: 482 lvb_type: 1 00000100:00100000:3.0:1734016115.579135:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333699840 00000100:00100000:3.0:1734016115.579137:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333699840 00010000:00010000:3.0:1734016115.579146:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711562c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e589c expref: 7 pid: 7684 timeout: 482 lvb_type: 1 00000100:00100000:3.0:1734016115.579161:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2997 00000100:00100000:3.0:1734016115.579168:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333699968:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016115.579183:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016115.579204:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115625 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5895 expref: 7 pid: 7684 timeout: 482 lvb_type: 1 00010000:00010000:3.0:1734016115.579214:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115625 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5895 expref: 7 pid: 7684 timeout: 482 lvb_type: 1 00010000:00010000:3.0:1734016115.579238:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115625 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5895 expref: 7 pid: 7684 timeout: 482 lvb_type: 1 00010000:00010000:3.0:1734016115.579267:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016115.579311:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333699968:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 142us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016115.579319:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2997 00000100:00100000:3.0:1734016115.579333:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2998 00000100:00100000:3.0:1734016115.579336:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333699840:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016115.579342:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016115.579347:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711562c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e589c expref: 7 pid: 7684 timeout: 482 lvb_type: 1 00010000:00010000:3.0:1734016115.579355:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711562c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e589c expref: 7 pid: 7684 timeout: 482 lvb_type: 1 00010000:00010000:3.0:1734016115.579366:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711562c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e589c expref: 7 pid: 7684 timeout: 482 lvb_type: 1 00010000:00010000:3.0:1734016115.579374:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.579376:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.579384:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115633 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7495680->7499775) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58a3 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.579391:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115633 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7495680->7499775) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58a3 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.579418:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115633 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7495680->7499775) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58a3 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016115.579430:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335285888:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016115.579461:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016115.584146:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335285888:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016115.584171:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016115.584235:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333699840:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4895us (5836us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016115.584246:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2998 00000100:00100000:2.0:1734016115.586709:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.587521:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333700224 00000100:00100000:1.0:1734016115.587533:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333700224 00002000:00100000:1.0:1734016115.587577:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7495680->7499775) req@ffff88012db08000 x1818247333700224/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016115.587586:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db08000 with x1818247333700224 ext(7495680->7499775) 00002000:00010000:1.0:1734016115.587591:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db08000 00000100:00100000:1.0:1734016115.587784:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8592 00000100:00100000:1.0:1734016115.587790:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333700224:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016115.588024:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333700224:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 232us (1325us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016115.588029:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8592 00002000:00100000:1.0:1734016115.588034:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7495680->7499775) req@ffff88012db08000 x1818247333700224/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016115.588040:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db08000 with x1818247333700224 ext(7495680->7499775) 00002000:00010000:1.0:1734016115.588042:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db08000 00000100:00100000:2.0:1734016115.591999:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.592224:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333700480 00000100:00100000:1.0:1734016115.592239:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333700480 00002000:00100000:1.0:1734016115.592296:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7491584->7495679) req@ffff88012db0b800 x1818247333700480/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016115.592307:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db0b800 with x1818247333700480 ext(7491584->7495679) 00002000:00010000:1.0:1734016115.592314:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db0b800 00000100:00100000:1.0:1734016115.593370:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8593 00000100:00100000:1.0:1734016115.593387:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333700480:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016115.593686:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333700480:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 302us (1699us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016115.593694:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8593 00002000:00100000:1.0:1734016115.593705:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7491584->7495679) req@ffff88012db0b800 x1818247333700480/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016115.593716:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db0b800 with x1818247333700480 ext(7491584->7495679) 00002000:00010000:1.0:1734016115.593722:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db0b800 00000100:00100000:2.0:1734016115.597402:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.598132:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333700736 00000100:00100000:3.0:1734016115.598145:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333700736 00002000:00100000:3.0:1734016115.598195:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7487488->7491583) req@ffff88012db09f80 x1818247333700736/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.598205:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db09f80 with x1818247333700736 ext(7487488->7491583) 00002000:00010000:3.0:1734016115.598210:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db09f80 00000100:00100000:3.0:1734016115.598386:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8594 00000100:00100000:3.0:1734016115.598393:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333700736:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016115.601040:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333700736:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 2632us (3633us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016115.601057:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8594 00002000:00100000:3.0:1734016115.601073:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7487488->7491583) req@ffff88012db09f80 x1818247333700736/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.601086:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db09f80 with x1818247333700736 ext(7487488->7491583) 00002000:00010000:3.0:1734016115.601092:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db09f80 00000100:00100000:2.0:1734016115.606309:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.606681:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333700864 00000100:00100000:3.0:1734016115.606691:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333700864 00002000:00100000:3.0:1734016115.606741:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7487488->7499775) req@ffff88012db08700 x1818247333700864/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 12776/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016115.606750:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db08700 with x1818247333700864 ext(7487488->7499775) 00002000:00010000:3.0:1734016115.606756:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db08700 00000100:00100000:3.0:1734016115.606789:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8595 00000100:00100000:3.0:1734016115.606796:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333700864:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016115.608290:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333700864:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1490us (1985us total) trans 4294969396 rc 0/0 00000100:00100000:0.0:1734016115.608300:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8595 00002000:00100000:0.0:1734016115.608308:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7487488->7499775) req@ffff88012db08700 x1818247333700864/t4294969396(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:76/0 lens 12776/448 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016115.608318:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db08700 with x1818247333700864 ext(7487488->7499775) 00002000:00010000:0.0:1734016115.608322:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db08700 00000100:00100000:2.0:1734016115.610925:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.611084:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333700992 00000100:00100000:3.0:1734016115.611098:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333700992 00000100:00100000:3.0:1734016115.611713:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10839 00000100:00100000:3.0:1734016115.611725:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333700992:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016115.613640:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969396 is committed 00000100:00100000:3.0:1734016115.614152:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333700992:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2418us (3233us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016115.614164:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10839 00000100:00100000:2.0:1734016115.617785:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.618042:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333701120 00000100:00100000:3.0:1734016115.618054:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333701120 00000100:00100000:3.0:1734016115.618143:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10840 00000100:00100000:3.0:1734016115.618151:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333701120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016115.618176:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016115.618199:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc2711563a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e58aa expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016115.618267:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335286016:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016115.618349:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92840 going to sleep for 11 seconds 00002000:00010000:3.0:1734016115.621228:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016115 -> 1734016116 00002000:00010000:3.0:1734016115.621236:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 280 -> 304 00000100:00100000:3.0:1734016115.621257:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335286016:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016115.621291:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc2711563a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58aa expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.621309:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc2711563a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58aa expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.621542:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4480, rc 0) 00000100:00100000:3.0:1734016115.621605:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333701120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3453us (3834us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016115.621615:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10840 00000100:00100000:2.0:1734016115.625264:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.625504:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333701248 00000100:00100000:3.0:1734016115.625515:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333701248 00000100:00100000:3.0:1734016115.625599:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10841 00000100:00100000:3.0:1734016115.625608:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88009024b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333701248:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016115.625633:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016115.625654:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115641 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e58b1 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016115.625725:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335286144:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016115.625823:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016115.629321:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335286144:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016115.629356:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115641 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58b1 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.629369:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115641 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58b1 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.629399:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016115.629455:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88009024b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333701248:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3846us (4205us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016115.629463:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10841 00000100:00100000:3.0:1734016115.634756:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.634826:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333701376 00000100:00100000:0.0:1734016115.634835:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333701376 00000100:00100000:0.0:1734016115.634881:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10842 00000100:00100000:0.0:1734016115.634887:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333701376:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016115.635100:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8089707 -> 8089707 00002000:00010000:0.0:1734016115.635103:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016116 -> 1734016116 00002000:00010000:0.0:1734016115.635105:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016116 -> 1734016115 00002000:00010000:0.0:1734016115.635107:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016116 -> 1734016115 00002000:00010000:0.0:1734016115.635109:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 304 -> 320 00000100:00100000:0.0:1734016115.635164:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333701376:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 276us (415us total) trans 4294969397 rc 0/0 00000100:00100000:0.0:1734016115.635171:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10842 00000100:00100000:2.0:1734016115.638484:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.639545:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333701504 00000100:00100000:0.0:1734016115.639556:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333701504 00000100:00100000:0.0:1734016115.639603:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10843 00000100:00100000:0.0:1734016115.639609:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333701504:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016115.639628:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016115.639644:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115648 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e58b8 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016115.639696:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335286272:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016115.639769:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00002000:00010000:0.0:1734016115.644048:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016115 -> 1734016116 00002000:00010000:0.0:1734016115.644057:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016115 -> 1734016116 00000100:00100000:0.0:1734016115.644085:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335286272:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016115.644133:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115648 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58b8 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016115.644150:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115648 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58b8 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016115.644180:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580900, rc 0) 00000100:00100000:0.0:1734016115.644241:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333701504:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4629us (5765us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016115.644250:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10843 00000100:00100000:3.0:1734016115.647532:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.647598:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333701632 00000100:00100000:0.0:1734016115.647607:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333701632 00000100:00100000:0.0:1734016115.647658:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10844 00000100:00100000:0.0:1734016115.647666:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333701632:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016115.647685:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016115.647700:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc2711564f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e58bf expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016115.647763:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335286400:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016115.647875:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016115.651039:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335286400:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016115.651090:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc2711564f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58bf expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016115.651106:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc2711564f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58bf expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016115.651945:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581d40, rc 0) 00000100:00100000:0.0:1734016115.652045:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333701632:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4373us (4515us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016115.652056:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10844 00000100:00100000:3.0:1734016115.655381:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.655473:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333701760 00000100:00100000:0.0:1734016115.655487:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333701760 00000100:00100000:0.0:1734016115.655593:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10845 00000100:00100000:0.0:1734016115.655604:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333701760:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016115.655633:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016115.655663:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115656 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e58c6 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016115.655750:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335286528:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016115.656677:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016115.660277:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335286528:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016115.660315:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115656 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58c6 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016115.660333:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115656 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58c6 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016115.660359:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580900, rc 0) 00000100:00100000:1.0:1734016115.660410:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333701760:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4807us (5043us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016115.660420:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10845 00000100:00100000:3.0:1734016115.669664:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.670045:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333701888 00000100:00100000:1.0:1734016115.670059:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333701888 00000100:00100000:1.0:1734016115.670136:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10846 00000100:00100000:1.0:1734016115.670145:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333701888:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016115.670174:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016115.670197:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711565d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e58cd expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016115.670287:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b132300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335286656:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016115.670376:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016115.673157:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b132300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335286656:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016115.673208:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711565d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58cd expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016115.673224:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711565d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58cd expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016115.673236:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016115.673309:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333701888:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3161us (3658us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016115.673320:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10846 00000100:00100000:1.0:1734016115.678038:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.678116:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333702144 00000100:00100000:0.0:1734016115.678126:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333702144 00000100:00100000:0.0:1734016115.678684:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2182 00000100:00100000:0.0:1734016115.678691:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+22:9668:x1818247333702144:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016115.678738:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016115.678763:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc271155fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5872 expref: 22 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.678821:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016115.678826:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016115.679466:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115664 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.679482:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271155ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5848 expref: 27 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.679487:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115664 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.679519:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271155ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5848 expref: 27 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.679530:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271155ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5848 expref: 27 pid: 7704 timeout: 482 lvb_type: 0 00000100:00100000:0.0:1734016115.679542:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335286784:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016115.679609:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eed80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016115.682373:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b4b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335286784:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016115.682397:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115664 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016115.684150:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.684551:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333702272 00000100:00100000:3.0:1734016115.684557:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333702272 00010000:00010000:3.0:1734016115.684583:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271155ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5848 expref: 28 pid: 7704 timeout: 482 lvb_type: 0 00000100:00100000:3.0:1734016115.684613:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2999 00000100:00100000:3.0:1734016115.684618:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b130700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+28:1981:x1818247333702272:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016115.684628:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016115.684632:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271155ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5848 expref: 28 pid: 7704 timeout: 482 lvb_type: 0 00010000:00010000:3.0:1734016115.684641:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271155ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5848 expref: 28 pid: 7704 timeout: 482 lvb_type: 0 00010000:00010000:3.0:1734016115.684658:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271155ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5848 expref: 28 pid: 7704 timeout: 482 lvb_type: 0 00010000:00010000:3.0:1734016115.684678:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016115.684683:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115664 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016115.684690:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115664 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016115.684696:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115664 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016115.684711:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016115.684752:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b130700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:1981:x1818247333702272:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 134us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016115.684758:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2999 00010000:00010000:0.0:1734016115.684831:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115664 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.684838:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115664 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:0.0:1734016115.684909:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968702 00000004:00010000:0.0:1734016115.684945:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012b132300 reply state ffff8800759b7000 transno 4294968703 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115664 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016115.684952:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016115.685018:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+24:9668:x1818247333702144:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 6327us (6991us total) trans 4294968703 rc 0/0 00000100:00100000:0.0:1734016115.685025:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2182 00000020:00080000:0.0:1734016115.685028:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1734016115.689155:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.689255:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333702400 00000100:00100000:1.0:1734016115.689266:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333702400 00000100:00100000:1.0:1734016115.689327:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10847 00000100:00100000:1.0:1734016115.689335:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333702400:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016115.689363:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016115.689390:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711566b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e58d4 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.689423:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115633 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7495680->7499775) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58a3 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.689430:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016115.689432:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016115.689437:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711566b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58d4 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.689474:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115633 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7495680->7499775) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58a3 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.689486:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115633 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7495680->7499775) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58a3 expref: 6 pid: 8216 timeout: 482 lvb_type: 0 00000100:00100000:1.0:1734016115.689501:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335286912:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016115.692362:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1734016115.694307:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115664 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.694321:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115664 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.694328:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115664 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.694334:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7580900 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016115.694339:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115664 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.694344:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115664 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.694361:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016115.694365:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016115.694368:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115664 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.694373:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115664 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016115.695935:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335286912:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016115.695973:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711566b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58d4 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.695991:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016115.697024:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333702400:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7682us (7878us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016115.697038:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10847 00000100:00100000:0.0:1734016115.697447:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.698027:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333702528 00000100:00100000:1.0:1734016115.698036:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333702528 00010000:00010000:1.0:1734016115.698063:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115633 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7495680->7499775) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58a3 expref: 7 pid: 8216 timeout: 482 lvb_type: 0 00000100:00100000:1.0:1734016115.698452:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3000 00000100:00100000:1.0:1734016115.698459:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333702528:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016115.698472:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016115.698493:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115633 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7495680->7499775) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58a3 expref: 7 pid: 8216 timeout: 482 lvb_type: 0 00010000:00010000:1.0:1734016115.698504:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115633 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7495680->7499775) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58a3 expref: 7 pid: 8216 timeout: 482 lvb_type: 0 00010000:00010000:1.0:1734016115.698525:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115633 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7495680->7499775) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58a3 expref: 7 pid: 8216 timeout: 482 lvb_type: 0 00010000:00010000:1.0:1734016115.698559:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016115.698561:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016115.698567:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711566b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58d4 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.698576:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711566b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58d4 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016115.698610:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711566b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58d4 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016115.698631:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b130a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335287040:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016115.700103:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016115.704116:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.704226:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b130a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335287040:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016115.704254:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016115.704406:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333702656 00000100:00100000:2.0:1734016115.704413:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333702656 00002000:00010000:2.0:1734016115.704452:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (9574109->18446744073709551615) 00002000:00100000:2.0:1734016115.704456:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b4bb80 with x1818247333702656 ext(9574109->18446744073709551615) 00002000:00010000:2.0:1734016115.704467:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b4bb80. 00000100:00100000:2.0:1734016115.704497:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8596 00000100:00100000:2.0:1734016115.704504:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333702656:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016115.704761:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8089707 -> 9574109 00002000:00010000:2.0:1734016115.704764:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016116 -> 1734016116 00002000:00010000:2.0:1734016115.704766:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016116 -> 1734016115 00002000:00010000:2.0:1734016115.704767:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016116 -> 1734016116 00002000:00010000:2.0:1734016115.704770:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 320 -> 320 00000100:00100000:1.0:1734016115.704836:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333702528:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6376us (7388us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016115.704844:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3000 00000100:00100000:2.0:1734016115.705649:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333702656:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1143us (1544us total) trans 4294969398 rc 0/0 00000100:00100000:2.0:1734016115.705657:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8596 00002000:00010000:2.0:1734016115.705660:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (9574109->18446744073709551615) 00002000:00100000:2.0:1734016115.705662:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b4bb80 with x1818247333702656 ext(9574109->18446744073709551615) 00002000:00010000:2.0:1734016115.705669:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b4bb80. 00000100:00100000:1.0:1734016115.709174:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.709263:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333702784 00000100:00100000:2.0:1734016115.709272:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333702784 00000100:00100000:2.0:1734016115.709767:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2183 00000100:00100000:2.0:1734016115.709774:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:9668:x1818247333702784:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016115.709791:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016115.709838:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115672 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e58db expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.709921:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115679 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016115.709932:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016115.709941:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:2.0:1734016115.709973:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 9574109 00000004:00200000:2.0:1734016115.709977:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016115.709990:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016115.710012:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115672 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58db expref: 29 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.710024:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115679 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58db expref: 28 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.710031:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016115.710034:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016115.710037:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd680, rc 0) 00000100:00100000:2.0:1734016115.710091:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+28:9668:x1818247333702784:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 316us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016115.710099:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2183 00000100:00100000:0.0:1734016115.713540:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.714168:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333702912 00000100:00100000:1.0:1734016115.714176:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333702912 00000100:00100000:1.0:1734016115.714508:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10848 00000100:00100000:1.0:1734016115.714516:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333702912:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016115.714536:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016115.714557:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27115680 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e58e2 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016115.714620:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b131180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335287168:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016115.715293:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00002000:00010000:2.0:1734016115.718731:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016115 -> 1734016116 00000100:00100000:2.0:1734016115.718755:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b131180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335287168:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016115.718784:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27115680 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58e2 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016115.718797:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc27115680 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58e2 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016115.718945:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499eac0, rc 0) 00000100:00100000:2.0:1734016115.719033:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333702912:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4515us (5503us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016115.719043:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10848 00000100:00100000:0.0:1734016115.722638:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.722738:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333703040 00000100:00100000:2.0:1734016115.722748:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333703040 00000100:00100000:2.0:1734016115.722796:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10849 00000100:00100000:2.0:1734016115.722829:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333703040:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016115.722849:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016115.722869:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115687 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e58e9 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016115.722925:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335287296:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016115.723002:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016115.725382:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335287296:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016115.725417:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115687 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58e9 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016115.725431:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115687 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58e9 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016115.725767:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016115.725848:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333703040:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3018us (3218us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016115.725856:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10849 00000100:00100000:1.0:1734016115.729455:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.729601:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333703296 00000100:00100000:2.0:1734016115.729612:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333703296 00000100:00100000:2.0:1734016115.729664:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2184 00000100:00100000:2.0:1734016115.729671:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+23:9668:x1818247333703296:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016115.730430:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711568e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.730456:0:7704:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115679 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58db expref: 27 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.730463:0:7704:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711568e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.730499:0:7704:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115679 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58db expref: 27 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.730512:0:7704:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115679 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58db expref: 27 pid: 13956 timeout: 482 lvb_type: 0 00000100:00100000:2.0:1734016115.730528:0:7704:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335287424:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016115.731199:0:7704:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e180 going to sleep for 11 seconds 00000100:00100000:2.0:1734016115.737818:0:7704:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335287424:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016115.737849:0:7704:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711568e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:1.0:1734016115.738207:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.738667:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333703424 00000100:00100000:2.0:1734016115.738676:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333703424 00010000:00010000:2.0:1734016115.738707:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115679 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58db expref: 28 pid: 13956 timeout: 482 lvb_type: 0 00000100:00100000:2.0:1734016115.738747:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3001 00000100:00100000:2.0:1734016115.738753:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b42c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+28:1982:x1818247333703424:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016115.738765:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016115.738770:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115679 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58db expref: 28 pid: 13956 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1734016115.738779:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115679 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58db expref: 28 pid: 13956 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1734016115.738829:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115679 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58db expref: 28 pid: 13956 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1734016115.738848:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016115.738853:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711568e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.738865:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711568e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.738873:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711568e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.738889:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016115.738937:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b42c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:1982:x1818247333703424:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 183us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016115.738945:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3001 00010000:00010000:2.0:1734016115.739026:0:7704:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711568e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.739032:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711568e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:2.0:1734016115.739108:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968704 00000004:00010000:2.0:1734016115.739151:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012b131f80 reply state ffff880075dac000 transno 4294968705 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711568e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:2.0:1734016115.739158:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016115.739216:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+26:9668:x1818247333703296:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 9545us (9774us total) trans 4294968705 rc 0/0 00000100:00100000:2.0:1734016115.739222:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2184 00000020:00080000:2.0:1734016115.739226:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1734016115.741848:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711568e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016115.741867:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711568e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016115.741874:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711568e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016115.741880:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc480 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016115.741886:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711568e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016115.741892:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711568e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016115.741911:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016115.741913:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016115.741918:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711568e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016115.741923:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711568e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00000100:00100000:1.0:1734016115.742506:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.742587:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333703552 00000100:00100000:2.0:1734016115.742595:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333703552 00002000:00010000:2.0:1734016115.742623:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (2839468->18446744073709551615) 00002000:00100000:2.0:1734016115.742627:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b130700 with x1818247333703552 ext(2839468->18446744073709551615) 00002000:00010000:2.0:1734016115.742636:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b130700. 00000100:00100000:2.0:1734016115.742657:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8597 00000100:00100000:2.0:1734016115.742663:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333703552:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016115.747190:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9574109 -> 2839468 00002000:00010000:2.0:1734016115.747197:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016116 -> 1734016116 00002000:00010000:2.0:1734016115.747199:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016116 -> 1734016115 00002000:00010000:2.0:1734016115.747201:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016116 -> 1734016116 00002000:00010000:2.0:1734016115.747203:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 320 -> 144 00000100:00100000:2.0:1734016115.753885:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333703552:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 11197us (11360us total) trans 4294969399 rc 0/0 00000100:00100000:2.0:1734016115.753906:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8597 00002000:00010000:2.0:1734016115.753920:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (2839468->18446744073709551615) 00002000:00100000:2.0:1734016115.753926:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b130700 with x1818247333703552 ext(2839468->18446744073709551615) 00002000:00010000:2.0:1734016115.753943:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b130700. 00000100:00100000:0.0:1734016115.759490:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.759702:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333703680 00000100:00100000:2.0:1734016115.759717:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333703680 00000100:00100000:2.0:1734016115.759782:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2185 00000100:00100000:2.0:1734016115.759790:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+25:9668:x1818247333703680:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016115.759847:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016115.759870:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115695 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e58f0 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.759975:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711569c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.759989:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711569c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.760000:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711569c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:2.0:1734016115.760028:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 2839468 00000004:00200000:2.0:1734016115.760033:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016115.760054:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711569c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016115.760081:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115695 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58f0 expref: 27 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.760098:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711569c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58f0 expref: 26 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.760108:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016115.760110:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016115.760114:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016115.760168:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+26:9668:x1818247333703680:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 378us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016115.760175:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2185 00000100:00100000:1.0:1734016115.764940:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.765046:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333703936 00000100:00100000:3.0:1734016115.765055:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333703936 00000100:00100000:3.0:1734016115.765226:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8598 00000100:00100000:3.0:1734016115.765234:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333703936:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:3.0:1734016115.765270:0:7687:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271156a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.765289:0:7687:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711566b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58d4 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.765297:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016115.765300:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016115.765302:0:7687:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271156a3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1335296->1392639] (req 1335296->1392639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.765333:0:7687:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711566b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58d4 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.765344:0:7687:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711566b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58d4 expref: 9 pid: 7684 timeout: 482 lvb_type: 0 00000100:00100000:3.0:1734016115.765357:0:7687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335287552:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016115.765696:0:7687:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016115.767917:0:7687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335287552:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016115.767940:0:7687:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271156a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1335296->1392639] (req 1335296->1392639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016115.770295:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.770743:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333704064 00000100:00100000:3.0:1734016115.770753:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333704064 00010000:00010000:3.0:1734016115.770784:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711566b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58d4 expref: 10 pid: 7684 timeout: 482 lvb_type: 0 00000100:00100000:3.0:1734016115.770856:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3002 00000100:00100000:3.0:1734016115.770863:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333704064:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016115.770875:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016115.770896:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711566b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58d4 expref: 10 pid: 7684 timeout: 482 lvb_type: 0 00010000:00010000:3.0:1734016115.770906:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711566b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58d4 expref: 10 pid: 7684 timeout: 482 lvb_type: 0 00010000:00010000:3.0:1734016115.770924:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711566b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58d4 expref: 10 pid: 7684 timeout: 482 lvb_type: 0 00010000:00010000:3.0:1734016115.770940:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.770942:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.770945:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271156a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1335296->1392639] (req 1335296->1392639) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.770952:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271156a3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1335296->1392639] (req 1335296->1392639) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.770991:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016115.771029:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333704064:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 166us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016115.771035:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3002 00010000:00010000:3.0:1734016115.771058:0:7687:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271156a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1335296->1392639] (req 1335296->1392639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.771065:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271156a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1335296->1392639] (req 1335296->1392639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1734016115.776505:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969400 is committed 00000001:00080000:2.0:1734016115.776535:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969397 is committed 00002000:00010000:3.0:1734016115.776743:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016115 -> 1734016116 00002000:00010000:3.0:1734016115.776748:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 144 -> 256 00010000:00010000:3.0:1734016115.776758:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271156a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1335296->1392639] (req 1335296->1392639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.776768:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271156a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1335296->1392639] (req 1335296->1392639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.776775:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271156a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1335296->1392639] (req 1335296->1392639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.776781:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4900 already unused, calling callback (ffffffffa080e100) 00010000:00010000:3.0:1734016115.776785:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271156a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1335296->1392639] (req 1335296->1392639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.776792:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271156a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1335296->1392639] (req 1335296->1392639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.776868:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271156a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1335296->1392639] (req 1335296->1392639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.776873:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271156a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [1335296->1392639] (req 1335296->1392639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016115.777744:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333703936:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 12504us (12806us total) trans 4294969400 rc 0/0 00000100:00100000:3.0:1734016115.777757:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8598 00000100:00100000:1.0:1734016115.781490:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.781735:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333704192 00000100:00100000:2.0:1734016115.781748:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333704192 00000100:00100000:2.0:1734016115.782074:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2186 00000100:00100000:2.0:1734016115.782084:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:9668:x1818247333704192:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016115.782116:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016115.782143:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271156aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e58f7 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.782256:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271156b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016115.782276:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271156b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016115.782289:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271156b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:2.0:1734016115.782321:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 2839468 00000004:00200000:2.0:1734016115.782325:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016115.782348:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271156b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016115.782375:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271156aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58f7 expref: 29 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.782695:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271156b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58f7 expref: 28 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.782705:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016115.782708:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016115.782711:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016115.783858:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+28:9668:x1818247333704192:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1763us (2365us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016115.783871:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2186 00000100:00100000:1.0:1734016115.787592:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.787687:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333704320 00000100:00100000:2.0:1734016115.787697:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333704320 00000100:00100000:3.0:1734016115.787896:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10850 00000100:00100000:3.0:1734016115.787905:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333704320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016115.787924:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016115.787946:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271156b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e58fe expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1734016115.787973:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 2839468, mtime: 0x675afc74, atime: 0x675afc74, ctime: 0x675afc74, blocks: 0x100 00010000:00010000:3.0:1734016115.787996:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.787998:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.788007:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271156b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58fe expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.788022:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271156b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58fe expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.788032:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4b40, rc 0) 00000100:00100000:3.0:1734016115.788095:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333704320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 191us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016115.788102:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10850 00000100:00100000:0.0:1734016115.790937:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.791042:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333704448 00000100:00100000:2.0:1734016115.791052:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333704448 00000100:00100000:2.0:1734016115.791103:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10851 00000100:00100000:2.0:1734016115.791110:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333704448:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016115.791130:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016115.791147:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271156bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5905 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.791174:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016115.791176:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016115.791184:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271156bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5905 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016115.791199:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271156bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5905 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016115.791211:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016115.791419:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333704448:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 307us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016115.791425:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10851 00000100:00100000:1.0:1734016115.798996:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.799131:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333704704 00000100:00100000:3.0:1734016115.799142:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333704704 00000100:00100000:3.0:1734016115.799213:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8599 00000100:00100000:3.0:1734016115.799221:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333704704:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:3.0:1734016115.799257:0:7687:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.799275:0:7687:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271156b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58fe expref: 5 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.799284:0:7687:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271156bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5905 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.799289:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.799291:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.799294:0:7687:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156c6 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [9572352->9621503] (req 9572352->9621503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.799326:0:7687:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271156bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5905 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.799338:0:7687:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271156bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5905 expref: 7 pid: 7684 timeout: 482 lvb_type: 1 00000100:00100000:3.0:1734016115.799353:0:7687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335287680:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016115.799428:0:7687:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271156b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58fe expref: 5 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.799436:0:7687:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271156b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58fe expref: 5 pid: 8216 timeout: 482 lvb_type: 1 00000100:00100000:3.0:1734016115.799444:0:7687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335287808:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016115.799460:0:7687:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016115.803192:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.803232:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.803525:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333704832 00000100:00100000:3.0:1734016115.803535:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333704832 00010000:00010000:3.0:1734016115.803573:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271156bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5905 expref: 8 pid: 7684 timeout: 482 lvb_type: 1 00000100:00100000:3.0:1734016115.803615:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333704960 00000100:00100000:3.0:1734016115.803617:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333704960 00010000:00010000:3.0:1734016115.803626:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271156b8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58fe expref: 6 pid: 8216 timeout: 482 lvb_type: 1 00000100:00100000:3.0:1734016115.803642:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3003 00000100:00100000:3.0:1734016115.803649:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333704832:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016115.803666:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016115.803691:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271156bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5905 expref: 8 pid: 7684 timeout: 482 lvb_type: 1 00010000:00010000:3.0:1734016115.803700:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271156bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5905 expref: 8 pid: 7684 timeout: 482 lvb_type: 1 00010000:00010000:3.0:1734016115.803732:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016115.803774:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333704832:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 124us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016115.803780:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3003 00000100:00100000:3.0:1734016115.803794:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3004 00000100:00100000:3.0:1734016115.803828:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333704960:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016115.803835:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016115.803840:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271156b8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58fe expref: 6 pid: 8216 timeout: 482 lvb_type: 1 00010000:00010000:3.0:1734016115.803848:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271156b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58fe expref: 6 pid: 8216 timeout: 482 lvb_type: 1 00010000:00010000:3.0:1734016115.803858:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.803860:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.803864:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [9572352->9621503] (req 9572352->9621503) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.803873:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156c6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [9572352->9621503] (req 9572352->9621503) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.803892:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016115.803907:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333704960:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 106us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016115.803911:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3004 00010000:00010000:3.0:1734016115.803953:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271156bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5905 expref: 7 pid: 7684 timeout: 482 lvb_type: 1 00000100:00100000:3.0:1734016115.803980:0:7687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335287680:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016115.803990:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271156b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58fe expref: 5 pid: 8216 timeout: 482 lvb_type: 1 00000100:00100000:3.0:1734016115.804000:0:7687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335287808:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016115.804016:0:7687:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9572352->9621503] (req 9572352->9621503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.804024:0:7687:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9572352->9621503] (req 9572352->9621503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016115.804029:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9572352->9621503] (req 9572352->9621503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1734016115.811655:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969401 is committed 00002000:00010000:0.0:1734016115.811727:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 2839468 -> 9621504 00002000:00010000:0.0:1734016115.811731:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 256 -> 352 00010000:00010000:0.0:1734016115.811741:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9572352->9621503] (req 9572352->9621503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.811751:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9572352->9621503] (req 9572352->9621503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.811758:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9572352->9621503] (req 9572352->9621503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.811763:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df58c0 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016115.811766:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9572352->9621503] (req 9572352->9621503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.811772:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9572352->9621503] (req 9572352->9621503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.811790:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9572352->9621503] (req 9572352->9621503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.811795:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [9572352->9621503] (req 9572352->9621503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016115.812303:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333704704:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 13078us (13315us total) trans 4294969401 rc 0/0 00000100:00100000:1.0:1734016115.812312:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8599 00000100:00100000:1.0:1734016115.815766:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016115.815908:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333705088 00000100:00100000:3.0:1734016115.815919:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333705088 00000100:00100000:3.0:1734016115.815986:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10852 00000100:00100000:3.0:1734016115.815993:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333705088:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016115.816014:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016115.816037:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e590c expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1734016115.816059:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 9621504, mtime: 0x675afc74, atime: 0x675afc74, ctime: 0x675afc74, blocks: 0x160 00010000:00010000:3.0:1734016115.816080:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.816083:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016115.816089:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e590c expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.816102:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e590c expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016115.816112:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df58c0, rc 0) 00000100:00100000:3.0:1734016115.816158:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333705088:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 165us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016115.816164:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10852 00000100:00100000:2.0:1734016115.820532:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.820709:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333705216 00000100:00100000:0.0:1734016115.820720:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333705216 00000100:00100000:0.0:1734016115.820783:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10853 00000100:00100000:0.0:1734016115.820790:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333705216:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016115.820850:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016115.820871:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc271156d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5913 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.820899:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016115.820901:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016115.820910:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc271156d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5913 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016115.820925:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc271156d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5913 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016115.820938:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582d00, rc 0) 00000100:00100000:0.0:1734016115.821005:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333705216:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 215us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016115.821013:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10853 00000100:00100000:0.0:1734016115.826405:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016115.826516:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333705472 00000100:00100000:1.0:1734016115.826525:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333705472 00002000:00100000:1.0:1734016115.826564:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3108864->9621503) req@ffff880073b48380 x1818247333705472/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 504/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016115.826574:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48380 with x1818247333705472 ext(3108864->9621503) 00002000:00010000:1.0:1734016115.826579:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b48380 00000100:00100000:1.0:1734016115.826615:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8600 00000100:00100000:1.0:1734016115.826621:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333705472:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016115.860757:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333705472:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 34122us (34346us total) trans 0 rc 1531904/1531904 00000100:00100000:2.0:1734016115.860771:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8600 00002000:00100000:2.0:1734016115.860786:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3108864->9621503) req@ffff880073b48380 x1818247333705472/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 504/440 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 1531904/1531904 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.860796:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48380 with x1818247333705472 ext(3108864->9621503) 00002000:00010000:2.0:1734016115.860818:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b48380 00000100:00100000:3.0:1734016115.879332:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.879442:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333705728 00000100:00100000:2.0:1734016115.879452:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333705728 00002000:00100000:2.0:1734016115.879499:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3104768->3108863) req@ffff88007560bb80 x1818247333705728/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.879509:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560bb80 with x1818247333705728 ext(3104768->3108863) 00002000:00010000:2.0:1734016115.879514:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560bb80 00000100:00100000:2.0:1734016115.879552:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8601 00000100:00100000:2.0:1734016115.879560:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333705728:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016115.879774:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333705728:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 214us (455us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016115.879781:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8601 00002000:00100000:2.0:1734016115.879786:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3104768->3108863) req@ffff88007560bb80 x1818247333705728/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.879793:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560bb80 with x1818247333705728 ext(3104768->3108863) 00002000:00010000:2.0:1734016115.879795:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560bb80 00000100:00100000:0.0:1734016115.895142:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.895276:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333705984 00000100:00100000:2.0:1734016115.895290:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333705984 00002000:00100000:2.0:1734016115.895350:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3100672->3104767) req@ffff880073b48700 x1818247333705984/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.895362:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48700 with x1818247333705984 ext(3100672->3104767) 00002000:00010000:2.0:1734016115.895368:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b48700 00000100:00100000:2.0:1734016115.895428:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8602 00000100:00100000:2.0:1734016115.895438:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333705984:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016115.895686:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333705984:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 248us (556us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016115.895694:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8602 00002000:00100000:2.0:1734016115.895702:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3100672->3104767) req@ffff880073b48700 x1818247333705984/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.895708:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48700 with x1818247333705984 ext(3100672->3104767) 00002000:00010000:2.0:1734016115.895711:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b48700 00000100:00100000:1.0:1734016115.901964:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.902045:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333706240 00000100:00100000:0.0:1734016115.902054:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333706240 00002000:00100000:0.0:1734016115.902095:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3096576->3100671) req@ffff880130408700 x1818247333706240/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016115.902106:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880130408700 with x1818247333706240 ext(3096576->3100671) 00002000:00010000:0.0:1734016115.902112:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130408700 00000100:00100000:0.0:1734016115.902145:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8603 00000100:00100000:0.0:1734016115.902151:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333706240:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016115.902419:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333706240:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 266us (472us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016115.902427:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8603 00002000:00100000:0.0:1734016115.902433:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3096576->3100671) req@ffff880130408700 x1818247333706240/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016115.902441:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880130408700 with x1818247333706240 ext(3096576->3100671) 00002000:00010000:0.0:1734016115.902444:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130408700 00000100:00100000:3.0:1734016115.913753:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.914157:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333706496 00000100:00100000:0.0:1734016115.914169:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333706496 00002000:00100000:0.0:1734016115.914224:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3092480->3096575) req@ffff88007560a300 x1818247333706496/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016115.914234:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560a300 with x1818247333706496 ext(3092480->3096575) 00002000:00010000:0.0:1734016115.914240:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560a300 00000100:00100000:0.0:1734016115.914274:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8604 00000100:00100000:0.0:1734016115.914280:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333706496:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016115.914943:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333706496:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 659us (1202us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016115.914952:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8604 00002000:00100000:0.0:1734016115.914969:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3092480->3096575) req@ffff88007560a300 x1818247333706496/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016115.914976:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560a300 with x1818247333706496 ext(3092480->3096575) 00002000:00010000:0.0:1734016115.914979:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560a300 00000100:00100000:1.0:1734016115.926690:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.926779:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333706752 00000100:00100000:0.0:1734016115.926790:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333706752 00002000:00100000:0.0:1734016115.926849:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3088384->3092479) req@ffff88013040b480 x1818247333706752/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016115.926858:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88013040b480 with x1818247333706752 ext(3088384->3092479) 00002000:00010000:0.0:1734016115.926865:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013040b480 00000100:00100000:0.0:1734016115.927797:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8605 00000100:00100000:0.0:1734016115.927840:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333706752:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016115.932216:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333706752:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 4365us (5525us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016115.932230:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8605 00002000:00100000:0.0:1734016115.932248:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3088384->3092479) req@ffff88013040b480 x1818247333706752/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016115.932258:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88013040b480 with x1818247333706752 ext(3088384->3092479) 00002000:00010000:0.0:1734016115.932266:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013040b480 00000100:00100000:1.0:1734016115.939849:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.939937:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333707008 00000100:00100000:0.0:1734016115.939949:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333707008 00002000:00100000:0.0:1734016115.940035:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3084288->3088383) req@ffff880130408380 x1818247333707008/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016115.940046:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880130408380 with x1818247333707008 ext(3084288->3088383) 00002000:00010000:0.0:1734016115.940052:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130408380 00000100:00100000:0.0:1734016115.940301:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8606 00000100:00100000:0.0:1734016115.940308:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333707008:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016115.941228:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333707008:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 915us (1434us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016115.941239:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8606 00002000:00100000:0.0:1734016115.941248:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3084288->3088383) req@ffff880130408380 x1818247333707008/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016115.941258:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880130408380 with x1818247333707008 ext(3084288->3088383) 00002000:00010000:0.0:1734016115.941261:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130408380 00000100:00100000:3.0:1734016115.944832:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.944964:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333707264 00000100:00100000:0.0:1734016115.944972:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333707264 00002000:00100000:0.0:1734016115.945009:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3080192->3084287) req@ffff8800756edc00 x1818247333707264/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016115.945019:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756edc00 with x1818247333707264 ext(3080192->3084287) 00002000:00010000:0.0:1734016115.945024:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756edc00 00000100:00100000:0.0:1734016115.945059:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8607 00000100:00100000:0.0:1734016115.945065:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333707264:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016115.945229:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333707264:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 162us (428us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016115.945239:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8607 00002000:00100000:0.0:1734016115.945245:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3080192->3084287) req@ffff8800756edc00 x1818247333707264/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016115.945252:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756edc00 with x1818247333707264 ext(3080192->3084287) 00002000:00010000:0.0:1734016115.945254:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756edc00 00000100:00100000:1.0:1734016115.950626:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.950911:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333707520 00000100:00100000:2.0:1734016115.950920:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333707520 00002000:00100000:2.0:1734016115.950984:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3076096->3080191) req@ffff88013040aa00 x1818247333707520/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.950998:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88013040aa00 with x1818247333707520 ext(3076096->3080191) 00002000:00010000:2.0:1734016115.951004:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013040aa00 00000100:00100000:2.0:1734016115.951044:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8608 00000100:00100000:2.0:1734016115.951052:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333707520:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016115.951285:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333707520:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 233us (670us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016115.951293:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8608 00002000:00100000:2.0:1734016115.951298:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3076096->3080191) req@ffff88013040aa00 x1818247333707520/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.951305:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88013040aa00 with x1818247333707520 ext(3076096->3080191) 00002000:00010000:2.0:1734016115.951307:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013040aa00 00000100:00100000:1.0:1734016115.962358:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.962453:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333707776 00000100:00100000:0.0:1734016115.962462:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333707776 00002000:00100000:0.0:1734016115.962516:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3072000->3076095) req@ffff880130408a80 x1818247333707776/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016115.962527:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880130408a80 with x1818247333707776 ext(3072000->3076095) 00002000:00010000:0.0:1734016115.962533:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130408a80 00000100:00100000:0.0:1734016115.962566:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8609 00000100:00100000:0.0:1734016115.962572:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333707776:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016115.962748:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333707776:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 175us (402us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016115.962756:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8609 00002000:00100000:0.0:1734016115.962761:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3072000->3076095) req@ffff880130408a80 x1818247333707776/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016115.962768:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880130408a80 with x1818247333707776 ext(3072000->3076095) 00002000:00010000:0.0:1734016115.962771:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130408a80 00000100:00100000:3.0:1734016115.968614:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.968943:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333708032 00000100:00100000:2.0:1734016115.968951:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333708032 00002000:00100000:2.0:1734016115.969006:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3067904->3071999) req@ffff8800756ece00 x1818247333708032/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.969016:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ece00 with x1818247333708032 ext(3067904->3071999) 00002000:00010000:2.0:1734016115.969023:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ece00 00000100:00100000:2.0:1734016115.969763:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8610 00000100:00100000:2.0:1734016115.969772:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333708032:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016115.972265:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333708032:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 2477us (3649us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016115.972284:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8610 00002000:00100000:2.0:1734016115.972303:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3067904->3071999) req@ffff8800756ece00 x1818247333708032/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.972314:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ece00 with x1818247333708032 ext(3067904->3071999) 00002000:00010000:2.0:1734016115.972321:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ece00 00000100:00100000:1.0:1734016115.977644:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.978414:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333708288 00000100:00100000:2.0:1734016115.978423:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333708288 00002000:00100000:2.0:1734016115.978468:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3063808->3067903) req@ffff880130409500 x1818247333708288/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/0 e 0 to 0 dl 1734016126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.978480:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880130409500 with x1818247333708288 ext(3063808->3067903) 00002000:00010000:2.0:1734016115.978487:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130409500 00000100:00100000:2.0:1734016115.978657:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8611 00000100:00100000:2.0:1734016115.978664:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333708288:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016115.978854:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333708288:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 189us (1218us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016115.978861:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8611 00002000:00100000:2.0:1734016115.978866:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3063808->3067903) req@ffff880130409500 x1818247333708288/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:76/0 lens 488/4536 e 0 to 0 dl 1734016126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016115.978872:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880130409500 with x1818247333708288 ext(3063808->3067903) 00002000:00010000:2.0:1734016115.978875:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130409500 00000100:00100000:1.0:1734016115.984781:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.985336:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333708544 00000100:00100000:2.0:1734016115.985346:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333708544 00000100:00100000:2.0:1734016115.985389:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2187 00000100:00100000:2.0:1734016115.985395:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+26:9668:x1818247333708544:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016115.985445:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016115.985470:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711569c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58f0 expref: 26 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.985504:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016115.985509:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016115.985658:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271156db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016115.985670:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271156b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58f7 expref: 27 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.985676:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271156db lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016115.985701:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271156b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58f7 expref: 27 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016115.985713:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271156b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58f7 expref: 27 pid: 13956 timeout: 483 lvb_type: 0 00000100:00100000:2.0:1734016115.985726:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db08380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335287936:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016115.985794:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016115.989702:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016115.989902:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db08380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335287936:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016115.989926:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271156db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016115.990754:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333708672 00000100:00100000:0.0:1734016115.990762:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333708672 00010000:00010000:0.0:1734016115.990794:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271156b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58f7 expref: 28 pid: 13956 timeout: 483 lvb_type: 0 00000100:00100000:0.0:1734016115.990870:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3005 00000100:00100000:0.0:1734016115.990876:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+28:1982:x1818247333708672:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016115.990888:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016115.990893:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271156b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58f7 expref: 28 pid: 13956 timeout: 483 lvb_type: 0 00010000:00010000:0.0:1734016115.990903:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271156b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58f7 expref: 28 pid: 13956 timeout: 483 lvb_type: 0 00010000:00010000:0.0:1734016115.990925:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271156b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e58f7 expref: 28 pid: 13956 timeout: 483 lvb_type: 0 00010000:00010000:0.0:1734016115.990960:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016115.990965:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271156db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.990972:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271156db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.990978:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271156db lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.990996:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016115.991050:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:1982:x1818247333708672:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 172us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016115.991056:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3005 00010000:00010000:2.0:1734016115.991611:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271156db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016115.991618:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271156db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:2.0:1734016115.991711:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968706 00000004:00010000:2.0:1734016115.991760:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007bd3ce00 reply state ffff880075da9000 transno 4294968707 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271156db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016115.991765:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016115.991857:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+28:9668:x1818247333708544:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 6460us (7089us total) trans 4294968707 rc 0/0 00000100:00100000:2.0:1734016115.991862:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2187 00000020:00080000:2.0:1734016115.991866:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1734016115.997637:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271156db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.997653:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271156db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.997659:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271156db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.997664:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcb40 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016115.997668:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271156db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.997674:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271156db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.997689:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016115.997691:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016115.997695:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271156db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016115.997699:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271156db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:3.0:1734016115.997766:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016115.998090:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333708800 00000100:00100000:0.0:1734016115.998098:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333708800 00000100:00100000:0.0:1734016115.998132:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10854 00000100:00100000:0.0:1734016115.998137:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333708800:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016115.998151:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016115.998164:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271156e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e591a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.998187:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e590c expref: 5 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016115.998200:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc271156d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5913 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016115.998205:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016115.998207:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016115.998210:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271156e2 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e591a expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016115.998241:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc271156d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5913 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016115.998252:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc271156d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5913 expref: 8 pid: 7684 timeout: 483 lvb_type: 1 00000100:00100000:0.0:1734016115.998266:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335288064:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016115.998329:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e590c expref: 5 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016115.998337:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e590c expref: 5 pid: 8216 timeout: 483 lvb_type: 1 00000100:00100000:0.0:1734016115.998345:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335288192:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016115.998361:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016116.003752:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b4a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335288064:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016116.008131:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016116.009712:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b4b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335288192:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016116.009746:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271156e2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e591a expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.009765:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582f40, rc 0) 00000100:00100000:0.0:1734016116.009851:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333708800:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11711us (12087us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016116.009862:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10854 00000100:00100000:1.0:1734016116.010617:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333708928 00000100:00100000:1.0:1734016116.010625:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333708928 00010000:00010000:1.0:1734016116.010655:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e590c expref: 6 pid: 8216 timeout: 483 lvb_type: 1 00000100:00100000:1.0:1734016116.010692:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3006 00000100:00100000:1.0:1734016116.010698:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333708928:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016116.010709:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016116.010726:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e590c expref: 6 pid: 8216 timeout: 483 lvb_type: 1 00010000:00010000:1.0:1734016116.010735:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e590c expref: 6 pid: 8216 timeout: 483 lvb_type: 1 00010000:00010000:1.0:1734016116.010756:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271156cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e590c expref: 6 pid: 8216 timeout: 483 lvb_type: 1 00010000:00010000:1.0:1734016116.010780:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016116.010819:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333708928:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 121us (2699us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016116.010825:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3006 00000100:00080000:0.0:1734016116.011205:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016086 00000100:00100000:3.0:1734016116.012359:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.012470:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333709056 00000100:00100000:2.0:1734016116.012477:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333709056 00010000:00010000:2.0:1734016116.012502:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc271156d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5913 expref: 8 pid: 7684 timeout: 483 lvb_type: 1 00000100:00100000:2.0:1734016116.012535:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3007 00000100:00100000:2.0:1734016116.012541:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333709056:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016116.012551:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016116.012568:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc271156d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5913 expref: 8 pid: 7684 timeout: 483 lvb_type: 1 00010000:00010000:2.0:1734016116.012578:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc271156d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5913 expref: 8 pid: 7684 timeout: 483 lvb_type: 1 00010000:00010000:2.0:1734016116.012598:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc271156d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5913 expref: 8 pid: 7684 timeout: 483 lvb_type: 1 00010000:00010000:2.0:1734016116.012693:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016116.012695:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016116.012700:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271156e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e591a expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.012709:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271156e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e591a expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.012742:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271156e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e591a expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016116.012755:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db08380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335288320:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016116.012836:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016116.017661:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db08380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335288320:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016116.017684:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016116.017733:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333709056:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5191us (5378us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016116.017744:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3007 00000100:00100000:3.0:1734016116.017850:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.018516:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333709184 00000100:00100000:1.0:1734016116.018524:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333709184 00002000:00010000:1.0:1734016116.018552:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (5350859->18446744073709551615) 00002000:00100000:1.0:1734016116.018557:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073945180 with x1818247333709184 ext(5350859->18446744073709551615) 00002000:00010000:1.0:1734016116.018565:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073945180. 00000100:00100000:1.0:1734016116.018594:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8612 00000100:00100000:1.0:1734016116.018599:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333709184:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016116.019713:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 9621504 -> 5350859 00002000:00010000:1.0:1734016116.019717:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016116 -> 1734016116 00002000:00010000:1.0:1734016116.019719:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016116 -> 1734016116 00002000:00010000:1.0:1734016116.019721:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016116 -> 1734016116 00002000:00010000:1.0:1734016116.019722:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 352 -> 256 00000100:00100000:1.0:1734016116.019783:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333709184:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1182us (1933us total) trans 4294969402 rc 0/0 00000100:00100000:1.0:1734016116.019790:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8612 00002000:00010000:1.0:1734016116.019793:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (5350859->18446744073709551615) 00002000:00100000:1.0:1734016116.019795:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073945180 with x1818247333709184 ext(5350859->18446744073709551615) 00002000:00010000:1.0:1734016116.019829:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073945180. 00000100:00100000:2.0:1734016116.024896:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016116.024971:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333709312 00000100:00100000:0.0:1734016116.024980:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333709312 00000100:00100000:0.0:1734016116.025042:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2188 00000100:00100000:0.0:1734016116.025049:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:9668:x1818247333709312:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016116.025070:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016116.025093:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc271156e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5921 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.025193:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc271156f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016116.025209:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc271156f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016116.025220:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc271156f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016116.025249:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 5350859 00000004:00200000:0.0:1734016116.025253:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016116.025272:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc271156f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016116.025294:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc271156e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5921 expref: 29 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.025337:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc271156f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5921 expref: 28 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.025344:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016116.025347:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016116.025350:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:0.0:1734016116.025407:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+28:9668:x1818247333709312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 357us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016116.025413:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2188 00000100:00100000:3.0:1734016116.028617:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016116.028680:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333709440 00000100:00100000:0.0:1734016116.028688:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333709440 00000100:00100000:0.0:1734016116.028738:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10855 00000100:00100000:0.0:1734016116.028745:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333709440:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016116.028759:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016116.028778:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc271156f7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5928 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016116.028861:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335288448:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016116.028967:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016116.033452:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b4b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335288448:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016116.033492:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc271156f7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5928 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.033508:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc271156f7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5928 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.033535:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581200, rc 0) 00000100:00100000:2.0:1734016116.033596:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333709440:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4850us (4987us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016116.033604:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10855 00000100:00100000:2.0:1734016116.036794:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016116.036919:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333709568 00000100:00100000:0.0:1734016116.036929:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333709568 00000100:00100000:0.0:1734016116.036989:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10856 00000100:00100000:0.0:1734016116.036997:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333709568:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016116.037023:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016116.037040:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc271156fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e592f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016116.037108:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335288576:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016116.037189:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016116.039926:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b4a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335288576:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016116.040012:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc271156fe lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e592f expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016116.040025:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc271156fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e592f expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016116.040052:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00000100:00100000:1.0:1734016116.040236:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333709568:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3236us (3448us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016116.040246:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10856 00000100:00100000:0.0:1734016116.044273:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.044500:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333709696 00000100:00100000:1.0:1734016116.044510:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333709696 00000100:00100000:1.0:1734016116.044586:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10857 00000100:00100000:1.0:1734016116.044592:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333709696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016116.044608:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016116.044623:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27115705 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5936 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016116.044677:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335288704:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016116.044744:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016116.048429:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335288704:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016116.048467:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27115705 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5936 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.048485:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27115705 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5936 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.048511:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016116.048700:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333709696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4105us (4433us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016116.048708:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10857 00000100:00100000:3.0:1734016116.053081:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.053201:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333709824 00000100:00100000:1.0:1734016116.053212:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333709824 00000100:00100000:1.0:1734016116.053283:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10858 00000100:00100000:1.0:1734016116.053292:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333709824:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016116.053315:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016116.053337:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711570c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e593d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.053370:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271156e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e591a expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.053377:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016116.053379:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016116.053383:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711570c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3100672->3104767] (req 3100672->3104767) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e593d expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.053423:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271156e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e591a expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.053439:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271156e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e591a expref: 7 pid: 8216 timeout: 483 lvb_type: 0 00000100:00100000:1.0:1734016116.053454:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335288832:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016116.053527:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016116.056763:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016116.056880:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333709952 00000100:00100000:3.0:1734016116.056887:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333709952 00010000:00010000:3.0:1734016116.056914:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271156e2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e591a expref: 8 pid: 8216 timeout: 483 lvb_type: 0 00000100:00100000:3.0:1734016116.056960:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3008 00000100:00100000:3.0:1734016116.056967:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b42c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333709952:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016116.056979:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016116.056998:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271156e2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e591a expref: 8 pid: 8216 timeout: 483 lvb_type: 0 00010000:00010000:3.0:1734016116.057010:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271156e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e591a expref: 8 pid: 8216 timeout: 483 lvb_type: 0 00010000:00010000:3.0:1734016116.057031:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016116.057033:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016116.057040:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711570c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3100672->3104767) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e593d expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.057048:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711570c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3100672->3104767) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e593d expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.057082:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711570c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3100672->3104767) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e593d expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016116.057097:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335288960:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016116.057153:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c920c0 going to sleep for 11 seconds 00010000:00010000:1.0:1734016116.057861:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc271156e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e591a expref: 8 pid: 8216 timeout: 483 lvb_type: 0 00000100:00100000:1.0:1734016116.057890:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335288832:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016116.057911:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711570c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3100672->3104767) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e593d expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.057920:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016116.057968:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333709824:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4677us (4900us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016116.057976:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10858 00000100:00100000:3.0:1734016116.061114:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335288960:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016116.061147:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016116.061207:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b42c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333709952:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4237us (4450us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016116.061222:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3008 00000100:00100000:3.0:1734016116.062159:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.063682:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333710208 00000100:00100000:2.0:1734016116.063696:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333710208 00002000:00100000:2.0:1734016116.063751:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3100672->3104767) req@ffff8800755b4380 x1818247333710208/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:77/0 lens 488/0 e 0 to 0 dl 1734016127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016116.063761:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4380 with x1818247333710208 ext(3100672->3104767) 00002000:00010000:2.0:1734016116.063766:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4380 00000100:00100000:2.0:1734016116.063816:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8613 00000100:00100000:2.0:1734016116.063823:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333710208:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016116.063990:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333710208:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 166us (1833us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016116.063996:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8613 00002000:00100000:2.0:1734016116.064001:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3100672->3104767) req@ffff8800755b4380 x1818247333710208/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:77/0 lens 488/4536 e 0 to 0 dl 1734016127 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016116.064008:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4380 with x1818247333710208 ext(3100672->3104767) 00002000:00010000:2.0:1734016116.064011:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4380 00000100:00100000:2.0:1734016116.067685:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.067905:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333710464 00000100:00100000:1.0:1734016116.067916:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333710464 00002000:00100000:1.0:1734016116.067969:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3096576->3100671) req@ffff88012db09c00 x1818247333710464/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:77/0 lens 488/0 e 0 to 0 dl 1734016127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016116.067979:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db09c00 with x1818247333710464 ext(3096576->3100671) 00002000:00010000:1.0:1734016116.067986:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db09c00 00000100:00100000:1.0:1734016116.068024:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8614 00000100:00100000:1.0:1734016116.068032:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333710464:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016116.069443:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333710464:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1401us (1756us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016116.069457:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8614 00002000:00100000:1.0:1734016116.069469:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3096576->3100671) req@ffff88012db09c00 x1818247333710464/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:77/0 lens 488/4536 e 0 to 0 dl 1734016127 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016116.069479:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db09c00 with x1818247333710464 ext(3096576->3100671) 00002000:00010000:1.0:1734016116.069485:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db09c00 00000100:00100000:0.0:1734016116.072681:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.072781:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333710592 00000100:00100000:2.0:1734016116.072789:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333710592 00000100:00100000:2.0:1734016116.072853:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2189 00000100:00100000:2.0:1734016116.072858:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+27:9668:x1818247333710592:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016116.072880:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016116.072896:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115713 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5944 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.072983:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711571a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016116.072993:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711571a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016116.073002:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711571a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:2.0:1734016116.073024:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 5350859 00000004:00200000:2.0:1734016116.073027:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016116.073039:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711571a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016116.073058:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115713 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5944 expref: 29 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.073088:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711571a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5944 expref: 28 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.073096:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016116.073099:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016116.073102:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016116.073158:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+28:9668:x1818247333710592:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 297us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016116.073164:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2189 00000100:00100000:3.0:1734016116.076622:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.077363:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333710720 00000100:00100000:1.0:1734016116.077372:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333710720 00000100:00100000:1.0:1734016116.078213:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10859 00000100:00100000:1.0:1734016116.078225:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333710720:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016116.078247:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016116.078263:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27115721 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e594b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.078289:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.078292:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.078300:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27115721 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e594b expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.078316:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27115721 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e594b expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.078325:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016116.079780:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333710720:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1547us (3163us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016116.079793:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10859 00000100:00100000:0.0:1734016116.080741:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016116.080786:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.081051:0:6475:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333710848 00000100:00100000:2.0:1734016116.081060:0:6475:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333710848 00000100:00100000:2.0:1734016116.081110:0:6475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 324 00000100:00100000:2.0:1734016116.081116:0:6475:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7612450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99867e87-1bc2-4e49-bd45-a757ae2fdd76+12:1981:x1818247333710848:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1734016116.081174:0:6475:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7612450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99867e87-1bc2-4e49-bd45-a757ae2fdd76+12:1981:x1818247333710848:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 58us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016116.081181:0:6475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 324 00000100:00100000:1.0:1734016116.081304:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333710976 00000100:00100000:1.0:1734016116.081307:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333710976 00000100:00100000:1.0:1734016116.081328:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 157 00000100:00100000:1.0:1734016116.081333:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333710976:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1734016116.081365:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333710976:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 31us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016116.081371:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 157 00000100:00080000:0.0:1734016116.081646:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016086 00000100:00080000:0.0:1734016116.081651:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016086 00000100:00100000:2.0:1734016116.084596:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.084719:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333711232 00000100:00100000:1.0:1734016116.084729:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333711232 00000100:00100000:1.0:1734016116.084832:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8615 00000100:00100000:1.0:1734016116.084840:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333711232:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:1.0:1734016116.084880:0:7687:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27115728 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.084895:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.084898:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.084905:0:7687:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27115728 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2367488->2416639] (req 2367488->2416639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.084920:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27115728 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2367488->2416639] (req 2367488->2416639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.087537:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27115728 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2367488->2416639] (req 2367488->2416639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.087552:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27115728 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2367488->2416639] (req 2367488->2416639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.087559:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27115728 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2367488->2416639] (req 2367488->2416639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.087565:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499db00 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016116.087568:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27115728 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2367488->2416639] (req 2367488->2416639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.087576:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27115728 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2367488->2416639] (req 2367488->2416639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.087591:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27115728 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2367488->2416639] (req 2367488->2416639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.087596:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27115728 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2367488->2416639] (req 2367488->2416639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016116.087675:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333711232:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 2832us (3084us total) trans 0 rc 49152/49152 00000100:00100000:1.0:1734016116.087684:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8615 00000100:00100000:0.0:1734016116.091101:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.091307:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333711488 00000100:00100000:1.0:1734016116.091318:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333711488 00000100:00100000:1.0:1734016116.091372:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8616 00000100:00100000:1.0:1734016116.091379:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333711488:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:1.0:1734016116.091417:0:7687:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc2711572f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.091434:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.091436:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.091440:0:7687:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc2711572f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3977216->4005887] (req 3977216->4005887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.091452:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc2711572f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3977216->4005887] (req 3977216->4005887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.094320:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc2711572f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3977216->4005887] (req 3977216->4005887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.094334:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc2711572f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3977216->4005887] (req 3977216->4005887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.094341:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc2711572f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3977216->4005887] (req 3977216->4005887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.094348:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499df80 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016116.094351:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc2711572f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3977216->4005887] (req 3977216->4005887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.094359:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc2711572f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3977216->4005887] (req 3977216->4005887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.094374:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc2711572f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3977216->4005887] (req 3977216->4005887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.094380:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc2711572f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3977216->4005887] (req 3977216->4005887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016116.094475:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333711488:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 3092us (3379us total) trans 0 rc 28672/28672 00000100:00100000:1.0:1734016116.094486:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8616 00000100:00100000:0.0:1734016116.108407:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.109147:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333711744 00000100:00100000:1.0:1734016116.109157:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333711744 00002000:00100000:1.0:1734016116.109200:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4202495) req@ffff88007487ed80 x1818247333711744/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:77/0 lens 504/0 e 0 to 0 dl 1734016127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016116.109209:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487ed80 with x1818247333711744 ext(0->4202495) 00002000:00010000:1.0:1734016116.109214:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487ed80 00000100:00100000:1.0:1734016116.109589:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8617 00000100:00100000:1.0:1734016116.109597:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333711744:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016116.110561:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.111416:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333712000 00000100:00100000:2.0:1734016116.111423:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333712000 00002000:00100000:2.0:1734016116.111452:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (4202496->5353471) req@ffff88007487f800 x1818247333712000/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:77/0 lens 488/0 e 0 to 0 dl 1734016127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016116.111461:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487f800 with x1818247333712000 ext(4202496->5353471) 00002000:00010000:2.0:1734016116.111467:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487f800 00000100:00100000:2.0:1734016116.111971:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8618 00000100:00100000:2.0:1734016116.111978:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333712000:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016116.136206:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333712000:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 24220us (25640us total) trans 0 rc 1150976/1150976 00000100:00100000:2.0:1734016116.136216:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8618 00002000:00100000:2.0:1734016116.136225:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (4202496->5353471) req@ffff88007487f800 x1818247333712000/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:77/0 lens 488/440 e 0 to 0 dl 1734016127 ref 1 fl Complete:/200/0 rc 1150976/1150976 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016116.136238:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487f800 with x1818247333712000 ext(4202496->5353471) 00002000:00010000:2.0:1734016116.136243:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487f800 00000100:00100000:1.0:1734016116.155254:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333711744:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 45648us (46845us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016116.155267:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8617 00002000:00100000:1.0:1734016116.155279:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4202495) req@ffff88007487ed80 x1818247333711744/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:77/0 lens 504/440 e 0 to 0 dl 1734016127 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016116.155287:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487ed80 with x1818247333711744 ext(0->4202495) 00002000:00010000:1.0:1734016116.155292:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487ed80 00000100:00100000:0.0:1734016116.163011:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.163781:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333712256 00000100:00100000:1.0:1734016116.163791:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333712256 00000100:00100000:1.0:1734016116.164229:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8619 00000100:00100000:1.0:1734016116.164236:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333712256:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:1.0:1734016116.164272:0:7687:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27115736 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.164291:0:7687:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711570c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3100672->3104767) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e593d expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.164298:0:7687:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27115721 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e594b expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.164304:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.164306:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.164308:0:7687:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27115736 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3215360->3264511] (req 3215360->3264511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.164343:0:7687:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27115721 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e594b expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.164354:0:7687:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27115721 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e594b expref: 8 pid: 8216 timeout: 483 lvb_type: 1 00000100:00100000:1.0:1734016116.164368:0:7687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335289088:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016116.164639:0:7687:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711570c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3100672->3104767) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e593d expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.164649:0:7687:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711570c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3100672->3104767) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e593d expref: 5 pid: 8216 timeout: 483 lvb_type: 0 00000100:00100000:1.0:1734016116.164657:0:7687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335289216:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016116.164680:0:7687:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016116.174493:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016116.175131:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016116.175155:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333712384 00000100:00100000:0.0:1734016116.175163:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333712384 00010000:00010000:0.0:1734016116.175197:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27115721 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e594b expref: 9 pid: 8216 timeout: 483 lvb_type: 1 00000100:00100000:1.0:1734016116.175443:0:7687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335289088:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016116.175453:0:7687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335289216:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016116.175477:0:7687:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27115736 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3215360->3264511] (req 3215360->3264511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016116.175529:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333712512 00000100:00100000:0.0:1734016116.175532:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333712512 00010000:00010000:0.0:1734016116.175543:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711570c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3100672->3104767) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e593d expref: 6 pid: 8216 timeout: 483 lvb_type: 0 00000100:00100000:0.0:1734016116.175558:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3009 00000100:00100000:0.0:1734016116.175563:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333712384:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016116.175576:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016116.175596:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27115721 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e594b expref: 9 pid: 8216 timeout: 483 lvb_type: 1 00010000:00010000:0.0:1734016116.175606:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27115721 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e594b expref: 9 pid: 8216 timeout: 483 lvb_type: 1 00010000:00010000:0.0:1734016116.175630:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27115721 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e594b expref: 9 pid: 8216 timeout: 483 lvb_type: 1 00010000:00010000:0.0:1734016116.175654:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016116.175692:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333712384:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 127us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016116.175697:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3009 00000100:00100000:0.0:1734016116.175711:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3010 00000100:00100000:0.0:1734016116.175715:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333712512:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016116.175726:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016116.175732:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711570c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3100672->3104767) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e593d expref: 6 pid: 8216 timeout: 483 lvb_type: 0 00010000:00010000:0.0:1734016116.175740:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711570c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3100672->3104767) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e593d expref: 6 pid: 8216 timeout: 483 lvb_type: 0 00010000:00010000:0.0:1734016116.175751:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711570c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3100672->3104767) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e593d expref: 6 pid: 8216 timeout: 483 lvb_type: 0 00010000:00010000:0.0:1734016116.175760:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016116.175762:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016116.175766:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27115736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3215360->3264511] (req 3215360->3264511) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.175775:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27115736 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3215360->3264511] (req 3215360->3264511) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.175794:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016116.175822:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333712512:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 106us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016116.175828:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3010 00010000:00010000:1.0:1734016116.176425:0:7687:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27115736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3215360->3264511] (req 3215360->3264511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.176434:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27115736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3215360->3264511] (req 3215360->3264511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1734016116.195712:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969403 is committed 00002000:00010000:1.0:1734016116.195868:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 256 -> 352 00010000:00010000:1.0:1734016116.195885:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27115736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3215360->3264511] (req 3215360->3264511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.195896:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27115736 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3215360->3264511] (req 3215360->3264511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.195905:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27115736 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3215360->3264511] (req 3215360->3264511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.195910:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499f180 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016116.195916:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27115736 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3215360->3264511] (req 3215360->3264511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.195925:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27115736 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3215360->3264511] (req 3215360->3264511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.195957:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27115736 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3215360->3264511] (req 3215360->3264511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.195962:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f180/0x5e3a3adc27115736 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3215360->3264511] (req 3215360->3264511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016116.196074:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333712256:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 31832us (33281us total) trans 4294969403 rc 0/0 00000100:00100000:1.0:1734016116.196084:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8619 00000100:00100000:0.0:1734016116.205683:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.205914:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333712640 00000100:00100000:2.0:1734016116.205921:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333712640 00000100:00100000:2.0:1734016116.205969:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10860 00000100:00100000:2.0:1734016116.205975:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333712640:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016116.205991:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016116.206007:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711573d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5952 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1734016116.206025:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 5350859, mtime: 0x675afc74, atime: 0x675afc74, ctime: 0x675afc74, blocks: 0x160 00010000:00010000:2.0:1734016116.206041:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016116.206043:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016116.206050:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711573d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5952 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.206062:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711573d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5952 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.206071:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016116.206111:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333712640:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 136us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016116.206117:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10860 00000100:00100000:0.0:1734016116.216272:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.216383:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333712768 00000100:00100000:2.0:1734016116.216391:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333712768 00000100:00100000:2.0:1734016116.216447:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10861 00000100:00100000:2.0:1734016116.216454:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333712768:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016116.216476:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016116.216494:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115744 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5959 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.216519:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016116.216521:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016116.216529:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115744 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5959 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.216549:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115744 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5959 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.216560:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016116.216618:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333712768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 163us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016116.216624:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10861 00000100:00100000:0.0:1734016116.220769:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.220849:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333713024 00000100:00100000:1.0:1734016116.220859:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333713024 00000100:00100000:1.0:1734016116.220942:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8620 00000100:00100000:1.0:1734016116.220957:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333713024:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:1.0:1734016116.220997:0:7687:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711574b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.221012:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.221014:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.221020:0:7687:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711574b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3964928->3989503] (req 3964928->3989503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.221035:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711574b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3964928->3989503] (req 3964928->3989503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.227930:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711574b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3964928->3989503] (req 3964928->3989503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.227958:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711574b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3964928->3989503] (req 3964928->3989503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.227965:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711574b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3964928->3989503] (req 3964928->3989503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.227972:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499f3c0 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016116.227975:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711574b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3964928->3989503] (req 3964928->3989503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.227982:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711574b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3964928->3989503] (req 3964928->3989503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.227998:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711574b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3964928->3989503] (req 3964928->3989503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.228003:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711574b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3964928->3989503] (req 3964928->3989503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016116.229593:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333713024:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 8632us (8827us total) trans 0 rc 24576/24576 00000100:00100000:1.0:1734016116.229605:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8620 00000100:00100000:2.0:1734016116.235537:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016116.235606:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333713280 00000100:00100000:0.0:1734016116.235619:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333713280 00000100:00100000:0.0:1734016116.235672:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2190 00000100:00100000:0.0:1734016116.235680:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+28:9668:x1818247333713280:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016116.235744:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016116.235776:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc271156f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5921 expref: 28 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.235820:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016116.235824:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016116.235986:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115752 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016116.236001:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711571a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5944 expref: 27 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.236007:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115752 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016116.236037:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711571a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5944 expref: 27 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.236049:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711571a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5944 expref: 27 pid: 7704 timeout: 483 lvb_type: 0 00000100:00100000:0.0:1734016116.236063:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335289344:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016116.236127:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eed80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016116.241178:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335289344:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016116.241206:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115752 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016116.241259:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016116.241318:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333713408 00000100:00100000:0.0:1734016116.241326:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333713408 00010000:00010000:0.0:1734016116.241354:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711571a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5944 expref: 28 pid: 7704 timeout: 483 lvb_type: 0 00000100:00100000:0.0:1734016116.241395:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3011 00000100:00100000:0.0:1734016116.241402:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+28:1982:x1818247333713408:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016116.241416:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016116.241423:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711571a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5944 expref: 28 pid: 7704 timeout: 483 lvb_type: 0 00010000:00010000:0.0:1734016116.241433:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711571a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5944 expref: 28 pid: 7704 timeout: 483 lvb_type: 0 00010000:00010000:0.0:1734016116.241451:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711571a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5944 expref: 28 pid: 7704 timeout: 483 lvb_type: 0 00010000:00010000:0.0:1734016116.242118:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016116.242125:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115752 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016116.242135:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115752 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016116.242142:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115752 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016116.242174:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016116.242281:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115752 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016116.242288:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115752 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:2.0:1734016116.242368:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968708 00000004:00010000:2.0:1734016116.242409:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012db0a300 reply state ffff8800759b5000 transno 4294968709 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115752 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016116.242420:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016116.242503:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+27:1982:x1818247333713408:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1099us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016116.242512:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3011 00000100:00100000:2.0:1734016116.243561:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+30:9668:x1818247333713280:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 7868us (8026us total) trans 4294968709 rc 0/0 00000100:00100000:2.0:1734016116.243571:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2190 00000020:00080000:2.0:1734016116.243579:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1734016116.247628:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115752 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016116.247645:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115752 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016116.247652:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115752 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016116.247661:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7582f40 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016116.247668:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115752 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016116.247676:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115752 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016116.247698:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016116.247703:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016116.247708:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115752 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016116.247714:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115752 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016116.248110:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.248599:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333713536 00000100:00100000:1.0:1734016116.248609:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333713536 00000100:00100000:1.0:1734016116.248658:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10862 00000100:00100000:1.0:1734016116.248666:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333713536:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016116.248690:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016116.248708:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115759 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5960 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.248732:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711573d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5952 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.248741:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115744 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5959 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.248748:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.248750:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.248753:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115759 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5960 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.248784:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115744 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5959 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.248797:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115744 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5959 expref: 6 pid: 7684 timeout: 483 lvb_type: 1 00000100:00100000:1.0:1734016116.248845:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335289472:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016116.248928:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711573d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5952 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.248936:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711573d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5952 expref: 7 pid: 7684 timeout: 483 lvb_type: 1 00000100:00100000:1.0:1734016116.248960:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335289600:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016116.248978:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016116.257880:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335289472:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016116.257945:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016116.258041:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016116.258129:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333713792 00000100:00100000:3.0:1734016116.258135:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333713792 00010000:00010000:3.0:1734016116.258164:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115744 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5959 expref: 7 pid: 7684 timeout: 483 lvb_type: 1 00000100:00100000:3.0:1734016116.258188:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333713664 00000100:00100000:3.0:1734016116.258191:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333713664 00010000:00010000:3.0:1734016116.258200:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711573d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5952 expref: 8 pid: 7684 timeout: 483 lvb_type: 1 00000100:00100000:3.0:1734016116.258228:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3012 00000100:00100000:3.0:1734016116.258234:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333713792:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016116.258246:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016116.258266:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115744 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5959 expref: 7 pid: 7684 timeout: 483 lvb_type: 1 00010000:00010000:3.0:1734016116.258275:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115744 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5959 expref: 7 pid: 7684 timeout: 483 lvb_type: 1 00010000:00010000:3.0:1734016116.258294:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115744 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5959 expref: 7 pid: 7684 timeout: 483 lvb_type: 1 00010000:00010000:3.0:1734016116.258311:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016116.258360:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333713792:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 125us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016116.258367:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3012 00000100:00100000:3.0:1734016116.258382:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3013 00000100:00100000:3.0:1734016116.258385:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333713664:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016116.258391:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016116.258397:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711573d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5952 expref: 8 pid: 7684 timeout: 483 lvb_type: 1 00010000:00010000:3.0:1734016116.258406:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711573d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5952 expref: 8 pid: 7684 timeout: 483 lvb_type: 1 00010000:00010000:3.0:1734016116.258417:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016116.258419:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016116.258423:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115759 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5960 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.258431:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115759 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5960 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.258464:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115759 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5960 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016116.258481:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335289728:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016116.258520:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1734016116.259815:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711573d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5952 expref: 8 pid: 7684 timeout: 483 lvb_type: 1 00000100:00100000:1.0:1734016116.259847:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335289600:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016116.259878:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115759 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5960 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.259888:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d8c0, rc 0) 00000100:00100000:1.0:1734016116.259941:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333713536:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11275us (11837us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016116.259958:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10862 00000100:00100000:0.0:1734016116.263517:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016116.264158:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335289728:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016116.264184:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016116.265593:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333713664:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7196us (7542us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016116.265608:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3013 00000100:00100000:1.0:1734016116.265690:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333713920 00000100:00100000:1.0:1734016116.265699:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333713920 00002000:00010000:1.0:1734016116.265738:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (3940734->18446744073709551615) 00002000:00100000:1.0:1734016116.265743:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487fb80 with x1818247333713920 ext(3940734->18446744073709551615) 00002000:00010000:1.0:1734016116.265756:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487fb80. 00000100:00100000:1.0:1734016116.265790:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8621 00000100:00100000:1.0:1734016116.265796:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333713920:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016116.267019:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 5350859 -> 3940734 00002000:00010000:1.0:1734016116.267026:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016116 -> 1734016116 00002000:00010000:1.0:1734016116.267029:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016116 -> 1734016116 00002000:00010000:1.0:1734016116.267031:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016116 -> 1734016116 00002000:00010000:1.0:1734016116.267033:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 352 -> 352 00000100:00100000:1.0:1734016116.275218:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333713920:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 9403us (11696us total) trans 4294969404 rc 0/0 00000100:00100000:1.0:1734016116.275232:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8621 00002000:00010000:1.0:1734016116.275241:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (3940734->18446744073709551615) 00002000:00100000:1.0:1734016116.275245:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487fb80 with x1818247333713920 ext(3940734->18446744073709551615) 00002000:00010000:1.0:1734016116.275256:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487fb80. 00000100:00100000:0.0:1734016116.279167:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.279264:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333714048 00000100:00100000:2.0:1734016116.279273:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333714048 00000100:00100000:2.0:1734016116.279356:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2191 00000100:00100000:2.0:1734016116.279364:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+27:9668:x1818247333714048:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016116.279387:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016116.279409:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115760 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5967 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.279513:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115767 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016116.279527:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016116.279539:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:2.0:1734016116.279562:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 3940734 00000004:00200000:2.0:1734016116.279565:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016116.279581:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016116.279604:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115760 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5967 expref: 29 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.279646:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115767 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5967 expref: 28 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.279654:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016116.279657:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016116.279659:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016116.279729:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+28:9668:x1818247333714048:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 365us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016116.279734:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2191 00000100:00100000:0.0:1734016116.283688:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.283793:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333714176 00000100:00100000:1.0:1734016116.283833:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333714176 00000100:00100000:1.0:1734016116.283991:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10863 00000100:00100000:1.0:1734016116.283999:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333714176:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016116.284018:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016116.284038:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc2711576e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e596e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016116.284098:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335289856:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016116.284161:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016116.288238:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335289856:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016116.288279:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc2711576e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e596e expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.288290:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc2711576e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e596e expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.288459:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016116.288665:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333714176:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4664us (4984us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016116.288674:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10863 00000100:00100000:0.0:1734016116.292094:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.292249:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333714304 00000100:00100000:1.0:1734016116.292262:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333714304 00000100:00100000:1.0:1734016116.292326:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10864 00000100:00100000:1.0:1734016116.292336:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333714304:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016116.292366:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016116.292388:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27115775 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5975 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016116.292469:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335289984:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016116.292568:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016116.294767:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335289984:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016116.295060:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27115775 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5975 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.295075:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27115775 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5975 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.295600:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016116.295718:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333714304:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3382us (3637us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016116.295731:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10864 00000100:00100000:3.0:1734016116.301955:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016116.302029:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333714560 00000100:00100000:0.0:1734016116.302039:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333714560 00000100:00100000:0.0:1734016116.302098:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2192 00000100:00100000:0.0:1734016116.302105:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+28:9668:x1818247333714560:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016116.302161:0:7704:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016116.302190:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115767 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5967 expref: 28 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.302878:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016116.302883:0:7704:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016116.303013:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc2711577c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016116.303023:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc2711577c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016116.303030:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc2711577c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:0.0:1734016116.303056:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968710 00000004:00010000:0.0:1734016116.303072:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800755b6d80 reply state ffff8800759b0000 transno 4294968711 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc2711577c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016116.303078:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016116.303163:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+30:9668:x1818247333714560:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 1057us (1224us total) trans 4294968711 rc 0/0 00000100:00100000:0.0:1734016116.303170:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2192 00000020:00080000:0.0:1734016116.303174:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016116.305538:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc2711577c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016116.305550:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc2711577c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016116.305555:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc2711577c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016116.305560:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7582f40 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016116.305563:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc2711577c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016116.305569:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc2711577c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016116.305583:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016116.305586:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016116.305589:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc2711577c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016116.305597:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc2711577c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00000100:00100000:3.0:1734016116.306912:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.307065:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333714688 00000100:00100000:1.0:1734016116.307073:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333714688 00000100:00100000:1.0:1734016116.307121:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10865 00000100:00100000:1.0:1734016116.307127:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333714688:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016116.307143:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016116.307159:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27115783 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e597c expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.307182:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115759 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5960 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.307188:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016116.307190:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016116.307193:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27115783 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e597c expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.307222:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115759 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5960 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.307232:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115759 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5960 expref: 6 pid: 8216 timeout: 483 lvb_type: 0 00000100:00100000:1.0:1734016116.307247:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335290112:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016116.307306:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016116.310691:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335290112:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016116.310721:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27115783 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e597c expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.310735:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016116.311655:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333714688:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4523us (4745us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016116.311664:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10865 00000100:00100000:0.0:1734016116.312656:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016116.312823:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333714816 00000100:00100000:3.0:1734016116.312830:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333714816 00010000:00010000:3.0:1734016116.312856:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115759 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5960 expref: 7 pid: 8216 timeout: 483 lvb_type: 0 00000100:00100000:3.0:1734016116.312901:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3014 00000100:00100000:3.0:1734016116.312908:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333714816:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016116.312920:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016116.312942:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115759 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5960 expref: 7 pid: 8216 timeout: 483 lvb_type: 0 00010000:00010000:3.0:1734016116.312960:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115759 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5960 expref: 7 pid: 8216 timeout: 483 lvb_type: 0 00010000:00010000:3.0:1734016116.312981:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115759 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5960 expref: 7 pid: 8216 timeout: 483 lvb_type: 0 00010000:00010000:3.0:1734016116.313004:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016116.313006:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016116.313012:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27115783 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e597c expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.313020:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27115783 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e597c expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.313051:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27115783 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e597c expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016116.313065:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335290240:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016116.313136:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016116.316938:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335290240:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016116.316974:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016116.317035:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333714816:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4126us (4380us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016116.317046:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3014 00000100:00100000:0.0:1734016116.317670:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.317945:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333714944 00000100:00100000:1.0:1734016116.317961:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333714944 00002000:00010000:1.0:1734016116.317989:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (5761613->18446744073709551615) 00002000:00100000:1.0:1734016116.317992:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073792a00 with x1818247333714944 ext(5761613->18446744073709551615) 00002000:00010000:1.0:1734016116.317999:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073792a00. 00000100:00100000:1.0:1734016116.318028:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8622 00000100:00100000:1.0:1734016116.318034:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333714944:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016116.318189:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 3940734 -> 5761613 00002000:00010000:1.0:1734016116.318192:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016116 -> 1734016116 00002000:00010000:1.0:1734016116.318194:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016116 -> 1734016116 00002000:00010000:1.0:1734016116.318196:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016116 -> 1734016116 00002000:00010000:1.0:1734016116.318197:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 352 -> 352 00000100:00100000:1.0:1734016116.318234:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333714944:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 199us (565us total) trans 4294969405 rc 0/0 00000100:00100000:1.0:1734016116.318240:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8622 00002000:00010000:1.0:1734016116.318242:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (5761613->18446744073709551615) 00002000:00100000:1.0:1734016116.318244:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073792a00 with x1818247333714944 ext(5761613->18446744073709551615) 00002000:00010000:1.0:1734016116.318247:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073792a00. 00000100:00100000:0.0:1734016116.322030:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.322149:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333715072 00000100:00100000:2.0:1734016116.322162:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333715072 00000100:00100000:2.0:1734016116.322289:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2193 00000100:00100000:2.0:1734016116.322297:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+29:9668:x1818247333715072:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016116.322328:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016116.322347:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711578a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5983 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.322429:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115791 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016116.322442:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016116.322454:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:2.0:1734016116.322481:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 5761613 00000004:00200000:2.0:1734016116.322486:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016116.322500:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016116.322522:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711578a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5983 expref: 31 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.323201:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115791 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5983 expref: 30 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.323214:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016116.323217:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016116.323219:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016116.323500:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+30:9668:x1818247333715072:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1201us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016116.323508:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2193 00000100:00100000:2.0:1734016116.328064:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.328222:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333715200 00000100:00100000:1.0:1734016116.328231:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333715200 00000100:00100000:1.0:1734016116.328279:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10866 00000100:00100000:1.0:1734016116.328285:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333715200:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016116.328457:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 5761613 -> 5761613 00002000:00010000:1.0:1734016116.328460:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016116 -> 1734016116 00002000:00010000:1.0:1734016116.328462:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016116 -> 1734016116 00002000:00010000:1.0:1734016116.328463:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016116 -> 1734016116 00002000:00010000:1.0:1734016116.328465:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 352 -> 352 00000100:00100000:1.0:1734016116.328543:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333715200:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 256us (486us total) trans 4294969406 rc 0/0 00000100:00100000:1.0:1734016116.328550:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10866 00000100:00100000:0.0:1734016116.331876:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.332106:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333715328 00000100:00100000:2.0:1734016116.332116:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333715328 00000100:00100000:2.0:1734016116.332168:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2194 00000100:00100000:2.0:1734016116.332175:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+29:9668:x1818247333715328:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016116.332198:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016116.332219:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115798 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e598a expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.332308:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc2711579f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016116.332320:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc2711579f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016116.332330:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc2711579f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:2.0:1734016116.332352:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 5761613 00000004:00200000:2.0:1734016116.332356:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016116.332373:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc2711579f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016116.332397:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115798 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e598a expref: 31 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.332413:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc2711579f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e598a expref: 30 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.332420:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016116.332422:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016116.332424:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd680, rc 0) 00000100:00100000:2.0:1734016116.332487:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+30:9668:x1818247333715328:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 312us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016116.332493:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2194 00000100:00100000:0.0:1734016116.335134:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.335553:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333715456 00000100:00100000:2.0:1734016116.335563:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333715456 00000100:00100000:2.0:1734016116.336252:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10867 00000100:00100000:2.0:1734016116.336263:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333715456:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016116.336287:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016116.336310:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271157a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5991 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016116.336385:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335290368:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016116.336461:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016116.339626:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335290368:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016116.339669:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271157a6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5991 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.339687:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271157a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5991 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.340186:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016116.340252:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333715456:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3989us (5123us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016116.340262:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10867 00000100:00100000:0.0:1734016116.343071:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.343188:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333715584 00000100:00100000:2.0:1734016116.343198:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333715584 00000100:00100000:2.0:1734016116.343492:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10868 00000100:00100000:2.0:1734016116.343503:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333715584:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016116.343530:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016116.343554:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271157ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5998 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016116.343641:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335290496:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016116.344376:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016116.353292:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335290496:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016116.353336:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271157ad lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5998 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.353351:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271157ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5998 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.353388:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016116.353452:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333715584:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9950us (10395us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016116.353461:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10868 00000100:00100000:3.0:1734016116.356619:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.357630:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333715712 00000100:00100000:2.0:1734016116.357642:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333715712 00000100:00100000:1.0:1734016116.360650:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10869 00000100:00100000:1.0:1734016116.360667:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333715712:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016116.360694:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016116.360723:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc271157b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e599f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016116.360793:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335290624:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016116.361547:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016116.365089:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335290624:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016116.365127:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc271157b4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e599f expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.365142:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc271157b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e599f expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.365242:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d8c0, rc 0) 00000100:00100000:1.0:1734016116.365400:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333715712:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4735us (8793us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016116.365409:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10869 00000100:00100000:0.0:1734016116.369057:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.369168:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333715840 00000100:00100000:1.0:1734016116.369176:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333715840 00000100:00100000:1.0:1734016116.369222:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10870 00000100:00100000:1.0:1734016116.369228:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333715840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016116.369243:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016116.369258:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc271157bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e59a6 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016116.369309:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335290752:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016116.369363:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016116.371367:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335290752:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016116.371399:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc271157bb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59a6 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.371412:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc271157bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59a6 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.371485:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016116.371541:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333715840:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2311us (2491us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016116.371555:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10870 00000100:00100000:0.0:1734016116.377250:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016116.377987:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333716096 00000100:00100000:3.0:1734016116.377995:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333716096 00000100:00100000:3.0:1734016116.378555:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8623 00000100:00100000:3.0:1734016116.378562:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333716096:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:3.0:1734016116.378595:0:13914:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271157c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.378611:0:13914:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27115783 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e597c expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.378618:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016116.378620:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016116.378623:0:13914:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271157c2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8249344->8306687] (req 8249344->8306687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.378656:0:13914:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27115783 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e597c expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.378667:0:13914:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27115783 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e597c expref: 9 pid: 8216 timeout: 483 lvb_type: 0 00000100:00100000:3.0:1734016116.378681:0:13914:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335290880:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016116.378755:0:13914:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016116.382369:0:13914:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335290880:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016116.382398:0:13914:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271157c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8249344->8306687] (req 8249344->8306687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016116.384061:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.384321:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333716224 00000100:00100000:2.0:1734016116.384329:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333716224 00010000:00010000:2.0:1734016116.384366:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27115783 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e597c expref: 10 pid: 8216 timeout: 483 lvb_type: 0 00000100:00100000:2.0:1734016116.384393:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3015 00000100:00100000:2.0:1734016116.384399:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b42c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333716224:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016116.384412:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016116.384435:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27115783 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e597c expref: 10 pid: 8216 timeout: 483 lvb_type: 0 00010000:00010000:2.0:1734016116.384447:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27115783 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e597c expref: 10 pid: 8216 timeout: 483 lvb_type: 0 00010000:00010000:2.0:1734016116.384465:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27115783 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e597c expref: 10 pid: 8216 timeout: 483 lvb_type: 0 00010000:00010000:2.0:1734016116.384495:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016116.384497:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016116.384502:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271157c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8249344->8306687] (req 8249344->8306687) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.384510:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271157c2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8249344->8306687] (req 8249344->8306687) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.384543:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016116.384599:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b42c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333716224:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 199us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016116.384607:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3015 00010000:00010000:3.0:1734016116.385069:0:13914:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271157c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8249344->8306687] (req 8249344->8306687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.385084:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271157c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8249344->8306687] (req 8249344->8306687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1734016116.392837:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969407 is committed 00000001:00080000:2.0:1734016116.392855:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969404 is committed 00002000:00010000:3.0:1734016116.392972:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 5761613 -> 8306688 00002000:00010000:3.0:1734016116.392976:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016116 -> 1734016117 00002000:00010000:3.0:1734016116.392978:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016116 -> 1734016117 00002000:00010000:3.0:1734016116.392980:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 352 -> 464 00010000:00010000:3.0:1734016116.392991:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271157c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8249344->8306687] (req 8249344->8306687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.393002:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271157c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8249344->8306687] (req 8249344->8306687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.393010:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271157c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8249344->8306687] (req 8249344->8306687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.393016:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df73c0 already unused, calling callback (ffffffffa080e100) 00010000:00010000:3.0:1734016116.393020:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271157c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8249344->8306687] (req 8249344->8306687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.393027:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271157c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8249344->8306687] (req 8249344->8306687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.393043:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271157c2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8249344->8306687] (req 8249344->8306687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.393050:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271157c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [8249344->8306687] (req 8249344->8306687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016116.393879:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333716096:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 15311us (16632us total) trans 4294969407 rc 0/0 00000100:00100000:3.0:1734016116.393889:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8623 00000100:00100000:1.0:1734016116.401129:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.401255:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333716352 00000100:00100000:2.0:1734016116.401272:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333716352 00000100:00100000:2.0:1734016116.401349:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10871 00000100:00100000:2.0:1734016116.401358:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333716352:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016116.401388:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016116.401416:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271157c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e59ad expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1734016116.401447:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 8306688, mtime: 0x675afc75, atime: 0x675afc74, ctime: 0x675afc75, blocks: 0x1d0 00010000:00010000:2.0:1734016116.401476:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016116.401479:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016116.401488:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271157c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ad expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.401506:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271157c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ad expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.401525:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016116.404516:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333716352:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3143us (3389us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016116.404531:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10871 00000100:00100000:2.0:1734016116.410625:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016116.411185:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333716480 00000100:00100000:3.0:1734016116.411195:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333716480 00000100:00100000:3.0:1734016116.411297:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10872 00000100:00100000:3.0:1734016116.411303:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333716480:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016116.411319:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016116.411334:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271157d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e59b4 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.411355:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016116.411357:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016116.411365:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271157d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59b4 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016116.411378:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271157d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59b4 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016116.411388:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7a80, rc 0) 00000100:00100000:3.0:1734016116.412058:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333716480:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 752us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016116.412067:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10872 00000100:00100000:0.0:1734016116.416017:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016116.416172:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333716608 00000100:00100000:3.0:1734016116.416182:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333716608 00000100:00100000:3.0:1734016116.416230:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10873 00000100:00100000:3.0:1734016116.416237:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333716608:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016116.416254:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016116.416270:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e59bb expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.416295:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271157c9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ad expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016116.416304:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271157d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59b4 expref: 5 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016116.416309:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016116.416312:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016116.416315:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157d7 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [225280->241663] (req 225280->241663) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59bb expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.416342:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271157d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59b4 expref: 5 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016116.416351:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271157d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59b4 expref: 5 pid: 8216 timeout: 483 lvb_type: 1 00000100:00100000:3.0:1734016116.416363:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335291008:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016116.416688:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271157c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ad expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016116.416695:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271157c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ad expref: 8 pid: 8216 timeout: 483 lvb_type: 1 00000100:00100000:3.0:1734016116.416703:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335291136:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016116.416718:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016116.419487:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.419529:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016116.419713:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335291008:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016116.419724:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013040b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335291136:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016116.419756:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157d7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [225280->241663] (req 225280->241663) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59bb expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.419771:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016116.419851:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333716608:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3612us (3841us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016116.419862:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10873 00000100:00100000:0.0:1734016116.420673:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333716864 00000100:00100000:0.0:1734016116.420683:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333716864 00010000:00010000:0.0:1734016116.420716:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271157c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ad expref: 8 pid: 8216 timeout: 483 lvb_type: 1 00000100:00100000:0.0:1734016116.420736:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333716736 00000100:00100000:0.0:1734016116.420738:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333716736 00010000:00010000:0.0:1734016116.420751:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271157d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59b4 expref: 6 pid: 8216 timeout: 483 lvb_type: 1 00000100:00100000:0.0:1734016116.420787:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3016 00000100:00100000:0.0:1734016116.420793:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333716864:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016116.420823:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016116.420848:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271157c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ad expref: 8 pid: 8216 timeout: 483 lvb_type: 1 00010000:00010000:0.0:1734016116.420857:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271157c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ad expref: 8 pid: 8216 timeout: 483 lvb_type: 1 00010000:00010000:0.0:1734016116.420898:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271157c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ad expref: 8 pid: 8216 timeout: 483 lvb_type: 1 00010000:00010000:0.0:1734016116.420923:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016116.420957:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333716864:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 154us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016116.420964:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3016 00000100:00100000:0.0:1734016116.420976:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3017 00000100:00100000:0.0:1734016116.420980:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333716736:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016116.420986:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016116.420992:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271157d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59b4 expref: 6 pid: 8216 timeout: 483 lvb_type: 1 00010000:00010000:0.0:1734016116.421003:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271157d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59b4 expref: 6 pid: 8216 timeout: 483 lvb_type: 1 00010000:00010000:0.0:1734016116.421018:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271157d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59b4 expref: 6 pid: 8216 timeout: 483 lvb_type: 1 00010000:00010000:0.0:1734016116.421026:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016116.421027:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016116.421032:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 225280->241663) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59bb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.421040:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 225280->241663) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59bb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.421064:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 225280->241663) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59bb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016116.421076:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335291264:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016116.421108:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eed80 going to sleep for 11 seconds 00000100:00100000:1.0:1734016116.427352:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335291264:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016116.427380:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016116.427436:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333716736:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6453us (7905us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016116.427446:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3017 00000100:00100000:0.0:1734016116.427930:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016116.428119:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333716992 00000100:00100000:3.0:1734016116.428126:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333716992 00000100:00100000:3.0:1734016116.428362:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10874 00000100:00100000:3.0:1734016116.428369:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333716992:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016116.428620:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8306688 -> 8306688 00002000:00010000:3.0:1734016116.428624:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016117 -> 1734016117 00002000:00010000:3.0:1734016116.428626:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016116 -> 1734016116 00002000:00010000:3.0:1734016116.428628:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016117 -> 1734016117 00002000:00010000:3.0:1734016116.428629:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 464 -> 464 00000100:00100000:3.0:1734016116.428695:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333716992:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 325us (766us total) trans 4294969408 rc 0/0 00000100:00100000:3.0:1734016116.428703:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10874 00000100:00100000:2.0:1734016116.434509:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.434853:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333717120 00000100:00100000:1.0:1734016116.434861:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333717120 00000100:00100000:1.0:1734016116.434912:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10875 00000100:00100000:1.0:1734016116.434919:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333717120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016116.434936:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016116.434959:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271157de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e59c2 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016116.435008:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335291392:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016116.435072:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016116.438521:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335291392:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016116.438559:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271157de lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59c2 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.438575:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271157de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59c2 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.439121:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016116.439193:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333717120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4272us (4690us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016116.439204:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10875 00000100:00100000:0.0:1734016116.462434:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.469245:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333717248 00000100:00100000:1.0:1734016116.469257:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333717248 00000100:00100000:1.0:1734016116.469320:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10876 00000100:00100000:1.0:1734016116.469327:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333717248:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016116.469345:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016116.469361:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271157e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e59c9 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.469387:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 225280->241663) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59bb expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.469394:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016116.469396:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016116.469399:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271157e5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3874816->3891199] (req 3874816->3891199) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59c9 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.469427:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 225280->241663) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59bb expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.469436:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 225280->241663) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59bb expref: 7 pid: 8216 timeout: 483 lvb_type: 0 00000100:00100000:1.0:1734016116.469451:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335291520:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016116.469505:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016116.479146:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335291520:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016116.479185:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271157e5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3874816->3891199] (req 3874816->3891199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59c9 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.479205:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016116.479279:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333717248:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9951us (16852us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016116.479289:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10876 00000100:00100000:3.0:1734016116.483610:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.483721:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333717376 00000100:00100000:1.0:1734016116.483732:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333717376 00010000:00010000:1.0:1734016116.483772:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 225280->241663) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59bb expref: 8 pid: 8216 timeout: 483 lvb_type: 0 00000100:00100000:1.0:1734016116.483838:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3018 00000100:00100000:1.0:1734016116.483844:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333717376:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016116.483856:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016116.483878:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 225280->241663) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59bb expref: 8 pid: 8216 timeout: 483 lvb_type: 0 00010000:00010000:1.0:1734016116.483890:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 225280->241663) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59bb expref: 8 pid: 8216 timeout: 483 lvb_type: 0 00010000:00010000:1.0:1734016116.483922:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 225280->241663) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59bb expref: 8 pid: 8216 timeout: 483 lvb_type: 0 00010000:00010000:1.0:1734016116.483953:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.483955:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.483961:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271157e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->3891199) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59c9 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.483969:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271157e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->3891199) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59c9 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.483997:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271157e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->3891199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59c9 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016116.484009:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335291648:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016116.484058:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016116.493277:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.493419:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335291648:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016116.493444:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016116.493501:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333717376:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9654us (9903us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016116.493511:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3018 00000100:00100000:2.0:1734016116.494102:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333717504 00000100:00100000:2.0:1734016116.494109:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333717504 00000100:00100000:2.0:1734016116.494140:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10877 00000100:00100000:2.0:1734016116.494145:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333717504:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016116.494328:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8306688 -> 8306688 00002000:00010000:2.0:1734016116.494331:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016117 -> 1734016117 00002000:00010000:2.0:1734016116.494333:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016116 -> 1734016116 00002000:00010000:2.0:1734016116.494335:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016117 -> 1734016116 00002000:00010000:2.0:1734016116.494336:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 464 -> 496 00000100:00100000:2.0:1734016116.494620:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333717504:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 474us (1351us total) trans 4294969409 rc 0/0 00000100:00100000:2.0:1734016116.494628:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10877 00000100:00100000:0.0:1734016116.502254:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.502365:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333717632 00000100:00100000:2.0:1734016116.502374:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333717632 00000100:00100000:2.0:1734016116.502489:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10878 00000100:00100000:2.0:1734016116.502496:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333717632:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016116.502516:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016116.502534:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271157ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e59d0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016116.502584:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335291776:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016116.502739:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ecc0 going to sleep for 11 seconds 00002000:00010000:2.0:1734016116.508071:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016116 -> 1734016117 00000100:00100000:2.0:1734016116.508101:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335291776:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016116.508143:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271157ec lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59d0 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.508154:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271157ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59d0 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.508183:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016116.508833:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333717632:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6299us (6551us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016116.508842:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10878 00000100:00100000:0.0:1734016116.512236:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.513782:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333717760 00000100:00100000:2.0:1734016116.513796:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333717760 00000100:00100000:2.0:1734016116.513884:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10879 00000100:00100000:2.0:1734016116.513894:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333717760:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016116.513925:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016116.513957:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271157f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e59d7 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016116.514034:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335291904:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016116.514125:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016116.521254:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335291904:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016116.521296:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271157f3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59d7 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.521313:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271157f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59d7 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.521334:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016116.521391:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333717760:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7497us (9164us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016116.521402:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10879 00010000:00010000:3.0:1734016116.528275:0:6469:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1734016116.529146:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016116.529234:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333718016 00000100:00100000:3.0:1734016116.529244:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333718016 00000100:00100000:3.0:1734016116.529321:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8624 00000100:00100000:3.0:1734016116.529332:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333718016:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:3.0:1734016116.529391:0:13914:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157fa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.529411:0:13914:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271157e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->3891199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59c9 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.529418:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016116.529420:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016116.529423:0:13914:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157fa lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3731456->3739647] (req 3731456->3739647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.529456:0:13914:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271157e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->3891199) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59c9 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.529469:0:13914:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271157e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->3891199) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59c9 expref: 7 pid: 7684 timeout: 483 lvb_type: 0 00000100:00100000:3.0:1734016116.529482:0:13914:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335292032:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016116.529532:0:13914:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016116.533574:0:13914:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335292032:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016116.533611:0:13914:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157fa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3731456->3739647] (req 3731456->3739647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016116.535074:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.535131:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333718144 00000100:00100000:1.0:1734016116.535139:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333718144 00010000:00010000:1.0:1734016116.535171:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271157e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59c9 expref: 8 pid: 7684 timeout: 483 lvb_type: 0 00000100:00100000:1.0:1734016116.535217:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3019 00000100:00100000:1.0:1734016116.535225:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333718144:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016116.535238:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016116.535258:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271157e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3874816->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59c9 expref: 8 pid: 7684 timeout: 483 lvb_type: 0 00010000:00010000:1.0:1734016116.535269:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271157e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3874816->3891199) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59c9 expref: 8 pid: 7684 timeout: 483 lvb_type: 0 00010000:00010000:1.0:1734016116.535290:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271157e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3874816->3891199) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59c9 expref: 8 pid: 7684 timeout: 483 lvb_type: 0 00010000:00010000:1.0:1734016116.535320:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.535323:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.535327:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3731456->3739647] (req 3731456->3739647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.535335:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157fa lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3731456->3739647] (req 3731456->3739647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.535357:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016116.535367:0:13914:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3731456->3739647] (req 3731456->3739647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.535377:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3731456->3739647] (req 3731456->3739647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016116.535415:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333718144:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 190us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016116.535422:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3019 00010000:00010000:3.0:1734016116.535474:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3731456->3739647] (req 3731456->3739647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.535481:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3731456->3739647] (req 3731456->3739647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.535487:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3731456->3739647] (req 3731456->3739647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.535493:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df7180 already unused, calling callback (ffffffffa080e100) 00010000:00010000:3.0:1734016116.535496:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3731456->3739647] (req 3731456->3739647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.535502:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3731456->3739647] (req 3731456->3739647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.535510:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3731456->3739647] (req 3731456->3739647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.535515:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271157fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3731456->3739647] (req 3731456->3739647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016116.535560:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333718016:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 6230us (6421us total) trans 0 rc 8192/8192 00000100:00100000:3.0:1734016116.535568:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8624 00000100:00100000:2.0:1734016116.538725:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016116.538840:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333718272 00000100:00100000:0.0:1734016116.538852:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333718272 00000100:00100000:0.0:1734016116.538916:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10880 00000100:00100000:0.0:1734016116.538924:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333718272:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016116.538954:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016116.538974:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115801 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e59de expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016116.538997:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 8306688, mtime: 0x675afc75, atime: 0x675afc74, ctime: 0x675afc74, blocks: 0x1f0 00010000:00010000:0.0:1734016116.539016:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016116.539018:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016116.539027:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115801 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59de expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016116.539046:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115801 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59de expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016116.539060:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581200, rc 0) 00000100:00100000:0.0:1734016116.539116:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333718272:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 192us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016116.539123:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10880 00000100:00100000:0.0:1734016116.542404:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016116.542480:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333718400 00000100:00100000:3.0:1734016116.542487:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333718400 00000100:00100000:3.0:1734016116.542515:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10881 00000100:00100000:3.0:1734016116.542520:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333718400:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016116.542535:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016116.542549:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115808 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e59e5 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.542566:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016116.542568:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016116.542574:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115808 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59e5 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016116.542586:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115808 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59e5 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016116.542595:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016116.542712:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333718400:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 191us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016116.542718:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10881 00000100:00100000:1.0:1734016116.546290:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016116.546400:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333718528 00000100:00100000:3.0:1734016116.546413:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333718528 00000100:00100000:3.0:1734016116.546666:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10882 00000100:00100000:3.0:1734016116.546679:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333718528:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016116.546708:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016116.546732:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc2711580f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e59ec expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.546769:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115801 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59de expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016116.546778:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115808 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59e5 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016116.546784:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016116.546786:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016116.546788:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc2711580f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7675904->7700479] (req 7675904->7700479) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ec expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.546841:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115808 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59e5 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016116.546853:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115808 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59e5 expref: 7 pid: 8216 timeout: 483 lvb_type: 1 00000100:00100000:3.0:1734016116.546866:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335292160:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016116.547165:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115801 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59de expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016116.547174:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115801 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59de expref: 8 pid: 7684 timeout: 483 lvb_type: 1 00000100:00100000:3.0:1734016116.547184:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335292288:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016116.547201:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016116.553531:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.553618:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016116.553695:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333718784 00000100:00100000:0.0:1734016116.553704:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333718784 00010000:00010000:0.0:1734016116.553735:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115801 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59de expref: 9 pid: 7684 timeout: 483 lvb_type: 1 00000100:00100000:0.0:1734016116.553759:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333718656 00000100:00100000:0.0:1734016116.553762:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333718656 00010000:00010000:0.0:1734016116.553770:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115808 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59e5 expref: 8 pid: 8216 timeout: 483 lvb_type: 1 00000100:00100000:0.0:1734016116.553786:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3020 00000100:00100000:0.0:1734016116.553793:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333718784:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016116.553831:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016116.553851:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115801 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59de expref: 9 pid: 7684 timeout: 483 lvb_type: 1 00010000:00010000:0.0:1734016116.553861:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115801 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59de expref: 9 pid: 7684 timeout: 483 lvb_type: 1 00010000:00010000:0.0:1734016116.553885:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016116.553922:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333718784:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 130us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016116.553927:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3020 00000100:00100000:0.0:1734016116.553939:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3021 00000100:00100000:0.0:1734016116.553952:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333718656:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016116.553958:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016116.553963:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115808 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59e5 expref: 8 pid: 8216 timeout: 483 lvb_type: 1 00010000:00010000:0.0:1734016116.553971:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115808 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59e5 expref: 8 pid: 8216 timeout: 483 lvb_type: 1 00010000:00010000:0.0:1734016116.553980:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016116.553982:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016116.553987:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc2711580f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 7675904->7700479) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ec expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.553995:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc2711580f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 7675904->7700479) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ec expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.554021:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc2711580f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 7675904->7700479) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ec expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016116.554032:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335292416:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016116.554058:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eec00 going to sleep for 11 seconds 00010000:00010000:3.0:1734016116.554230:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115808 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59e5 expref: 8 pid: 8216 timeout: 483 lvb_type: 1 00000100:00100000:3.0:1734016116.554246:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335292160:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016116.554253:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115801 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59de expref: 8 pid: 7684 timeout: 483 lvb_type: 1 00000100:00100000:3.0:1734016116.554260:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013040a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335292288:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016116.554277:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc2711580f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7675904->7700479) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ec expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.554285:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7a80, rc 0) 00000100:00100000:3.0:1734016116.554310:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333718528:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7633us (8029us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016116.554317:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10882 00000100:00100000:0.0:1734016116.559305:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335292416:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016116.559341:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016116.560164:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333718656:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6216us (6543us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016116.560177:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3021 00000100:00100000:0.0:1734016116.560682:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016116.560825:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333718912 00000100:00100000:3.0:1734016116.560833:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333718912 00000100:00100000:3.0:1734016116.560863:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10883 00000100:00100000:3.0:1734016116.560869:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333718912:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016116.561095:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8306688 -> 8306688 00002000:00010000:3.0:1734016116.561098:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016117 -> 1734016116 00002000:00010000:3.0:1734016116.561100:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016116 -> 1734016116 00002000:00010000:3.0:1734016116.561102:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016116 -> 1734016116 00002000:00010000:3.0:1734016116.561104:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 496 -> 496 00000100:00100000:3.0:1734016116.561178:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333718912:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 308us (496us total) trans 4294969410 rc 0/0 00000100:00100000:3.0:1734016116.561184:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10883 00000100:00100000:0.0:1734016116.565270:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.565961:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333719040 00000100:00100000:2.0:1734016116.565973:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333719040 00000100:00100000:2.0:1734016116.566030:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10884 00000100:00100000:2.0:1734016116.566037:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333719040:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016116.566056:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016116.566075:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115816 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e59f3 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016116.566139:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335292544:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016116.566210:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ecc0 going to sleep for 11 seconds 00002000:00010000:0.0:1734016116.569032:0:7684:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime: 1734016116 -> 1734016117 00002000:00010000:0.0:1734016116.569040:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016116 -> 1734016117 00002000:00010000:0.0:1734016116.569042:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016116 -> 1734016117 00000100:00100000:0.0:1734016116.569062:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335292544:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016116.569093:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115816 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59f3 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016116.569106:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115816 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59f3 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016116.569134:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:0.0:1734016116.569187:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333719040:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3148us (3925us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016116.569199:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10884 00000100:00100000:0.0:1734016116.572634:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.572852:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333719168 00000100:00100000:2.0:1734016116.572867:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333719168 00000100:00100000:2.0:1734016116.572939:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10885 00000100:00100000:2.0:1734016116.572955:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333719168:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016116.572980:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016116.573005:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711581d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e59fa expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016116.573086:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335292672:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016116.573179:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e600 going to sleep for 11 seconds 00000100:00100000:0.0:1734016116.576316:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335292672:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016116.576360:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711581d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59fa expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016116.576373:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711581d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59fa expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016116.576401:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:0.0:1734016116.576450:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333719168:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3494us (3834us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016116.576460:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10885 00000100:00100000:0.0:1734016116.580080:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.580289:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333719296 00000100:00100000:2.0:1734016116.580300:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333719296 00000100:00100000:2.0:1734016116.580356:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10886 00000100:00100000:2.0:1734016116.580363:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88009024ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333719296:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016116.580380:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016116.580397:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115824 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a01 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016116.580459:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335292800:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016116.580525:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e600 going to sleep for 11 seconds 00000100:00100000:0.0:1734016116.583226:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335292800:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016116.583261:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115824 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a01 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016116.583276:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115824 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a01 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016116.583462:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd440, rc 0) 00000100:00100000:0.0:1734016116.583519:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88009024ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333719296:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3155us (3447us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016116.583531:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10886 00000100:00100000:2.0:1734016116.587458:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016116.587546:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333719424 00000100:00100000:0.0:1734016116.587554:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333719424 00000100:00100000:0.0:1734016116.587614:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10887 00000100:00100000:0.0:1734016116.587622:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333719424:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016116.587644:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016116.587666:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711582b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a08 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.587696:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc2711580f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7675904->7700479) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ec expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.587702:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016116.587704:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016116.587707:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711582b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6688768->6692863] (req 6688768->6692863) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a08 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.587741:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc2711580f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7675904->7700479) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ec expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.587753:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc2711580f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7675904->7700479) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ec expref: 7 pid: 8216 timeout: 483 lvb_type: 0 00000100:00100000:0.0:1734016116.587765:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335292928:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016116.588197:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eec00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016116.591548:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335292928:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016116.591590:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711582b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6688768->6692863] (req 6688768->6692863) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a08 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.591604:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:0.0:1734016116.591660:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333719424:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4038us (4212us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016116.591670:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10887 00000100:00100000:0.0:1734016116.592411:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.592763:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333719552 00000100:00100000:1.0:1734016116.592771:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333719552 00010000:00010000:1.0:1734016116.592837:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc2711580f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7675904->7700479) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ec expref: 8 pid: 8216 timeout: 483 lvb_type: 0 00000100:00100000:1.0:1734016116.592861:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3022 00000100:00100000:1.0:1734016116.592866:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b42c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333719552:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016116.592890:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016116.592910:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc2711580f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7675904->7700479) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ec expref: 8 pid: 8216 timeout: 483 lvb_type: 0 00010000:00010000:1.0:1734016116.592920:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc2711580f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7675904->7700479) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ec expref: 8 pid: 8216 timeout: 483 lvb_type: 0 00010000:00010000:1.0:1734016116.592939:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc2711580f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7675904->7700479) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e59ec expref: 8 pid: 8216 timeout: 483 lvb_type: 0 00010000:00010000:1.0:1734016116.592973:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.592975:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.592980:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711582b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6688768->6692863) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a08 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.592987:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711582b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6688768->6692863) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a08 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.593013:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711582b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6688768->6692863) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a08 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016116.593024:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335293056:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016116.593064:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016116.599141:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335293056:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016116.599163:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016116.599223:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b42c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333719552:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6355us (6811us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016116.599235:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3022 00000100:00100000:0.0:1734016116.613863:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016116.614092:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333720064 00000100:00100000:3.0:1734016116.614103:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333720064 00002000:00100000:3.0:1734016116.614157:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8306687) req@ffff880073790700 x1818247333720064/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:77/0 lens 504/0 e 0 to 0 dl 1734016127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016116.614167:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790700 with x1818247333720064 ext(4190208->8306687) 00002000:00010000:3.0:1734016116.614173:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073790700 00000100:00100000:3.0:1734016116.614210:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8625 00000100:00100000:3.0:1734016116.614216:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333720064:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016116.622741:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.622833:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333719808 00000100:00100000:1.0:1734016116.622842:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333719808 00002000:00100000:1.0:1734016116.622889:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->6692863) req@ffff88007487df80 x1818247333719808/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:77/0 lens 504/0 e 0 to 0 dl 1734016127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016116.622900:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487df80 with x1818247333719808 ext(0->6692863) 00002000:00010000:1.0:1734016116.622905:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487df80 00000100:00100000:1.0:1734016116.622938:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8626 00000100:00100000:1.0:1734016116.622953:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333719808:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016116.703634:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333720064:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 89407us (89773us total) trans 0 rc 4112384/4112384 00000100:00100000:2.0:1734016116.703646:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8625 00002000:00100000:2.0:1734016116.703658:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (4190208->8306687) req@ffff880073790700 x1818247333720064/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:77/0 lens 504/440 e 0 to 0 dl 1734016127 ref 1 fl Complete:/200/0 rc 4112384/4112384 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016116.703672:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790700 with x1818247333720064 ext(4190208->8306687) 00002000:00010000:2.0:1734016116.703678:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073790700 00000100:00100000:1.0:1734016116.725689:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333719808:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 102732us (102946us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016116.725700:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8626 00002000:00100000:1.0:1734016116.725711:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->6692863) req@ffff88007487df80 x1818247333719808/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:77/0 lens 504/440 e 0 to 0 dl 1734016127 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016116.725719:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487df80 with x1818247333719808 ext(0->6692863) 00002000:00010000:1.0:1734016116.725725:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487df80 00000100:00100000:2.0:1734016116.737325:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.737491:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333720320 00000100:00100000:1.0:1734016116.737498:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333720320 00000100:00100000:1.0:1734016116.737542:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8627 00000100:00100000:1.0:1734016116.737549:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333720320:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:1.0:1734016116.737580:0:7687:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27115832 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.737596:0:7687:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711582b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6688768->6692863) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a08 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.737603:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.737604:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.737606:0:7687:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27115832 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3039232->3100671] (req 3039232->3100671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.737633:0:7687:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711582b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6688768->6692863) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a08 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.737642:0:7687:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711582b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6688768->6692863) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a08 expref: 7 pid: 7684 timeout: 483 lvb_type: 0 00000100:00100000:1.0:1734016116.737654:0:7687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335293184:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016116.738405:0:7687:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1734016116.743109:0:7687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335293184:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016116.743141:0:7687:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27115832 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3039232->3100671] (req 3039232->3100671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016116.755144:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.755285:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333720448 00000100:00100000:1.0:1734016116.755295:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333720448 00010000:00010000:1.0:1734016116.755331:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711582b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6688768->6692863) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a08 expref: 8 pid: 7684 timeout: 483 lvb_type: 0 00000100:00100000:1.0:1734016116.755377:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3023 00000100:00100000:1.0:1734016116.755384:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333720448:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016116.755397:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016116.755416:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711582b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6688768->6692863) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a08 expref: 8 pid: 7684 timeout: 483 lvb_type: 0 00010000:00010000:1.0:1734016116.755429:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711582b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6688768->6692863) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a08 expref: 8 pid: 7684 timeout: 483 lvb_type: 0 00010000:00010000:1.0:1734016116.755449:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc2711582b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6688768->6692863) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a08 expref: 8 pid: 7684 timeout: 483 lvb_type: 0 00010000:00010000:1.0:1734016116.755741:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.755743:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.755747:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27115832 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3039232->3100671] (req 3039232->3100671) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.755757:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27115832 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3039232->3100671] (req 3039232->3100671) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.755821:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016116.755922:0:7687:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27115832 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3039232->3100671] (req 3039232->3100671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.755930:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27115832 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3039232->3100671] (req 3039232->3100671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016116.756164:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333720448:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 778us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016116.756172:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3023 00000001:00080000:2.0:1734016116.761288:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969411 is committed 00000001:00080000:2.0:1734016116.761307:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969408 is committed 00002000:00010000:0.0:1734016116.761393:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 496 -> 616 00010000:00010000:0.0:1734016116.761408:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27115832 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3039232->3100671] (req 3039232->3100671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.761419:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27115832 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3039232->3100671] (req 3039232->3100671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.761426:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27115832 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3039232->3100671] (req 3039232->3100671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.761431:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499ed00 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016116.761435:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27115832 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3039232->3100671] (req 3039232->3100671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.761442:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27115832 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3039232->3100671] (req 3039232->3100671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.761457:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27115832 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3039232->3100671] (req 3039232->3100671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.761467:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27115832 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3039232->3100671] (req 3039232->3100671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016116.764028:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333720320:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 26467us (26699us total) trans 4294969411 rc 0/0 00000100:00100000:0.0:1734016116.764041:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8627 00000100:00100000:3.0:1734016116.769997:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.770598:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333720576 00000100:00100000:1.0:1734016116.770607:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333720576 00000100:00100000:1.0:1734016116.770646:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10888 00000100:00100000:1.0:1734016116.770653:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333720576:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016116.770678:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016116.770699:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27115839 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a0f expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016116.770723:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 8306688, mtime: 0x675afc75, atime: 0x675afc74, ctime: 0x675afc74, blocks: 0x268 00010000:00010000:1.0:1734016116.770745:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.770746:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.770754:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27115839 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a0f expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.770772:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27115839 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a0f expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.770781:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016116.770860:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333720576:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 207us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016116.770865:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10888 00000100:00100000:2.0:1734016116.778210:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.779488:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333720832 00000100:00100000:1.0:1734016116.779500:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333720832 00000100:00100000:1.0:1734016116.779544:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2195 00000100:00100000:1.0:1734016116.779551:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+30:9668:x1818247333720832:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016116.779598:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016116.779622:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115791 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5983 expref: 30 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.779652:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016116.779655:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016116.779779:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115840 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016116.779791:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc2711579f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e598a expref: 29 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.779797:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115840 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016116.779833:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc2711579f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e598a expref: 29 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.779843:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc2711579f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e598a expref: 29 pid: 7704 timeout: 483 lvb_type: 0 00000100:00100000:1.0:1734016116.779854:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335293312:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016116.780086:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016116.782116:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335293312:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016116.782140:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115840 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016116.785432:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016116.785497:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333720960 00000100:00100000:0.0:1734016116.785506:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333720960 00010000:00010000:0.0:1734016116.785542:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc2711579f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e598a expref: 30 pid: 7704 timeout: 483 lvb_type: 0 00000100:00100000:0.0:1734016116.785569:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3024 00000100:00100000:0.0:1734016116.785575:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+30:1981:x1818247333720960:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016116.785591:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016116.785597:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc2711579f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e598a expref: 30 pid: 7704 timeout: 483 lvb_type: 0 00010000:00010000:0.0:1734016116.785610:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc2711579f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e598a expref: 30 pid: 7704 timeout: 483 lvb_type: 0 00010000:00010000:0.0:1734016116.785632:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc2711579f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e598a expref: 30 pid: 7704 timeout: 483 lvb_type: 0 00010000:00010000:0.0:1734016116.785655:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016116.785661:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115840 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016116.785674:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016116.785681:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115840 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016116.785705:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016116.785772:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+29:1981:x1818247333720960:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 195us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016116.785780:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3024 00010000:00010000:0.0:1734016116.785840:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016116.785846:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:0.0:1734016116.785936:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968712 00000004:00010000:0.0:1734016116.785987:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007487dc00 reply state ffff880075d98000 transno 4294968713 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016116.785994:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016116.786057:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+32:9668:x1818247333720832:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 6505us (7856us total) trans 4294968713 rc 0/0 00000100:00100000:0.0:1734016116.786064:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2195 00000020:00080000:0.0:1734016116.786068:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016116.789684:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1734016116.790327:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016116.790340:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115840 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016116.790347:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115840 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016116.790352:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499ed00 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016116.790356:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115840 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016116.790363:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115840 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016116.790378:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016116.790382:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016116.790385:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115840 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016116.790390:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ed00/0x5e3a3adc27115840 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016116.791127:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333721088 00000100:00100000:2.0:1734016116.791137:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333721088 00000100:00100000:2.0:1734016116.791177:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10889 00000100:00100000:2.0:1734016116.791184:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333721088:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016116.791200:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016116.791215:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115847 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a16 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.791238:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27115839 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a0f expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.791244:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016116.791247:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016116.791250:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115847 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a16 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.791279:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27115839 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a0f expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.791290:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27115839 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a0f expref: 8 pid: 7684 timeout: 483 lvb_type: 1 00000100:00100000:2.0:1734016116.791303:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335293440:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016116.791469:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016116.798720:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335293440:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016116.798760:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115847 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a16 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016116.798783:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:0.0:1734016116.798866:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333721088:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7681us (9191us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016116.798875:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10889 00000100:00100000:3.0:1734016116.812150:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.812244:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333721216 00000100:00100000:2.0:1734016116.812253:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333721216 00010000:00010000:2.0:1734016116.812288:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27115839 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a0f expref: 8 pid: 7684 timeout: 483 lvb_type: 1 00000100:00100000:2.0:1734016116.812314:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3025 00000100:00100000:2.0:1734016116.812320:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333721216:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016116.812334:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016116.812353:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27115839 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a0f expref: 8 pid: 7684 timeout: 483 lvb_type: 1 00010000:00010000:2.0:1734016116.812365:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27115839 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a0f expref: 8 pid: 7684 timeout: 483 lvb_type: 1 00010000:00010000:2.0:1734016116.812382:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27115839 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a0f expref: 8 pid: 7684 timeout: 483 lvb_type: 1 00010000:00010000:2.0:1734016116.813131:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016116.813134:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016116.813140:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115847 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a16 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.813149:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115847 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a16 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.813390:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115847 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a16 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016116.813405:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335293568:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016116.813659:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016116.824341:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013040b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335293568:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016116.824371:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016116.824427:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333721216:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 12104us (12283us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016116.824440:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3025 00000100:00100000:0.0:1734016116.824739:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.828042:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333721344 00000100:00100000:1.0:1734016116.828054:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333721344 00002000:00010000:1.0:1734016116.828090:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (10058140->18446744073709551615) 00002000:00100000:1.0:1734016116.828094:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073792300 with x1818247333721344 ext(10058140->18446744073709551615) 00002000:00010000:1.0:1734016116.828104:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073792300. 00000100:00100000:1.0:1734016116.828148:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8628 00000100:00100000:1.0:1734016116.828154:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333721344:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016116.828338:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8306688 -> 10058140 00002000:00010000:1.0:1734016116.828341:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016117 -> 1734016117 00002000:00010000:1.0:1734016116.828343:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016116 -> 1734016116 00002000:00010000:1.0:1734016116.828345:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016116 -> 1734016117 00002000:00010000:1.0:1734016116.828347:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 616 -> 616 00000100:00100000:1.0:1734016116.828408:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333721344:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 253us (3669us total) trans 4294969412 rc 0/0 00000100:00100000:1.0:1734016116.828415:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8628 00002000:00010000:1.0:1734016116.828418:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (10058140->18446744073709551615) 00002000:00100000:1.0:1734016116.828420:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073792300 with x1818247333721344 ext(10058140->18446744073709551615) 00002000:00010000:1.0:1734016116.828424:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073792300. 00000100:00100000:0.0:1734016116.860624:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.860727:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333721600 00000100:00100000:2.0:1734016116.860736:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333721600 00002000:00100000:2.0:1734016116.860785:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8306688->10059775) req@ffff880073791c00 x1818247333721600/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:77/0 lens 488/0 e 0 to 0 dl 1734016127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016116.860793:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073791c00 with x1818247333721600 ext(8306688->10059775) 00002000:00010000:2.0:1734016116.860828:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073791c00 00000100:00100000:2.0:1734016116.860859:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8629 00000100:00100000:2.0:1734016116.860865:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333721600:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016116.892700:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333721600:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 31825us (32076us total) trans 0 rc 1753088/1753088 00000100:00100000:2.0:1734016116.892711:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8629 00002000:00100000:2.0:1734016116.892723:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (8306688->10059775) req@ffff880073791c00 x1818247333721600/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:77/0 lens 488/440 e 0 to 0 dl 1734016127 ref 1 fl Complete:/200/0 rc 1753088/1753088 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016116.892732:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073791c00 with x1818247333721600 ext(8306688->10059775) 00002000:00010000:2.0:1734016116.892737:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073791c00 00000100:00100000:3.0:1734016116.911065:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.913950:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333721728 00000100:00100000:2.0:1734016116.913969:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333721728 00002000:00100000:2.0:1734016116.914036:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (10022912->10058139) req@ffff88013040b800 x1818247333721728/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:77/0 lens 488/0 e 0 to 0 dl 1734016127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016116.914048:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88013040b800 with x1818247333721728 ext(10022912->10058139) 00002000:00010000:2.0:1734016116.914055:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013040b800 00000100:00100000:2.0:1734016116.915551:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8630 00000100:00100000:2.0:1734016116.915561:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333721728:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016116.923313:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333721728:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 7743us (12251us total) trans 4294969413 rc 0/0 00000100:00100000:2.0:1734016116.923325:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8630 00002000:00100000:2.0:1734016116.923336:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (10022912->10058139) req@ffff88013040b800 x1818247333721728/t4294969413(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:77/0 lens 488/448 e 0 to 0 dl 1734016127 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016116.923344:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88013040b800 with x1818247333721728 ext(10022912->10058139) 00002000:00010000:2.0:1734016116.923349:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013040b800 00000100:00100000:3.0:1734016116.935796:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016116.935918:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333721856 00000100:00100000:0.0:1734016116.935926:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333721856 00000100:00100000:0.0:1734016116.935985:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2196 00000100:00100000:0.0:1734016116.935992:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+31:9668:x1818247333721856:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:0.0:1734016116.936114:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+31:9668:x1818247333721856:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 122us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016116.936121:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2196 00000100:00100000:3.0:1734016116.942343:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016116.942971:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333721984 00000100:00100000:0.0:1734016116.942980:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333721984 00000100:00100000:0.0:1734016116.943387:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10890 00000100:00100000:0.0:1734016116.943395:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333721984:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016116.945035:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969413 is committed 00000100:00100000:0.0:1734016116.945159:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333721984:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 1762us (2825us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016116.945167:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10890 00000100:00100000:1.0:1734016116.950394:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.950490:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333722112 00000100:00100000:2.0:1734016116.950501:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333722112 00000100:00100000:2.0:1734016116.950563:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2197 00000100:00100000:2.0:1734016116.950571:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+31:9668:x1818247333722112:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016116.950595:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016116.950615:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711584e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a1d expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.950706:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115855 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016116.950720:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016116.950731:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:2.0:1734016116.950760:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 10058140 00000004:00200000:2.0:1734016116.950765:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016116.950782:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016116.950860:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc2711584e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a1d expref: 33 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.951094:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115855 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a1d expref: 32 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.951103:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016116.951105:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016116.951108:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016116.951368:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+32:9668:x1818247333722112:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 796us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016116.951375:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2197 00000100:00100000:3.0:1734016116.958085:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.958201:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333722240 00000100:00100000:1.0:1734016116.958212:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333722240 00000100:00100000:1.0:1734016116.958271:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10891 00000100:00100000:1.0:1734016116.958278:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333722240:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016116.958299:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016116.958321:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711585c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a24 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016116.958394:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335293696:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016116.958461:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fcc0 going to sleep for 11 seconds 00002000:00010000:1.0:1734016116.960054:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016116 -> 1734016117 00002000:00010000:1.0:1734016116.960061:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 616 -> 688 00000100:00100000:1.0:1734016116.960078:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335293696:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016116.960112:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711585c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a24 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.960124:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711585c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a24 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.960136:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016116.960174:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333722240:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1896us (2103us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016116.960182:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10891 00000100:00100000:2.0:1734016116.966721:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016116.967409:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333722496 00000100:00100000:3.0:1734016116.967421:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333722496 00000100:00100000:3.0:1734016116.967489:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8631 00000100:00100000:3.0:1734016116.967496:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333722496:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:3.0:1734016116.967532:0:13914:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115863 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.967551:0:13914:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115847 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a16 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.967558:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016116.967560:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016116.967563:0:13914:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115863 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4415488->4476927] (req 4415488->4476927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.967600:0:13914:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115847 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a16 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.967615:0:13914:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115847 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a16 expref: 6 pid: 8216 timeout: 484 lvb_type: 0 00000100:00100000:3.0:1734016116.967630:0:13914:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335293824:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016116.967708:0:13914:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016116.975011:0:13914:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335293824:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016116.975049:0:13914:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115863 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4415488->4476927] (req 4415488->4476927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016116.983247:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016116.983349:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333722624 00000100:00100000:3.0:1734016116.983357:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333722624 00010000:00010000:3.0:1734016116.983394:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115847 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a16 expref: 7 pid: 8216 timeout: 484 lvb_type: 0 00000100:00100000:3.0:1734016116.983426:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3026 00000100:00100000:3.0:1734016116.983434:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333722624:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016116.983455:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016116.983479:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115847 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a16 expref: 7 pid: 8216 timeout: 484 lvb_type: 0 00010000:00010000:3.0:1734016116.983491:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115847 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a16 expref: 7 pid: 8216 timeout: 484 lvb_type: 0 00010000:00010000:3.0:1734016116.983521:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115847 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a16 expref: 7 pid: 8216 timeout: 484 lvb_type: 0 00010000:00010000:3.0:1734016116.983549:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016116.983551:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016116.983555:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115863 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4415488->4476927] (req 4415488->4476927) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.983564:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115863 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4415488->4476927] (req 4415488->4476927) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016116.983603:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016116.983652:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333722624:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 219us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016116.983659:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3026 00010000:00010000:1.0:1734016116.984038:0:13914:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115863 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4415488->4476927] (req 4415488->4476927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.984048:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115863 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4415488->4476927] (req 4415488->4476927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.988024:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115863 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4415488->4476927] (req 4415488->4476927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.988043:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115863 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4415488->4476927] (req 4415488->4476927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.988054:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115863 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4415488->4476927] (req 4415488->4476927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.988061:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df73c0 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016116.988065:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115863 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4415488->4476927] (req 4415488->4476927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.988073:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115863 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4415488->4476927] (req 4415488->4476927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.988088:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115863 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4415488->4476927] (req 4415488->4476927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016116.988095:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115863 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4415488->4476927] (req 4415488->4476927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016116.988908:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333722496:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 21407us (22197us total) trans 0 rc 61440/61440 00000100:00100000:1.0:1734016116.988920:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8631 00000100:00100000:3.0:1734016116.994836:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016116.995010:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333722752 00000100:00100000:1.0:1734016116.995020:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333722752 00000100:00100000:1.0:1734016116.995074:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10892 00000100:00100000:1.0:1734016116.995080:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333722752:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016116.995096:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016116.995112:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711586a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a2b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016116.995135:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 10058140, mtime: 0x675afc75, atime: 0x675afc74, ctime: 0x675afc75, blocks: 0x2b0 00010000:00010000:1.0:1734016116.995154:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.995156:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016116.995163:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711586a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a2b expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.995180:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711586a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a2b expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016116.995190:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016116.995236:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333722752:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 156us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016116.995243:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10892 00000100:00100000:3.0:1734016116.998629:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016116.998766:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333722880 00000100:00100000:2.0:1734016116.998778:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333722880 00000100:00100000:2.0:1734016116.998867:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10893 00000100:00100000:2.0:1734016116.998874:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333722880:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016116.998897:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016116.998921:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115871 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a32 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.998956:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711586a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a2b expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.998963:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016116.998964:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016116.998967:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115871 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5910528->5980159] (req 5910528->5980159) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a32 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016116.998997:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711586a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a2b expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016116.999008:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711586a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a2b expref: 8 pid: 8216 timeout: 484 lvb_type: 1 00000100:00100000:2.0:1734016116.999022:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335293952:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016116.999091:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.002283:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016117.002450:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333723008 00000100:00100000:0.0:1734016117.002461:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333723008 00000100:00100000:2.0:1734016117.002694:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335293952:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016117.002735:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115871 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5910528->5980159] (req 5910528->5980159) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a32 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.002754:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016117.002847:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:9668:x1818247333722880:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3972us (4232us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016117.002860:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10893 00010000:00010000:0.0:1734016117.002963:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711586a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a2b expref: 8 pid: 8216 timeout: 484 lvb_type: 1 00000100:00100000:0.0:1734016117.002994:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3027 00000100:00100000:0.0:1734016117.002999:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333723008:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016117.003013:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016117.003036:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711586a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a2b expref: 8 pid: 8216 timeout: 484 lvb_type: 1 00010000:00010000:0.0:1734016117.003046:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711586a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a2b expref: 8 pid: 8216 timeout: 484 lvb_type: 1 00010000:00010000:0.0:1734016117.003069:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711586a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a2b expref: 8 pid: 8216 timeout: 484 lvb_type: 1 00000100:00080000:1.0:1734016117.003748:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016087 00010000:00010000:0.0:1734016117.004026:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016117.004028:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016117.004039:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115871 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5910528->5980159) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a32 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016117.004050:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115871 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5910528->5980159) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a32 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016117.004092:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115871 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5910528->5980159) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a32 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016117.004107:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073792680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335294080:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016117.004708:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.009102:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.009481:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333723136 00000100:00100000:2.0:1734016117.009494:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333723136 00000100:00100000:1.0:1734016117.009625:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073792680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335294080:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016117.009657:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016117.009888:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10894 00000100:00100000:2.0:1734016117.009897:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333723136:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016117.010159:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10058140 -> 10058140 00002000:00010000:2.0:1734016117.010163:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016117 -> 1734016117 00002000:00010000:2.0:1734016117.010165:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016116 -> 1734016116 00002000:00010000:2.0:1734016117.010167:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016117 -> 1734016117 00002000:00010000:2.0:1734016117.010168:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 688 -> 824 00000100:00100000:1.0:1734016117.010324:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333723008:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7322us (8051us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016117.010334:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3027 00000100:00100000:2.0:1734016117.010873:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333723136:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 975us (1785us total) trans 4294969414 rc 0/0 00000100:00100000:2.0:1734016117.010881:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10894 00000100:00100000:3.0:1734016117.014947:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.015227:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333723264 00000100:00100000:2.0:1734016117.015237:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333723264 00000100:00080000:1.0:1734016117.015518:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016087 00000100:00100000:2.0:1734016117.015618:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2198 00000100:00100000:2.0:1734016117.015627:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+29:9668:x1818247333723264:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016117.015649:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016117.015669:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27115878 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a39 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.015762:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711587f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016117.015777:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711587f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016117.015791:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711587f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:2.0:1734016117.015842:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 10058140 00000004:00200000:2.0:1734016117.015847:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016117.015863:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711587f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016117.015888:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27115878 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a39 expref: 31 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.016143:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711587f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a39 expref: 30 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.016150:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016117.016152:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016117.016154:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016117.016198:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+30:9668:x1818247333723264:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 572us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016117.016204:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2198 00000100:00100000:3.0:1734016117.021626:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.021728:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333723392 00000100:00100000:2.0:1734016117.021738:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333723392 00000100:00100000:2.0:1734016117.021780:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10895 00000100:00100000:2.0:1734016117.021787:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333723392:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016117.021929:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016117.021955:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115886 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a40 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016117.022009:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335294208:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016117.022068:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ef00 going to sleep for 11 seconds 00002000:00010000:2.0:1734016117.033475:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016116 -> 1734016117 00000100:00100000:2.0:1734016117.033507:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335294208:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016117.033538:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115886 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a40 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.033553:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115886 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a40 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.033567:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016117.033624:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333723392:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11836us (12009us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016117.033632:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10895 00000100:00100000:3.0:1734016117.041417:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.045025:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333723520 00000100:00100000:2.0:1734016117.045038:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333723520 00000100:00100000:2.0:1734016117.045104:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10896 00000100:00100000:2.0:1734016117.045111:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333723520:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016117.045128:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016117.045146:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc2711588d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a47 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016117.045203:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335294336:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016117.045295:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016117.048200:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335294336:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016117.048236:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc2711588d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a47 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.048250:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc2711588d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a47 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.048274:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016117.048331:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333723520:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3219us (6923us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016117.048340:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10896 00000100:00100000:3.0:1734016117.058457:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.058994:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333723648 00000100:00100000:2.0:1734016117.059009:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333723648 00000100:00100000:2.0:1734016117.059062:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10897 00000100:00100000:2.0:1734016117.059069:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333723648:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016117.059088:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016117.059113:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115894 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a4e expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.059139:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115871 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5910528->5980159) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a32 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.059146:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016117.059147:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016117.059150:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115894 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [8343552->8368127] (req 8343552->8368127) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a4e expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.059183:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115871 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5910528->5980159) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a32 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.059193:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115871 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5910528->5980159) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a32 expref: 7 pid: 7684 timeout: 484 lvb_type: 0 00000100:00100000:2.0:1734016117.059206:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335294464:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016117.059267:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.068738:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016117.068877:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333723776 00000100:00100000:1.0:1734016117.068892:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333723776 00010000:00010000:1.0:1734016117.068950:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115871 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5910528->5980159) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a32 expref: 8 pid: 7684 timeout: 484 lvb_type: 0 00000100:00100000:1.0:1734016117.068997:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3028 00000100:00100000:1.0:1734016117.069006:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333723776:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016117.069022:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016117.069052:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115871 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5910528->5980159) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a32 expref: 8 pid: 7684 timeout: 484 lvb_type: 0 00010000:00010000:1.0:1734016117.069071:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115871 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5910528->5980159) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a32 expref: 8 pid: 7684 timeout: 484 lvb_type: 0 00010000:00010000:1.0:1734016117.069103:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016117.069106:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016117.069113:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115894 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8343552->8368127) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a4e expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016117.069122:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115894 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8343552->8368127) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a4e expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016117.069170:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115894 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8343552->8368127) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a4e expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016117.069185:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335294592:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016117.070798:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115871 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5910528->5980159) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a32 expref: 8 pid: 7684 timeout: 484 lvb_type: 0 00000100:00100000:2.0:1734016117.070847:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335294464:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016117.070875:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115894 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8343552->8368127) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a4e expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.070885:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016117.070975:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333723648:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11906us (12533us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016117.070983:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10897 00000100:00100000:1.0:1734016117.076954:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016117.085659:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335294592:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016117.085684:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016117.085749:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333723776:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 16742us (17031us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016117.085760:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3028 00000100:00100000:3.0:1734016117.086364:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.086455:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333723904 00000100:00100000:2.0:1734016117.086463:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333723904 00000100:00100000:2.0:1734016117.088228:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10898 00000100:00100000:2.0:1734016117.088240:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333723904:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016117.088446:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10058140 -> 10058140 00002000:00010000:2.0:1734016117.088450:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016117 -> 1734016117 00002000:00010000:2.0:1734016117.088452:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016117 -> 1734016116 00002000:00010000:2.0:1734016117.088453:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016117 -> 1734016117 00002000:00010000:2.0:1734016117.088455:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 824 -> 824 00000100:00100000:2.0:1734016117.089881:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333723904:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1638us (3513us total) trans 4294969415 rc 0/0 00000100:00100000:2.0:1734016117.089891:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10898 00000100:00100000:0.0:1734016117.093253:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.093379:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333724032 00000100:00100000:2.0:1734016117.093392:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333724032 00000100:00100000:1.0:1734016117.094867:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10899 00000100:00100000:1.0:1734016117.094875:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333724032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016117.094901:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016117.094920:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc2711589b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a55 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016117.094994:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335294720:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016117.095422:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fcc0 going to sleep for 11 seconds 00002000:00010000:1.0:1734016117.108878:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016116 -> 1734016117 00000100:00100000:1.0:1734016117.108905:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335294720:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016117.108947:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc2711589b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a55 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016117.108961:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc2711589b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a55 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016117.108986:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016117.109040:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333724032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 14164us (15803us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016117.109048:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10899 00000100:00100000:0.0:1734016117.111519:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016117.112275:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333724160 00000100:00100000:1.0:1734016117.112285:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333724160 00000100:00100000:1.0:1734016117.113593:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10900 00000100:00100000:1.0:1734016117.113606:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333724160:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016117.113627:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016117.113644:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271158a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a5c expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016117.113704:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335294848:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016117.115024:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016117.117166:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335294848:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016117.117213:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271158a2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a5c expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016117.117230:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271158a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a5c expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016117.117243:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016117.117311:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333724160:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3706us (5801us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016117.117319:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10900 00000100:00100000:0.0:1734016117.121454:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016117.121547:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333724288 00000100:00100000:1.0:1734016117.121556:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333724288 00000100:00100000:1.0:1734016117.122092:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10901 00000100:00100000:1.0:1734016117.122100:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333724288:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016117.122119:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016117.122134:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271158a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a63 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016117.122181:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335294976:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016117.122237:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016117.125861:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335294976:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016117.125917:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271158a9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a63 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.125943:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc271158a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a63 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.126005:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:2.0:1734016117.126200:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333724288:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4097us (4750us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016117.126212:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10901 00000100:00100000:0.0:1734016117.129110:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.129272:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333724416 00000100:00100000:2.0:1734016117.129282:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333724416 00000100:00100000:2.0:1734016117.129366:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10902 00000100:00100000:2.0:1734016117.129374:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333724416:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016117.129391:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016117.129406:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271158b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a6a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016117.129457:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335295104:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016117.130072:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016117.135484:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335295104:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016117.135531:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271158b0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a6a expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.135546:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271158b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a6a expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.136135:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016117.136215:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333724416:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6838us (7114us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016117.136225:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10902 00000100:00100000:2.0:1734016117.139433:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67a75f73-9674-4938-8c12-63813a36f078:3504:1818247335295232:0@lo:400:kworker.0 00000100:00100000:2.0:1734016117.139507:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1734016117.139530:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3504:1818247335295744:0@lo:400:kworker.0 00000100:00100000:2.0:1734016117.139553:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1734016117.139573:0:3504:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1734016117.139578:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335295616:0@lo:400:kworker.0 00000100:00100000:2.0:1734016117.139597:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1734016117.139616:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3506:1818247335295488:0@lo:400:kworker.0 00000100:00100000:2.0:1734016117.139633:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1734016117.139646:0:3506:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1734016117.139650:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3506:1818247335295360:0@lo:400:kworker.0 00000100:00100000:2.0:1734016117.139664:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1734016117.139673:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335295872:0@lo:400:kworker.0 00000100:00100000:2.0:1734016117.139686:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1734016117.139710:0:6474:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335295232 00000100:00100000:2.0:1734016117.139718:0:6474:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335295232 00000100:00100000:2.0:1734016117.139754:0:6474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1734016117.139761:0:6474:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7612050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a75f73-9674-4938-8c12-63813a36f078+18:3504:x1818247335295232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1734016117.139819:0:6474:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7612050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a75f73-9674-4938-8c12-63813a36f078+18:3504:x1818247335295232:12345-0@lo:400:kworker.0 Request processed in 39us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016117.139826:0:6474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1734016117.139853:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335295744 00000100:00100000:2.0:1734016117.139855:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335295744 00000100:00100000:2.0:1734016117.139872:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335295488 00000100:00100000:2.0:1734016117.139874:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335295488 00000100:00100000:2.0:1734016117.139885:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335295360 00000100:00100000:2.0:1734016117.139887:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335295360 00000100:00100000:2.0:1734016117.139896:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1734016117.139899:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3504:x1818247335295744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1734016117.139922:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3504:x1818247335295744:12345-0@lo:400:kworker.0 Request processed in 22us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016117.139927:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1734016117.139949:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1734016117.139953:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3506:x1818247335295488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1734016117.139975:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3506:x1818247335295488:12345-0@lo:400:kworker.0 Request processed in 21us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016117.139979:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1734016117.139987:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1734016117.139989:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3506:x1818247335295360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1734016117.140005:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3506:x1818247335295360:12345-0@lo:400:kworker.0 Request processed in 14us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016117.140009:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1734016117.140034:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3506:1818247335295360:0@lo:400:kworker.0 00000100:00100000:2.0:1734016117.140041:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3506:1818247335295488:0@lo:400:kworker.0 00000100:00100000:2.0:1734016117.140062:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67a75f73-9674-4938-8c12-63813a36f078:3504:1818247335295232:0@lo:400:kworker.0 00000100:00100000:2.0:1734016117.140069:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3504:1818247335295744:0@lo:400:kworker.0 00000100:00100000:2.0:1734016117.140082:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335295616 00000100:00100000:2.0:1734016117.140084:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335295616 00000100:00100000:2.0:1734016117.140106:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335295872 00000100:00100000:2.0:1734016117.140108:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335295872 00000100:00100000:2.0:1734016117.140120:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1734016117.140123:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335295616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1734016117.140147:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335295616:12345-0@lo:400:kworker.0 Request processed in 23us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016117.140151:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1734016117.140158:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1734016117.140161:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335295872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1734016117.140179:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335295872:12345-0@lo:400:kworker.0 Request processed in 18us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016117.140184:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1734016117.140203:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335295872:0@lo:400:kworker.0 00000100:00100000:2.0:1734016117.140219:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335295616:0@lo:400:kworker.0 00000100:00080000:1.0:1734016117.140700:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016087 00000100:00080000:1.0:1734016117.140705:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016087 00000100:00080000:1.0:1734016117.140707:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016087 00000100:00080000:1.0:1734016117.140708:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016087 00000100:00100000:2.0:1734016117.141290:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016117.141436:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333724544 00000100:00100000:0.0:1734016117.141442:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333724544 00000100:00100000:0.0:1734016117.141474:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10903 00000100:00100000:0.0:1734016117.141479:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333724544:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016117.141491:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016117.141508:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc271158b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a71 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016117.141557:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073791180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335296000:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016117.142200:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eec00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016117.144305:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073791180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335296000:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016117.144340:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc271158b7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a71 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.144352:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc271158b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a71 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.144374:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:2.0:1734016117.144410:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333724544:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2930us (3122us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016117.144418:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10903 00000100:00100000:0.0:1734016117.147540:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.147917:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333724672 00000100:00100000:2.0:1734016117.147926:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333724672 00000100:00100000:2.0:1734016117.147970:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10904 00000100:00100000:2.0:1734016117.147978:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333724672:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016117.147998:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016117.148017:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271158be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a78 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016117.148075:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075653480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335296128:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016117.148136:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016117.150404:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075653480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335296128:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016117.150441:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271158be lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a78 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.150455:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271158be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a78 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.150707:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016117.150758:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333724672:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2780us (3227us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016117.150767:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10904 00000100:00100000:0.0:1734016117.153595:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016117.155200:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333724928 00000100:00100000:1.0:1734016117.155213:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333724928 00000100:00100000:1.0:1734016117.155276:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8632 00000100:00100000:1.0:1734016117.155283:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333724928:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:1.0:1734016117.155323:0:13914:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271158c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016117.155341:0:13914:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115894 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8343552->8368127) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a4e expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016117.155347:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016117.155349:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016117.155351:0:13914:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271158c5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016117.155383:0:13914:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115894 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8343552->8368127) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a4e expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016117.155394:0:13914:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115894 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8343552->8368127) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a4e expref: 6 pid: 7684 timeout: 484 lvb_type: 0 00000100:00100000:1.0:1734016117.155407:0:13914:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335296256:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016117.155473:0:13914:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016117.160093:0:13914:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335296256:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016117.160120:0:13914:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271158c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016117.160216:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016117.160293:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333725056 00000100:00100000:1.0:1734016117.160301:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333725056 00010000:00010000:1.0:1734016117.160332:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115894 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8343552->8368127) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a4e expref: 7 pid: 7684 timeout: 484 lvb_type: 0 00000100:00100000:3.0:1734016117.165079:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3029 00000100:00100000:3.0:1734016117.165094:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b42c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333725056:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016117.165116:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016117.165145:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115894 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8343552->8368127) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a4e expref: 7 pid: 7684 timeout: 484 lvb_type: 0 00010000:00010000:3.0:1734016117.165160:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115894 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8343552->8368127) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a4e expref: 7 pid: 7684 timeout: 484 lvb_type: 0 00010000:00010000:3.0:1734016117.165187:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115894 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8343552->8368127) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a4e expref: 7 pid: 7684 timeout: 484 lvb_type: 0 00010000:00010000:3.0:1734016117.165295:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016117.165297:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016117.165302:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271158c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.165311:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271158c5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.165334:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016117.165392:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b42c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333725056:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 300us (5176us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016117.165398:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3029 00010000:00010000:1.0:1734016117.165477:0:13914:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271158c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016117.165484:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271158c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1734016117.174615:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969416 is committed 00000001:00080000:2.0:1734016117.174632:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969415 is committed 00002000:00010000:1.0:1734016117.174897:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 824 -> 904 00010000:00010000:1.0:1734016117.174910:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271158c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016117.174920:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271158c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016117.174928:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271158c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016117.174945:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499ef40 already unused, calling callback (ffffffffa080e100) 00010000:00010000:1.0:1734016117.174949:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271158c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016117.174957:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271158c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016117.174974:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271158c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016117.174983:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271158c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [6316032->6356991] (req 6316032->6356991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016117.175076:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333724928:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 19788us (21484us total) trans 4294969416 rc 0/0 00000100:00100000:1.0:1734016117.175085:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8632 00000100:00100000:0.0:1734016117.181983:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.185219:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333725184 00000100:00100000:2.0:1734016117.185236:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333725184 00000100:00100000:2.0:1734016117.185300:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10905 00000100:00100000:2.0:1734016117.185307:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333725184:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016117.185327:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016117.185350:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271158cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a7f expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1734016117.185372:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 10058140, mtime: 0x675afc75, atime: 0x675afc75, ctime: 0x675afc75, blocks: 0x388 00010000:00010000:2.0:1734016117.185390:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016117.185392:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016117.185400:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271158cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a7f expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.185413:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271158cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a7f expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.185427:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016117.185498:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333725184:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 191us (3704us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016117.185504:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10905 00000100:00100000:0.0:1734016117.187449:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335296384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1734016117.187521:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1734016117.187695:0:7686:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335296384 00000100:00100000:3.0:1734016117.187704:0:7686:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335296384 00000100:00100000:3.0:1734016117.187766:0:7686:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1734016117.187773:0:7686:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335296384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1734016117.187797:0:7686:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 980042304 pending 0 free 3923546112 avail 3691655168 00000100:00100000:3.0:1734016117.187862:0:7686:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335296384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016117.187869:0:7686:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1734016117.187979:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335296384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1734016117.193526:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.193729:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333725312 00000100:00100000:2.0:1734016117.193744:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333725312 00000100:00100000:2.0:1734016117.193788:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10906 00000100:00100000:2.0:1734016117.193796:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333725312:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016117.193855:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016117.193875:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271158d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a86 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.193918:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271158cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a7f expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.193926:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016117.193929:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016117.193945:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271158d3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7213056->7245823] (req 7213056->7245823) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a86 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.193982:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271158cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a7f expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.194000:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271158cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a7f expref: 7 pid: 7684 timeout: 484 lvb_type: 1 00000100:00100000:2.0:1734016117.194023:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075651f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335296512:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016117.194118:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016117.197286:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.198160:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333725440 00000100:00100000:3.0:1734016117.198172:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333725440 00010000:00010000:3.0:1734016117.198211:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271158cc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a7f expref: 8 pid: 7684 timeout: 484 lvb_type: 1 00000100:00100000:3.0:1734016117.198259:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3030 00000100:00100000:3.0:1734016117.198268:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333725440:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016117.198284:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016117.198302:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271158cc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a7f expref: 8 pid: 7684 timeout: 484 lvb_type: 1 00010000:00010000:3.0:1734016117.198316:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271158cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a7f expref: 8 pid: 7684 timeout: 484 lvb_type: 1 00010000:00010000:3.0:1734016117.198344:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016117.198347:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016117.198354:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271158d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7213056->7245823) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a86 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.198363:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271158d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7213056->7245823) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a86 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.198402:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271158d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7213056->7245823) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a86 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.198415:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335296640:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016117.198477:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92180 going to sleep for 11 seconds 00010000:00010000:2.0:1734016117.198840:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271158cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a7f expref: 8 pid: 7684 timeout: 484 lvb_type: 1 00000100:00100000:2.0:1734016117.198857:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075651f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335296512:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016117.198878:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271158d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7213056->7245823) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a86 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.198885:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016117.198906:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333725312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5110us (5397us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016117.198912:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10906 00000100:00100000:3.0:1734016117.200534:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335296640:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016117.200552:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016117.200585:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333725440:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 2318us (3316us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016117.200594:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3030 00000100:00100000:0.0:1734016117.200885:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.201141:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333725568 00000100:00100000:3.0:1734016117.201148:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333725568 00000100:00100000:3.0:1734016117.201179:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10907 00000100:00100000:3.0:1734016117.201184:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333725568:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016117.201467:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10058140 -> 10058140 00002000:00010000:3.0:1734016117.201470:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016117 -> 1734016117 00002000:00010000:3.0:1734016117.201473:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016117 -> 1734016117 00002000:00010000:3.0:1734016117.201475:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016117 -> 1734016117 00002000:00010000:3.0:1734016117.201477:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 904 -> 904 00000100:00100000:3.0:1734016117.201522:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333725568:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 336us (637us total) trans 4294969417 rc 0/0 00000100:00100000:3.0:1734016117.201529:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10907 00000100:00100000:0.0:1734016117.205884:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.208299:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333725696 00000100:00100000:2.0:1734016117.208317:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333725696 00000100:00100000:2.0:1734016117.208407:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10908 00000100:00100000:2.0:1734016117.208415:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333725696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016117.208439:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016117.208461:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271158da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a8d expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016117.208523:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075651f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335296768:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016117.208597:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.212424:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075651f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335296768:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.212473:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271158da lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a8d expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.212487:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271158da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a8d expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.212946:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:3.0:1734016117.213010:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333725696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4595us (7139us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.213020:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10908 00000100:00100000:0.0:1734016117.215594:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.215821:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333725824 00000100:00100000:3.0:1734016117.215831:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333725824 00000100:00100000:3.0:1734016117.215876:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10909 00000100:00100000:3.0:1734016117.215883:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333725824:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.215904:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.215923:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271158e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a94 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.215996:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335296896:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.216055:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92180 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.220711:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335296896:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.220757:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271158e1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a94 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.220771:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271158e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a94 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.220784:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df58c0, rc 0) 00000100:00100000:3.0:1734016117.221243:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333725824:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5358us (5657us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.221250:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10909 00000100:00100000:0.0:1734016117.226089:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.226606:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333725952 00000100:00100000:3.0:1734016117.226616:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333725952 00000100:00100000:3.0:1734016117.226958:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10910 00000100:00100000:3.0:1734016117.226965:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333725952:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.226985:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.227001:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271158e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5a9b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.227052:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335297024:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.229060:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92180 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.232154:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335297024:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.232185:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271158e8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a9b expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.232197:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc271158e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a9b expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.232222:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4b40, rc 0) 00000100:00100000:3.0:1734016117.232262:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333725952:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5296us (6184us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.232273:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10910 00000100:00100000:0.0:1734016117.234778:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.235031:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333726080 00000100:00100000:3.0:1734016117.235042:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333726080 00000100:00100000:3.0:1734016117.235097:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10911 00000100:00100000:3.0:1734016117.235106:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333726080:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.235131:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.235153:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271158ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5aa2 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.235188:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271158d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7213056->7245823) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a86 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.235196:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016117.235198:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016117.235203:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271158ef lrc: 4/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5210112->5214207] (req 5210112->5214207) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa2 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.235239:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271158d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7213056->7245823) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a86 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.235251:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271158d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7213056->7245823) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a86 expref: 6 pid: 8216 timeout: 484 lvb_type: 0 00000100:00100000:3.0:1734016117.235267:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335297152:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016117.235340:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92180 going to sleep for 11 seconds 00000100:00100000:0.0:1734016117.238838:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.238967:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333726208 00000100:00100000:2.0:1734016117.238978:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333726208 00010000:00010000:2.0:1734016117.239020:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271158d3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7213056->7245823) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a86 expref: 7 pid: 8216 timeout: 484 lvb_type: 0 00000100:00100000:2.0:1734016117.239054:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3031 00000100:00100000:2.0:1734016117.239061:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333726208:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016117.239081:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016117.239105:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271158d3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7213056->7245823) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a86 expref: 7 pid: 8216 timeout: 484 lvb_type: 0 00010000:00010000:2.0:1734016117.239117:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271158d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7213056->7245823) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a86 expref: 7 pid: 8216 timeout: 484 lvb_type: 0 00010000:00010000:2.0:1734016117.239147:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016117.239150:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016117.239157:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271158ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5210112->5214207) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa2 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.239167:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271158ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5210112->5214207) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa2 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.239203:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271158ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5210112->5214207) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa2 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016117.239215:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075651180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335297280:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016117.239272:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00010000:00010000:3.0:1734016117.239397:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271158d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7213056->7245823) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a86 expref: 7 pid: 8216 timeout: 484 lvb_type: 0 00000100:00100000:3.0:1734016117.239411:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335297152:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016117.239433:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271158ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5210112->5214207) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa2 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.239441:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016117.239463:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333726080:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4358us (4700us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016117.239470:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10911 00000100:00100000:2.0:1734016117.241790:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075651180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335297280:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016117.241848:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016117.242460:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333726208:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3396us (3659us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016117.242473:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3031 00000100:00100000:0.0:1734016117.243929:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016117.244545:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333726464 00000100:00100000:1.0:1734016117.244557:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333726464 00002000:00100000:1.0:1734016117.244620:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (5210112->10059775) req@ffff880073b4a300 x1818247333726464/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:78/0 lens 504/0 e 0 to 0 dl 1734016128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016117.244634:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b4a300 with x1818247333726464 ext(5210112->10059775) 00002000:00010000:1.0:1734016117.244641:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b4a300 00000100:00100000:1.0:1734016117.245226:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8633 00000100:00100000:1.0:1734016117.245233:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333726464:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016117.247604:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333726464:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 2360us (3671us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1734016117.247615:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8633 00002000:00100000:1.0:1734016117.247626:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (5210112->10059775) req@ffff880073b4a300 x1818247333726464/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:78/0 lens 504/440 e 0 to 0 dl 1734016128 ref 1 fl Complete:/200/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016117.247634:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b4a300 with x1818247333726464 ext(5210112->10059775) 00002000:00010000:1.0:1734016117.247641:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b4a300 00000100:00100000:2.0:1734016117.250523:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.250630:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333726592 00000100:00100000:3.0:1734016117.250638:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333726592 00000100:00100000:3.0:1734016117.250866:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10912 00000100:00100000:3.0:1734016117.250872:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333726592:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.250890:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.250905:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271158f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5aa9 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.250928:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016117.250930:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016117.250948:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271158f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa9 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.250962:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271158f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa9 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.250972:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016117.251314:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333726592:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 441us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016117.251321:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10912 00000100:00100000:0.0:1734016117.255105:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016117.255234:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333726848 00000100:00100000:1.0:1734016117.255243:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333726848 00000100:00100000:1.0:1734016117.255314:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2199 00000100:00100000:1.0:1734016117.255322:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+32:9668:x1818247333726848:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016117.255382:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016117.255412:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115855 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a1d expref: 32 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016117.255433:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016117.255438:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016117.255593:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271158fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016117.255604:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711587f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a39 expref: 29 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016117.255610:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271158fd lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016117.255636:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711587f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a39 expref: 29 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016117.255647:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711587f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a39 expref: 29 pid: 7704 timeout: 484 lvb_type: 0 00000100:00100000:1.0:1734016117.255662:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335297408:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016117.255718:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fcc0 going to sleep for 11 seconds 00000100:00080000:2.0:1734016117.255778:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016087 00000100:00100000:2.0:1734016117.258636:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335297408:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016117.258664:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271158fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:0.0:1734016117.259446:0:6461:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968714 is committed 00000001:00080000:0.0:1734016117.259459:0:6461:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968709 is committed 00000100:00100000:2.0:1734016117.260207:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016117.260576:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333726976 00000100:00100000:0.0:1734016117.260584:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333726976 00010000:00010000:0.0:1734016117.260617:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711587f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a39 expref: 12 pid: 7704 timeout: 484 lvb_type: 0 00000100:00100000:0.0:1734016117.260652:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3032 00000100:00100000:0.0:1734016117.260658:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075652300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333726976:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016117.260669:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016117.260674:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711587f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a39 expref: 12 pid: 7704 timeout: 484 lvb_type: 0 00010000:00010000:0.0:1734016117.260684:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711587f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a39 expref: 12 pid: 7704 timeout: 484 lvb_type: 0 00010000:00010000:0.0:1734016117.260703:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711587f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5a39 expref: 12 pid: 7704 timeout: 484 lvb_type: 0 00010000:00010000:0.0:1734016117.260726:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016117.260732:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271158fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016117.260740:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271158fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016117.260746:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271158fd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016117.260774:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016117.260828:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075652300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333726976:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 170us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016117.260834:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3032 00010000:00010000:3.0:1734016117.261309:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271158fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016117.261315:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271158fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:3.0:1734016117.261396:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968714 00000004:00010000:3.0:1734016117.261434:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880073b4a680 reply state ffff880075570000 transno 4294968715 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271158fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016117.261440:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016117.262371:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+15:9668:x1818247333726848:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 7047us (7275us total) trans 4294968715 rc 0/0 00000100:00100000:3.0:1734016117.262379:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2199 00000020:00080000:3.0:1734016117.262383:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1734016117.264409:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271158fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016117.264422:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271158fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016117.264429:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271158fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016117.264434:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499e400 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016117.264438:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271158fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016117.264443:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271158fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016117.264459:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016117.264462:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016117.264465:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271158fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016117.264469:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271158fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016117.264943:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.265136:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333727104 00000100:00100000:3.0:1734016117.265144:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333727104 00000100:00100000:3.0:1734016117.265190:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10913 00000100:00100000:3.0:1734016117.265196:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075650700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333727104:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.265211:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.265227:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115904 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ab0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.265253:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271158ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5210112->5214207) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa2 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.265261:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271158f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa9 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.265266:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016117.265267:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016117.265270:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115904 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ab0 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.265294:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271158f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa9 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.265304:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271158f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa9 expref: 6 pid: 7684 timeout: 484 lvb_type: 1 00000100:00100000:3.0:1734016117.265317:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335297536:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016117.265387:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271158ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5210112->5214207) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa2 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.265394:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271158ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5210112->5214207) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa2 expref: 8 pid: 7684 timeout: 484 lvb_type: 0 00000100:00100000:3.0:1734016117.265403:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075884380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335297664:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016117.265417:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.270523:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335297536:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016117.270538:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075884380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335297664:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016117.270571:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115904 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ab0 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.270587:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016117.270651:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075650700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333727104:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5454us (5719us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016117.270660:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10913 00000100:00100000:1.0:1734016117.275270:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016117.275319:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016117.275480:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333727360 00000100:00100000:0.0:1734016117.275491:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333727360 00010000:00010000:0.0:1734016117.275527:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271158ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5210112->5214207) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa2 expref: 8 pid: 7684 timeout: 484 lvb_type: 0 00000100:00100000:0.0:1734016117.275550:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333727232 00000100:00100000:0.0:1734016117.275551:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333727232 00010000:00010000:0.0:1734016117.275558:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271158f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa9 expref: 7 pid: 7684 timeout: 484 lvb_type: 1 00000100:00100000:0.0:1734016117.275574:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3033 00000100:00100000:0.0:1734016117.275580:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333727360:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016117.275596:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016117.275618:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271158ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5210112->5214207) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa2 expref: 8 pid: 7684 timeout: 484 lvb_type: 0 00010000:00010000:0.0:1734016117.275627:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271158ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5210112->5214207) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa2 expref: 8 pid: 7684 timeout: 484 lvb_type: 0 00010000:00010000:0.0:1734016117.275648:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271158ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5210112->5214207) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa2 expref: 8 pid: 7684 timeout: 484 lvb_type: 0 00010000:00010000:0.0:1734016117.275667:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016117.275719:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333727360:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 139us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016117.275725:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3033 00000100:00100000:0.0:1734016117.275741:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3034 00000100:00100000:0.0:1734016117.275744:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333727232:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016117.275750:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016117.275755:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271158f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa9 expref: 7 pid: 7684 timeout: 484 lvb_type: 1 00010000:00010000:0.0:1734016117.275764:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271158f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa9 expref: 7 pid: 7684 timeout: 484 lvb_type: 1 00010000:00010000:0.0:1734016117.275772:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271158f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aa9 expref: 7 pid: 7684 timeout: 484 lvb_type: 1 00010000:00010000:0.0:1734016117.275779:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016117.275781:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016117.275785:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115904 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ab0 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016117.275792:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115904 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ab0 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016117.275835:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115904 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ab0 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016117.275846:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335297792:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016117.275874:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eec00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016117.280712:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016117.280869:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335297792:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016117.280889:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016117.281011:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333727488 00000100:00100000:1.0:1734016117.281017:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333727488 00002000:00010000:1.0:1734016117.281049:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (8707575->18446744073709551615) 00002000:00100000:1.0:1734016117.281053:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075653b80 with x1818247333727488 ext(8707575->18446744073709551615) 00002000:00010000:1.0:1734016117.281061:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075653b80. 00000100:00100000:1.0:1734016117.281085:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8634 00000100:00100000:1.0:1734016117.281092:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333727488:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016117.282271:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10058140 -> 8707575 00002000:00010000:1.0:1734016117.282279:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016117 -> 1734016117 00002000:00010000:1.0:1734016117.282281:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016117 -> 1734016117 00002000:00010000:1.0:1734016117.282283:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016117 -> 1734016117 00002000:00010000:1.0:1734016117.282285:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 904 -> 832 00000100:00100000:0.0:1734016117.282567:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333727232:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6816us (7242us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016117.282579:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3034 00000100:00100000:1.0:1734016117.284739:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333727488:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 3632us (4019us total) trans 4294969418 rc 0/0 00000100:00100000:1.0:1734016117.284753:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8634 00002000:00010000:1.0:1734016117.284760:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (8707575->18446744073709551615) 00002000:00100000:1.0:1734016117.284764:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075653b80 with x1818247333727488 ext(8707575->18446744073709551615) 00002000:00010000:1.0:1734016117.284774:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075653b80. 00000100:00100000:3.0:1734016117.289677:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016117.289752:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333727616 00000100:00100000:0.0:1734016117.289760:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333727616 00000100:00100000:3.0:1734016117.290464:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2200 00000100:00100000:3.0:1734016117.290471:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:9668:x1818247333727616:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.290494:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.290512:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc2711590b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ab7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.290595:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27115912 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016117.290607:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27115912 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016117.290616:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27115912 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016117.290641:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 8707575 00000004:00200000:3.0:1734016117.290644:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016117.290658:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27115912 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016117.290679:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc2711590b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ab7 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.290706:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27115912 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ab7 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.290714:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016117.290716:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016117.290719:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016117.290766:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+15:9668:x1818247333727616:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 295us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016117.290773:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2200 00000100:00100000:0.0:1734016117.296632:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.296797:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333727872 00000100:00100000:3.0:1734016117.296825:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333727872 00000100:00100000:3.0:1734016117.296864:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2201 00000100:00100000:3.0:1734016117.296869:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+15:9668:x1818247333727872:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016117.296912:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016117.296946:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27115912 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ab7 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.296960:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016117.296963:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016117.297075:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc27115919 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.297086:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc27115919 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.297094:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc27115919 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:3.0:1734016117.297122:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968716 00000004:00010000:3.0:1734016117.297138:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800755b6300 reply state ffff880073a05000 transno 4294968717 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc27115919 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:3.0:1734016117.297144:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016117.297218:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+17:9668:x1818247333727872:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 348us (593us total) trans 4294968717 rc 0/0 00000100:00100000:3.0:1734016117.297224:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2201 00000020:00080000:3.0:1734016117.297227:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016117.302275:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1734016117.302347:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc27115919 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.302357:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc27115919 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.302363:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc27115919 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.302368:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df7840 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016117.302371:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc27115919 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.302376:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc27115919 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.302390:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016117.302392:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016117.302395:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc27115919 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.302399:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc27115919 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:1.0:1734016117.302760:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333728000 00000100:00100000:1.0:1734016117.302768:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333728000 00002000:00010000:1.0:1734016117.302838:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (2659775->18446744073709551615) 00002000:00100000:1.0:1734016117.302842:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4700 with x1818247333728000 ext(2659775->18446744073709551615) 00002000:00010000:1.0:1734016117.302851:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4700. 00000100:00100000:1.0:1734016117.302877:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8635 00000100:00100000:1.0:1734016117.302884:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333728000:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016117.310285:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8707575 -> 2659775 00002000:00010000:1.0:1734016117.310295:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016117 -> 1734016117 00002000:00010000:1.0:1734016117.310297:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016117 -> 1734016117 00002000:00010000:1.0:1734016117.310299:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016117 -> 1734016117 00002000:00010000:1.0:1734016117.310301:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 832 -> 256 00000100:00100000:1.0:1734016117.310389:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333728000:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 7501us (8117us total) trans 4294969419 rc 0/0 00000100:00100000:1.0:1734016117.310400:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8635 00002000:00010000:1.0:1734016117.310404:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (2659775->18446744073709551615) 00002000:00100000:1.0:1734016117.310407:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4700 with x1818247333728000 ext(2659775->18446744073709551615) 00002000:00010000:1.0:1734016117.310413:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4700. 00000100:00100000:2.0:1734016117.321228:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016117.321312:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333728128 00000100:00100000:0.0:1734016117.321322:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333728128 00000100:00100000:0.0:1734016117.321384:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2202 00000100:00100000:0.0:1734016117.321393:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:9668:x1818247333728128:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016117.321411:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016117.321431:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27115920 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5abe expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016117.321527:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115927 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016117.321540:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016117.321551:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:0.0:1734016117.321572:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 2659775 00000004:00200000:0.0:1734016117.321576:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016117.321594:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016117.321618:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27115920 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5abe expref: 13 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016117.321634:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115927 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5abe expref: 12 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016117.321642:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016117.321644:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016117.321646:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75818c0, rc 0) 00000100:00100000:0.0:1734016117.321688:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:9668:x1818247333728128:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 296us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016117.321693:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2202 00000100:00100000:0.0:1734016117.324594:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.325639:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333728256 00000100:00100000:3.0:1734016117.325652:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333728256 00000100:00100000:3.0:1734016117.325694:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10914 00000100:00100000:3.0:1734016117.325700:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333728256:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.325720:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.325735:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711592e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ac5 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.325785:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335297920:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.327525:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.333246:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335297920:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.333298:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711592e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ac5 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.333312:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711592e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ac5 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.333325:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016117.333400:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333728256:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7697us (8819us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.333411:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10914 00000100:00100000:0.0:1734016117.339278:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.340456:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333728384 00000100:00100000:3.0:1734016117.340468:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333728384 00000100:00100000:3.0:1734016117.340526:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10915 00000100:00100000:3.0:1734016117.340533:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333728384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.340552:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.340570:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115935 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5acc expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.340623:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335298048:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.340694:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.346374:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335298048:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.346410:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115935 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5acc expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.346422:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115935 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5acc expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.346473:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016117.346527:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333728384:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5994us (7267us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.346535:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10915 00000100:00100000:0.0:1734016117.353576:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.355118:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333728512 00000100:00100000:3.0:1734016117.355131:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333728512 00000100:00100000:3.0:1734016117.355192:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10916 00000100:00100000:3.0:1734016117.355200:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333728512:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.355224:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.355249:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711593c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ad3 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.355313:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335298176:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.355705:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.360986:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335298176:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.361023:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711593c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ad3 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.361036:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711593c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ad3 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.361051:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016117.361108:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333728512:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5907us (7546us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.361120:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10916 00000100:00100000:0.0:1734016117.369191:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.369388:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333728640 00000100:00100000:3.0:1734016117.369396:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333728640 00000100:00100000:3.0:1734016117.369438:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10917 00000100:00100000:3.0:1734016117.369445:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333728640:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.369462:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.369478:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115943 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ada expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.369530:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335298304:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.369598:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.374939:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335298304:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.374971:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115943 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ada expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.374984:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115943 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ada expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.375005:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016117.375053:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333728640:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5607us (5870us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.375062:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10917 00000100:00100000:1.0:1734016117.380483:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.380608:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333728768 00000100:00100000:3.0:1734016117.380617:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333728768 00000100:00100000:3.0:1734016117.380662:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10918 00000100:00100000:3.0:1734016117.380670:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333728768:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.380686:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.380703:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711594a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ae1 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.380753:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335298432:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.380832:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.383509:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335298432:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.383553:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711594a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ae1 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.383565:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc2711594a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ae1 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.383704:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7840, rc 0) 00000100:00100000:3.0:1734016117.383770:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333728768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3099us (3294us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.383782:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10918 00000100:00100000:1.0:1734016117.390997:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.391162:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333728896 00000100:00100000:3.0:1734016117.391173:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333728896 00000100:00100000:3.0:1734016117.391525:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10919 00000100:00100000:3.0:1734016117.391533:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333728896:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.391554:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.391572:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115951 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ae8 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.391638:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335298560:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.391890:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.394083:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335298560:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.394116:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115951 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ae8 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.394129:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115951 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ae8 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.394143:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016117.394185:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333728896:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2650us (3204us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.394194:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10919 00000100:00100000:2.0:1734016117.395215:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335298688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1734016117.395255:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1734016117.395282:0:7685:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335298688 00000100:00100000:2.0:1734016117.395287:0:7685:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335298688 00000100:00100000:2.0:1734016117.395313:0:7685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1734016117.395318:0:7685:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075653100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335298688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1734016117.395340:0:7685:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 490160704 pending 0 free 3923677184 avail 3692154880 00000100:00100000:2.0:1734016117.395364:0:7685:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075653100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335298688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016117.395369:0:7685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1734016117.395393:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335298688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1734016117.398421:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.398660:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333729024 00000100:00100000:3.0:1734016117.398672:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333729024 00000100:00100000:3.0:1734016117.398863:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10920 00000100:00100000:3.0:1734016117.398878:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333729024:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.398904:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.398924:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115958 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5aef expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.398992:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335298816:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.399070:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.404178:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335298816:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.404245:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115958 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aef expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.404266:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115958 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5aef expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.404299:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4480, rc 0) 00000100:00100000:3.0:1734016117.405386:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333729024:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6501us (6965us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.405403:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10920 00000100:00100000:1.0:1734016117.411166:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.411278:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333729152 00000100:00100000:3.0:1734016117.411289:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333729152 00000100:00100000:3.0:1734016117.411516:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10921 00000100:00100000:3.0:1734016117.411525:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333729152:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.411548:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.411568:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711595f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5af6 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.411636:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335298944:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.411713:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.414709:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335298944:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.414761:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711595f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5af6 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.414778:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711595f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5af6 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.414849:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016117.414907:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333729152:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3381us (3748us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.414919:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10921 00000100:00100000:1.0:1734016117.423977:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.424082:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333729280 00000100:00100000:3.0:1734016117.424095:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333729280 00000100:00100000:3.0:1734016117.424154:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10922 00000100:00100000:3.0:1734016117.424164:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333729280:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.424189:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.424209:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115966 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5afd expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.424282:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335299072:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.424363:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.428676:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335299072:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.428725:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115966 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5afd expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.428743:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115966 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5afd expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.429434:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016117.429553:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333729280:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5388us (5589us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.429570:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10922 00000100:00100000:0.0:1734016117.435063:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.435353:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333729408 00000100:00100000:3.0:1734016117.435364:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333729408 00000100:00100000:3.0:1734016117.435497:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10923 00000100:00100000:3.0:1734016117.435505:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333729408:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.435533:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.435563:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc2711596d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b04 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.435638:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335299200:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.436407:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.440610:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335299200:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.440659:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc2711596d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b04 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.440674:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc2711596d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b04 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.440819:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4b40, rc 0) 00000100:00100000:3.0:1734016117.441302:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333729408:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5795us (6248us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.441314:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10923 00000100:00100000:1.0:1734016117.446089:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.446223:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333729664 00000100:00100000:3.0:1734016117.446234:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333729664 00000100:00100000:3.0:1734016117.446556:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2203 00000100:00100000:3.0:1734016117.446566:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+16:9668:x1818247333729664:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016117.446877:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27115974 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.446896:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115927 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5abe expref: 11 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.446905:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27115974 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.446949:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115927 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5abe expref: 11 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.446965:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115927 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5abe expref: 11 pid: 6478 timeout: 484 lvb_type: 0 00000100:00100000:3.0:1734016117.446980:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335299328:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016117.447656:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.451735:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335299328:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016117.451766:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27115974 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:1.0:1734016117.451850:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016117.452050:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333729792 00000100:00100000:0.0:1734016117.452057:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333729792 00010000:00010000:0.0:1734016117.452087:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115927 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5abe expref: 12 pid: 6478 timeout: 484 lvb_type: 0 00000100:00100000:0.0:1734016117.452117:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3035 00000100:00100000:0.0:1734016117.452125:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333729792:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016117.452142:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016117.452148:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115927 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5abe expref: 12 pid: 6478 timeout: 484 lvb_type: 0 00010000:00010000:0.0:1734016117.452158:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115927 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5abe expref: 12 pid: 6478 timeout: 484 lvb_type: 0 00010000:00010000:0.0:1734016117.452178:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115927 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5abe expref: 12 pid: 6478 timeout: 484 lvb_type: 0 00010000:00010000:0.0:1734016117.452798:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016117.452832:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27115974 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016117.452841:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27115974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016117.452847:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27115974 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016117.452875:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016117.452916:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333729792:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 792us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016117.452923:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3035 00010000:00010000:3.0:1734016117.453088:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27115974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.453094:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27115974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:3.0:1734016117.453169:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968718 00000004:00010000:3.0:1734016117.453202:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007bd3dc00 reply state ffff880073a06000 transno 4294968719 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27115974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:3.0:1734016117.453209:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016117.453273:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+19:9668:x1818247333729664:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 6707us (7206us total) trans 4294968719 rc 0/0 00000100:00100000:3.0:1734016117.453278:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2203 00000020:00080000:3.0:1734016117.453282:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1734016117.457328:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1734016117.457428:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27115974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.457436:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27115974 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.457443:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27115974 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.457449:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df58c0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016117.457454:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27115974 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.457459:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27115974 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.457475:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016117.457477:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016117.457480:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27115974 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.457484:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27115974 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016117.457532:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333729920 00000100:00100000:0.0:1734016117.457540:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333729920 00002000:00010000:0.0:1734016117.457569:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (5170995->18446744073709551615) 00002000:00100000:0.0:1734016117.457573:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3df80 with x1818247333729920 ext(5170995->18446744073709551615) 00002000:00010000:0.0:1734016117.457580:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3df80. 00000100:00100000:0.0:1734016117.458092:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8636 00000100:00100000:0.0:1734016117.458100:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333729920:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016117.458300:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 2659775 -> 5170995 00002000:00010000:0.0:1734016117.458303:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016117 -> 1734016118 00002000:00010000:0.0:1734016117.458305:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016117 -> 1734016117 00002000:00010000:0.0:1734016117.458307:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016117 -> 1734016118 00002000:00010000:0.0:1734016117.458309:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 256 -> 256 00000100:00100000:0.0:1734016117.458356:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333729920:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 256us (1037us total) trans 4294969420 rc 0/0 00000100:00100000:0.0:1734016117.458363:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8636 00002000:00010000:0.0:1734016117.458366:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (5170995->18446744073709551615) 00002000:00100000:0.0:1734016117.458368:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3df80 with x1818247333729920 ext(5170995->18446744073709551615) 00002000:00010000:0.0:1734016117.458371:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3df80. 00000100:00100000:1.0:1734016117.461782:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.461906:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333730048 00000100:00100000:3.0:1734016117.461918:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333730048 00000100:00100000:3.0:1734016117.461976:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2204 00000100:00100000:3.0:1734016117.461986:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333730048:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.462017:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.462044:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711597b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b0b expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.462153:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115982 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.462169:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115982 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.462181:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115982 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:3.0:1734016117.462210:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 5170995 00000004:00200000:3.0:1734016117.462214:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016117.462230:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115982 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.462251:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711597b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b0b expref: 20 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.462266:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115982 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b0b expref: 19 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.462273:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016117.462276:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016117.462279:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7a80, rc 0) 00000100:00100000:3.0:1734016117.462328:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+19:9668:x1818247333730048:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 343us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016117.462336:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2204 00000100:00100000:0.0:1734016117.465227:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.465535:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333730176 00000100:00100000:2.0:1734016117.465543:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333730176 00000100:00100000:2.0:1734016117.465590:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2205 00000100:00100000:2.0:1734016117.465597:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:9668:x1818247333730176:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016117.465616:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016117.465634:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115989 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b12 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.465717:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115990 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016117.465730:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016117.465739:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016117.465761:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 5170995 00000004:00200000:2.0:1734016117.465765:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016117.465780:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016117.465831:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115989 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b12 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.465851:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115990 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b12 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.465858:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016117.465860:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016117.465864:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016117.466962:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:9668:x1818247333730176:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1361us (1742us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016117.466970:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2205 00000100:00100000:1.0:1734016117.469650:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.470018:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333730304 00000100:00100000:3.0:1734016117.470029:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333730304 00000100:00100000:3.0:1734016117.470076:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10924 00000100:00100000:3.0:1734016117.470084:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333730304:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.470106:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.470124:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115997 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b19 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.470191:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335299456:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.470278:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.472458:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335299456:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.472506:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115997 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b19 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.472522:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115997 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b19 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.472551:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016117.472892:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333730304:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2806us (3247us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.472902:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10924 00000100:00100000:1.0:1734016117.474949:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.475111:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333730432 00000100:00100000:3.0:1734016117.475117:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333730432 00000100:00100000:3.0:1734016117.475678:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10925 00000100:00100000:3.0:1734016117.475685:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333730432:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.475701:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.475721:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711599e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b20 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.475768:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335299584:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.476055:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.478894:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335299584:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.478937:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711599e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b20 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.478948:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711599e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b20 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.478962:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016117.479052:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333730432:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3365us (4108us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.479062:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10925 00000100:00100000:1.0:1734016117.482706:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.486015:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333730560 00000100:00100000:3.0:1734016117.486028:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333730560 00000100:00100000:3.0:1734016117.486087:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10926 00000100:00100000:3.0:1734016117.486094:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333730560:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.486113:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.486133:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271159a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b27 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.486163:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115904 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ab0 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.486176:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016117.486178:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016117.486181:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271159a5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2424832->2486271] (req 2424832->2486271) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b27 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.486221:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115904 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ab0 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.486232:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115904 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ab0 expref: 9 pid: 7684 timeout: 484 lvb_type: 0 00000100:00100000:3.0:1734016117.486247:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335299712:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016117.486323:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.488830:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335299712:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016117.488860:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271159a5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2424832->2486271] (req 2424832->2486271) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b27 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.488875:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df58c0, rc 0) 00000100:00100000:3.0:1734016117.488920:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333730560:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2826us (6227us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016117.488937:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10926 00000100:00100000:1.0:1734016117.490969:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016117.491025:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333730688 00000100:00100000:0.0:1734016117.491033:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333730688 00010000:00010000:0.0:1734016117.491058:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115904 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ab0 expref: 10 pid: 7684 timeout: 484 lvb_type: 0 00000100:00100000:0.0:1734016117.491085:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3036 00000100:00100000:0.0:1734016117.491091:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b42c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333730688:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016117.491102:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016117.491119:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115904 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ab0 expref: 10 pid: 7684 timeout: 484 lvb_type: 0 00010000:00010000:0.0:1734016117.491129:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115904 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ab0 expref: 10 pid: 7684 timeout: 484 lvb_type: 0 00010000:00010000:0.0:1734016117.491147:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115904 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ab0 expref: 10 pid: 7684 timeout: 484 lvb_type: 0 00010000:00010000:0.0:1734016117.491171:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016117.491174:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016117.491180:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271159a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2486271) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b27 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016117.491189:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271159a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2486271) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b27 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016117.491217:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271159a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2486271) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b27 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016117.491229:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db09880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335299840:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016117.491279:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eec00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016117.495381:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.495459:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333730816 00000100:00100000:3.0:1734016117.495465:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333730816 00000100:00100000:3.0:1734016117.495501:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10927 00000100:00100000:3.0:1734016117.495507:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333730816:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016117.495729:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 5170995 -> 5170995 00002000:00010000:3.0:1734016117.495732:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016118 -> 1734016118 00002000:00010000:3.0:1734016117.495734:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016117 -> 1734016117 00002000:00010000:3.0:1734016117.495736:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016118 -> 1734016118 00002000:00010000:3.0:1734016117.495737:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 256 -> 256 00000100:00100000:3.0:1734016117.495826:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333730816:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 316us (453us total) trans 4294969421 rc 0/0 00000100:00100000:3.0:1734016117.495833:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10927 00000100:00100000:0.0:1734016117.496146:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db09880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335299840:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016117.496169:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016117.496191:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b42c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333730688:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5099us (5230us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016117.496200:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3036 00000100:00100000:0.0:1734016117.504321:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016117.505201:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333730944 00000100:00100000:1.0:1734016117.505209:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333730944 00000100:00100000:1.0:1734016117.505247:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10928 00000100:00100000:1.0:1734016117.505253:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333730944:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016117.505268:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016117.505282:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc271159ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b2e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016117.505328:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335299968:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016117.505379:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016117.508791:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335299968:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016117.508855:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc271159ac lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b2e expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.508869:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc271159ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b2e expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.508891:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:2.0:1734016117.508948:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333730944:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3694us (4638us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016117.508956:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10928 00000100:00100000:0.0:1734016117.511105:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.511190:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333731072 00000100:00100000:2.0:1734016117.511199:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333731072 00000100:00100000:2.0:1734016117.511247:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10929 00000100:00100000:2.0:1734016117.511254:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333731072:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016117.511273:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016117.511287:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271159b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b35 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016117.511352:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075652d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335300096:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016117.511431:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016117.513502:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075652d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335300096:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016117.513540:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271159b3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b35 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.513554:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271159b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b35 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.513571:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016117.513623:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333731072:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2368us (2526us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016117.513631:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10929 00000100:00100000:1.0:1734016117.521013:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.521842:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333731328 00000100:00100000:2.0:1734016117.521851:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333731328 00000100:00100000:2.0:1734016117.521900:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2206 00000100:00100000:2.0:1734016117.521906:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:9668:x1818247333731328:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016117.521956:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016117.521978:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115990 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b12 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.522002:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016117.522006:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016117.522132:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016117.522144:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115982 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b0b expref: 18 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.522149:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159ba lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016117.522176:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115982 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b0b expref: 18 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.522187:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115982 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b0b expref: 18 pid: 6479 timeout: 484 lvb_type: 0 00000100:00100000:2.0:1734016117.522199:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075652d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335300224:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016117.522269:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016117.527272:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075652d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335300224:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016117.527308:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:1.0:1734016117.527669:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016117.527737:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333731456 00000100:00100000:0.0:1734016117.527745:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333731456 00010000:00010000:0.0:1734016117.527782:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115982 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b0b expref: 19 pid: 6479 timeout: 484 lvb_type: 0 00000100:00100000:0.0:1734016117.527824:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3037 00000100:00100000:0.0:1734016117.527832:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+19:1982:x1818247333731456:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016117.527848:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016117.527855:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115982 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b0b expref: 19 pid: 6479 timeout: 484 lvb_type: 0 00010000:00010000:0.0:1734016117.527866:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115982 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b0b expref: 19 pid: 6479 timeout: 484 lvb_type: 0 00010000:00010000:0.0:1734016117.527887:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115982 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b0b expref: 19 pid: 6479 timeout: 484 lvb_type: 0 00010000:00010000:0.0:1734016117.528839:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016117.528846:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016117.528857:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016117.528865:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159ba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016117.528897:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016117.528964:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247333731456:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1131us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016117.528973:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3037 00010000:00010000:2.0:1734016117.529552:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016117.529560:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:2.0:1734016117.529644:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968720 00000004:00010000:2.0:1734016117.529686:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007bd3c380 reply state ffff8800737ef000 transno 4294968721 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016117.529692:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016117.529760:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333731328:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 7852us (8756us total) trans 4294968721 rc 0/0 00000100:00100000:2.0:1734016117.529767:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2206 00000020:00080000:2.0:1734016117.529771:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016117.532660:0:8957:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1734016117.534152:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016117.534171:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016117.534179:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016117.534187:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd440 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016117.534192:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016117.534198:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016117.534214:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016117.534217:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016117.534220:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016117.534225:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:1.0:1734016117.535192:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.535509:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333731584 00000100:00100000:2.0:1734016117.535520:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333731584 00002000:00010000:2.0:1734016117.535563:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (2916761->18446744073709551615) 00002000:00100000:2.0:1734016117.535567:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3c000 with x1818247333731584 ext(2916761->18446744073709551615) 00002000:00010000:2.0:1734016117.535583:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3c000. 00000100:00100000:2.0:1734016117.535780:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8637 00000100:00100000:2.0:1734016117.535787:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333731584:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016117.536140:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 5170995 -> 2916761 00002000:00010000:2.0:1734016117.536143:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016118 -> 1734016118 00002000:00010000:2.0:1734016117.536145:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016117 -> 1734016117 00002000:00010000:2.0:1734016117.536147:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016118 -> 1734016118 00002000:00010000:2.0:1734016117.536148:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 256 -> 256 00000100:00100000:2.0:1734016117.536403:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333731584:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 615us (1218us total) trans 4294969422 rc 0/0 00000100:00100000:2.0:1734016117.536410:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8637 00002000:00010000:2.0:1734016117.536414:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (2916761->18446744073709551615) 00002000:00100000:2.0:1734016117.536416:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3c000 with x1818247333731584 ext(2916761->18446744073709551615) 00002000:00010000:2.0:1734016117.536421:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3c000. 00000100:00100000:1.0:1734016117.539212:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.539340:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333731712 00000100:00100000:2.0:1734016117.539349:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333731712 00000100:00100000:2.0:1734016117.539398:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2207 00000100:00100000:2.0:1734016117.539404:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333731712:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016117.539423:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016117.539440:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271159c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b3c expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.539515:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016117.539527:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016117.539538:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016117.539560:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 2916761 00000004:00200000:2.0:1734016117.539564:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016117.539580:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016117.539599:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc271159c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b3c expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.539613:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b3c expref: 19 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.539619:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016117.539621:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016117.539624:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd440, rc 0) 00000100:00100000:2.0:1734016117.539672:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+19:9668:x1818247333731712:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 267us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016117.539678:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2207 00000100:00100000:0.0:1734016117.543102:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.543214:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333731840 00000100:00100000:2.0:1734016117.543222:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333731840 00000100:00100000:2.0:1734016117.543272:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10930 00000100:00100000:2.0:1734016117.543280:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88009024a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333731840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016117.543298:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016117.543315:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271159cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b43 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016117.543366:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075652d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335300352:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016117.543701:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016117.545716:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075652d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335300352:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016117.545745:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271159cf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b43 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.545758:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271159cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b43 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.545770:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016117.545914:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88009024a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333731840:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2632us (2817us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016117.545921:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10930 00000100:00100000:1.0:1734016117.548253:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.548496:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333731968 00000100:00100000:2.0:1734016117.548508:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333731968 00000100:00100000:2.0:1734016117.548681:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10931 00000100:00100000:2.0:1734016117.548689:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333731968:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016117.548713:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016117.548738:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271159d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b4a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016117.548955:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075653800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335300480:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016117.549039:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016117.553556:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075653800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335300480:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016117.553596:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271159d6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b4a expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.553616:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc271159d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b4a expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.553628:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd680, rc 0) 00000100:00100000:2.0:1734016117.553693:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333731968:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5002us (5447us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016117.553705:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10931 00000100:00100000:1.0:1734016117.563485:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.564206:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333732096 00000100:00100000:2.0:1734016117.564214:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333732096 00000100:00100000:2.0:1734016117.564409:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10932 00000100:00100000:2.0:1734016117.564416:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333732096:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016117.564435:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016117.564451:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271159dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b51 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016117.564502:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075653800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335300608:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016117.564568:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016117.567323:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075653800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335300608:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016117.567364:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271159dd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b51 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.567380:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271159dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b51 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.567658:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016117.568033:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333732096:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3615us (4560us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016117.568042:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10932 00000100:00100000:0.0:1734016117.570433:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.570584:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333732224 00000100:00100000:2.0:1734016117.570591:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333732224 00000100:00100000:2.0:1734016117.570697:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10933 00000100:00100000:2.0:1734016117.570704:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333732224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016117.570718:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016117.570732:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271159e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b58 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016117.570772:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075653800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335300736:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016117.570949:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016117.573062:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075653800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335300736:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016117.573102:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271159e4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b58 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.573118:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271159e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b58 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.573131:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:3.0:1734016117.573545:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333732224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2837us (3114us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.573556:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10933 00000100:00100000:1.0:1734016117.577788:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.577887:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333732352 00000100:00100000:3.0:1734016117.577896:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333732352 00000100:00100000:3.0:1734016117.577969:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10934 00000100:00100000:3.0:1734016117.577976:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333732352:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.577994:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.578010:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271159eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b5f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.578062:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335300864:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.578120:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.580468:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335300864:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.580498:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271159eb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b5f expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.580511:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc271159eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b5f expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.582209:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7a80, rc 0) 00000100:00100000:3.0:1734016117.582295:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333732352:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4315us (4512us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.582304:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10934 00000100:00100000:1.0:1734016117.588024:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.588111:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333732480 00000100:00100000:3.0:1734016117.588119:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333732480 00000100:00100000:3.0:1734016117.588284:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10935 00000100:00100000:3.0:1734016117.588291:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333732480:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.588311:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.588332:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271159f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b66 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.588389:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335300992:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.588453:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.591072:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335300992:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.591117:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271159f2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b66 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.591131:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271159f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b66 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.591425:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016117.591485:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333732480:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3192us (3468us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.591493:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10935 00000100:00100000:1.0:1734016117.594566:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.594670:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333732608 00000100:00100000:3.0:1734016117.594679:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333732608 00000100:00100000:3.0:1734016117.594730:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2208 00000100:00100000:3.0:1734016117.594736:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:9668:x1818247333732608:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.594760:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.594779:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc271159f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b6d expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.594875:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115a00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.594887:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115a00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.594898:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115a00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:3.0:1734016117.594917:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 2916761 00000004:00200000:3.0:1734016117.594920:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016117.594943:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115a00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016117.594962:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc271159f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b6d expref: 15 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.594977:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115a00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b6d expref: 14 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.594985:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016117.594988:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016117.594991:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016117.595048:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333732608:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 312us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016117.595055:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2208 00000100:00100000:1.0:1734016117.597923:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.598114:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333732736 00000100:00100000:3.0:1734016117.598124:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333732736 00000100:00100000:3.0:1734016117.598425:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10936 00000100:00100000:3.0:1734016117.598431:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333732736:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016117.598651:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 2916761 -> 2916761 00002000:00010000:3.0:1734016117.598654:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016118 -> 1734016118 00002000:00010000:3.0:1734016117.598656:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016117 -> 1734016117 00002000:00010000:3.0:1734016117.598658:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016118 -> 1734016117 00002000:00010000:3.0:1734016117.598660:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 256 -> 280 00000100:00100000:3.0:1734016117.598713:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333732736:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 281us (802us total) trans 4294969423 rc 0/0 00000100:00100000:3.0:1734016117.598719:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10936 00000100:00100000:1.0:1734016117.602120:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016117.602192:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333732864 00000100:00100000:0.0:1734016117.602202:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333732864 00000100:00100000:0.0:1734016117.602258:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10937 00000100:00100000:0.0:1734016117.602266:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333732864:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016117.602288:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016117.602306:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27115a07 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b74 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016117.602363:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335301120:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016117.602429:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00002000:00010000:0.0:1734016117.605327:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016117 -> 1734016118 00000100:00100000:0.0:1734016117.605362:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335301120:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016117.605403:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27115a07 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b74 expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016117.605416:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27115a07 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b74 expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016117.605442:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:0.0:1734016117.605498:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333732864:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3232us (3389us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016117.605509:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10937 00000100:00100000:1.0:1734016117.608474:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016117.608589:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333732992 00000100:00100000:0.0:1734016117.608599:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333732992 00000100:00100000:0.0:1734016117.608650:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10938 00000100:00100000:0.0:1734016117.608659:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333732992:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016117.608682:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016117.608704:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27115a0e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b7b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016117.608762:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335301248:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016117.608854:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016117.611197:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335301248:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016117.611234:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27115a0e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b7b expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016117.611249:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27115a0e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b7b expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016117.611900:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581680, rc 0) 00000100:00100000:0.0:1734016117.611965:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333732992:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3306us (3500us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016117.611976:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10938 00000100:00100000:1.0:1734016117.616059:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016117.616124:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333733120 00000100:00100000:0.0:1734016117.616136:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333733120 00000100:00100000:0.0:1734016117.616197:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10939 00000100:00100000:0.0:1734016117.616207:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333733120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016117.616229:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016117.616249:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27115a15 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b82 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016117.616312:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335301376:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016117.616377:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016117.618528:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335301376:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016117.618580:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27115a15 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b82 expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016117.618597:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27115a15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b82 expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016117.618629:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581b00, rc 0) 00000100:00100000:0.0:1734016117.618693:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333733120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2486us (2647us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016117.618703:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10939 00000100:00100000:1.0:1734016117.627693:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016117.627765:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333733248 00000100:00100000:0.0:1734016117.627774:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333733248 00000100:00100000:0.0:1734016117.627846:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10940 00000100:00100000:0.0:1734016117.627854:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333733248:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016117.627873:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016117.627894:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27115a1c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b89 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016117.627965:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335301504:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016117.628026:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016117.629693:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335301504:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016117.629717:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27115a1c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b89 expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016117.629729:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27115a1c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b89 expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016117.629754:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:0.0:1734016117.629919:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333733248:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2065us (2238us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016117.629935:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10940 00000100:00100000:1.0:1734016117.631965:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016117.632217:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333733376 00000100:00100000:0.0:1734016117.632230:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333733376 00000100:00100000:0.0:1734016117.632291:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10941 00000100:00100000:0.0:1734016117.632300:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333733376:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016117.632520:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 2916761 -> 2916761 00002000:00010000:0.0:1734016117.632523:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016118 -> 1734016117 00002000:00010000:0.0:1734016117.632525:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016117 -> 1734016117 00002000:00010000:0.0:1734016117.632526:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016118 -> 1734016117 00002000:00010000:0.0:1734016117.632528:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 280 -> 280 00000100:00100000:0.0:1734016117.632593:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333733376:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 293us (639us total) trans 4294969424 rc 0/0 00000100:00100000:0.0:1734016117.632602:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10941 00000100:00100000:1.0:1734016117.636153:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.637012:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333733504 00000100:00100000:3.0:1734016117.637020:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333733504 00000100:00100000:3.0:1734016117.637068:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10942 00000100:00100000:3.0:1734016117.637075:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333733504:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.637097:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.637115:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115a23 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b90 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.637170:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335301632:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.637227:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00002000:00010000:3.0:1734016117.639431:0:8216:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime: 1734016117 -> 1734016118 00002000:00010000:3.0:1734016117.639439:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016117 -> 1734016118 00000100:00100000:3.0:1734016117.639459:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335301632:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.639487:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115a23 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b90 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.639499:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115a23 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b90 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.639513:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016117.640080:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333733504:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3003us (3933us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.640088:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10942 00000100:00100000:1.0:1734016117.643686:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.643888:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333733632 00000100:00100000:3.0:1734016117.643900:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333733632 00000100:00100000:3.0:1734016117.643958:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10943 00000100:00100000:3.0:1734016117.643966:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333733632:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.643987:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.644004:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115a2a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b97 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.644059:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335301760:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.644119:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.646609:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335301760:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.646649:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115a2a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b97 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.646662:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115a2a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b97 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.646759:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4480, rc 0) 00000100:00100000:3.0:1734016117.647104:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333733632:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3137us (3427us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.647117:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10943 00000100:00100000:1.0:1734016117.655494:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.655662:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333733760 00000100:00100000:3.0:1734016117.655677:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333733760 00000100:00100000:3.0:1734016117.655749:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10944 00000100:00100000:3.0:1734016117.655758:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333733760:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.655785:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.655852:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115a31 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5b9e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.655935:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335301888:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.656007:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.658519:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335301888:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.658550:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115a31 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b9e expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.658563:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115a31 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b9e expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.659221:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016117.659267:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333733760:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3511us (3796us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.659277:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10944 00000100:00100000:1.0:1734016117.661171:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.661242:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333733888 00000100:00100000:3.0:1734016117.661251:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333733888 00000100:00100000:3.0:1734016117.661282:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10945 00000100:00100000:3.0:1734016117.661289:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:9668:x1818247333733888:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.661304:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.661320:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115a38 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ba5 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.661343:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271159a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2486271) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b27 expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.661350:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016117.661351:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016117.661355:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115a38 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5668864->5685247] (req 5668864->5685247) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ba5 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.661389:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271159a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2486271) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b27 expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.661399:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271159a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2486271) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b27 expref: 10 pid: 7684 timeout: 484 lvb_type: 0 00000100:00100000:3.0:1734016117.661410:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335302016:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016117.661453:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016117.665186:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.665297:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335302016:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016117.665333:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115a38 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5668864->5685247] (req 5668864->5685247) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ba5 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.665353:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7840, rc 0) 00000100:00100000:3.0:1734016117.665406:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:9668:x1818247333733888:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4117us (4240us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016117.665413:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10945 00000100:00100000:0.0:1734016117.665620:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333734016 00000100:00100000:0.0:1734016117.665627:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333734016 00010000:00010000:0.0:1734016117.665648:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271159a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2486271) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b27 expref: 11 pid: 7684 timeout: 484 lvb_type: 0 00000100:00100000:0.0:1734016117.665675:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3038 00000100:00100000:0.0:1734016117.665681:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333734016:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016117.665691:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016117.665708:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271159a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2486271) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b27 expref: 11 pid: 7684 timeout: 484 lvb_type: 0 00010000:00010000:0.0:1734016117.665717:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271159a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2486271) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b27 expref: 11 pid: 7684 timeout: 484 lvb_type: 0 00010000:00010000:0.0:1734016117.665737:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc271159a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2486271) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b27 expref: 11 pid: 7684 timeout: 484 lvb_type: 0 00010000:00010000:0.0:1734016117.665760:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016117.665762:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016117.665768:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115a38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5668864->5685247) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ba5 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016117.665776:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115a38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5668864->5685247) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ba5 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016117.665820:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115a38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5668864->5685247) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ba5 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016117.665832:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335302144:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016117.665861:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016117.670006:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016117.670097:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335302144:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016117.670120:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016117.670163:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333734016:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4481us (4990us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016117.670173:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3038 00000100:00100000:3.0:1734016117.670247:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333734144 00000100:00100000:3.0:1734016117.670253:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333734144 00000100:00100000:3.0:1734016117.670281:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10946 00000100:00100000:3.0:1734016117.670287:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333734144:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016117.670548:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 2916761 -> 5685157 00002000:00010000:3.0:1734016117.670551:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016118 -> 1734016117 00002000:00010000:3.0:1734016117.670553:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016117 -> 1734016117 00002000:00010000:3.0:1734016117.670555:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016118 -> 1734016117 00002000:00010000:3.0:1734016117.670557:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 280 -> 312 00000100:00100000:3.0:1734016117.670579:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333734144:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 291us (583us total) trans 4294969425 rc 0/0 00000100:00100000:3.0:1734016117.670585:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10946 00000100:00100000:0.0:1734016117.673725:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.674201:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333734272 00000100:00100000:2.0:1734016117.674215:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333734272 00000100:00100000:2.0:1734016117.674271:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10947 00000100:00100000:2.0:1734016117.674279:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333734272:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016117.674302:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016117.674323:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115a3f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5bac expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016117.674377:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075653800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335302272:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016117.674442:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00002000:00010000:2.0:1734016117.677240:0:7684:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime: 1734016117 -> 1734016118 00002000:00010000:2.0:1734016117.677247:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016117 -> 1734016118 00000100:00100000:2.0:1734016117.677271:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075653800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335302272:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016117.677309:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115a3f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bac expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.677324:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115a3f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bac expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.677511:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016117.677567:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333734272:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3288us (3850us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016117.677576:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10947 00000100:00100000:1.0:1734016117.682228:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.682323:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333734400 00000100:00100000:2.0:1734016117.682331:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333734400 00000100:00100000:2.0:1734016117.682380:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10948 00000100:00100000:2.0:1734016117.682385:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333734400:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016117.682404:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016117.682424:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115a46 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5bb3 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016117.682471:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075653800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335302400:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016117.682534:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016117.687302:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075653800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335302400:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016117.687336:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115a46 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bb3 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.687350:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115a46 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bb3 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.687374:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016117.687563:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333734400:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5175us (5343us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016117.687570:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10948 00000100:00100000:1.0:1734016117.694396:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.694639:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333734528 00000100:00100000:2.0:1734016117.694647:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333734528 00000100:00100000:2.0:1734016117.694696:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10949 00000100:00100000:2.0:1734016117.694703:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333734528:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016117.694960:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 5685157 -> 5685157 00002000:00010000:2.0:1734016117.694963:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016118 -> 1734016117 00002000:00010000:2.0:1734016117.694966:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016117 -> 1734016117 00002000:00010000:2.0:1734016117.694967:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016118 -> 1734016117 00002000:00010000:2.0:1734016117.694969:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 312 -> 352 00000100:00100000:2.0:1734016117.695021:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333734528:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 317us (631us total) trans 4294969426 rc 0/0 00000100:00100000:2.0:1734016117.695029:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10949 00000100:00100000:1.0:1734016117.698349:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.698615:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333734656 00000100:00100000:3.0:1734016117.698624:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333734656 00000100:00100000:3.0:1734016117.698919:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10950 00000100:00100000:3.0:1734016117.698936:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333734656:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.698957:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.698980:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27115a4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5bba expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.699031:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335302528:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.699097:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00002000:00010000:3.0:1734016117.704614:0:8216:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime: 1734016117 -> 1734016118 00002000:00010000:3.0:1734016117.704623:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016117 -> 1734016118 00000100:00100000:3.0:1734016117.704644:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335302528:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.704683:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27115a4d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bba expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.704697:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27115a4d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bba expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.704723:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df58c0, rc 0) 00000100:00100000:3.0:1734016117.704782:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333734656:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5855us (6444us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.704789:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10950 00000100:00100000:1.0:1734016117.709402:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.709513:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333734784 00000100:00100000:3.0:1734016117.709526:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333734784 00000100:00100000:3.0:1734016117.710144:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10951 00000100:00100000:3.0:1734016117.710154:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:9668:x1818247333734784:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.710182:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.710207:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115a54 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5bc1 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.710248:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115a38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5668864->5685247) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ba5 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.710257:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016117.710259:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016117.710263:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115a54 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2306048->2310143] (req 2306048->2310143) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bc1 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.710311:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115a38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5668864->5685247) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ba5 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.710328:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115a38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5668864->5685247) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ba5 expref: 11 pid: 8216 timeout: 484 lvb_type: 0 00000100:00100000:3.0:1734016117.710345:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335302656:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016117.710430:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.714031:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335302656:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016117.714066:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115a54 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2306048->2310143] (req 2306048->2310143) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bc1 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.714085:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016117.714151:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:9668:x1818247333734784:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3996us (4761us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016117.714159:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10951 00000100:00100000:1.0:1734016117.715313:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.715503:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333734912 00000100:00100000:2.0:1734016117.715511:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333734912 00010000:00010000:2.0:1734016117.715544:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115a38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5668864->5685247) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ba5 expref: 12 pid: 8216 timeout: 484 lvb_type: 0 00000100:00100000:2.0:1734016117.715578:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3039 00000100:00100000:2.0:1734016117.715584:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333734912:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016117.715599:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016117.715620:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115a38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5668864->5685247) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ba5 expref: 12 pid: 8216 timeout: 484 lvb_type: 0 00010000:00010000:2.0:1734016117.715631:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115a38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5668864->5685247) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ba5 expref: 12 pid: 8216 timeout: 484 lvb_type: 0 00010000:00010000:2.0:1734016117.715649:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115a38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5668864->5685247) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ba5 expref: 12 pid: 8216 timeout: 484 lvb_type: 0 00010000:00010000:2.0:1734016117.715667:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016117.715669:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016117.715675:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115a54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2306048->2310143) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bc1 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.715684:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115a54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2306048->2310143) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bc1 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.715710:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115a54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2306048->2310143) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bc1 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016117.715723:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075653800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335302784:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016117.715772:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00000100:00100000:1.0:1734016117.729164:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.729251:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333735168 00000100:00100000:3.0:1734016117.729262:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333735168 00002000:00100000:3.0:1734016117.729307:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff8801369f1500 x1818247333735168/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:78/0 lens 488/0 e 0 to 0 dl 1734016128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016117.729318:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1500 with x1818247333735168 ext(0->4194303) 00002000:00010000:3.0:1734016117.729323:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f1500 00000100:00100000:3.0:1734016117.729346:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8638 00000100:00100000:3.0:1734016117.729352:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333735168:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016117.733146:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075653800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335302784:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016117.733183:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016117.733258:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333734912:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 17671us (17949us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016117.733271:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3039 00000100:00100000:0.0:1734016117.735179:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016117.735276:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333735424 00000100:00100000:1.0:1734016117.735287:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333735424 00002000:00100000:1.0:1734016117.735336:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (4194304->5685247) req@ffff88012db0ad80 x1818247333735424/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:78/0 lens 488/0 e 0 to 0 dl 1734016128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016117.735346:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db0ad80 with x1818247333735424 ext(4194304->5685247) 00002000:00010000:1.0:1734016117.735352:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db0ad80 00000100:00100000:1.0:1734016117.735372:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8639 00000100:00100000:1.0:1734016117.735377:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1982:x1818247333735424:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016117.776539:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1982:x1818247333735424:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 41142us (41351us total) trans 0 rc 1490944/1490944 00000100:00100000:1.0:1734016117.776556:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8639 00002000:00100000:1.0:1734016117.776573:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (4194304->5685247) req@ffff88012db0ad80 x1818247333735424/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:78/0 lens 488/440 e 0 to 0 dl 1734016128 ref 1 fl Complete:/200/0 rc 1490944/1490944 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016117.776584:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db0ad80 with x1818247333735424 ext(4194304->5685247) 00002000:00010000:1.0:1734016117.776592:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db0ad80 00000100:00100000:3.0:1734016117.804100:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333735168:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 74728us (74926us total) trans 0 rc 4194304/4194304 00000100:00100000:3.0:1734016117.804119:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8638 00002000:00100000:3.0:1734016117.804140:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff8801369f1500 x1818247333735168/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:78/0 lens 488/440 e 0 to 0 dl 1734016128 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016117.804150:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1500 with x1818247333735168 ext(0->4194303) 00002000:00010000:3.0:1734016117.804157:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f1500 00000100:00100000:2.0:1734016117.824461:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.824632:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333735552 00000100:00100000:3.0:1734016117.824642:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333735552 00002000:00100000:3.0:1734016117.824682:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2297856->2310143) req@ffff880075653800 x1818247333735552/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:78/0 lens 12776/0 e 0 to 0 dl 1734016128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016117.824692:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075653800 with x1818247333735552 ext(2297856->2310143) 00002000:00010000:3.0:1734016117.824698:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075653800 00000100:00100000:3.0:1734016117.824728:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8640 00000100:00100000:3.0:1734016117.824734:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333735552:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016117.825549:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1982:x1818247333735552:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 811us (1094us total) trans 4294969427 rc 0/0 00000100:00100000:3.0:1734016117.825556:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8640 00002000:00100000:3.0:1734016117.825562:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2297856->2310143) req@ffff880075653800 x1818247333735552/t4294969427(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:78/0 lens 12776/448 e 0 to 0 dl 1734016128 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016117.825569:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075653800 with x1818247333735552 ext(2297856->2310143) 00002000:00010000:3.0:1734016117.825572:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075653800 00000100:00100000:2.0:1734016117.830520:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016117.831355:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333735680 00000100:00100000:0.0:1734016117.831366:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333735680 00000100:00100000:0.0:1734016117.831963:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2209 00000100:00100000:0.0:1734016117.831974:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333735680:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:0.0:1734016117.832116:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333735680:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 143us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016117.832122:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2209 00000100:00100000:0.0:1734016117.833974:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.834084:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333735808 00000100:00100000:3.0:1734016117.834092:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333735808 00000100:00100000:3.0:1734016117.834135:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10952 00000100:00100000:3.0:1734016117.834141:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1981:x1818247333735808:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016117.835069:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969427 is committed 00000001:00080000:0.0:1734016117.835078:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969426 is committed 00000100:00100000:3.0:1734016117.836343:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333735808:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 1731us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016117.836355:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10952 00000100:00100000:2.0:1734016117.840761:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.841001:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333735936 00000100:00100000:3.0:1734016117.841013:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333735936 00000100:00100000:3.0:1734016117.841071:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10953 00000100:00100000:3.0:1734016117.841079:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333735936:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.841106:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.841127:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115a5b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5bc8 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.841202:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335302912:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.844578:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00002000:00010000:3.0:1734016117.847765:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016117 -> 1734016118 00002000:00010000:3.0:1734016117.847781:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 352 -> 376 00000100:00100000:3.0:1734016117.848509:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335302912:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.848558:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115a5b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bc8 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.848574:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115a5b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bc8 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.849089:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7840, rc 0) 00000100:00100000:3.0:1734016117.849167:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333735936:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8087us (8414us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.849176:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10953 00000100:00100000:0.0:1734016117.856591:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.856653:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333736064 00000100:00100000:3.0:1734016117.856662:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333736064 00000100:00100000:3.0:1734016117.856706:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10954 00000100:00100000:3.0:1734016117.856712:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333736064:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.856727:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.856744:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115a62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5bcf expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.856794:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335303040:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.856884:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.859191:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335303040:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.859229:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115a62 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bcf expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.859243:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115a62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bcf expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.859662:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016117.859717:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333736064:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3003us (3133us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.859725:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10954 00000100:00100000:0.0:1734016117.862937:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.863078:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333736192 00000100:00100000:3.0:1734016117.863086:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333736192 00000100:00100000:3.0:1734016117.863133:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10955 00000100:00100000:3.0:1734016117.863139:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333736192:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.863158:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.863172:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115a69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5bd6 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.863221:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335303168:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.863271:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.864683:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335303168:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.864708:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115a69 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bd6 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.864719:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115a69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bd6 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.864743:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016117.864783:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333736192:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1643us (1869us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.864790:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10955 00000100:00100000:0.0:1734016117.867380:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.867497:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333736320 00000100:00100000:3.0:1734016117.867509:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333736320 00000100:00100000:3.0:1734016117.867662:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10956 00000100:00100000:3.0:1734016117.867670:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333736320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.867690:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.867711:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115a70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5bdd expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.867782:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335303296:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.868102:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.870169:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335303296:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.870211:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115a70 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bdd expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.870229:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115a70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bdd expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.870242:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7840, rc 0) 00000100:00100000:3.0:1734016117.870298:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333736320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2626us (2928us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.870311:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10956 00000100:00100000:1.0:1734016117.872748:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.873029:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333736448 00000100:00100000:3.0:1734016117.873038:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333736448 00000100:00100000:3.0:1734016117.873087:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10957 00000100:00100000:3.0:1734016117.873093:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333736448:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016117.873296:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 5685157 -> 5685157 00002000:00010000:3.0:1734016117.873299:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016118 -> 1734016118 00002000:00010000:3.0:1734016117.873301:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016118 -> 1734016117 00002000:00010000:3.0:1734016117.873303:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016118 -> 1734016117 00002000:00010000:3.0:1734016117.873304:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 376 -> 488 00000100:00100000:3.0:1734016117.873364:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333736448:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 271us (627us total) trans 4294969428 rc 0/0 00000100:00100000:3.0:1734016117.873375:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10957 00000100:00100000:0.0:1734016117.875951:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.876067:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333736576 00000100:00100000:3.0:1734016117.876075:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333736576 00000100:00100000:3.0:1734016117.876209:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10958 00000100:00100000:3.0:1734016117.876217:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333736576:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.876239:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.876259:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27115a77 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5be4 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.876321:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335303424:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.876398:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00002000:00010000:3.0:1734016117.878266:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016117 -> 1734016118 00002000:00010000:3.0:1734016117.878275:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016117 -> 1734016118 00000100:00100000:3.0:1734016117.878300:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335303424:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.878333:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27115a77 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5be4 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.878346:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27115a77 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5be4 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.878395:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df58c0, rc 0) 00000100:00100000:3.0:1734016117.878445:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333736576:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2222us (2498us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.878454:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10958 00000100:00100000:1.0:1734016117.880657:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.880775:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333736704 00000100:00100000:3.0:1734016117.880789:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333736704 00000100:00100000:3.0:1734016117.881203:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10959 00000100:00100000:3.0:1734016117.881213:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333736704:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.881237:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.881255:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115a7e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5beb expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.881315:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335303552:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.881697:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.884433:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335303552:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.884483:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115a7e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5beb expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.884501:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115a7e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5beb expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.884525:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016117.884586:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333736704:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3373us (3937us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.884595:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10959 00000100:00100000:0.0:1734016117.888106:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.888251:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333736832 00000100:00100000:3.0:1734016117.888259:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333736832 00000100:00100000:3.0:1734016117.888324:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10960 00000100:00100000:3.0:1734016117.888330:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333736832:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.888349:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.888365:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115a85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5bf2 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.888413:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335303680:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.888662:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.891097:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335303680:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.891137:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115a85 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bf2 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.891154:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115a85 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bf2 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.891182:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4480, rc 0) 00000100:00100000:3.0:1734016117.891244:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333736832:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2912us (3147us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.891253:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10960 00000100:00100000:1.0:1734016117.893701:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.893978:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333736960 00000100:00100000:3.0:1734016117.893986:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333736960 00000100:00100000:3.0:1734016117.894025:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10961 00000100:00100000:3.0:1734016117.894031:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333736960:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.894051:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.894068:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115a8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5bf9 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.894118:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335303808:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.894176:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.896498:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335303808:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.896538:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115a8c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bf9 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.896555:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115a8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bf9 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.896567:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016117.897091:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333736960:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3056us (3397us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.897103:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10961 00000100:00100000:1.0:1734016117.906346:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.906695:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333737088 00000100:00100000:3.0:1734016117.906706:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333737088 00000100:00100000:3.0:1734016117.907019:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10962 00000100:00100000:3.0:1734016117.907028:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333737088:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016117.910181:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 5685157 -> 5685157 00002000:00010000:3.0:1734016117.910194:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016118 -> 1734016117 00002000:00010000:3.0:1734016117.910197:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016118 -> 1734016117 00002000:00010000:3.0:1734016117.910198:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016118 -> 1734016117 00002000:00010000:3.0:1734016117.910200:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 488 -> 488 00000100:00100000:3.0:1734016117.910334:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333737088:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 3300us (3994us total) trans 4294969429 rc 0/0 00000100:00100000:3.0:1734016117.910345:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10962 00000100:00100000:1.0:1734016117.914145:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.914267:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333737216 00000100:00100000:3.0:1734016117.914277:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333737216 00000100:00100000:3.0:1734016117.914915:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10963 00000100:00100000:3.0:1734016117.914935:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333737216:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.914958:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.914982:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115a93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c00 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.915060:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335303936:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.915720:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00002000:00010000:3.0:1734016117.919182:0:8216:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime: 1734016117 -> 1734016118 00002000:00010000:3.0:1734016117.919190:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016117 -> 1734016118 00002000:00010000:3.0:1734016117.919191:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016117 -> 1734016118 00000100:00100000:3.0:1734016117.919216:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335303936:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.919250:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115a93 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c00 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.919263:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115a93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c00 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.919797:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016117.920006:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333737216:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5067us (5874us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.920017:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10963 00000100:00100000:1.0:1734016117.923444:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.923584:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333737344 00000100:00100000:3.0:1734016117.923593:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333737344 00000100:00100000:3.0:1734016117.923677:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10964 00000100:00100000:3.0:1734016117.923684:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333737344:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.923700:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.923715:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115a9a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c07 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.923763:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335304064:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.923855:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.926143:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335304064:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.926202:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115a9a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c07 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.926220:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115a9a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c07 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.926248:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4b40, rc 0) 00000100:00100000:3.0:1734016117.926326:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333737344:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2640us (2890us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.926339:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10964 00000100:00100000:1.0:1734016117.929617:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.929731:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333737472 00000100:00100000:3.0:1734016117.929745:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333737472 00000100:00100000:3.0:1734016117.929865:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10965 00000100:00100000:3.0:1734016117.929872:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333737472:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.929890:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.929912:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115aa1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c0e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.929978:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335304192:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.930621:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.933308:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335304192:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.933365:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115aa1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c0e expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.933383:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115aa1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c0e expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.933416:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016117.934152:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333737472:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4277us (4548us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.934160:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10965 00000100:00100000:1.0:1734016117.943057:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.943140:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333737600 00000100:00100000:3.0:1734016117.943153:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333737600 00000100:00100000:3.0:1734016117.943225:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10966 00000100:00100000:3.0:1734016117.943236:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333737600:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.943267:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.943292:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27115aa8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c15 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016117.943379:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335304320:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016117.943483:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.945295:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335304320:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016117.945330:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27115aa8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c15 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.945344:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7a80/0x5e3a3adc27115aa8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c15 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.945373:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7a80, rc 0) 00000100:00100000:3.0:1734016117.945644:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333737600:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2408us (2604us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016117.945653:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10966 00000100:00100000:1.0:1734016117.948845:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.948988:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333737856 00000100:00100000:3.0:1734016117.948997:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333737856 00000100:00100000:3.0:1734016117.949060:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8641 00000100:00100000:3.0:1734016117.949067:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333737856:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:3.0:1734016117.949104:0:7687:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115aaf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.949119:0:7687:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115a54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2306048->2310143) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bc1 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.949126:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016117.949128:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016117.949130:0:7687:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115aaf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4661248->4714495] (req 4661248->4714495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.949159:0:7687:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115a54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2306048->2310143) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bc1 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.949169:0:7687:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115a54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2306048->2310143) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bc1 expref: 8 pid: 8216 timeout: 485 lvb_type: 0 00000100:00100000:3.0:1734016117.949184:0:7687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335304448:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016117.949245:0:7687:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.959030:0:7687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335304448:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016117.959066:0:7687:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115aaf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4661248->4714495] (req 4661248->4714495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016117.966661:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.966839:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333737984 00000100:00100000:2.0:1734016117.966853:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333737984 00010000:00010000:2.0:1734016117.966892:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115a54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2306048->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bc1 expref: 9 pid: 8216 timeout: 485 lvb_type: 0 00000100:00100000:2.0:1734016117.966965:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3040 00000100:00100000:2.0:1734016117.966972:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333737984:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016117.966990:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016117.967018:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115a54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2306048->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bc1 expref: 9 pid: 8216 timeout: 485 lvb_type: 0 00010000:00010000:2.0:1734016117.967032:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115a54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2306048->2310143) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bc1 expref: 9 pid: 8216 timeout: 485 lvb_type: 0 00010000:00010000:2.0:1734016117.967067:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115a54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2306048->2310143) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5bc1 expref: 9 pid: 8216 timeout: 485 lvb_type: 0 00010000:00010000:2.0:1734016117.967104:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016117.967106:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016117.967112:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115aaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4661248->4714495] (req 4661248->4714495) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.967120:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115aaf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [4661248->4714495] (req 4661248->4714495) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.967141:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016117.968175:0:7687:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115aaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4661248->4714495] (req 4661248->4714495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.968184:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115aaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4661248->4714495] (req 4661248->4714495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016117.969065:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333737984:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 2086us (2410us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016117.969076:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3040 00000001:00080000:1.0:1734016117.975585:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969430 is committed 00002000:00010000:2.0:1734016117.975680:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 488 -> 592 00010000:00010000:2.0:1734016117.975691:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115aaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4661248->4714495] (req 4661248->4714495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.975701:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115aaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4661248->4714495] (req 4661248->4714495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.975709:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115aaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4661248->4714495] (req 4661248->4714495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.975714:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df73c0 already unused, calling callback (ffffffffa080e100) 00010000:00010000:2.0:1734016117.975717:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115aaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4661248->4714495] (req 4661248->4714495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.975724:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115aaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4661248->4714495] (req 4661248->4714495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.975738:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115aaf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4661248->4714495] (req 4661248->4714495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.975742:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115aaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [4661248->4714495] (req 4661248->4714495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016117.975842:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333737856:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 26770us (27001us total) trans 4294969430 rc 0/0 00000100:00100000:2.0:1734016117.975849:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8641 00000100:00100000:1.0:1734016117.979345:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.979457:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333738112 00000100:00100000:3.0:1734016117.979469:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333738112 00000100:00100000:3.0:1734016117.979528:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10967 00000100:00100000:3.0:1734016117.979536:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333738112:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.979563:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.979586:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115ab6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c1c expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1734016117.979607:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 5685157, mtime: 0x675afc76, atime: 0x675afc75, ctime: 0x675afc76, blocks: 0x250 00010000:00010000:3.0:1734016117.979629:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016117.979631:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016117.979638:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115ab6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c1c expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.979652:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115ab6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c1c expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.979669:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016117.979728:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333738112:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 192us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016117.979734:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10967 00000100:00100000:0.0:1734016117.982010:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.982081:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333738240 00000100:00100000:2.0:1734016117.982091:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333738240 00000100:00100000:2.0:1734016117.982179:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10968 00000100:00100000:2.0:1734016117.982185:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333738240:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016117.982205:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016117.982221:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115abd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c23 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016117.982241:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016117.982242:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016117.982250:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115abd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c23 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.982261:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115abd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c23 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016117.982272:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016117.982326:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333738240:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 142us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016117.982330:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10968 00000100:00100000:1.0:1734016117.984505:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016117.984891:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333738368 00000100:00100000:3.0:1734016117.984902:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333738368 00000100:00100000:3.0:1734016117.984960:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10969 00000100:00100000:3.0:1734016117.984967:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333738368:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016117.984987:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016117.985006:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115ac4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c2a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.985029:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115ab6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c1c expref: 5 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.985037:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115abd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c23 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.985043:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016117.985045:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016117.985048:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115ac4 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c2a expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.985078:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115abd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c23 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.985092:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115abd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c23 expref: 8 pid: 7684 timeout: 485 lvb_type: 1 00000100:00100000:3.0:1734016117.985104:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335304576:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016117.985177:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115ab6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c1c expref: 5 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016117.985185:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115ab6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c1c expref: 5 pid: 8216 timeout: 485 lvb_type: 1 00000100:00100000:3.0:1734016117.985192:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335304704:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016117.985208:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016117.988796:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335304576:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016117.988842:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335304704:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016117.988871:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115ac4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c2a expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016117.988885:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016117.988952:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333738368:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3983us (4456us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016117.988961:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10969 00000100:00100000:0.0:1734016117.989447:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016117.989521:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016117.989547:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333738624 00000100:00100000:0.0:1734016117.989552:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333738624 00010000:00010000:0.0:1734016117.989575:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115ab6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c1c expref: 6 pid: 8216 timeout: 485 lvb_type: 1 00000100:00100000:0.0:1734016117.989609:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333738496 00000100:00100000:0.0:1734016117.989612:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333738496 00010000:00010000:0.0:1734016117.989620:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115abd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c23 expref: 8 pid: 7684 timeout: 485 lvb_type: 1 00000100:00100000:0.0:1734016117.989633:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3041 00000100:00100000:0.0:1734016117.989640:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333738624:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016117.989653:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016117.989669:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115ab6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c1c expref: 6 pid: 8216 timeout: 485 lvb_type: 1 00010000:00010000:0.0:1734016117.989677:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115ab6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c1c expref: 6 pid: 8216 timeout: 485 lvb_type: 1 00010000:00010000:0.0:1734016117.989699:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115ab6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c1c expref: 6 pid: 8216 timeout: 485 lvb_type: 1 00010000:00010000:0.0:1734016117.989714:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016117.989733:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333738624:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 94us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016117.989743:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3041 00000100:00100000:0.0:1734016117.989755:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3042 00000100:00100000:0.0:1734016117.989759:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333738496:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016117.989765:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016117.989772:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115abd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c23 expref: 8 pid: 7684 timeout: 485 lvb_type: 1 00010000:00010000:0.0:1734016117.989781:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115abd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c23 expref: 8 pid: 7684 timeout: 485 lvb_type: 1 00010000:00010000:0.0:1734016117.989791:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115abd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c23 expref: 8 pid: 7684 timeout: 485 lvb_type: 1 00010000:00010000:0.0:1734016117.989819:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016117.989821:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016117.989827:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->176127) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c2a expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016117.989835:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->176127) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c2a expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016117.989865:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->176127) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c2a expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016117.989878:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335304832:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016117.989909:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016117.993224:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335304832:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016117.993250:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016117.993307:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333738496:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3545us (3784us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016117.993318:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3042 00000100:00100000:1.0:1734016117.994755:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016117.995886:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333738880 00000100:00100000:2.0:1734016117.995901:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333738880 00002000:00100000:2.0:1734016117.995990:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (172032->176127) req@ffff8800758ad180 x1818247333738880/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:78/0 lens 488/0 e 0 to 0 dl 1734016128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016117.996001:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758ad180 with x1818247333738880 ext(172032->176127) 00002000:00010000:2.0:1734016117.996007:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758ad180 00000100:00100000:2.0:1734016117.996050:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8642 00000100:00100000:2.0:1734016117.996058:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333738880:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016117.996242:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333738880:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 183us (1492us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016117.996248:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8642 00002000:00100000:2.0:1734016117.996254:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (172032->176127) req@ffff8800758ad180 x1818247333738880/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:78/0 lens 488/4536 e 0 to 0 dl 1734016128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016117.996261:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758ad180 with x1818247333738880 ext(172032->176127) 00002000:00010000:2.0:1734016117.996264:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758ad180 00000100:00100000:2.0:1734016118.000682:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.001125:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333739136 00000100:00100000:0.0:1734016118.001135:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333739136 00002000:00100000:0.0:1734016118.001281:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (167936->172031) req@ffff880075650700 x1818247333739136/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016118.001291:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075650700 with x1818247333739136 ext(167936->172031) 00002000:00010000:0.0:1734016118.001296:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075650700 00000100:00100000:0.0:1734016118.001417:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8643 00000100:00100000:0.0:1734016118.001425:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075650700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333739136:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016118.001644:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075650700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333739136:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 219us (971us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016118.001652:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8643 00002000:00100000:0.0:1734016118.001657:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (167936->172031) req@ffff880075650700 x1818247333739136/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016118.001664:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075650700 with x1818247333739136 ext(167936->172031) 00002000:00010000:0.0:1734016118.001667:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075650700 00000100:00100000:0.0:1734016118.006320:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016118.006545:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333739264 00000100:00100000:1.0:1734016118.006559:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333739264 00002000:00100000:1.0:1734016118.006601:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (167936->176127) req@ffff880073b48000 x1818247333739264/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 8680/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016118.006612:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48000 with x1818247333739264 ext(167936->176127) 00002000:00010000:1.0:1734016118.006618:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b48000 00000100:00100000:1.0:1734016118.006657:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8644 00000100:00100000:1.0:1734016118.006665:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333739264:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016118.007459:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333739264:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 790us (1151us total) trans 4294969431 rc 0/0 00000100:00100000:1.0:1734016118.007469:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8644 00002000:00100000:1.0:1734016118.007476:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (167936->176127) req@ffff880073b48000 x1818247333739264/t4294969431(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 8680/448 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016118.007483:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48000 with x1818247333739264 ext(167936->176127) 00002000:00010000:1.0:1734016118.007487:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b48000 00000100:00100000:2.0:1734016118.010960:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016118.011603:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333739392 00000100:00100000:3.0:1734016118.011615:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333739392 00000100:00100000:3.0:1734016118.011688:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2210 00000100:00100000:3.0:1734016118.011697:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+19:9668:x1818247333739392:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:3.0:1734016118.011957:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+19:9668:x1818247333739392:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 261us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016118.011965:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2210 00000100:00100000:2.0:1734016118.015493:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016118.015604:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333739520 00000100:00100000:3.0:1734016118.015615:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333739520 00000100:00100000:3.0:1734016118.015650:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10970 00000100:00100000:3.0:1734016118.015657:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333739520:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:1.0:1734016118.030935:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969431 is committed 00000100:00100000:3.0:1734016118.031902:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333739520:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 16238us (16413us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016118.031913:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10970 00000100:00100000:0.0:1734016118.034534:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016118.034675:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333739648 00000100:00100000:3.0:1734016118.034690:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333739648 00000100:00100000:3.0:1734016118.034779:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10971 00000100:00100000:3.0:1734016118.034791:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333739648:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016118.034844:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016118.034866:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115acb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c31 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016118.034944:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335304960:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016118.035010:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92cc0 going to sleep for 11 seconds 00000100:00080000:2.0:1734016118.035149:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016088 00002000:00010000:3.0:1734016118.064672:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016117 -> 1734016118 00002000:00010000:3.0:1734016118.064680:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 592 -> 608 00000100:00100000:3.0:1734016118.064704:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335304960:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016118.064741:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115acb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c31 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016118.064757:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115acb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c31 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016118.064780:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016118.064841:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333739648:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 30053us (30319us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016118.064848:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10971 00000100:00100000:3.0:1734016118.068765:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.068826:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333739776 00000100:00100000:0.0:1734016118.068833:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333739776 00000100:00100000:0.0:1734016118.068873:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10972 00000100:00100000:0.0:1734016118.068878:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333739776:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016118.068894:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016118.068909:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27115ad2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c38 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016118.068966:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335305088:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016118.069021:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eed80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016118.070828:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335305088:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016118.070858:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27115ad2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c38 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016118.070868:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27115ad2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c38 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016118.070885:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:2.0:1734016118.070933:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333739776:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2053us (2174us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016118.070939:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10972 00000100:00100000:3.0:1734016118.074146:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.075345:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333739904 00000100:00100000:2.0:1734016118.075357:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333739904 00000100:00100000:2.0:1734016118.075419:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10973 00000100:00100000:2.0:1734016118.075427:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333739904:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016118.075844:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 5685157 -> 5685157 00002000:00010000:2.0:1734016118.075849:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016118 -> 1734016118 00002000:00010000:2.0:1734016118.075851:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016118 -> 1734016117 00002000:00010000:2.0:1734016118.075853:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016118 -> 1734016118 00002000:00010000:2.0:1734016118.075854:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 608 -> 608 00000100:00100000:2.0:1734016118.075935:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333739904:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 508us (1797us total) trans 4294969432 rc 0/0 00000100:00100000:2.0:1734016118.075941:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10973 00000100:00100000:3.0:1734016118.078391:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.078461:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333740032 00000100:00100000:0.0:1734016118.078471:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333740032 00000100:00100000:0.0:1734016118.078525:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10974 00000100:00100000:0.0:1734016118.078531:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88009024a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333740032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016118.078551:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016118.078569:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27115ad9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c3f expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016118.078623:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335305216:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016118.078691:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00002000:00010000:0.0:1734016118.081180:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016117 -> 1734016118 00000100:00100000:0.0:1734016118.081213:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335305216:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016118.081245:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27115ad9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c3f expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.081258:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27115ad9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c3f expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.081345:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016118.081475:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88009024a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333740032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2942us (3093us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016118.081484:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10974 00000100:00100000:3.0:1734016118.085896:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.085981:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333740160 00000100:00100000:0.0:1734016118.085990:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333740160 00000100:00100000:0.0:1734016118.086192:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10975 00000100:00100000:0.0:1734016118.086200:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333740160:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016118.086218:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016118.086233:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27115ae0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c46 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016118.086282:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335305344:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016118.086342:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016118.088021:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335305344:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016118.088051:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27115ae0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c46 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.088061:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27115ae0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c46 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.088086:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:0.0:1734016118.088132:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333740160:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1931us (2244us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016118.088141:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10975 00000100:00100000:0.0:1734016118.091367:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016118.091497:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333740416 00000100:00100000:1.0:1734016118.091508:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333740416 00002000:00100000:1.0:1734016118.091559:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2654208->2658303) req@ffff8800756a5500 x1818247333740416/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016118.091570:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a5500 with x1818247333740416 ext(2654208->2658303) 00002000:00010000:1.0:1734016118.091576:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a5500 00000100:00100000:1.0:1734016118.091596:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8645 00000100:00100000:1.0:1734016118.091603:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333740416:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016118.091770:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333740416:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 166us (411us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016118.091777:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8645 00002000:00100000:1.0:1734016118.091783:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2654208->2658303) req@ffff8800756a5500 x1818247333740416/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016118.091790:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a5500 with x1818247333740416 ext(2654208->2658303) 00002000:00010000:1.0:1734016118.091793:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a5500 00000100:00100000:0.0:1734016118.096028:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.097036:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333740672 00000100:00100000:2.0:1734016118.097044:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333740672 00002000:00100000:2.0:1734016118.097083:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2650112->2654207) req@ffff8800756a5880 x1818247333740672/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.097093:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a5880 with x1818247333740672 ext(2650112->2654207) 00002000:00010000:2.0:1734016118.097098:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a5880 00000100:00100000:2.0:1734016118.097130:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8646 00000100:00100000:2.0:1734016118.097138:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333740672:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016118.097279:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333740672:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 140us (1259us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016118.097285:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8646 00002000:00100000:2.0:1734016118.097290:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2650112->2654207) req@ffff8800756a5880 x1818247333740672/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.097296:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a5880 with x1818247333740672 ext(2650112->2654207) 00002000:00010000:2.0:1734016118.097299:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a5880 00000100:00100000:0.0:1734016118.099899:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016118.100002:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333740928 00000100:00100000:1.0:1734016118.100011:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333740928 00002000:00100000:1.0:1734016118.100049:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2646016->2650111) req@ffff8800756a5c00 x1818247333740928/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016118.100058:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a5c00 with x1818247333740928 ext(2646016->2650111) 00002000:00010000:1.0:1734016118.100063:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a5c00 00000100:00100000:1.0:1734016118.100127:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8647 00000100:00100000:1.0:1734016118.100133:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333740928:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016118.100272:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333740928:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 138us (380us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016118.100279:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8647 00002000:00100000:1.0:1734016118.100284:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2646016->2650111) req@ffff8800756a5c00 x1818247333740928/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016118.100291:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a5c00 with x1818247333740928 ext(2646016->2650111) 00002000:00010000:1.0:1734016118.100293:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a5c00 00000100:00100000:0.0:1734016118.103885:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.104255:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333741184 00000100:00100000:2.0:1734016118.104270:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333741184 00002000:00100000:2.0:1734016118.104328:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2641920->2646015) req@ffff8800756a5f80 x1818247333741184/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.104340:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a5f80 with x1818247333741184 ext(2641920->2646015) 00002000:00010000:2.0:1734016118.104346:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a5f80 00000100:00100000:2.0:1734016118.104380:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8648 00000100:00100000:2.0:1734016118.104388:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333741184:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016118.104597:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333741184:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 208us (723us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016118.104604:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8648 00002000:00100000:2.0:1734016118.104608:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2641920->2646015) req@ffff8800756a5f80 x1818247333741184/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.104616:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a5f80 with x1818247333741184 ext(2641920->2646015) 00002000:00010000:2.0:1734016118.104618:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a5f80 00000100:00100000:0.0:1734016118.109339:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016118.109433:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333741440 00000100:00100000:1.0:1734016118.109442:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333741440 00002000:00100000:1.0:1734016118.109485:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2637824->2641919) req@ffff8800756a6300 x1818247333741440/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016118.109493:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6300 with x1818247333741440 ext(2637824->2641919) 00002000:00010000:1.0:1734016118.109498:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a6300 00000100:00100000:1.0:1734016118.109532:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8649 00000100:00100000:1.0:1734016118.109538:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333741440:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016118.109671:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333741440:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 132us (341us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016118.109677:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8649 00002000:00100000:1.0:1734016118.109682:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2637824->2641919) req@ffff8800756a6300 x1818247333741440/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016118.109688:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6300 with x1818247333741440 ext(2637824->2641919) 00002000:00010000:1.0:1734016118.109690:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a6300 00000100:00100000:0.0:1734016118.111887:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.112291:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333741696 00000100:00100000:2.0:1734016118.112300:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333741696 00002000:00100000:2.0:1734016118.112337:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2633728->2637823) req@ffff8800756a6680 x1818247333741696/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.112345:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6680 with x1818247333741696 ext(2633728->2637823) 00002000:00010000:2.0:1734016118.112352:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a6680 00000100:00100000:2.0:1734016118.112373:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8650 00000100:00100000:2.0:1734016118.112380:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333741696:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016118.112529:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333741696:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 148us (648us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016118.112536:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8650 00002000:00100000:2.0:1734016118.112542:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2633728->2637823) req@ffff8800756a6680 x1818247333741696/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.112549:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6680 with x1818247333741696 ext(2633728->2637823) 00002000:00010000:2.0:1734016118.112552:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a6680 00000100:00100000:0.0:1734016118.114674:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.114768:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333741952 00000100:00100000:2.0:1734016118.114777:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333741952 00002000:00100000:2.0:1734016118.114844:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2629632->2633727) req@ffff8800756a6a00 x1818247333741952/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.114854:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6a00 with x1818247333741952 ext(2629632->2633727) 00002000:00010000:2.0:1734016118.114859:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a6a00 00000100:00100000:2.0:1734016118.114984:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8651 00000100:00100000:2.0:1734016118.114991:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333741952:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016118.115372:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333741952:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 379us (705us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016118.115379:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8651 00002000:00100000:2.0:1734016118.115385:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2629632->2633727) req@ffff8800756a6a00 x1818247333741952/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.115392:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6a00 with x1818247333741952 ext(2629632->2633727) 00002000:00010000:2.0:1734016118.115394:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a6a00 00000100:00100000:0.0:1734016118.118328:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.118523:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333742208 00000100:00100000:2.0:1734016118.118531:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333742208 00002000:00100000:2.0:1734016118.118572:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2625536->2629631) req@ffff8800756a7100 x1818247333742208/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.118583:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a7100 with x1818247333742208 ext(2625536->2629631) 00002000:00010000:2.0:1734016118.118589:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a7100 00000100:00100000:2.0:1734016118.119021:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8652 00000100:00100000:2.0:1734016118.119028:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333742208:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016118.119176:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333742208:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 147us (856us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016118.119182:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8652 00002000:00100000:2.0:1734016118.119187:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2625536->2629631) req@ffff8800756a7100 x1818247333742208/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.119193:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a7100 with x1818247333742208 ext(2625536->2629631) 00002000:00010000:2.0:1734016118.119196:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a7100 00000100:00100000:0.0:1734016118.123062:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016118.123216:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333742464 00000100:00100000:1.0:1734016118.123227:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333742464 00002000:00100000:1.0:1734016118.123271:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2621440->2625535) req@ffff8800756a7480 x1818247333742464/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016118.123281:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a7480 with x1818247333742464 ext(2621440->2625535) 00002000:00010000:1.0:1734016118.123286:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a7480 00000100:00100000:1.0:1734016118.123328:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8653 00000100:00100000:1.0:1734016118.123333:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333742464:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016118.123477:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333742464:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 143us (429us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016118.123483:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8653 00002000:00100000:1.0:1734016118.123489:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2621440->2625535) req@ffff8800756a7480 x1818247333742464/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016118.123495:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a7480 with x1818247333742464 ext(2621440->2625535) 00002000:00010000:1.0:1734016118.123498:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a7480 00000100:00100000:0.0:1734016118.126293:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.126790:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333742720 00000100:00100000:2.0:1734016118.126814:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333742720 00002000:00100000:2.0:1734016118.126857:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2617344->2621439) req@ffff8800756a7800 x1818247333742720/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.126866:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a7800 with x1818247333742720 ext(2617344->2621439) 00002000:00010000:2.0:1734016118.126871:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a7800 00000100:00100000:2.0:1734016118.126906:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8654 00000100:00100000:2.0:1734016118.126912:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333742720:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016118.127071:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333742720:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 157us (787us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016118.127079:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8654 00002000:00100000:2.0:1734016118.127085:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2617344->2621439) req@ffff8800756a7800 x1818247333742720/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.127091:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a7800 with x1818247333742720 ext(2617344->2621439) 00002000:00010000:2.0:1734016118.127094:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a7800 00000100:00100000:0.0:1734016118.130654:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016118.130734:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333742976 00000100:00100000:1.0:1734016118.130747:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333742976 00002000:00100000:1.0:1734016118.130792:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2613248->2617343) req@ffff8800756a7b80 x1818247333742976/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016118.130837:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a7b80 with x1818247333742976 ext(2613248->2617343) 00002000:00010000:1.0:1734016118.130843:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a7b80 00000100:00100000:1.0:1734016118.130876:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8655 00000100:00100000:1.0:1734016118.130883:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333742976:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016118.131062:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333742976:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 178us (428us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016118.131068:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8655 00002000:00100000:1.0:1734016118.131073:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2613248->2617343) req@ffff8800756a7b80 x1818247333742976/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016118.131079:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a7b80 with x1818247333742976 ext(2613248->2617343) 00002000:00010000:1.0:1734016118.131082:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a7b80 00000100:00100000:0.0:1734016118.133883:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.133957:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333743232 00000100:00100000:2.0:1734016118.133970:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333743232 00002000:00100000:2.0:1734016118.134022:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2609152->2613247) req@ffff8800756a4e00 x1818247333743232/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.134033:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a4e00 with x1818247333743232 ext(2609152->2613247) 00002000:00010000:2.0:1734016118.134040:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a4e00 00000100:00100000:2.0:1734016118.134092:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8656 00000100:00100000:2.0:1734016118.134100:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333743232:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016118.134264:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333743232:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 163us (394us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016118.134271:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8656 00002000:00100000:2.0:1734016118.134277:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2609152->2613247) req@ffff8800756a4e00 x1818247333743232/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.134284:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a4e00 with x1818247333743232 ext(2609152->2613247) 00002000:00010000:2.0:1734016118.134287:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a4e00 00000100:00100000:0.0:1734016118.136789:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.136937:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333743488 00000100:00100000:2.0:1734016118.136948:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333743488 00002000:00100000:2.0:1734016118.136994:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2605056->2609151) req@ffff8800756a4380 x1818247333743488/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.137007:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a4380 with x1818247333743488 ext(2605056->2609151) 00002000:00010000:2.0:1734016118.137015:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a4380 00000100:00100000:2.0:1734016118.137129:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8657 00000100:00100000:2.0:1734016118.137137:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333743488:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016118.137356:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333743488:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 220us (583us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016118.137363:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8657 00002000:00100000:2.0:1734016118.137368:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2605056->2609151) req@ffff8800756a4380 x1818247333743488/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.137375:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a4380 with x1818247333743488 ext(2605056->2609151) 00002000:00010000:2.0:1734016118.137378:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a4380 00000100:00100000:0.0:1734016118.140293:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016118.140417:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333743744 00000100:00100000:1.0:1734016118.140430:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333743744 00002000:00100000:1.0:1734016118.140478:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2600960->2605055) req@ffff8800756a4a80 x1818247333743744/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016118.140489:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a4a80 with x1818247333743744 ext(2600960->2605055) 00002000:00010000:1.0:1734016118.140496:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a4a80 00000100:00100000:1.0:1734016118.140541:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8658 00000100:00100000:1.0:1734016118.140550:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333743744:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016118.140719:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333743744:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 169us (435us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016118.140726:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8658 00002000:00100000:1.0:1734016118.140732:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2600960->2605055) req@ffff8800756a4a80 x1818247333743744/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016118.140739:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a4a80 with x1818247333743744 ext(2600960->2605055) 00002000:00010000:1.0:1734016118.140742:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a4a80 00000100:00100000:0.0:1734016118.146401:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.146516:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333743872 00000100:00100000:2.0:1734016118.146528:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333743872 00002000:00100000:2.0:1734016118.146576:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2600960->2658303) req@ffff8800756a4000 x1818247333743872/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.146591:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a4000 with x1818247333743872 ext(2600960->2658303) 00002000:00010000:2.0:1734016118.146598:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a4000 00000100:00100000:2.0:1734016118.146907:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8659 00000100:00100000:2.0:1734016118.146915:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333743872:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016118.151366:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333743872:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4436us (4959us total) trans 4294969433 rc 0/0 00000100:00100000:0.0:1734016118.151380:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8659 00002000:00100000:0.0:1734016118.151399:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (2600960->2658303) req@ffff8800756a4000 x1818247333743872/t4294969433(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/448 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016118.151409:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a4000 with x1818247333743872 ext(2600960->2658303) 00002000:00010000:0.0:1734016118.151416:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a4000 00000100:00100000:0.0:1734016118.155430:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.155565:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333744000 00000100:00100000:2.0:1734016118.155579:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333744000 00000100:00100000:2.0:1734016118.155687:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10976 00000100:00100000:2.0:1734016118.155698:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333744000:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:1.0:1734016118.161665:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969433 is committed 00000100:00100000:2.0:1734016118.168142:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333744000:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 12436us (12713us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016118.168155:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10976 00000100:00100000:2.0:1734016118.173552:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.173949:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333744128 00000100:00100000:0.0:1734016118.173958:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333744128 00000100:00100000:0.0:1734016118.174015:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10977 00000100:00100000:0.0:1734016118.174023:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333744128:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016118.174045:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016118.174066:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27115ae7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c4d expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016118.174124:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335305472:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016118.174197:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00002000:00010000:2.0:1734016118.178211:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 608 -> 720 00000100:00100000:2.0:1734016118.178272:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335305472:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016118.178331:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27115ae7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c4d expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016118.178355:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27115ae7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c4d expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016118.178384:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:2.0:1734016118.178495:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333744128:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4469us (4956us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016118.178511:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10977 00000100:00100000:0.0:1734016118.185054:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.185479:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333744256 00000100:00100000:2.0:1734016118.185488:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333744256 00000100:00100000:2.0:1734016118.185532:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10978 00000100:00100000:2.0:1734016118.185539:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333744256:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016118.185561:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016118.185584:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115aee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c54 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016118.185645:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075650380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335305600:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016118.185718:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016118.190757:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075650380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335305600:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016118.190791:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115aee lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c54 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016118.190832:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115aee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c54 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016118.190846:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016118.191533:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333744256:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5985us (6480us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016118.191543:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10978 00000100:00100000:0.0:1734016118.200913:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016118.203141:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333744512 00000100:00100000:3.0:1734016118.203158:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333744512 00000100:00100000:3.0:1734016118.203217:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2211 00000100:00100000:3.0:1734016118.203224:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:9668:x1818247333744512:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016118.203276:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016118.203304:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115a00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b6d expref: 14 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016118.203691:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016118.203696:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016118.206867:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115af5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016118.206890:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b3c expref: 18 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016118.206901:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115af5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016118.206945:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b3c expref: 18 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016118.206957:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b3c expref: 18 pid: 6478 timeout: 485 lvb_type: 0 00000100:00100000:3.0:1734016118.206970:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335305728:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016118.207051:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016118.219141:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335305728:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016118.219177:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115af5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016118.220130:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.220490:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333744640 00000100:00100000:2.0:1734016118.220498:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333744640 00010000:00010000:2.0:1734016118.220527:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b3c expref: 19 pid: 6478 timeout: 485 lvb_type: 0 00000100:00100000:2.0:1734016118.220555:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3043 00000100:00100000:2.0:1734016118.220562:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b42c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+19:1982:x1818247333744640:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016118.220573:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016118.220577:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b3c expref: 19 pid: 6478 timeout: 485 lvb_type: 0 00010000:00010000:2.0:1734016118.220586:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b3c expref: 19 pid: 6478 timeout: 485 lvb_type: 0 00010000:00010000:2.0:1734016118.220605:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc271159c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5b3c expref: 19 pid: 6478 timeout: 485 lvb_type: 0 00010000:00010000:2.0:1734016118.220636:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016118.220640:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115af5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016118.220647:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115af5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016118.220652:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115af5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016118.220673:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016118.220729:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b42c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247333744640:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 166us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016118.220736:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3043 00010000:00010000:2.0:1734016118.220793:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115af5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016118.220818:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115af5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:2.0:1734016118.222828:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968722 00000004:00010000:2.0:1734016118.222889:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007bd3e680 reply state ffff880073a03000 transno 4294968723 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115af5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:2.0:1734016118.222898:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016118.223018:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333744512:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 19790us (22114us total) trans 4294968723 rc 0/0 00000100:00100000:2.0:1734016118.223027:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2211 00000020:00080000:2.0:1734016118.223032:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1734016118.229089:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115af5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016118.229103:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115af5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016118.229109:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115af5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016118.229114:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df7a80 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016118.229117:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115af5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016118.229123:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115af5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016118.229140:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016118.229143:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016118.229146:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115af5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016118.229151:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115af5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016118.233796:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.236586:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333744768 00000100:00100000:2.0:1734016118.236604:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333744768 00000100:00100000:2.0:1734016118.236675:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10979 00000100:00100000:2.0:1734016118.236686:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333744768:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016118.236709:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016118.236734:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115afc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c5b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.236765:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->176127) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c2a expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.236774:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016118.236776:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016118.236780:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115afc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c5b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.236843:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->176127) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c2a expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.236859:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115ac4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->176127) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c2a expref: 6 pid: 8216 timeout: 485 lvb_type: 0 00000100:00100000:2.0:1734016118.236874:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075650380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335305856:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016118.237571:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016118.248552:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.249067:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075650380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335305856:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016118.249098:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115afc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c5b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.249114:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016118.249161:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333744768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12476us (15376us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016118.249169:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10979 00000100:00100000:1.0:1734016118.249436:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333744896 00000100:00100000:1.0:1734016118.249443:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333744896 00010000:00010000:1.0:1734016118.249470:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115ac4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->176127) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c2a expref: 7 pid: 8216 timeout: 485 lvb_type: 0 00000100:00100000:1.0:1734016118.249507:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3044 00000100:00100000:1.0:1734016118.249514:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333744896:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016118.249526:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016118.249546:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115ac4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 172032->176127) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c2a expref: 7 pid: 8216 timeout: 485 lvb_type: 0 00010000:00010000:1.0:1734016118.249557:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 172032->176127) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c2a expref: 7 pid: 8216 timeout: 485 lvb_type: 0 00010000:00010000:1.0:1734016118.249579:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115ac4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 172032->176127) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c2a expref: 7 pid: 8216 timeout: 485 lvb_type: 0 00010000:00010000:1.0:1734016118.250089:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016118.250091:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016118.250097:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115afc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c5b expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016118.250105:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115afc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c5b expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016118.250134:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115afc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c5b expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016118.250145:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335305984:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016118.250198:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016118.256001:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.257387:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333745024 00000100:00100000:2.0:1734016118.257397:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333745024 00002000:00010000:2.0:1734016118.257439:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (8086679->18446744073709551615) 00002000:00100000:2.0:1734016118.257445:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3f480 with x1818247333745024 ext(8086679->18446744073709551615) 00002000:00010000:2.0:1734016118.257457:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3f480. 00000100:00100000:2.0:1734016118.257500:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8660 00000100:00100000:2.0:1734016118.257509:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333745024:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016118.257767:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 5685157 -> 8086679 00002000:00010000:2.0:1734016118.257771:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016118 -> 1734016118 00002000:00010000:2.0:1734016118.257773:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016118 -> 1734016117 00002000:00010000:2.0:1734016118.257775:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016118 -> 1734016118 00002000:00010000:2.0:1734016118.257777:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 720 -> 720 00000100:00100000:1.0:1734016118.258437:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335305984:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016118.258463:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016118.258566:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333745024:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1054us (2569us total) trans 4294969434 rc 0/0 00000100:00100000:1.0:1734016118.258570:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333744896:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9057us (10028us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016118.258575:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8660 00000100:00100000:1.0:1734016118.258577:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3044 00002000:00010000:2.0:1734016118.258579:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (8086679->18446744073709551615) 00002000:00100000:2.0:1734016118.258581:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3f480 with x1818247333745024 ext(8086679->18446744073709551615) 00002000:00010000:2.0:1734016118.258586:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3f480. 00000100:00100000:0.0:1734016118.287569:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.287949:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333745280 00000100:00100000:2.0:1734016118.287958:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333745280 00002000:00100000:2.0:1734016118.288002:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5685248->8089599) req@ffff88007bd3d500 x1818247333745280/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.288012:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3d500 with x1818247333745280 ext(5685248->8089599) 00002000:00010000:2.0:1734016118.288018:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3d500 00000100:00100000:2.0:1734016118.288037:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8661 00000100:00100000:2.0:1734016118.288044:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333745280:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016118.330614:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333745280:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 42556us (43047us total) trans 0 rc 2404352/2404352 00000100:00100000:2.0:1734016118.330627:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8661 00002000:00100000:2.0:1734016118.330640:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5685248->8089599) req@ffff88007bd3d500 x1818247333745280/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:79/0 lens 488/440 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 2404352/2404352 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.330650:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3d500 with x1818247333745280 ext(5685248->8089599) 00002000:00010000:2.0:1734016118.330656:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3d500 00000100:00100000:0.0:1734016118.349976:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.351536:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333745408 00000100:00100000:2.0:1734016118.351548:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333745408 00002000:00100000:2.0:1734016118.351602:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8048640->8086678) req@ffff88007bd3c700 x1818247333745408/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.351612:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3c700 with x1818247333745408 ext(8048640->8086678) 00002000:00010000:2.0:1734016118.351618:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3c700 00000100:00100000:2.0:1734016118.351663:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8662 00000100:00100000:2.0:1734016118.351669:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333745408:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016118.359707:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333745408:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 8028us (9738us total) trans 4294969435 rc 0/0 00000100:00100000:0.0:1734016118.359720:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8662 00002000:00100000:0.0:1734016118.359731:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8048640->8086678) req@ffff88007bd3c700 x1818247333745408/t4294969435(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:79/0 lens 488/448 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016118.359740:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3c700 with x1818247333745408 ext(8048640->8086678) 00002000:00010000:0.0:1734016118.359746:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3c700 00000100:00100000:0.0:1734016118.368793:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.368962:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333745536 00000100:00100000:2.0:1734016118.368973:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333745536 00000100:00100000:2.0:1734016118.369031:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2212 00000100:00100000:2.0:1734016118.369041:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:9668:x1818247333745536:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:2.0:1734016118.369220:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:9668:x1818247333745536:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 181us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016118.369228:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2212 00000100:00100000:0.0:1734016118.377599:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.377665:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333745664 00000100:00100000:2.0:1734016118.377676:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333745664 00000100:00100000:2.0:1734016118.377727:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10980 00000100:00100000:2.0:1734016118.377735:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333745664:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:1.0:1734016118.382427:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969435 is committed 00000100:00100000:2.0:1734016118.389221:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333745664:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 11477us (11622us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016118.389235:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10980 00000100:00100000:3.0:1734016118.394919:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.394996:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333745792 00000100:00100000:0.0:1734016118.395007:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333745792 00000100:00100000:0.0:1734016118.395072:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2213 00000100:00100000:0.0:1734016118.395079:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:9668:x1818247333745792:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016118.395107:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016118.395134:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27115b03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c62 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.395232:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27115b0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016118.395244:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27115b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016118.395253:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27115b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:0.0:1734016118.395277:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 8086679 00000004:00200000:0.0:1734016118.395280:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016118.395295:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27115b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016118.395321:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27115b03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c62 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.395353:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27115b0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c62 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.395360:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016118.395363:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016118.395366:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016118.395428:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333745792:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 348us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016118.395434:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2213 00000100:00100000:0.0:1734016118.401894:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.401977:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333745920 00000100:00100000:2.0:1734016118.401986:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333745920 00000100:00100000:2.0:1734016118.402047:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10981 00000100:00100000:2.0:1734016118.402055:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333745920:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016118.402075:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016118.402091:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115b11 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c69 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.402122:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115afc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c5b expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.402129:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016118.402131:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016118.402135:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115b11 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6733824->6799359] (req 6733824->6799359) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c69 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.402169:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115afc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c5b expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.402180:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115afc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c5b expref: 5 pid: 7684 timeout: 485 lvb_type: 0 00000100:00100000:2.0:1734016118.402191:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075650380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335306112:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016118.402273:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016118.408625:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075650380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335306112:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016118.408657:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115b11 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [6733824->6799359] (req 6733824->6799359) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c69 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.408674:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016118.408723:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333745920:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6669us (6839us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016118.408731:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10981 00000100:00100000:3.0:1734016118.412461:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016118.412560:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333746048 00000100:00100000:1.0:1734016118.412570:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333746048 00010000:00010000:1.0:1734016118.412604:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115afc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c5b expref: 6 pid: 7684 timeout: 485 lvb_type: 0 00000100:00100000:1.0:1734016118.412641:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3045 00000100:00100000:1.0:1734016118.412647:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333746048:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016118.412660:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1734016118.412676:0:6465:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016117 -> 1734016118 00002000:00010000:1.0:1734016118.412680:0:6465:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 720 -> 800 00010000:00010000:1.0:1734016118.412686:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115afc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c5b expref: 6 pid: 7684 timeout: 485 lvb_type: 0 00010000:00010000:1.0:1734016118.412695:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115afc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c5b expref: 6 pid: 7684 timeout: 485 lvb_type: 0 00010000:00010000:1.0:1734016118.412713:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115afc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c5b expref: 6 pid: 7684 timeout: 485 lvb_type: 0 00010000:00010000:1.0:1734016118.412741:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016118.412743:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016118.412749:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115b11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6733824->6799359) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c69 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016118.412757:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115b11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6733824->6799359) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c69 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016118.412788:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115b11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6733824->6799359) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c69 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016118.412829:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335306240:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016118.412882:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016118.436828:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335306240:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016118.436857:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016118.436928:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333746048:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 24279us (24474us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016118.436936:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3045 00000100:00100000:0.0:1734016118.441268:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.441388:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333746176 00000100:00100000:2.0:1734016118.441398:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333746176 00000100:00100000:2.0:1734016118.441442:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10982 00000100:00100000:2.0:1734016118.441450:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333746176:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016118.441717:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8086679 -> 8086679 00002000:00010000:2.0:1734016118.441720:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016118 -> 1734016118 00002000:00010000:2.0:1734016118.441722:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016118 -> 1734016118 00002000:00010000:2.0:1734016118.441724:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016118 -> 1734016118 00002000:00010000:2.0:1734016118.441726:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 800 -> 800 00000100:00100000:2.0:1734016118.442451:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333746176:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 998us (1191us total) trans 4294969436 rc 0/0 00000100:00100000:2.0:1734016118.442458:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10982 00000100:00100000:0.0:1734016118.454295:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.461278:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333746304 00000100:00100000:2.0:1734016118.461296:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333746304 00000100:00100000:2.0:1734016118.461368:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2214 00000100:00100000:2.0:1734016118.461377:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+18:9668:x1818247333746304:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016118.461403:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016118.461429:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115b18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c70 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.461533:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115b1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016118.461550:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016118.461562:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:2.0:1734016118.461594:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 8086679 00000004:00200000:2.0:1734016118.461599:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016118.461616:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016118.461642:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115b18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c70 expref: 20 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.461682:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115b1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c70 expref: 19 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.461691:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016118.461694:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016118.461699:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd440, rc 0) 00000100:00100000:2.0:1734016118.461813:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+19:9668:x1818247333746304:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 420us (7512us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016118.461820:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2214 00000100:00100000:3.0:1734016118.468897:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.468973:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333746432 00000100:00100000:0.0:1734016118.468980:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333746432 00000100:00100000:0.0:1734016118.469027:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10983 00000100:00100000:0.0:1734016118.469034:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333746432:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016118.469051:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016118.469071:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27115b26 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c77 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016118.469122:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335306368:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016118.469191:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016118.473925:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335306368:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016118.473970:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27115b26 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c77 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.473986:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27115b26 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c77 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.474015:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:0.0:1734016118.474087:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333746432:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5052us (5198us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016118.474097:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10983 00000100:00100000:1.0:1734016118.477568:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.477618:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333746560 00000100:00100000:0.0:1734016118.477627:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333746560 00000100:00100000:0.0:1734016118.477680:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10984 00000100:00100000:0.0:1734016118.477687:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333746560:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016118.477706:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016118.477722:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27115b2d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c7e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016118.477775:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335306496:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016118.477865:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016118.482779:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335306496:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016118.482854:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27115b2d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c7e expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.482869:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27115b2d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c7e expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.482897:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581b00, rc 0) 00000100:00100000:0.0:1734016118.482968:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333746560:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5279us (5407us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016118.482978:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10984 00000100:00100000:1.0:1734016118.487392:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.487479:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333746688 00000100:00100000:0.0:1734016118.487493:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333746688 00000100:00100000:0.0:1734016118.487559:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10985 00000100:00100000:0.0:1734016118.487568:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333746688:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016118.487592:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016118.487618:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27115b34 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c85 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.487652:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115b11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6733824->6799359) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c69 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.487664:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016118.487666:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016118.487669:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27115b34 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [176128->221183] (req 176128->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c85 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.487698:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115b11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6733824->6799359) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c69 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.487710:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115b11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6733824->6799359) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c69 expref: 7 pid: 7684 timeout: 485 lvb_type: 0 00000100:00100000:0.0:1734016118.487722:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335306624:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016118.489264:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016118.494154:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335306624:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016118.494183:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27115b34 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [176128->221183] (req 176128->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c85 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.494199:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581680, rc 0) 00000100:00100000:0.0:1734016118.494256:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333746688:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6689us (6880us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016118.494264:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10985 00000100:00100000:3.0:1734016118.522255:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016118.523796:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333746816 00000100:00100000:1.0:1734016118.523836:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333746816 00010000:00010000:1.0:1734016118.523881:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115b11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6733824->6799359) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c69 expref: 8 pid: 7684 timeout: 485 lvb_type: 0 00000100:00100000:1.0:1734016118.523939:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3046 00000100:00100000:1.0:1734016118.523945:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075887100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333746816:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016118.523960:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016118.523979:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115b11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6733824->6799359) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c69 expref: 8 pid: 7684 timeout: 485 lvb_type: 0 00010000:00010000:1.0:1734016118.523990:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115b11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6733824->6799359) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c69 expref: 8 pid: 7684 timeout: 485 lvb_type: 0 00010000:00010000:1.0:1734016118.524013:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115b11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6733824->6799359) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c69 expref: 8 pid: 7684 timeout: 485 lvb_type: 0 00010000:00010000:1.0:1734016118.524044:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016118.524046:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016118.524053:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27115b34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 176128->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c85 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016118.524061:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27115b34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 176128->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c85 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016118.524095:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27115b34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 176128->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c85 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016118.524108:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758afb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335306752:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016118.524174:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f780 going to sleep for 11 seconds 00010000:00010000:3.0:1734016118.536387:0:6468:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1734016118.537070:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758afb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335306752:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016118.537092:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016118.537147:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075887100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333746816:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 13200us (14906us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016118.537161:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3046 00000100:00100000:3.0:1734016118.542722:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.542841:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333746944 00000100:00100000:0.0:1734016118.542850:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333746944 00000100:00100000:0.0:1734016118.542899:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10986 00000100:00100000:0.0:1734016118.542906:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333746944:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016118.543168:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8086679 -> 8086679 00002000:00010000:0.0:1734016118.543172:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016118 -> 1734016118 00002000:00010000:0.0:1734016118.543174:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016118 -> 1734016118 00002000:00010000:0.0:1734016118.543176:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016118 -> 1734016118 00002000:00010000:0.0:1734016118.543178:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 800 -> 800 00000100:00100000:0.0:1734016118.543293:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333746944:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 386us (580us total) trans 4294969437 rc 0/0 00000100:00100000:0.0:1734016118.543302:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10986 00000100:00100000:3.0:1734016118.554328:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.554402:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333747072 00000100:00100000:0.0:1734016118.554413:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333747072 00000100:00100000:0.0:1734016118.554467:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10987 00000100:00100000:0.0:1734016118.554475:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333747072:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016118.554493:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016118.554511:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27115b3b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c8c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016118.554556:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335306880:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016118.554616:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00002000:00010000:0.0:1734016118.558051:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016118 -> 1734016119 00000100:00100000:0.0:1734016118.558086:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335306880:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016118.558126:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27115b3b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c8c expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.558140:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27115b3b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c8c expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.558167:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:0.0:1734016118.558227:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333747072:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3752us (3909us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016118.558237:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10987 00000100:00100000:3.0:1734016118.563285:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.563594:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333747200 00000100:00100000:0.0:1734016118.563603:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333747200 00000100:00100000:0.0:1734016118.563647:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10988 00000100:00100000:0.0:1734016118.563654:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333747200:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016118.563670:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016118.563685:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115b42 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c93 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016118.563734:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335307008:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016118.563796:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016118.565992:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335307008:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016118.566031:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115b42 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c93 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.566047:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115b42 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c93 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.566749:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75818c0, rc 0) 00000100:00100000:0.0:1734016118.566845:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333747200:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3189us (3571us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016118.566856:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10988 00000100:00100000:1.0:1734016118.583660:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.583942:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333747328 00000100:00100000:0.0:1734016118.583952:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333747328 00000100:00100000:0.0:1734016118.584013:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10989 00000100:00100000:0.0:1734016118.584021:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333747328:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016118.584042:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016118.584063:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27115b49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5c9a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016118.584128:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335307136:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016118.584195:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016118.603306:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335307136:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016118.603352:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27115b49 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c9a expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.603366:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27115b49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c9a expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.603396:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:0.0:1734016118.603451:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333747328:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 19430us (19798us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016118.603463:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10989 00000100:00100000:0.0:1734016118.606371:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.606446:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333747456 00000100:00100000:2.0:1734016118.606458:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333747456 00000100:00100000:2.0:1734016118.606515:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10990 00000100:00100000:2.0:1734016118.606522:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333747456:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016118.606541:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016118.606559:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115b50 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ca1 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016118.606613:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075650380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335307264:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016118.606675:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016118.611545:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075650380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335307264:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016118.611585:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115b50 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ca1 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016118.611599:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115b50 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ca1 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016118.611625:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016118.611681:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333747456:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5158us (5323us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016118.611689:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10990 00000100:00100000:0.0:1734016118.616626:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.616712:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333747584 00000100:00100000:2.0:1734016118.616722:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333747584 00000100:00100000:2.0:1734016118.616766:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10991 00000100:00100000:2.0:1734016118.616772:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333747584:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016118.617013:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8086679 -> 8086679 00002000:00010000:2.0:1734016118.617016:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016118 -> 1734016118 00002000:00010000:2.0:1734016118.617019:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016118 -> 1734016118 00002000:00010000:2.0:1734016118.617021:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016119 -> 1734016118 00002000:00010000:2.0:1734016118.617022:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 800 -> 936 00000100:00100000:2.0:1734016118.618543:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333747584:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1763us (1917us total) trans 4294969438 rc 0/0 00000100:00100000:2.0:1734016118.618553:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10991 00000100:00100000:0.0:1734016118.623215:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.623344:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333747712 00000100:00100000:2.0:1734016118.623355:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333747712 00000100:00100000:2.0:1734016118.623408:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10992 00000100:00100000:2.0:1734016118.623416:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333747712:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016118.623436:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016118.623457:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115b57 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ca8 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016118.623514:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075650380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335307392:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016118.623833:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ecc0 going to sleep for 11 seconds 00002000:00010000:2.0:1734016118.625477:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016118 -> 1734016119 00000100:00100000:2.0:1734016118.625499:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075650380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335307392:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016118.625526:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115b57 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ca8 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016118.625538:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115b57 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ca8 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016118.625561:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016118.626341:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333747712:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2922us (3135us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016118.626350:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10992 00000100:00100000:0.0:1734016118.628500:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.628622:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333747840 00000100:00100000:2.0:1734016118.628634:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333747840 00000100:00100000:2.0:1734016118.628676:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10993 00000100:00100000:2.0:1734016118.628683:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333747840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016118.628702:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016118.628719:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115b5e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5caf expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016118.628787:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075650380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335307520:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016118.628889:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016118.640499:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075650380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335307520:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016118.640533:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115b5e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5caf expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016118.640550:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115b5e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5caf expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016118.640636:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016118.641937:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333747840:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 13248us (13436us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016118.641947:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10993 00000100:00100000:1.0:1734016118.649187:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.649300:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333748096 00000100:00100000:0.0:1734016118.649316:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333748096 00000100:00100000:0.0:1734016118.649409:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8663 00000100:00100000:0.0:1734016118.649421:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333748096:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:0.0:1734016118.649481:0:7687:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115b65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.649505:0:7687:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27115b34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 176128->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c85 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.649514:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016118.649516:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016118.649519:0:7687:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115b65 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [10022912->10043391] (req 10022912->10043391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.649566:0:7687:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27115b34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 176128->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c85 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.649580:0:7687:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27115b34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 176128->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c85 expref: 8 pid: 8216 timeout: 485 lvb_type: 0 00000100:00100000:0.0:1734016118.649595:0:7687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335307648:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016118.649693:0:7687:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016118.662476:0:7687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335307648:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016118.662515:0:7687:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115b65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [10022912->10043391] (req 10022912->10043391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016118.662898:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.662974:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333748224 00000100:00100000:2.0:1734016118.662982:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333748224 00010000:00010000:2.0:1734016118.663016:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27115b34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 176128->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c85 expref: 9 pid: 8216 timeout: 485 lvb_type: 0 00000100:00100000:2.0:1734016118.663049:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3047 00000100:00100000:2.0:1734016118.663056:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333748224:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016118.663071:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016118.663098:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27115b34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 176128->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c85 expref: 9 pid: 8216 timeout: 485 lvb_type: 0 00010000:00010000:2.0:1734016118.663113:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27115b34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 176128->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c85 expref: 9 pid: 8216 timeout: 485 lvb_type: 0 00010000:00010000:2.0:1734016118.663135:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581680/0x5e3a3adc27115b34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 176128->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c85 expref: 9 pid: 8216 timeout: 485 lvb_type: 0 00010000:00010000:2.0:1734016118.663171:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016118.663173:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016118.663177:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115b65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [10022912->10043391] (req 10022912->10043391) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.663186:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115b65 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [10022912->10043391] (req 10022912->10043391) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.663206:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016118.663243:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333748224:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 187us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016118.663250:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3047 00010000:00010000:2.0:1734016118.663290:0:7687:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115b65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10022912->10043391] (req 10022912->10043391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.663296:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115b65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10022912->10043391] (req 10022912->10043391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1734016118.669634:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969439 is committed 00000001:00080000:1.0:1734016118.669655:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969436 is committed 00002000:00010000:2.0:1734016118.669791:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8086679 -> 10043392 00002000:00010000:2.0:1734016118.669796:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016118 -> 1734016119 00002000:00010000:2.0:1734016118.669866:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 936 -> 976 00010000:00010000:2.0:1734016118.669880:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115b65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10022912->10043391] (req 10022912->10043391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.669890:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115b65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10022912->10043391] (req 10022912->10043391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.669897:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115b65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10022912->10043391] (req 10022912->10043391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.669904:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a75818c0 already unused, calling callback (ffffffffa080e100) 00010000:00010000:2.0:1734016118.669918:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115b65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10022912->10043391] (req 10022912->10043391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.669926:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115b65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10022912->10043391] (req 10022912->10043391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.669942:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115b65 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10022912->10043391] (req 10022912->10043391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.669948:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27115b65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [10022912->10043391] (req 10022912->10043391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016118.670055:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333748096:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 20627us (20875us total) trans 4294969439 rc 0/0 00000100:00100000:2.0:1734016118.670068:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8663 00000100:00100000:0.0:1734016118.674303:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.674446:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333748352 00000100:00100000:2.0:1734016118.674455:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333748352 00000100:00100000:2.0:1734016118.674498:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10994 00000100:00100000:2.0:1734016118.674503:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333748352:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016118.674522:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016118.674538:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115b6c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5cb6 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1734016118.674557:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 10043392, mtime: 0x675afc77, atime: 0x675afc76, ctime: 0x675afc77, blocks: 0x3d0 00010000:00010000:2.0:1734016118.674576:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016118.674577:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016118.674585:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115b6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cb6 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016118.674600:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115b6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cb6 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016118.674609:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016118.675061:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333748352:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 554us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016118.675070:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10994 00000100:00100000:0.0:1734016118.678007:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016118.678137:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333748480 00000100:00100000:3.0:1734016118.678150:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333748480 00000100:00100000:3.0:1734016118.678219:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10995 00000100:00100000:3.0:1734016118.678228:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333748480:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016118.678254:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016118.678276:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115b73 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5cbd expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016118.678301:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016118.678304:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016118.678312:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115b73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cbd expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016118.678335:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115b73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cbd expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016118.678347:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016118.678404:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333748480:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 175us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016118.678411:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10995 00000100:00100000:0.0:1734016118.683988:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.685692:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333748736 00000100:00100000:2.0:1734016118.685701:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333748736 00002000:00100000:2.0:1734016118.685747:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5709824->5713919) req@ffff8801369f3b80 x1818247333748736/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.685758:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f3b80 with x1818247333748736 ext(5709824->5713919) 00002000:00010000:2.0:1734016118.685763:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f3b80 00000100:00100000:2.0:1734016118.685789:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8664 00000100:00100000:2.0:1734016118.685796:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333748736:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016118.686362:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333748736:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 564us (2382us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016118.686370:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8664 00002000:00100000:2.0:1734016118.686376:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5709824->5713919) req@ffff8801369f3b80 x1818247333748736/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.686383:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f3b80 with x1818247333748736 ext(5709824->5713919) 00002000:00010000:2.0:1734016118.686385:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f3b80 00000100:00100000:0.0:1734016118.690480:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.690935:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333748992 00000100:00100000:2.0:1734016118.690948:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333748992 00002000:00100000:2.0:1734016118.690989:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5705728->5709823) req@ffff8801369f1180 x1818247333748992/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.690999:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1180 with x1818247333748992 ext(5705728->5709823) 00002000:00010000:2.0:1734016118.691005:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f1180 00000100:00100000:2.0:1734016118.691028:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8665 00000100:00100000:2.0:1734016118.691035:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333748992:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016118.691221:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333748992:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 185us (762us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016118.691229:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8665 00002000:00100000:2.0:1734016118.691235:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5705728->5709823) req@ffff8801369f1180 x1818247333748992/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.691242:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1180 with x1818247333748992 ext(5705728->5709823) 00002000:00010000:2.0:1734016118.691245:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f1180 00000100:00100000:1.0:1734016118.694777:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.694894:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333749248 00000100:00100000:0.0:1734016118.694902:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333749248 00002000:00100000:0.0:1734016118.694953:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (5701632->5705727) req@ffff8800758ad880 x1818247333749248/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016118.694962:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758ad880 with x1818247333749248 ext(5701632->5705727) 00002000:00010000:0.0:1734016118.694968:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758ad880 00000100:00100000:0.0:1734016118.695002:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8666 00000100:00100000:0.0:1734016118.695008:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333749248:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016118.695173:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333749248:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 163us (405us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016118.695180:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8666 00002000:00100000:0.0:1734016118.695185:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (5701632->5705727) req@ffff8800758ad880 x1818247333749248/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016118.695192:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758ad880 with x1818247333749248 ext(5701632->5705727) 00002000:00010000:0.0:1734016118.695194:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758ad880 00000100:00100000:1.0:1734016118.698727:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.698984:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333749504 00000100:00100000:2.0:1734016118.698998:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333749504 00002000:00100000:2.0:1734016118.699063:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5697536->5701631) req@ffff8800758afb80 x1818247333749504/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.699080:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758afb80 with x1818247333749504 ext(5697536->5701631) 00002000:00010000:2.0:1734016118.699087:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758afb80 00000100:00100000:2.0:1734016118.699131:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8667 00000100:00100000:2.0:1734016118.699137:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333749504:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016118.699326:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333749504:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 187us (609us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016118.699332:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8667 00002000:00100000:2.0:1734016118.699338:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5697536->5701631) req@ffff8800758afb80 x1818247333749504/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.699343:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758afb80 with x1818247333749504 ext(5697536->5701631) 00002000:00010000:2.0:1734016118.699345:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758afb80 00000100:00100000:1.0:1734016118.702341:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.702410:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333749760 00000100:00100000:0.0:1734016118.702419:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333749760 00002000:00100000:0.0:1734016118.702458:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (5693440->5697535) req@ffff8800758ace00 x1818247333749760/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016118.702468:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758ace00 with x1818247333749760 ext(5693440->5697535) 00002000:00010000:0.0:1734016118.702472:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758ace00 00000100:00100000:0.0:1734016118.702505:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8668 00000100:00100000:0.0:1734016118.702512:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333749760:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016118.702656:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333749760:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 142us (323us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016118.702663:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8668 00002000:00100000:0.0:1734016118.702668:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (5693440->5697535) req@ffff8800758ace00 x1818247333749760/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016118.702675:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758ace00 with x1818247333749760 ext(5693440->5697535) 00002000:00010000:0.0:1734016118.702677:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758ace00 00000100:00100000:1.0:1734016118.705771:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.706007:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333750016 00000100:00100000:2.0:1734016118.706019:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333750016 00002000:00100000:2.0:1734016118.706078:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5689344->5693439) req@ffff8800758af480 x1818247333750016/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.706091:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758af480 with x1818247333750016 ext(5689344->5693439) 00002000:00010000:2.0:1734016118.706098:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758af480 00000100:00100000:2.0:1734016118.706132:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8669 00000100:00100000:2.0:1734016118.706139:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333750016:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016118.706366:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333750016:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 225us (603us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016118.706374:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8669 00002000:00100000:2.0:1734016118.706381:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5689344->5693439) req@ffff8800758af480 x1818247333750016/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:79/0 lens 488/4536 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.706390:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758af480 with x1818247333750016 ext(5689344->5693439) 00002000:00010000:2.0:1734016118.706393:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758af480 00000100:00100000:1.0:1734016118.711515:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.711615:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333750272 00000100:00100000:0.0:1734016118.711629:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333750272 00000100:00100000:0.0:1734016118.711711:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8670 00000100:00100000:0.0:1734016118.711719:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333750272:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:0.0:1734016118.711763:0:13914:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115b7a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.711776:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016118.711779:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016118.711784:0:13914:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115b7a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1204224->1245183] (req 1204224->1245183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.711843:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115b7a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1204224->1245183] (req 1204224->1245183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.714999:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115b7a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1204224->1245183] (req 1204224->1245183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.715019:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115b7a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1204224->1245183] (req 1204224->1245183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.715029:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115b7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1204224->1245183] (req 1204224->1245183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.715036:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581200 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016118.715039:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115b7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1204224->1245183] (req 1204224->1245183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.715047:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115b7a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1204224->1245183] (req 1204224->1245183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.715067:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115b7a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1204224->1245183] (req 1204224->1245183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.715072:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27115b7a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1204224->1245183] (req 1204224->1245183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016118.715186:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333750272:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 3459us (3676us total) trans 0 rc 40960/40960 00000100:00100000:0.0:1734016118.715205:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8670 00000100:00100000:1.0:1734016118.719019:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.719583:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333750400 00000100:00100000:2.0:1734016118.719597:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333750400 00000100:00100000:2.0:1734016118.719666:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10996 00000100:00100000:2.0:1734016118.719675:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333750400:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016118.719698:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016118.719724:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115b81 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5cc4 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.719756:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115b6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cb6 expref: 5 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016118.719765:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115b73 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cbd expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016118.719773:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016118.719775:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016118.719780:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115b81 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2715648->2756607] (req 2715648->2756607) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cc4 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.719865:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115b73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cbd expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016118.719881:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115b73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cbd expref: 8 pid: 8216 timeout: 485 lvb_type: 1 00000100:00100000:2.0:1734016118.719902:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075650380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335307776:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016118.720015:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115b6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cb6 expref: 5 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016118.720024:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115b6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cb6 expref: 5 pid: 7684 timeout: 485 lvb_type: 1 00000100:00100000:2.0:1734016118.720033:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075651880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335307904:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016118.720052:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016118.725259:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.725368:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075650380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335307776:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016118.725378:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075651880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335307904:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016118.725406:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115b81 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2715648->2756607] (req 2715648->2756607) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cc4 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.725423:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016118.725489:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333750400:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5814us (6483us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016118.725497:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10996 00000100:00100000:0.0:1734016118.725756:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016118.725896:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333750528 00000100:00100000:3.0:1734016118.725903:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333750528 00010000:00010000:3.0:1734016118.725935:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115b6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cb6 expref: 6 pid: 7684 timeout: 485 lvb_type: 1 00000100:00100000:3.0:1734016118.725954:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333750656 00000100:00100000:3.0:1734016118.725956:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333750656 00010000:00010000:3.0:1734016118.725965:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115b73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cbd expref: 8 pid: 8216 timeout: 485 lvb_type: 1 00000100:00100000:3.0:1734016118.725977:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3048 00000100:00100000:3.0:1734016118.725982:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333750528:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016118.725994:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016118.726013:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115b6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cb6 expref: 6 pid: 7684 timeout: 485 lvb_type: 1 00010000:00010000:3.0:1734016118.726021:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115b6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cb6 expref: 6 pid: 7684 timeout: 485 lvb_type: 1 00010000:00010000:3.0:1734016118.726045:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115b6c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cb6 expref: 6 pid: 7684 timeout: 485 lvb_type: 1 00010000:00010000:3.0:1734016118.726058:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016118.726077:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333750528:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 94us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016118.726083:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3048 00000100:00100000:3.0:1734016118.726094:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3049 00000100:00100000:3.0:1734016118.726098:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333750656:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016118.726104:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016118.726111:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115b73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cbd expref: 8 pid: 8216 timeout: 485 lvb_type: 1 00010000:00010000:3.0:1734016118.726119:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115b73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cbd expref: 8 pid: 8216 timeout: 485 lvb_type: 1 00010000:00010000:3.0:1734016118.726129:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115b73 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cbd expref: 8 pid: 8216 timeout: 485 lvb_type: 1 00010000:00010000:3.0:1734016118.726138:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016118.726139:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016118.726145:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115b81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->2756607) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cc4 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016118.726152:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115b81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->2756607) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cc4 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016118.726178:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115b81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->2756607) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cc4 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016118.726190:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335308032:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016118.726217:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016118.731348:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013040a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335308032:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016118.731375:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016118.731438:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333750656:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5337us (5680us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016118.731449:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3049 00000100:00100000:1.0:1734016118.731854:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016118.732382:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333750784 00000100:00100000:3.0:1734016118.732390:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333750784 00000100:00100000:3.0:1734016118.732739:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10997 00000100:00100000:3.0:1734016118.732746:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333750784:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016118.732959:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10043392 -> 10043392 00002000:00010000:3.0:1734016118.732963:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016119 -> 1734016119 00002000:00010000:3.0:1734016118.732965:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016118 -> 1734016118 00002000:00010000:3.0:1734016118.732966:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016119 -> 1734016118 00002000:00010000:3.0:1734016118.732968:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 976 -> 1056 00000100:00100000:3.0:1734016118.733012:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333750784:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 266us (1159us total) trans 4294969440 rc 0/0 00000100:00100000:3.0:1734016118.733018:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10997 00000100:00100000:1.0:1734016118.736941:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.737025:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333750912 00000100:00100000:0.0:1734016118.737039:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333750912 00000100:00100000:0.0:1734016118.737115:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10998 00000100:00100000:0.0:1734016118.737124:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333750912:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016118.737151:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016118.737172:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27115b88 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ccb expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016118.737253:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335308160:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016118.737339:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00002000:00010000:0.0:1734016118.739480:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016118 -> 1734016119 00002000:00010000:0.0:1734016118.739487:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016118 -> 1734016119 00000100:00100000:0.0:1734016118.739508:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335308160:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016118.739540:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27115b88 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ccb expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.739554:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27115b88 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ccb expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.739577:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582f40, rc 0) 00000100:00100000:0.0:1734016118.739620:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333750912:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2498us (2691us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016118.739629:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10998 00000100:00100000:2.0:1734016118.746660:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.746745:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333751168 00000100:00100000:0.0:1734016118.746757:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333751168 00000100:00100000:0.0:1734016118.746861:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8671 00000100:00100000:0.0:1734016118.746870:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333751168:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:0.0:1734016118.746934:0:13914:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115b8f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.746958:0:13914:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115b81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->2756607) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cc4 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.746967:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016118.746969:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016118.746972:0:13914:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115b8f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [593920->630783] (req 593920->630783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.747015:0:13914:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115b81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->2756607) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cc4 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.747029:0:13914:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115b81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->2756607) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cc4 expref: 7 pid: 7684 timeout: 485 lvb_type: 0 00000100:00100000:0.0:1734016118.747047:0:13914:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335308288:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016118.747138:0:13914:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016118.751784:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.753060:0:13914:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335308288:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016118.753093:0:13914:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115b8f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [593920->630783] (req 593920->630783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016118.753202:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333751296 00000100:00100000:3.0:1734016118.753209:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333751296 00010000:00010000:3.0:1734016118.753241:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115b81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->2756607) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cc4 expref: 8 pid: 7684 timeout: 485 lvb_type: 0 00000100:00100000:3.0:1734016118.753271:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3050 00000100:00100000:3.0:1734016118.753277:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b42c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333751296:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016118.753293:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016118.753318:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115b81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2715648->2756607) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cc4 expref: 8 pid: 7684 timeout: 485 lvb_type: 0 00010000:00010000:3.0:1734016118.753330:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115b81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2715648->2756607) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cc4 expref: 8 pid: 7684 timeout: 485 lvb_type: 0 00010000:00010000:3.0:1734016118.753352:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115b81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2715648->2756607) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cc4 expref: 8 pid: 7684 timeout: 485 lvb_type: 0 00010000:00010000:3.0:1734016118.753383:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016118.753385:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016118.753389:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115b8f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [593920->630783] (req 593920->630783) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016118.753398:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115b8f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [593920->630783] (req 593920->630783) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016118.753418:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016118.753536:0:13914:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115b8f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [593920->630783] (req 593920->630783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.753544:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115b8f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [593920->630783] (req 593920->630783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016118.754576:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b42c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333751296:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1295us (2797us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016118.754586:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3050 00010000:00010000:2.0:1734016118.762373:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115b8f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [593920->630783] (req 593920->630783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.762394:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115b8f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [593920->630783] (req 593920->630783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.762404:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115b8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [593920->630783] (req 593920->630783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.762411:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581440 already unused, calling callback (ffffffffa080e100) 00010000:00010000:2.0:1734016118.762415:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115b8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [593920->630783] (req 593920->630783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.762424:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115b8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [593920->630783] (req 593920->630783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.762444:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115b8f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [593920->630783] (req 593920->630783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016118.762451:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27115b8f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [593920->630783] (req 593920->630783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016118.762547:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333751168:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 15673us (15893us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1734016118.762557:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8671 00000100:00100000:1.0:1734016118.768044:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.768457:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333751424 00000100:00100000:0.0:1734016118.768465:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333751424 00000100:00100000:0.0:1734016118.768521:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 10999 00000100:00100000:0.0:1734016118.768528:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333751424:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016118.768544:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016118.768685:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27115b96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5cd2 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016118.768709:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 10043392, mtime: 0x675afc77, atime: 0x675afc76, ctime: 0x675afc76, blocks: 0x420 00010000:00010000:0.0:1734016118.768729:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016118.768731:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016118.768739:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27115b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cd2 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.768753:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27115b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cd2 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.768762:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00000100:00100000:0.0:1734016118.768839:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333751424:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 311us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016118.768845:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 10999 00000100:00100000:3.0:1734016118.773588:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.773653:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333751552 00000100:00100000:0.0:1734016118.773662:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333751552 00000100:00100000:0.0:1734016118.773704:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11000 00000100:00100000:0.0:1734016118.773711:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333751552:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016118.773727:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016118.773743:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27115b9d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5cd9 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.773764:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016118.773767:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016118.773774:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27115b9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cd9 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.773788:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27115b9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cd9 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016118.773797:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582d00, rc 0) 00000100:00100000:0.0:1734016118.773879:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333751552:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 166us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016118.773887:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11000 00000100:00100000:1.0:1734016118.779977:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016118.780759:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333751680 00000100:00100000:3.0:1734016118.780767:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333751680 00000100:00100000:3.0:1734016118.780841:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11001 00000100:00100000:3.0:1734016118.780848:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333751680:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016118.780872:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016118.780898:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115ba4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ce0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016118.780938:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27115b96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cd2 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016118.780946:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27115b9d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cd9 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016118.780952:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016118.780954:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016118.780957:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115ba4 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7651328->7663615] (req 7651328->7663615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ce0 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016118.780991:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27115b9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cd9 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016118.781003:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27115b9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cd9 expref: 7 pid: 8216 timeout: 485 lvb_type: 1 00000100:00100000:3.0:1734016118.781016:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335308416:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016118.782048:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27115b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cd2 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016118.782061:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27115b96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cd2 expref: 7 pid: 8216 timeout: 485 lvb_type: 1 00000100:00100000:3.0:1734016118.782072:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335308544:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016118.782103:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92180 going to sleep for 11 seconds 00000100:00100000:3.0:1734016118.786731:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130408e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335308416:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016118.786751:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335308544:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016118.786796:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115ba4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [7651328->7663615] (req 7651328->7663615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ce0 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016118.788215:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016118.788320:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333751680:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7467us (8352us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016118.788330:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11001 00000100:00100000:2.0:1734016118.790174:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016118.790224:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.790591:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333751808 00000100:00100000:0.0:1734016118.790604:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333751808 00010000:00010000:0.0:1734016118.790656:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27115b9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cd9 expref: 7 pid: 8216 timeout: 485 lvb_type: 1 00000100:00100000:0.0:1734016118.790702:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333751936 00000100:00100000:0.0:1734016118.790705:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333751936 00010000:00010000:0.0:1734016118.790717:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27115b96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cd2 expref: 8 pid: 8216 timeout: 485 lvb_type: 1 00000100:00100000:0.0:1734016118.790741:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3051 00000100:00100000:0.0:1734016118.790749:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075650380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333751808:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016118.790767:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016118.790790:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27115b9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cd9 expref: 7 pid: 8216 timeout: 485 lvb_type: 1 00010000:00010000:0.0:1734016118.790830:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27115b9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cd9 expref: 7 pid: 8216 timeout: 485 lvb_type: 1 00010000:00010000:0.0:1734016118.790856:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27115b9d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cd9 expref: 7 pid: 8216 timeout: 485 lvb_type: 1 00010000:00010000:0.0:1734016118.790875:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016118.790923:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075650380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333751808:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 175us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016118.790929:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3051 00000100:00100000:0.0:1734016118.790943:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3052 00000100:00100000:0.0:1734016118.790946:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075651180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333751936:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016118.790953:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016118.790959:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27115b96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cd2 expref: 8 pid: 8216 timeout: 485 lvb_type: 1 00010000:00010000:0.0:1734016118.790966:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27115b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cd2 expref: 8 pid: 8216 timeout: 485 lvb_type: 1 00010000:00010000:0.0:1734016118.790980:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27115b96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cd2 expref: 8 pid: 8216 timeout: 485 lvb_type: 1 00010000:00010000:0.0:1734016118.790988:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016118.790989:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016118.790994:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7651328->7663615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ce0 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.791001:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115ba4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7651328->7663615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ce0 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016118.791024:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115ba4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7651328->7663615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ce0 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016118.791035:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335308672:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016118.791061:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016118.795052:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.795235:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335308672:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016118.795255:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016118.795878:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333752064 00000100:00100000:3.0:1734016118.795885:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333752064 00000100:00100000:3.0:1734016118.795927:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11002 00000100:00100000:3.0:1734016118.795933:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333752064:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016118.796125:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10043392 -> 10043392 00002000:00010000:3.0:1734016118.796129:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016119 -> 1734016119 00002000:00010000:3.0:1734016118.796131:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016118 -> 1734016118 00002000:00010000:3.0:1734016118.796134:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016118 -> 1734016118 00002000:00010000:3.0:1734016118.796136:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1056 -> 1080 00000100:00100000:0.0:1734016118.796185:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075651180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333751936:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5236us (5959us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016118.796194:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3052 00000100:00100000:3.0:1734016118.797367:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333752064:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1426us (2315us total) trans 4294969441 rc 0/0 00000100:00100000:3.0:1734016118.797376:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11002 00000100:00100000:1.0:1734016118.802536:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016118.802674:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333752192 00000100:00100000:3.0:1734016118.802683:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333752192 00000100:00100000:3.0:1734016118.802773:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11003 00000100:00100000:3.0:1734016118.802780:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333752192:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016118.802828:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016118.802849:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115bab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ce7 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016118.802921:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335308800:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016118.803679:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92180 going to sleep for 11 seconds 00002000:00010000:3.0:1734016118.805848:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016118 -> 1734016119 00002000:00010000:3.0:1734016118.805855:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016118 -> 1734016119 00000100:00100000:3.0:1734016118.805879:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335308800:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016118.805926:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115bab lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ce7 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016118.805938:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115bab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ce7 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016118.805953:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4b40, rc 0) 00000100:00100000:3.0:1734016118.806012:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333752192:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3231us (3489us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016118.806020:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11003 00000100:00100000:2.0:1734016118.812373:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016118.812468:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333752320 00000100:00100000:3.0:1734016118.812481:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333752320 00000100:00100000:3.0:1734016118.812564:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11004 00000100:00100000:3.0:1734016118.812572:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333752320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016118.812593:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016118.812611:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115bb2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5cee expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016118.812675:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335308928:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016118.812999:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92180 going to sleep for 11 seconds 00000100:00100000:3.0:1734016118.816242:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335308928:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016118.816289:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115bb2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cee expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016118.816304:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115bb2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cee expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016118.816354:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016118.816977:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333752320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4402us (4614us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016118.816987:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11004 00000100:00100000:1.0:1734016118.840565:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016118.840603:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016118.840643:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016118.847628:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333752576 00000100:00100000:3.0:1734016118.847640:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333752576 00002000:00100000:3.0:1734016118.847691:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff88008719d880 x1818247333752576/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016118.847700:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719d880 with x1818247333752576 ext(0->4194303) 00002000:00010000:3.0:1734016118.847706:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719d880 00000100:00100000:3.0:1734016118.847736:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8672 00000100:00100000:3.0:1734016118.847744:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333752576:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016118.847863:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333752832 00000100:00100000:1.0:1734016118.847867:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333752832 00002000:00100000:1.0:1734016118.847882:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (8388608->10043391) req@ffff88008719df80 x1818247333752832/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016118.847889:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719df80 with x1818247333752832 ext(8388608->10043391) 00002000:00010000:1.0:1734016118.847891:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719df80 00000100:00100000:1.0:1734016118.847916:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333752704 00000100:00100000:1.0:1734016118.847918:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333752704 00002000:00100000:1.0:1734016118.847928:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (4194304->8388607) req@ffff88008719fb80 x1818247333752704/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016118.847933:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719fb80 with x1818247333752704 ext(4194304->8388607) 00002000:00010000:1.0:1734016118.847935:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719fb80 00000100:00100000:1.0:1734016118.847942:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8673 00000100:00100000:1.0:1734016118.847946:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333752832:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016118.848350:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8674 00000100:00100000:2.0:1734016118.848356:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333752704:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016118.893429:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333752832:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 45463us (52806us total) trans 0 rc 1654784/1654784 00000100:00100000:2.0:1734016118.893449:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8673 00002000:00100000:2.0:1734016118.893470:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (8388608->10043391) req@ffff88008719df80 x1818247333752832/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:79/0 lens 488/440 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 1654784/1654784 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016118.893482:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719df80 with x1818247333752832 ext(8388608->10043391) 00002000:00010000:2.0:1734016118.893490:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719df80 00000100:00100000:3.0:1734016118.927748:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333752576:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 79983us (87170us total) trans 0 rc 4194304/4194304 00000100:00100000:3.0:1734016118.927764:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8672 00002000:00100000:3.0:1734016118.927786:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff88008719d880 x1818247333752576/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:79/0 lens 488/440 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016118.927797:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719d880 with x1818247333752576 ext(0->4194303) 00002000:00010000:3.0:1734016118.927830:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719d880 00000100:00100000:2.0:1734016118.952755:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.953886:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333752704:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 105524us (113237us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1734016118.953897:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8674 00002000:00100000:0.0:1734016118.953918:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (4194304->8388607) req@ffff88008719fb80 x1818247333752704/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:79/0 lens 488/440 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016118.953927:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719fb80 with x1818247333752704 ext(4194304->8388607) 00002000:00010000:0.0:1734016118.953932:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719fb80 00000100:00100000:0.0:1734016118.953955:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333753088 00000100:00100000:0.0:1734016118.953961:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333753088 00002000:00100000:0.0:1734016118.954233:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1302528->1339391) req@ffff880075652300 x1818247333753088/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:79/0 lens 488/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016118.954240:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075652300 with x1818247333753088 ext(1302528->1339391) 00002000:00010000:0.0:1734016118.954243:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075652300 00000100:00100000:0.0:1734016118.954762:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8675 00000100:00100000:0.0:1734016118.954770:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333753088:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016118.963391:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333753088:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 8602us (10636us total) trans 4294969442 rc 0/0 00000100:00100000:0.0:1734016118.963410:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8675 00002000:00100000:0.0:1734016118.963435:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1302528->1339391) req@ffff880075652300 x1818247333753088/t4294969442(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:79/0 lens 488/448 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016118.963446:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075652300 with x1818247333753088 ext(1302528->1339391) 00002000:00010000:0.0:1734016118.963457:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075652300 00000100:00100000:1.0:1734016118.966857:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016118.967018:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333753216 00000100:00100000:3.0:1734016118.967036:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333753216 00000100:00100000:3.0:1734016118.967170:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11005 00000100:00100000:3.0:1734016118.967181:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333753216:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:1.0:1734016118.970893:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969442 is committed 00000001:00080000:1.0:1734016118.970929:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969440 is committed 00000100:00100000:3.0:1734016118.971237:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333753216:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 4045us (4439us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016118.971252:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11005 00000100:00100000:1.0:1734016118.974999:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016118.975106:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333753344 00000100:00100000:3.0:1734016118.975124:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333753344 00000100:00100000:3.0:1734016118.975689:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11006 00000100:00100000:3.0:1734016118.975699:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333753344:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016118.975722:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016118.975748:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115bb9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5cf5 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016118.975861:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335309056:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016118.976747:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92180 going to sleep for 11 seconds 00002000:00010000:3.0:1734016118.979927:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 1080 -> 1144 00000100:00100000:3.0:1734016118.979973:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335309056:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016118.980032:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115bb9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cf5 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016118.980049:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115bb9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cf5 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016118.980637:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016118.980724:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333753344:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5022us (5750us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016118.980736:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11006 00000100:00100000:1.0:1734016118.983471:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016118.983625:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333753472 00000100:00100000:3.0:1734016118.983635:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333753472 00000100:00100000:3.0:1734016118.983689:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11007 00000100:00100000:3.0:1734016118.983696:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333753472:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016118.983718:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016118.983741:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115bc0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5cfc expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016118.983842:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335309184:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016118.983922:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92180 going to sleep for 11 seconds 00000100:00100000:3.0:1734016118.986661:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335309184:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016118.986710:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115bc0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cfc expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016118.986725:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115bc0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5cfc expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016118.986741:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4480, rc 0) 00000100:00100000:3.0:1734016118.987029:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333753472:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3329us (3568us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016118.987040:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11007 00000100:00100000:2.0:1734016118.992462:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016118.992593:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333753600 00000100:00100000:0.0:1734016118.992604:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333753600 00002000:00100000:0.0:1734016118.992661:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (5382144->5386239) req@ffff880075651f80 x1818247333753600/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:79/0 lens 4584/0 e 0 to 0 dl 1734016129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016118.992671:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075651f80 with x1818247333753600 ext(5382144->5386239) 00002000:00010000:0.0:1734016118.992676:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075651f80 00000100:00100000:0.0:1734016118.993059:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8676 00000100:00100000:0.0:1734016118.993068:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333753600:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016118.993917:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333753600:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 848us (1468us total) trans 4294969443 rc 0/0 00000100:00100000:0.0:1734016118.993925:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8676 00002000:00100000:0.0:1734016118.993932:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (5382144->5386239) req@ffff880075651f80 x1818247333753600/t4294969443(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:79/0 lens 4584/448 e 0 to 0 dl 1734016129 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016118.993941:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075651f80 with x1818247333753600 ext(5382144->5386239) 00002000:00010000:0.0:1734016118.993945:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075651f80 00000100:00100000:1.0:1734016118.996261:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016118.996711:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333753728 00000100:00100000:3.0:1734016118.996725:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333753728 00000100:00100000:3.0:1734016118.996858:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11008 00000100:00100000:3.0:1734016118.996867:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333753728:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:1.0:1734016118.998412:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969443 is committed 00000100:00100000:3.0:1734016118.998894:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333753728:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2021us (2640us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016118.998913:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11008 00000100:00100000:1.0:1734016119.001493:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.001599:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333753856 00000100:00100000:3.0:1734016119.001610:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333753856 00000100:00080000:2.0:1734016119.001712:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016089 00000100:00100000:3.0:1734016119.001886:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11009 00000100:00100000:3.0:1734016119.001895:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333753856:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016119.001928:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016119.001948:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27115bc7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d03 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016119.002023:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335309312:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016119.002414:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92180 going to sleep for 11 seconds 00002000:00010000:3.0:1734016119.005565:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 1144 -> 1152 00000100:00100000:3.0:1734016119.005605:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335309312:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016119.005647:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27115bc7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d03 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.005661:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27115bc7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d03 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.005722:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df58c0, rc 0) 00000100:00100000:3.0:1734016119.005990:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333753856:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4092us (4507us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016119.006001:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11009 00000100:00100000:1.0:1734016119.010139:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.010234:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333753984 00000100:00100000:3.0:1734016119.010245:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333753984 00000100:00100000:3.0:1734016119.010289:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11010 00000100:00100000:3.0:1734016119.010298:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333753984:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016119.010318:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016119.010341:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115bce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d0a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016119.010409:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335309440:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016119.010483:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92180 going to sleep for 11 seconds 00000100:00100000:3.0:1734016119.015002:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335309440:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016119.015054:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115bce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d0a expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.015072:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115bce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d0a expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.015152:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7840, rc 0) 00000100:00100000:3.0:1734016119.015228:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333753984:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4927us (5094us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016119.015239:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11010 00000100:00100000:1.0:1734016119.022960:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.023090:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333754112 00000100:00100000:3.0:1734016119.023104:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333754112 00000100:00100000:3.0:1734016119.023169:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11011 00000100:00100000:3.0:1734016119.023178:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333754112:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016119.023515:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10043392 -> 10043392 00002000:00010000:3.0:1734016119.023518:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016119 -> 1734016119 00002000:00010000:3.0:1734016119.023520:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016119 -> 1734016118 00002000:00010000:3.0:1734016119.023522:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016119 -> 1734016119 00002000:00010000:3.0:1734016119.023524:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1152 -> 1152 00000100:00100000:3.0:1734016119.023619:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333754112:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 439us (673us total) trans 4294969444 rc 0/0 00000100:00100000:3.0:1734016119.023628:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11011 00000100:00100000:1.0:1734016119.028020:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.028131:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333754368 00000100:00100000:0.0:1734016119.028146:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333754368 00000100:00100000:0.0:1734016119.028257:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8677 00000100:00100000:0.0:1734016119.028268:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333754368:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:0.0:1734016119.028312:0:13914:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115bd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.028334:0:13914:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7651328->7663615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ce0 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.028342:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016119.028344:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016119.028347:0:13914:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115bd5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3866624->3878911] (req 3866624->3878911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.028387:0:13914:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115ba4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7651328->7663615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ce0 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.028407:0:13914:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115ba4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7651328->7663615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ce0 expref: 6 pid: 7684 timeout: 486 lvb_type: 0 00000100:00100000:0.0:1734016119.028427:0:13914:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335309568:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016119.028515:0:13914:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016119.034655:0:13914:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335309568:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016119.034687:0:13914:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115bd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3866624->3878911] (req 3866624->3878911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016119.047550:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.047638:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333754496 00000100:00100000:0.0:1734016119.047650:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333754496 00010000:00010000:0.0:1734016119.047689:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115ba4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 7651328->7663615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ce0 expref: 7 pid: 7684 timeout: 486 lvb_type: 0 00000100:00100000:0.0:1734016119.047734:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3053 00000100:00100000:0.0:1734016119.047741:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333754496:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016119.047757:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016119.047780:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115ba4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7651328->7663615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ce0 expref: 7 pid: 7684 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1734016119.047792:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115ba4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7651328->7663615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ce0 expref: 7 pid: 7684 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1734016119.047852:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115ba4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 7651328->7663615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ce0 expref: 7 pid: 7684 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1734016119.047875:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016119.047878:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016119.047882:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115bd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3866624->3878911] (req 3866624->3878911) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.047891:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115bd5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [3866624->3878911] (req 3866624->3878911) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.047926:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016119.047978:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333754496:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 236us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016119.047986:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3053 00010000:00010000:0.0:1734016119.048015:0:13914:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115bd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3866624->3878911] (req 3866624->3878911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.048023:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115bd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3866624->3878911] (req 3866624->3878911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016119.054945:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969445 is committed 00000001:00080000:0.0:1734016119.054967:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969444 is committed 00002000:00010000:2.0:1734016119.055091:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016118 -> 1734016119 00002000:00010000:2.0:1734016119.055096:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1152 -> 1176 00010000:00010000:2.0:1734016119.055111:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115bd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3866624->3878911] (req 3866624->3878911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.055124:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115bd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3866624->3878911] (req 3866624->3878911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.055132:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115bd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3866624->3878911] (req 3866624->3878911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.055139:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7580900 already unused, calling callback (ffffffffa080e100) 00010000:00010000:2.0:1734016119.055144:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115bd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3866624->3878911] (req 3866624->3878911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.055153:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115bd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3866624->3878911] (req 3866624->3878911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.055177:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115bd5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3866624->3878911] (req 3866624->3878911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.055183:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115bd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [3866624->3878911] (req 3866624->3878911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016119.056673:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333754368:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 28392us (28662us total) trans 4294969445 rc 0/0 00000100:00100000:2.0:1734016119.056689:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8677 00000100:00100000:1.0:1734016119.062916:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.063533:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333754624 00000100:00100000:3.0:1734016119.063545:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333754624 00000100:00100000:3.0:1734016119.063628:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11012 00000100:00100000:3.0:1734016119.063639:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333754624:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016119.063665:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016119.063690:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115bdc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d11 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1734016119.063717:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 10043392, mtime: 0x675afc77, atime: 0x675afc77, ctime: 0x675afc77, blocks: 0x498 00010000:00010000:3.0:1734016119.063739:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016119.063741:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016119.063748:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115bdc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d11 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.063764:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115bdc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d11 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.063776:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016119.063869:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333754624:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 230us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016119.063875:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11012 00000100:00100000:0.0:1734016119.067255:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.067452:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333754880 00000100:00100000:2.0:1734016119.067461:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333754880 00002000:00100000:2.0:1734016119.067501:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1376256->1380351) req@ffff8801369f2300 x1818247333754880/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.067512:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f2300 with x1818247333754880 ext(1376256->1380351) 00002000:00010000:2.0:1734016119.067517:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f2300 00000100:00100000:2.0:1734016119.067551:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8678 00000100:00100000:2.0:1734016119.067557:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333754880:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016119.067700:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333754880:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 141us (456us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016119.067707:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8678 00002000:00100000:2.0:1734016119.067712:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1376256->1380351) req@ffff8801369f2300 x1818247333754880/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.067719:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f2300 with x1818247333754880 ext(1376256->1380351) 00002000:00010000:2.0:1734016119.067722:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f2300 00000100:00100000:1.0:1734016119.072987:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.073105:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333755136 00000100:00100000:3.0:1734016119.073129:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333755136 00002000:00100000:3.0:1734016119.073218:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1372160->1376255) req@ffff88008719d180 x1818247333755136/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016119.073230:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719d180 with x1818247333755136 ext(1372160->1376255) 00002000:00010000:3.0:1734016119.073236:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719d180 00000100:00100000:3.0:1734016119.073350:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8679 00000100:00100000:3.0:1734016119.073362:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333755136:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016119.073770:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333755136:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 406us (800us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016119.073780:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8679 00002000:00100000:3.0:1734016119.073788:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1372160->1376255) req@ffff88008719d180 x1818247333755136/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016119.073795:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719d180 with x1818247333755136 ext(1372160->1376255) 00002000:00010000:3.0:1734016119.073798:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719d180 00000100:00100000:1.0:1734016119.077750:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.077891:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333755392 00000100:00100000:3.0:1734016119.077910:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333755392 00002000:00100000:3.0:1734016119.077968:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1368064->1372159) req@ffff88008719e680 x1818247333755392/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016119.077978:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719e680 with x1818247333755392 ext(1368064->1372159) 00002000:00010000:3.0:1734016119.077986:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719e680 00000100:00100000:3.0:1734016119.078553:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8680 00000100:00100000:3.0:1734016119.078562:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333755392:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016119.078761:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333755392:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 200us (1024us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016119.078769:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8680 00002000:00100000:3.0:1734016119.078776:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1368064->1372159) req@ffff88008719e680 x1818247333755392/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016119.078783:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719e680 with x1818247333755392 ext(1368064->1372159) 00002000:00010000:3.0:1734016119.078786:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719e680 00000100:00100000:0.0:1734016119.082850:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.091196:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333755648 00000100:00100000:2.0:1734016119.091214:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333755648 00002000:00100000:2.0:1734016119.091264:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1363968->1368063) req@ffff8801369f0700 x1818247333755648/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.091275:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f0700 with x1818247333755648 ext(1363968->1368063) 00002000:00010000:2.0:1734016119.091282:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f0700 00000100:00100000:2.0:1734016119.091330:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8681 00000100:00100000:2.0:1734016119.091337:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333755648:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016119.091553:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333755648:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 215us (8753us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016119.091561:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8681 00002000:00100000:2.0:1734016119.091566:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (1363968->1368063) req@ffff8801369f0700 x1818247333755648/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.091573:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f0700 with x1818247333755648 ext(1363968->1368063) 00002000:00010000:2.0:1734016119.091575:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f0700 00000100:00100000:0.0:1734016119.104428:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.104854:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333755904 00000100:00100000:3.0:1734016119.104863:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333755904 00002000:00100000:3.0:1734016119.104911:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1359872->1363967) req@ffff8801369f3480 x1818247333755904/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016119.104920:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f3480 with x1818247333755904 ext(1359872->1363967) 00002000:00010000:3.0:1734016119.104925:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f3480 00000100:00100000:3.0:1734016119.105000:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8682 00000100:00100000:3.0:1734016119.105008:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333755904:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016119.105161:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333755904:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 153us (745us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016119.105168:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8682 00002000:00100000:3.0:1734016119.105174:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1359872->1363967) req@ffff8801369f3480 x1818247333755904/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016119.105180:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f3480 with x1818247333755904 ext(1359872->1363967) 00002000:00010000:3.0:1734016119.105183:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f3480 00000100:00100000:0.0:1734016119.110066:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.110143:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333756032 00000100:00100000:2.0:1734016119.110154:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333756032 00000100:00100000:2.0:1734016119.110218:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11013 00000100:00100000:2.0:1734016119.110225:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333756032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016119.110250:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016119.110268:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27115be3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d18 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.110293:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016119.110295:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016119.110306:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27115be3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d18 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.110322:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27115be3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d18 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.110336:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd680, rc 0) 00000100:00100000:2.0:1734016119.110397:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333756032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 171us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016119.110403:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11013 00000100:00100000:0.0:1734016119.113954:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.114067:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333756160 00000100:00100000:3.0:1734016119.114075:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333756160 00000100:00100000:3.0:1734016119.114699:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11014 00000100:00100000:3.0:1734016119.114710:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333756160:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016119.114739:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016119.114770:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115bea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d1f expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.114844:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115bdc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d11 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.114858:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27115be3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d18 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.114863:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016119.114865:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016119.114870:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115bea lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3284992->3289087] (req 3284992->3289087) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d1f expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.114912:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27115be3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d18 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.114931:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27115be3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d18 expref: 6 pid: 8216 timeout: 486 lvb_type: 1 00000100:00100000:3.0:1734016119.114946:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335309696:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016119.115043:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115bdc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d11 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.115051:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115bdc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d11 expref: 7 pid: 7684 timeout: 486 lvb_type: 1 00000100:00100000:3.0:1734016119.115061:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335309824:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016119.115081:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016119.119330:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.119375:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.119718:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333756288 00000100:00100000:2.0:1734016119.119726:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333756288 00010000:00010000:2.0:1734016119.119764:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27115be3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d18 expref: 7 pid: 8216 timeout: 486 lvb_type: 1 00000100:00100000:2.0:1734016119.119788:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333756416 00000100:00100000:2.0:1734016119.119790:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333756416 00010000:00010000:2.0:1734016119.119826:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115bdc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d11 expref: 8 pid: 7684 timeout: 486 lvb_type: 1 00000100:00100000:2.0:1734016119.119843:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3054 00000100:00100000:2.0:1734016119.119848:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333756288:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016119.119861:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016119.119881:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27115be3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d18 expref: 7 pid: 8216 timeout: 486 lvb_type: 1 00010000:00010000:2.0:1734016119.119891:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27115be3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d18 expref: 7 pid: 8216 timeout: 486 lvb_type: 1 00010000:00010000:2.0:1734016119.119931:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016119.119977:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333756288:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 128us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016119.119982:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3054 00000100:00100000:2.0:1734016119.119996:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3055 00000100:00100000:2.0:1734016119.119999:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333756416:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016119.120005:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016119.120010:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115bdc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d11 expref: 8 pid: 7684 timeout: 486 lvb_type: 1 00010000:00010000:2.0:1734016119.120019:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115bdc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d11 expref: 8 pid: 7684 timeout: 486 lvb_type: 1 00010000:00010000:2.0:1734016119.120029:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016119.120031:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016119.120040:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115bea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3284992->3289087) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d1f expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.120050:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115bea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3284992->3289087) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d1f expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.120083:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115bea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3284992->3289087) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d1f expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016119.120097:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075653480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335309952:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016119.120132:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00010000:00010000:3.0:1734016119.120408:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27115be3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d18 expref: 6 pid: 8216 timeout: 486 lvb_type: 1 00000100:00100000:3.0:1734016119.120437:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130408000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335309696:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016119.120447:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115bdc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d11 expref: 8 pid: 7684 timeout: 486 lvb_type: 1 00000100:00100000:3.0:1734016119.120455:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130408e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335309824:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016119.120476:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115bea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3289087) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d1f expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.120484:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016119.120514:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333756160:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5807us (6576us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016119.120520:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11014 00000100:00100000:2.0:1734016119.123938:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.124131:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075653480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335309952:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016119.124151:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016119.124200:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333756416:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4198us (4823us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016119.124210:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3055 00000100:00100000:3.0:1734016119.124374:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333756672 00000100:00100000:3.0:1734016119.124380:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333756672 00002000:00100000:3.0:1734016119.124412:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3284992->3289087) req@ffff8800756ec000 x1818247333756672/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016119.124421:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ec000 with x1818247333756672 ext(3284992->3289087) 00002000:00010000:3.0:1734016119.124425:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ec000 00000100:00100000:3.0:1734016119.124449:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8683 00000100:00100000:3.0:1734016119.124454:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333756672:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016119.124570:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333756672:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 115us (640us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016119.124575:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8683 00002000:00100000:3.0:1734016119.124581:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3284992->3289087) req@ffff8800756ec000 x1818247333756672/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016119.124588:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ec000 with x1818247333756672 ext(3284992->3289087) 00002000:00010000:3.0:1734016119.124590:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ec000 00000100:00100000:0.0:1734016119.127952:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.128156:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333756928 00000100:00100000:2.0:1734016119.128168:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333756928 00002000:00100000:2.0:1734016119.128223:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3280896->3284991) req@ffff8801369f2d80 x1818247333756928/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.128236:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f2d80 with x1818247333756928 ext(3280896->3284991) 00002000:00010000:2.0:1734016119.128243:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f2d80 00000100:00100000:2.0:1734016119.128289:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8684 00000100:00100000:2.0:1734016119.128298:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333756928:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016119.128525:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333756928:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 227us (592us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016119.128531:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8684 00002000:00100000:2.0:1734016119.128537:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3280896->3284991) req@ffff8801369f2d80 x1818247333756928/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.128545:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f2d80 with x1818247333756928 ext(3280896->3284991) 00002000:00010000:2.0:1734016119.128548:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f2d80 00000100:00100000:0.0:1734016119.133603:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.133790:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333757056 00000100:00100000:3.0:1734016119.133827:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333757056 00002000:00100000:3.0:1734016119.133868:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3280896->3289087) req@ffff8801369f2a00 x1818247333757056/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 8680/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016119.133877:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f2a00 with x1818247333757056 ext(3280896->3289087) 00002000:00010000:3.0:1734016119.133883:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f2a00 00000100:00100000:3.0:1734016119.133917:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8685 00000100:00100000:3.0:1734016119.133923:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333757056:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016119.140635:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333757056:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 6702us (7031us total) trans 4294969446 rc 0/0 00000100:00100000:0.0:1734016119.140648:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8685 00002000:00100000:0.0:1734016119.140664:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3280896->3289087) req@ffff8801369f2a00 x1818247333757056/t4294969446(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 8680/448 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016119.140673:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f2a00 with x1818247333757056 ext(3280896->3289087) 00002000:00010000:0.0:1734016119.140678:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f2a00 00000100:00100000:0.0:1734016119.142997:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.143135:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333757184 00000100:00100000:3.0:1734016119.143146:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333757184 00000100:00100000:3.0:1734016119.143208:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11015 00000100:00100000:3.0:1734016119.143215:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333757184:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016119.145068:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969446 is committed 00000100:00100000:3.0:1734016119.145535:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333757184:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2315us (2550us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016119.145546:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11015 00000100:00100000:0.0:1734016119.149877:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.150224:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333757312 00000100:00100000:3.0:1734016119.150238:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333757312 00000100:00100000:3.0:1734016119.150857:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11016 00000100:00100000:3.0:1734016119.150866:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333757312:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016119.150887:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016119.150915:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115bf1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d26 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016119.150971:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335310080:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016119.151105:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00002000:00010000:3.0:1734016119.155665:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 1176 -> 1192 00000100:00100000:3.0:1734016119.155696:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130408e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335310080:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016119.155733:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115bf1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d26 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.155746:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7840/0x5e3a3adc27115bf1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d26 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.155780:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7840, rc 0) 00000100:00100000:3.0:1734016119.155878:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333757312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5011us (6015us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016119.155889:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11016 00000100:00100000:0.0:1734016119.160420:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.160519:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333757440 00000100:00100000:3.0:1734016119.160529:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333757440 00000100:00100000:3.0:1734016119.164102:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11017 00000100:00100000:3.0:1734016119.164122:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333757440:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016119.164150:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016119.164182:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27115bf8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d2d expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016119.164260:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335310208:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016119.164351:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016119.167145:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130408e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335310208:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016119.167185:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27115bf8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d2d expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.167200:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27115bf8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d2d expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.168128:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df58c0, rc 0) 00000100:00100000:3.0:1734016119.168863:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333757440:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4741us (8444us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016119.168873:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11017 00000100:00100000:0.0:1734016119.187461:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.192024:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333757568 00000100:00100000:3.0:1734016119.192042:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333757568 00000100:00100000:3.0:1734016119.192132:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11018 00000100:00100000:3.0:1734016119.192141:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88009024a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333757568:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016119.192161:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016119.192179:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115bff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d34 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016119.192255:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130408e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335310336:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016119.192356:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016119.197530:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130408e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335310336:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016119.197566:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115bff lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d34 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.197578:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4480/0x5e3a3adc27115bff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d34 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.197601:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4480, rc 0) 00000100:00100000:3.0:1734016119.197645:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88009024a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333757568:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5505us (10197us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016119.197654:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11018 00000100:00100000:0.0:1734016119.204656:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.206483:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333757696 00000100:00100000:3.0:1734016119.206493:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333757696 00000100:00100000:3.0:1734016119.207220:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11019 00000100:00100000:3.0:1734016119.207227:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333757696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016119.207249:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016119.207268:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115c06 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d3b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.207295:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115bea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3289087) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d1f expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.207304:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016119.207307:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016119.207310:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115c06 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [995328->1003519] (req 995328->1003519) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d3b expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.207345:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115bea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3289087) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d1f expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.207357:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115bea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3289087) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d1f expref: 5 pid: 7684 timeout: 486 lvb_type: 0 00000100:00100000:3.0:1734016119.207375:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335310464:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016119.207455:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016119.234430:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013040a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335310464:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016119.234477:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115c06 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [995328->1003519] (req 995328->1003519) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d3b expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.234498:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016119.234550:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333757696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 27321us (29903us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016119.234561:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11019 00000100:00100000:0.0:1734016119.236700:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.236937:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333757824 00000100:00100000:2.0:1734016119.236945:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333757824 00010000:00010000:2.0:1734016119.236973:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115bea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3289087) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d1f expref: 6 pid: 7684 timeout: 486 lvb_type: 0 00000100:00100000:0.0:1734016119.238070:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3056 00000100:00100000:0.0:1734016119.238080:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075650e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333757824:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016119.238095:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016119.238116:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115bea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3284992->3289087) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d1f expref: 6 pid: 7684 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1734016119.238129:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115bea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3284992->3289087) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d1f expref: 6 pid: 7684 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1734016119.238149:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115bea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3284992->3289087) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d1f expref: 6 pid: 7684 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1734016119.238183:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016119.238185:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016119.238190:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115c06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 995328->1003519) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d3b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.238198:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115c06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 995328->1003519) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d3b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.238229:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115c06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 995328->1003519) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d3b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016119.238241:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075653480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335310592:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016119.238297:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016119.241025:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075653480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335310592:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016119.241051:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016119.241098:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075650e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333757824:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3017us (4403us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016119.241109:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3056 00000100:00100000:0.0:1734016119.255058:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.255147:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333757952 00000100:00100000:3.0:1734016119.255157:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333757952 00000100:00100000:3.0:1734016119.255228:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11020 00000100:00100000:3.0:1734016119.255237:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333757952:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016119.255530:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10043392 -> 10043392 00002000:00010000:3.0:1734016119.255533:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016119 -> 1734016119 00002000:00010000:3.0:1734016119.255535:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016119 -> 1734016119 00002000:00010000:3.0:1734016119.255537:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016119 -> 1734016119 00002000:00010000:3.0:1734016119.255539:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1192 -> 1208 00000100:00100000:3.0:1734016119.255602:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333757952:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 365us (556us total) trans 4294969447 rc 0/0 00000100:00100000:3.0:1734016119.255609:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11020 00000100:00100000:0.0:1734016119.265191:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.265266:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333758080 00000100:00100000:2.0:1734016119.265275:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333758080 00000100:00100000:2.0:1734016119.265332:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11021 00000100:00100000:2.0:1734016119.265341:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333758080:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016119.265364:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016119.265388:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27115c0d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d42 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016119.265453:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335310720:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016119.265531:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016119.266886:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335310720:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016119.266926:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27115c0d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d42 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.266940:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27115c0d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d42 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.266968:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd680, rc 0) 00000100:00100000:2.0:1734016119.267012:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333758080:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1671us (1830us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016119.267021:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11021 00000100:00100000:0.0:1734016119.270297:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.270456:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333758208 00000100:00100000:2.0:1734016119.270470:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333758208 00000100:00100000:2.0:1734016119.270534:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11022 00000100:00100000:2.0:1734016119.270545:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333758208:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016119.270564:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016119.270582:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115c14 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d49 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.270618:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115c06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 995328->1003519) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d3b expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.270627:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016119.270628:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016119.270632:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115c14 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2076672->2097151] (req 2076672->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d49 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.270670:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115c06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 995328->1003519) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d3b expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.270682:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115c06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 995328->1003519) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d3b expref: 7 pid: 7684 timeout: 486 lvb_type: 0 00000100:00100000:2.0:1734016119.270700:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335310848:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016119.270784:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e600 going to sleep for 11 seconds 00000100:00100000:0.0:1734016119.274678:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.274777:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333758336 00000100:00100000:3.0:1734016119.274787:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333758336 00010000:00010000:3.0:1734016119.274860:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115c06 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 995328->1003519) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d3b expref: 8 pid: 7684 timeout: 486 lvb_type: 0 00000100:00100000:3.0:1734016119.274893:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3057 00000100:00100000:3.0:1734016119.274910:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b42c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333758336:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016119.274923:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016119.274943:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115c06 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 995328->1003519) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d3b expref: 8 pid: 7684 timeout: 486 lvb_type: 0 00010000:00010000:3.0:1734016119.274956:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115c06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 995328->1003519) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d3b expref: 8 pid: 7684 timeout: 486 lvb_type: 0 00010000:00010000:3.0:1734016119.274977:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016119.274979:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016119.274985:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115c14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d49 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.274993:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115c14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d49 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.275037:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115c14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d49 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016119.275050:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335310976:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016119.275125:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92780 going to sleep for 11 seconds 00010000:00010000:2.0:1734016119.275440:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115c06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 995328->1003519) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d3b expref: 8 pid: 7684 timeout: 486 lvb_type: 0 00000100:00100000:2.0:1734016119.276114:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335310848:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016119.276144:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115c14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d49 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.276160:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:3.0:1734016119.276413:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013040a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335310976:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016119.276428:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016119.276458:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b42c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333758336:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1557us (1793us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016119.276466:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3057 00000100:00100000:2.0:1734016119.277022:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333758208:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6478us (6737us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016119.277030:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11022 00000100:00100000:0.0:1734016119.287212:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.288155:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333758464 00000100:00100000:2.0:1734016119.288168:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333758464 00000100:00100000:3.0:1734016119.289393:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11023 00000100:00100000:3.0:1734016119.289404:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333758464:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016119.289694:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10043392 -> 10043392 00002000:00010000:3.0:1734016119.289698:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016119 -> 1734016119 00002000:00010000:3.0:1734016119.289700:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016119 -> 1734016119 00002000:00010000:3.0:1734016119.289702:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016119 -> 1734016119 00002000:00010000:3.0:1734016119.289705:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1208 -> 1248 00000100:00100000:3.0:1734016119.289765:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333758464:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 363us (2574us total) trans 4294969448 rc 0/0 00000100:00100000:3.0:1734016119.289772:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11023 00000100:00100000:1.0:1734016119.309188:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.310390:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333758592 00000100:00100000:3.0:1734016119.310413:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333758592 00000100:00100000:3.0:1734016119.310494:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11024 00000100:00100000:3.0:1734016119.310502:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333758592:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016119.310523:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016119.310542:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115c1b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d50 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016119.310605:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335311104:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016119.310692:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016119.318905:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013040a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335311104:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016119.318953:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115c1b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d50 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.318970:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115c1b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d50 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.319011:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016119.325298:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333758592:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 14772us (16111us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016119.325315:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11024 00000100:00100000:0.0:1734016119.327865:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.329068:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333758720 00000100:00100000:3.0:1734016119.329083:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333758720 00000100:00100000:3.0:1734016119.329313:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11025 00000100:00100000:3.0:1734016119.329323:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333758720:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016119.329345:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016119.329371:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115c22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d57 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016119.329436:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335311232:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016119.330139:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016119.332454:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013040a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335311232:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016119.332505:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115c22 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d57 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.332521:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115c22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d57 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016119.332589:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4b40, rc 0) 00000100:00100000:3.0:1734016119.336893:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333758720:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7542us (9082us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016119.336917:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11025 00000100:00100000:1.0:1734016119.340298:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.340392:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333758976 00000100:00100000:0.0:1734016119.340403:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333758976 00000100:00100000:0.0:1734016119.340466:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2215 00000100:00100000:0.0:1734016119.340473:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+19:9668:x1818247333758976:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016119.340527:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016119.340557:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115b1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c70 expref: 19 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.340584:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016119.340588:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016119.340749:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115c29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016119.340763:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27115b0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c62 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.340770:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115c29 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016119.340828:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27115b0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c62 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.340840:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27115b0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c62 expref: 15 pid: 6478 timeout: 486 lvb_type: 0 00000100:00100000:0.0:1734016119.340852:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075608a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335311360:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016119.340929:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00000100:00080000:2.0:1734016119.341090:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016089 00000100:00100000:0.0:1734016119.345165:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.346406:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333759104 00000100:00100000:3.0:1734016119.346418:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333759104 00010000:00010000:3.0:1734016119.346477:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27115b0a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c62 expref: 16 pid: 6478 timeout: 486 lvb_type: 0 00000100:00100000:3.0:1734016119.346515:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3058 00000100:00100000:3.0:1734016119.346522:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333759104:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016119.346545:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016119.346554:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27115b0a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c62 expref: 16 pid: 6478 timeout: 486 lvb_type: 0 00010000:00010000:3.0:1734016119.346566:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27115b0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c62 expref: 16 pid: 6478 timeout: 486 lvb_type: 0 00010000:00010000:3.0:1734016119.346590:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016119.346594:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115c29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016119.346602:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016119.346609:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115c29 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016119.347105:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016119.347163:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333759104:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 641us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016119.347171:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3058 00010000:00010000:2.0:1734016119.347460:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27115b0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5c62 expref: 15 pid: 6478 timeout: 486 lvb_type: 0 00000100:00100000:2.0:1734016119.347481:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075608a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335311360:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016119.347502:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016119.347510:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016119.347515:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00080000:0.0:1734016119.347522:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016089 00000001:00080000:2.0:1734016119.347638:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968724 00000004:00010000:2.0:1734016119.347688:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88008719f480 reply state ffff8800752bc000 transno 4294968725 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016119.347696:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016119.347775:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+21:9668:x1818247333758976:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 7302us (7492us total) trans 4294968725 rc 0/0 00000100:00100000:2.0:1734016119.347781:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2215 00000020:00080000:2.0:1734016119.347786:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1734016119.355089:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016119.355111:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115c29 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016119.355118:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115c29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016119.355126:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7580900 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016119.355132:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115c29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016119.355141:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115c29 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016119.355165:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016119.355168:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016119.355172:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115c29 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016119.355177:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27115c29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:1.0:1734016119.357206:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.357346:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333759232 00000100:00100000:3.0:1734016119.357360:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333759232 00000100:00100000:3.0:1734016119.357524:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11026 00000100:00100000:3.0:1734016119.357534:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333759232:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016119.357562:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016119.357584:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115c30 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d5e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.357630:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115c14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d49 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.357637:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016119.357639:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016119.357643:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115c30 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d5e expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.357677:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115c14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d49 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.357691:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115c14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d49 expref: 6 pid: 8216 timeout: 486 lvb_type: 0 00000100:00100000:3.0:1734016119.357706:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335311488:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016119.358135:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016119.360290:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013040a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335311488:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016119.360345:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115c30 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d5e expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.360373:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:1.0:1734016119.360430:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.360448:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333759232:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2915us (3257us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016119.360460:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11026 00000100:00100000:2.0:1734016119.360589:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333759360 00000100:00100000:2.0:1734016119.360599:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333759360 00010000:00010000:2.0:1734016119.360635:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115c14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d49 expref: 7 pid: 8216 timeout: 486 lvb_type: 0 00000100:00100000:2.0:1734016119.360868:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3059 00000100:00100000:2.0:1734016119.360875:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333759360:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016119.360891:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016119.360924:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115c14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d49 expref: 7 pid: 8216 timeout: 486 lvb_type: 0 00010000:00010000:2.0:1734016119.360937:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115c14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d49 expref: 7 pid: 8216 timeout: 486 lvb_type: 0 00010000:00010000:2.0:1734016119.360965:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115c14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d49 expref: 7 pid: 8216 timeout: 486 lvb_type: 0 00010000:00010000:2.0:1734016119.360986:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016119.360988:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016119.360994:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115c30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d5e expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.361003:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115c30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d5e expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.361035:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115c30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d5e expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016119.361051:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335311616:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016119.361149:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016119.362579:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335311616:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016119.362609:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016119.362626:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.362657:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333759360:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1781us (2227us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016119.362668:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3059 00000100:00100000:1.0:1734016119.362744:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333759488 00000100:00100000:1.0:1734016119.362752:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333759488 00002000:00010000:1.0:1734016119.362784:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (3552348->18446744073709551615) 00002000:00100000:1.0:1734016119.362788:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075deb480 with x1818247333759488 ext(3552348->18446744073709551615) 00002000:00010000:1.0:1734016119.362847:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075deb480. 00000100:00100000:1.0:1734016119.362877:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8686 00000100:00100000:1.0:1734016119.362883:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333759488:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016119.368365:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 10043392 -> 3552348 00002000:00010000:1.0:1734016119.368380:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016119 -> 1734016119 00002000:00010000:1.0:1734016119.368383:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016119 -> 1734016119 00002000:00010000:1.0:1734016119.368385:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016119 -> 1734016119 00002000:00010000:1.0:1734016119.368388:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1248 -> 800 00000100:00100000:1.0:1734016119.368529:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333759488:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 5632us (5890us total) trans 4294969449 rc 0/0 00000100:00100000:1.0:1734016119.368546:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8686 00002000:00010000:1.0:1734016119.368554:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (3552348->18446744073709551615) 00002000:00100000:1.0:1734016119.368559:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075deb480 with x1818247333759488 ext(3552348->18446744073709551615) 00002000:00010000:1.0:1734016119.368567:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075deb480. 00000100:00100000:0.0:1734016119.372965:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.373197:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333759616 00000100:00100000:2.0:1734016119.373217:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333759616 00000100:00100000:2.0:1734016119.375270:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2216 00000100:00100000:2.0:1734016119.375290:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333759616:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016119.375356:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016119.375400:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115c37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d65 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.375557:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115c3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016119.375577:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016119.375590:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016119.375620:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 3552348 00000004:00200000:2.0:1734016119.375626:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016119.375651:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016119.375680:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115c37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d65 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.375728:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115c3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d65 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.375738:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016119.375741:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016119.375744:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd440, rc 0) 00000100:00100000:2.0:1734016119.375859:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+21:9668:x1818247333759616:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 572us (2922us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016119.375867:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2216 00000100:00100000:2.0:1734016119.387613:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016119.389165:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333759872 00000100:00100000:1.0:1734016119.389184:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333759872 00002000:00100000:1.0:1734016119.389246:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->3555327) req@ffff8800756ed180 x1818247333759872/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016119.389257:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ed180 with x1818247333759872 ext(0->3555327) 00002000:00010000:1.0:1734016119.389263:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ed180 00000100:00100000:1.0:1734016119.389302:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8687 00000100:00100000:1.0:1734016119.389311:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333759872:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016119.433226:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333759872:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 43896us (45613us total) trans 0 rc 3555328/3555328 00000100:00100000:2.0:1734016119.433239:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8687 00002000:00100000:2.0:1734016119.433252:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->3555327) req@ffff8800756ed180 x1818247333759872/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:80/0 lens 488/440 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 3555328/3555328 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.433261:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ed180 with x1818247333759872 ext(0->3555327) 00002000:00010000:2.0:1734016119.433268:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ed180 00000100:00100000:2.0:1734016119.439271:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.441141:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333760000 00000100:00100000:3.0:1734016119.441162:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333760000 00000100:00100000:3.0:1734016119.441254:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2217 00000100:00100000:3.0:1734016119.441263:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:9668:x1818247333760000:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016119.441297:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016119.441326:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115c45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d6c expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.441478:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115c4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016119.441499:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115c4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016119.441515:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115c4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:3.0:1734016119.441542:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 3552348 00000004:00200000:3.0:1734016119.441548:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016119.441569:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115c4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016119.441595:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115c45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d6c expref: 17 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.441626:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115c4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d6c expref: 16 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.441636:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016119.441641:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016119.441644:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016119.445638:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333760000:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4359us (6361us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016119.445650:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2217 00000100:00100000:0.0:1734016119.450451:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.450515:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333760128 00000100:00100000:3.0:1734016119.450525:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333760128 00000100:00100000:3.0:1734016119.450583:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11027 00000100:00100000:3.0:1734016119.450590:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333760128:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016119.450610:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016119.450629:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115c53 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d73 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016119.450692:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335311744:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016119.450766:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92cc0 going to sleep for 11 seconds 00002000:00010000:0.0:1734016119.457343:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016119 -> 1734016120 00000100:00100000:0.0:1734016119.457384:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013040a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335311744:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016119.457437:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115c53 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d73 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016119.457457:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115c53 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d73 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016119.457491:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:0.0:1734016119.457573:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333760128:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6981us (7130us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016119.457584:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11027 00000100:00100000:0.0:1734016119.466573:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.466788:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333760256 00000100:00100000:2.0:1734016119.466850:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333760256 00000100:00100000:2.0:1734016119.466941:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11028 00000100:00100000:2.0:1734016119.466952:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333760256:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016119.466987:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016119.467014:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27115c5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d7a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016119.467097:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335311872:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016119.467188:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016119.473290:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335311872:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016119.473366:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27115c5a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d7a expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016119.473385:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd680/0x5e3a3adc27115c5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d7a expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016119.473418:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd680, rc 0) 00000100:00100000:0.0:1734016119.473502:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333760256:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6548us (6950us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016119.473514:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11028 00000100:00100000:3.0:1734016119.478090:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.478190:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333760384 00000100:00100000:0.0:1734016119.478211:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333760384 00000100:00100000:0.0:1734016119.478290:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11029 00000100:00100000:0.0:1734016119.478300:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333760384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016119.478333:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016119.478359:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27115c61 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d81 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016119.478458:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335312000:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016119.478555:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eed80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016119.486159:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335312000:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016119.486220:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27115c61 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d81 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016119.486241:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27115c61 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d81 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016119.486274:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:0.0:1734016119.486625:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333760384:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8324us (8558us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016119.486638:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11029 00000100:00100000:3.0:1734016119.497024:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.498420:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333760512 00000100:00100000:0.0:1734016119.498437:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333760512 00000100:00100000:0.0:1734016119.498508:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11030 00000100:00100000:0.0:1734016119.498517:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333760512:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016119.498546:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016119.498575:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115c68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d88 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016119.498651:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335312128:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016119.498742:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759eed80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016119.503163:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335312128:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016119.503221:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115c68 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d88 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016119.503238:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115c68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d88 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016119.503272:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581d40, rc 0) 00000100:00100000:0.0:1734016119.503347:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333760512:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4828us (6337us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016119.503356:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11030 00000100:00100000:1.0:1734016119.511559:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.512660:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333760768 00000100:00100000:2.0:1734016119.512683:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333760768 00000100:00100000:2.0:1734016119.512878:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8688 00000100:00100000:2.0:1734016119.512891:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333760768:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:2.0:1734016119.512965:0:7687:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115c6f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.512993:0:7687:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115c30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d5e expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.513003:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016119.513006:0:7687:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016119.513009:0:7687:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115c6f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2310144->2338815] (req 2310144->2338815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.513050:0:7687:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115c30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d5e expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.513067:0:7687:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115c30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d5e expref: 9 pid: 8216 timeout: 486 lvb_type: 0 00000100:00100000:2.0:1734016119.513090:0:7687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335312256:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016119.513184:0:7687:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016119.519682:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.519778:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333760896 00000100:00100000:0.0:1734016119.519788:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333760896 00010000:00010000:0.0:1734016119.519854:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115c30 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d5e expref: 10 pid: 8216 timeout: 486 lvb_type: 0 00000100:00100000:0.0:1734016119.519910:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3060 00000100:00100000:0.0:1734016119.519918:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333760896:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016119.519935:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016119.519960:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115c30 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d5e expref: 10 pid: 8216 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1734016119.519979:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115c30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d5e expref: 10 pid: 8216 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1734016119.520010:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016119.520014:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016119.520019:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115c6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2310144->2338815] (req 2310144->2338815) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.520029:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115c6f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [2310144->2338815] (req 2310144->2338815) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.520051:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016119.520097:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333760896:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 179us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016119.520104:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3060 00010000:00010000:2.0:1734016119.520312:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115c30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d5e expref: 9 pid: 8216 timeout: 486 lvb_type: 0 00000100:00100000:2.0:1734016119.520329:0:7687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:7687:1818247335312256:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016119.520350:0:7687:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115c6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2310144->2338815] (req 2310144->2338815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.520358:0:7687:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115c6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2310144->2338815] (req 2310144->2338815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.520363:0:7687:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115c6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2310144->2338815] (req 2310144->2338815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.526865:0:7687:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115c6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2310144->2338815] (req 2310144->2338815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.526889:0:7687:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115c6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2310144->2338815] (req 2310144->2338815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.526909:0:7687:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115c6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2310144->2338815] (req 2310144->2338815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.526916:0:7687:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc240 already unused, calling callback (ffffffffa080e100) 00010000:00010000:2.0:1734016119.526921:0:7687:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115c6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2310144->2338815] (req 2310144->2338815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.526930:0:7687:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115c6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2310144->2338815] (req 2310144->2338815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.526955:0:7687:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115c6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2310144->2338815] (req 2310144->2338815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.526962:0:7687:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115c6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [2310144->2338815] (req 2310144->2338815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7687 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016119.527367:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333760768:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 14468us (15815us total) trans 0 rc 28672/28672 00000100:00100000:2.0:1734016119.527384:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8688 00000100:00100000:3.0:1734016119.530491:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.530576:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333761024 00000100:00100000:0.0:1734016119.530592:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333761024 00000100:00100000:0.0:1734016119.531178:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11031 00000100:00100000:0.0:1734016119.531189:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333761024:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016119.531218:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016119.531253:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115c76 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d8f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1734016119.531289:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 3552348, mtime: 0x675afc77, atime: 0x675afc77, ctime: 0x675afc77, blocks: 0x320 00010000:00010000:0.0:1734016119.531326:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016119.531329:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016119.531341:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115c76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d8f expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016119.531362:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115c76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d8f expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016119.531377:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581d40, rc 0) 00000100:00100000:0.0:1734016119.531462:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333761024:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 273us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016119.531471:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11031 00000100:00100000:2.0:1734016119.536737:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.536832:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333761152 00000100:00100000:0.0:1734016119.536846:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333761152 00000100:00100000:0.0:1734016119.536922:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11032 00000100:00100000:0.0:1734016119.536931:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333761152:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016119.536963:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016119.536992:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27115c7d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d96 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.537024:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016119.537027:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016119.537036:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27115c7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d96 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016119.537054:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27115c7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d96 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016119.537067:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:0.0:1734016119.537148:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333761152:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 217us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016119.537156:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11032 00010000:00010000:2.0:1734016119.539765:0:8958:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1734016119.541196:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.541332:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333761408 00000100:00100000:2.0:1734016119.541353:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333761408 00002000:00100000:2.0:1734016119.541424:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3227648->3231743) req@ffff880075651180 x1818247333761408/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.541438:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075651180 with x1818247333761408 ext(3227648->3231743) 00002000:00010000:2.0:1734016119.541445:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075651180 00000100:00100000:2.0:1734016119.541889:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8689 00000100:00100000:2.0:1734016119.541908:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333761408:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016119.542189:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333761408:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 278us (1010us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016119.542203:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8689 00002000:00100000:2.0:1734016119.542210:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3227648->3231743) req@ffff880075651180 x1818247333761408/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.542219:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075651180 with x1818247333761408 ext(3227648->3231743) 00002000:00010000:2.0:1734016119.542222:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075651180 00000100:00100000:3.0:1734016119.547780:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.548112:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333761664 00000100:00100000:0.0:1734016119.548127:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333761664 00002000:00100000:0.0:1734016119.548194:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3223552->3227647) req@ffff880075650e00 x1818247333761664/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016119.548207:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075650e00 with x1818247333761664 ext(3223552->3227647) 00002000:00010000:0.0:1734016119.548215:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075650e00 00000100:00100000:0.0:1734016119.548264:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8690 00000100:00100000:0.0:1734016119.548275:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333761664:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016119.548553:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333761664:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 277us (788us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016119.548563:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8690 00002000:00100000:0.0:1734016119.548569:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3223552->3227647) req@ffff880075650e00 x1818247333761664/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016119.548576:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075650e00 with x1818247333761664 ext(3223552->3227647) 00002000:00010000:0.0:1734016119.548579:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075650e00 00000100:00100000:3.0:1734016119.552978:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.553974:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333761920 00000100:00100000:2.0:1734016119.553998:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333761920 00002000:00100000:2.0:1734016119.554078:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3219456->3223551) req@ffff88007345ca80 x1818247333761920/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.554091:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345ca80 with x1818247333761920 ext(3219456->3223551) 00002000:00010000:2.0:1734016119.554099:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345ca80 00000100:00100000:2.0:1734016119.554139:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8691 00000100:00100000:2.0:1734016119.554150:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333761920:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016119.555066:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333761920:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 913us (2105us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016119.555076:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8691 00002000:00100000:2.0:1734016119.555085:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3219456->3223551) req@ffff88007345ca80 x1818247333761920/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.555094:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345ca80 with x1818247333761920 ext(3219456->3223551) 00002000:00010000:2.0:1734016119.555098:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345ca80 00000100:00100000:3.0:1734016119.558058:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.558719:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333762176 00000100:00100000:2.0:1734016119.558733:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333762176 00002000:00100000:2.0:1734016119.558930:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3215360->3219455) req@ffff88007345c700 x1818247333762176/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.558949:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345c700 with x1818247333762176 ext(3215360->3219455) 00002000:00010000:2.0:1734016119.558957:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345c700 00000100:00100000:2.0:1734016119.558999:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8692 00000100:00100000:2.0:1734016119.559009:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333762176:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016119.559257:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333762176:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 248us (1209us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016119.559267:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8692 00002000:00100000:2.0:1734016119.559274:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (3215360->3219455) req@ffff88007345c700 x1818247333762176/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.559281:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345c700 with x1818247333762176 ext(3215360->3219455) 00002000:00010000:2.0:1734016119.559284:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345c700 00000100:00100000:3.0:1734016119.564529:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.564690:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333762432 00000100:00100000:0.0:1734016119.564703:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333762432 00002000:00100000:0.0:1734016119.564766:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3211264->3215359) req@ffff8800849b4000 x1818247333762432/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016119.564778:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b4000 with x1818247333762432 ext(3211264->3215359) 00002000:00010000:0.0:1734016119.564785:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b4000 00000100:00100000:0.0:1734016119.564886:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8693 00000100:00100000:0.0:1734016119.564906:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333762432:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016119.565146:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333762432:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 249us (638us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016119.565155:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8693 00002000:00100000:0.0:1734016119.565161:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (3211264->3215359) req@ffff8800849b4000 x1818247333762432/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016119.565169:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b4000 with x1818247333762432 ext(3211264->3215359) 00002000:00010000:0.0:1734016119.565172:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b4000 00000100:00100000:3.0:1734016119.571069:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.571296:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333762688 00000100:00100000:2.0:1734016119.571311:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333762688 00002000:00100000:2.0:1734016119.571374:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (864256->868351) req@ffff8800849b6a00 x1818247333762688/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.571386:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b6a00 with x1818247333762688 ext(864256->868351) 00002000:00010000:2.0:1734016119.571392:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b6a00 00000100:00100000:2.0:1734016119.571434:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8694 00000100:00100000:2.0:1734016119.571443:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333762688:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016119.571677:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333762688:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 234us (626us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016119.571687:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8694 00002000:00100000:2.0:1734016119.571694:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (864256->868351) req@ffff8800849b6a00 x1818247333762688/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.571703:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b6a00 with x1818247333762688 ext(864256->868351) 00002000:00010000:2.0:1734016119.571707:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b6a00 00000100:00100000:3.0:1734016119.575464:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.575560:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333762944 00000100:00100000:0.0:1734016119.575574:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333762944 00002000:00100000:0.0:1734016119.575633:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (860160->864255) req@ffff8800849b4a80 x1818247333762944/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016119.575644:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b4a80 with x1818247333762944 ext(860160->864255) 00002000:00010000:0.0:1734016119.575650:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b4a80 00000100:00100000:0.0:1734016119.575694:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8695 00000100:00100000:0.0:1734016119.575702:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333762944:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016119.575985:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333762944:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 282us (538us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016119.575994:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8695 00002000:00100000:0.0:1734016119.576001:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (860160->864255) req@ffff8800849b4a80 x1818247333762944/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016119.576008:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b4a80 with x1818247333762944 ext(860160->864255) 00002000:00010000:0.0:1734016119.576011:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b4a80 00000100:00100000:3.0:1734016119.579387:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.580204:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333763200 00000100:00100000:2.0:1734016119.580221:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333763200 00002000:00100000:2.0:1734016119.580306:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (856064->860159) req@ffff8800849b7800 x1818247333763200/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.580321:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b7800 with x1818247333763200 ext(856064->860159) 00002000:00010000:2.0:1734016119.580330:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b7800 00000100:00100000:2.0:1734016119.580574:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8696 00000100:00100000:2.0:1734016119.580584:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333763200:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016119.581285:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333763200:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 700us (1913us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016119.581293:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8696 00002000:00100000:2.0:1734016119.581300:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (856064->860159) req@ffff8800849b7800 x1818247333763200/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.581308:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b7800 with x1818247333763200 ext(856064->860159) 00002000:00010000:2.0:1734016119.581312:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b7800 00000100:00100000:3.0:1734016119.590610:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.591612:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333763456 00000100:00100000:2.0:1734016119.591631:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333763456 00002000:00100000:2.0:1734016119.591715:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (851968->856063) req@ffff8800849b6d80 x1818247333763456/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.591729:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b6d80 with x1818247333763456 ext(851968->856063) 00002000:00010000:2.0:1734016119.591736:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b6d80 00000100:00100000:2.0:1734016119.593012:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8697 00000100:00100000:2.0:1734016119.593024:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333763456:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016119.593285:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333763456:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 261us (2696us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016119.593293:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8697 00002000:00100000:2.0:1734016119.593301:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (851968->856063) req@ffff8800849b6d80 x1818247333763456/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.593310:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b6d80 with x1818247333763456 ext(851968->856063) 00002000:00010000:2.0:1734016119.593315:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b6d80 00000100:00100000:3.0:1734016119.603706:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.604601:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333763712 00000100:00100000:0.0:1734016119.604616:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333763712 00002000:00100000:0.0:1734016119.604682:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (847872->851967) req@ffff8800849b7b80 x1818247333763712/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016119.604695:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b7b80 with x1818247333763712 ext(847872->851967) 00002000:00010000:0.0:1734016119.604700:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b7b80 00000100:00100000:0.0:1734016119.604747:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8698 00000100:00100000:0.0:1734016119.604757:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333763712:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016119.605030:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333763712:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 274us (1342us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016119.605042:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8698 00002000:00100000:0.0:1734016119.605049:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (847872->851967) req@ffff8800849b7b80 x1818247333763712/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016119.605056:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b7b80 with x1818247333763712 ext(847872->851967) 00002000:00010000:0.0:1734016119.605059:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b7b80 00000100:00100000:3.0:1734016119.607687:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.607769:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333763968 00000100:00100000:2.0:1734016119.607783:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333763968 00002000:00100000:2.0:1734016119.607864:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (843776->847871) req@ffff8800a78cc380 x1818247333763968/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.607875:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cc380 with x1818247333763968 ext(843776->847871) 00002000:00010000:2.0:1734016119.607881:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cc380 00000100:00100000:3.0:1734016119.616956:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8699 00000100:00100000:3.0:1734016119.616981:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333763968:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016119.618483:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333763968:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1491us (10790us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016119.618501:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8699 00002000:00100000:3.0:1734016119.618515:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (843776->847871) req@ffff8800a78cc380 x1818247333763968/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016119.618527:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cc380 with x1818247333763968 ext(843776->847871) 00002000:00010000:3.0:1734016119.618534:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cc380 00000100:00100000:3.0:1734016119.621285:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.621556:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333764224 00000100:00100000:0.0:1734016119.621570:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333764224 00002000:00100000:0.0:1734016119.621634:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (839680->843775) req@ffff8800a78cca80 x1818247333764224/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016119.621647:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cca80 with x1818247333764224 ext(839680->843775) 00002000:00010000:0.0:1734016119.621654:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cca80 00000100:00100000:0.0:1734016119.621693:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8700 00000100:00100000:0.0:1734016119.621702:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333764224:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016119.621962:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333764224:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 259us (691us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016119.621971:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8700 00002000:00100000:0.0:1734016119.621977:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (839680->843775) req@ffff8800a78cca80 x1818247333764224/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016119.621985:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cca80 with x1818247333764224 ext(839680->843775) 00002000:00010000:0.0:1734016119.621988:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cca80 00000100:00100000:3.0:1734016119.624617:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.624698:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333764480 00000100:00100000:0.0:1734016119.624710:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333764480 00002000:00100000:0.0:1734016119.624768:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (835584->839679) req@ffff8800a78cd500 x1818247333764480/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016119.624779:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cd500 with x1818247333764480 ext(835584->839679) 00002000:00010000:0.0:1734016119.624787:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cd500 00000100:00100000:0.0:1734016119.624869:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8701 00000100:00100000:0.0:1734016119.624879:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333764480:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016119.625184:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333764480:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 305us (586us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016119.625192:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8701 00002000:00100000:0.0:1734016119.625199:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (835584->839679) req@ffff8800a78cd500 x1818247333764480/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016119.625206:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cd500 with x1818247333764480 ext(835584->839679) 00002000:00010000:0.0:1734016119.625209:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cd500 00000100:00100000:2.0:1734016119.629126:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.629786:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333764736 00000100:00100000:0.0:1734016119.629943:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333764736 00002000:00100000:0.0:1734016119.630034:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (831488->835583) req@ffff880073790000 x1818247333764736/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016119.630048:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790000 with x1818247333764736 ext(831488->835583) 00002000:00010000:0.0:1734016119.630056:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073790000 00000100:00100000:0.0:1734016119.630114:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8702 00000100:00100000:0.0:1734016119.630125:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333764736:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016119.630423:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333764736:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 298us (1312us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016119.630431:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8702 00002000:00100000:0.0:1734016119.630438:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (831488->835583) req@ffff880073790000 x1818247333764736/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016119.630447:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790000 with x1818247333764736 ext(831488->835583) 00002000:00010000:0.0:1734016119.630450:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073790000 00000100:00100000:3.0:1734016119.637053:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.638072:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333764992 00000100:00100000:0.0:1734016119.638091:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333764992 00000100:00100000:2.0:1734016119.639006:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2218 00000100:00100000:2.0:1734016119.639021:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:9668:x1818247333764992:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016119.639119:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016119.639168:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115c4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d6c expref: 16 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.640432:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016119.640444:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016119.640737:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115c84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016119.640766:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115c3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d65 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.640774:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115c84 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016119.640851:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115c3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d65 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.640869:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115c3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d65 expref: 20 pid: 6478 timeout: 486 lvb_type: 0 00000100:00100000:2.0:1734016119.640888:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335312384:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016119.641033:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016119.646375:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.647017:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335312384:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016119.647071:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115c84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:1.0:1734016119.647311:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333765120 00000100:00100000:1.0:1734016119.647326:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333765120 00010000:00010000:1.0:1734016119.647387:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115c3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d65 expref: 21 pid: 6478 timeout: 486 lvb_type: 0 00000100:00100000:1.0:1734016119.647698:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3061 00000100:00100000:1.0:1734016119.647710:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+21:1981:x1818247333765120:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016119.647741:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016119.647750:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115c3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d65 expref: 21 pid: 6478 timeout: 486 lvb_type: 0 00010000:00010000:1.0:1734016119.647770:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115c3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d65 expref: 21 pid: 6478 timeout: 486 lvb_type: 0 00010000:00010000:1.0:1734016119.647825:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115c3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d65 expref: 21 pid: 6478 timeout: 486 lvb_type: 0 00010000:00010000:1.0:1734016119.647867:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:1.0:1734016119.647884:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115c84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016119.647902:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115c84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016119.647910:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115c84 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016119.648643:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016119.648721:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+20:1981:x1818247333765120:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1011us (2372us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016119.648730:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3061 00010000:00010000:0.0:1734016119.648789:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115c84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016119.648797:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115c84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:0.0:1734016119.649250:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968726 00000004:00010000:0.0:1734016119.649316:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800a78cd880 reply state ffff8800a7acd000 transno 4294968727 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115c84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016119.649327:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016119.649435:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:9668:x1818247333764992:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 10415us (12406us total) trans 4294968727 rc 0/0 00000100:00100000:0.0:1734016119.649442:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2218 00000020:00080000:0.0:1734016119.649448:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1734016119.656406:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.656527:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333765248 00000100:00100000:0.0:1734016119.656543:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333765248 00000100:00100000:0.0:1734016119.656630:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11033 00000100:00100000:0.0:1734016119.656641:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:9668:x1818247333765248:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016119.656680:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016119.656713:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115c8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5d9d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.656768:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115c76 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d8f expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016119.656779:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27115c7d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d96 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016119.656787:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016119.656791:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016119.656795:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115c8b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d9d expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.656872:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27115c7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d96 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016119.656887:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27115c7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d96 expref: 8 pid: 7684 timeout: 486 lvb_type: 1 00000100:00100000:0.0:1734016119.656911:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335312512:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016119.657030:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115c76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d8f expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016119.657041:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115c76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d8f expref: 8 pid: 8216 timeout: 486 lvb_type: 1 00000100:00100000:0.0:1734016119.657051:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335312640:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016119.657074:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1734016119.657302:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115c84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016119.657318:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115c84 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016119.657325:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115c84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016119.657332:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbf180 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016119.657341:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115c84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016119.657352:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115c84 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016119.657379:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016119.657383:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016119.657390:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115c84 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016119.657395:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115c84 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016119.660745:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.660877:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.660985:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333765504 00000100:00100000:0.0:1734016119.660998:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333765504 00010000:00010000:0.0:1734016119.661052:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115c76 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d8f expref: 9 pid: 8216 timeout: 486 lvb_type: 1 00000100:00100000:0.0:1734016119.661091:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333765376 00000100:00100000:0.0:1734016119.661094:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333765376 00010000:00010000:0.0:1734016119.661105:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27115c7d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d96 expref: 9 pid: 7684 timeout: 486 lvb_type: 1 00000100:00100000:0.0:1734016119.661137:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3062 00000100:00100000:0.0:1734016119.661145:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333765504:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016119.661166:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016119.661197:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115c76 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d8f expref: 9 pid: 8216 timeout: 486 lvb_type: 1 00010000:00010000:0.0:1734016119.661209:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115c76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d8f expref: 9 pid: 8216 timeout: 486 lvb_type: 1 00010000:00010000:0.0:1734016119.661250:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016119.661308:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333765504:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 162us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016119.661318:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3062 00000100:00100000:0.0:1734016119.661341:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3063 00000100:00100000:0.0:1734016119.661345:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333765376:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016119.661354:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016119.661361:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27115c7d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d96 expref: 9 pid: 7684 timeout: 486 lvb_type: 1 00010000:00010000:0.0:1734016119.661372:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27115c7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d96 expref: 9 pid: 7684 timeout: 486 lvb_type: 1 00010000:00010000:0.0:1734016119.661388:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016119.661390:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016119.661397:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115c8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d9d expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.661409:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115c8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d9d expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.661459:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115c8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d9d expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016119.661478:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335312768:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016119.661522:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee480 going to sleep for 11 seconds 00010000:00010000:0.0:1734016119.661571:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc27115c7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d96 expref: 9 pid: 7684 timeout: 486 lvb_type: 1 00000100:00100000:0.0:1734016119.661600:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335312512:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016119.661612:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27115c76 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d8f expref: 8 pid: 8216 timeout: 486 lvb_type: 1 00000100:00100000:0.0:1734016119.661621:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335312640:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016119.661651:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115c8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d9d expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.661661:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580900, rc 0) 00000100:00100000:0.0:1734016119.661686:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:9668:x1818247333765248:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5048us (5302us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016119.661694:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11033 00000100:00100000:2.0:1734016119.665526:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.666307:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335312768:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016119.666351:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016119.666441:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333765376:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5091us (5561us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016119.666456:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3063 00000100:00100000:3.0:1734016119.669159:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333765632 00000100:00100000:3.0:1734016119.669187:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333765632 00002000:00010000:3.0:1734016119.669266:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (7974403->18446744073709551615) 00002000:00100000:3.0:1734016119.669272:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073793b80 with x1818247333765632 ext(7974403->18446744073709551615) 00002000:00010000:3.0:1734016119.669289:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073793b80. 00000100:00100000:3.0:1734016119.669339:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8703 00000100:00100000:3.0:1734016119.669353:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333765632:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016119.669702:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 3552348 -> 7974403 00002000:00010000:3.0:1734016119.669707:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016119 -> 1734016120 00002000:00010000:3.0:1734016119.669709:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016119 -> 1734016119 00002000:00010000:3.0:1734016119.669711:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016119 -> 1734016120 00002000:00010000:3.0:1734016119.669713:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 800 -> 800 00000100:00100000:3.0:1734016119.669821:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333765632:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 471us (4319us total) trans 4294969450 rc 0/0 00000100:00100000:3.0:1734016119.669831:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8703 00002000:00010000:3.0:1734016119.669835:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (7974403->18446744073709551615) 00002000:00100000:3.0:1734016119.669838:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073793b80 with x1818247333765632 ext(7974403->18446744073709551615) 00002000:00010000:3.0:1734016119.669842:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073793b80. 00000100:00100000:2.0:1734016119.676746:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016119.677034:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333765888 00000100:00100000:1.0:1734016119.677048:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333765888 00002000:00100000:1.0:1734016119.677119:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7970816->7974911) req@ffff880073790e00 x1818247333765888/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016119.677132:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790e00 with x1818247333765888 ext(7970816->7974911) 00002000:00010000:1.0:1734016119.677139:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073790e00 00000100:00100000:1.0:1734016119.677187:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8704 00000100:00100000:1.0:1734016119.677197:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333765888:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016119.677481:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333765888:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 283us (753us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016119.677490:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8704 00002000:00100000:1.0:1734016119.677497:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7970816->7974911) req@ffff880073790e00 x1818247333765888/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016119.677505:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790e00 with x1818247333765888 ext(7970816->7974911) 00002000:00010000:1.0:1734016119.677508:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073790e00 00000100:00100000:1.0:1734016119.681248:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.682257:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333766144 00000100:00100000:3.0:1734016119.682277:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333766144 00002000:00100000:3.0:1734016119.682358:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7966720->7970815) req@ffff88008719dc00 x1818247333766144/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016119.682371:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719dc00 with x1818247333766144 ext(7966720->7970815) 00002000:00010000:3.0:1734016119.682380:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719dc00 00000100:00100000:3.0:1734016119.682422:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8705 00000100:00100000:3.0:1734016119.682432:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333766144:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016119.683426:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333766144:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 990us (2201us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016119.683438:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8705 00002000:00100000:3.0:1734016119.683447:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7966720->7970815) req@ffff88008719dc00 x1818247333766144/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016119.683456:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719dc00 with x1818247333766144 ext(7966720->7970815) 00002000:00010000:3.0:1734016119.683460:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719dc00 00000100:00100000:1.0:1734016119.688543:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.688936:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333766400 00000100:00100000:3.0:1734016119.688948:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333766400 00002000:00100000:3.0:1734016119.689002:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7962624->7966719) req@ffff88008719e300 x1818247333766400/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016119.689013:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719e300 with x1818247333766400 ext(7962624->7966719) 00002000:00010000:3.0:1734016119.689021:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719e300 00000100:00100000:3.0:1734016119.689060:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8706 00000100:00100000:3.0:1734016119.689070:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333766400:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016119.689323:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333766400:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 254us (793us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016119.689332:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8706 00002000:00100000:3.0:1734016119.689338:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7962624->7966719) req@ffff88008719e300 x1818247333766400/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016119.689345:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719e300 with x1818247333766400 ext(7962624->7966719) 00002000:00010000:3.0:1734016119.689348:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719e300 00000100:00100000:2.0:1734016119.693974:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016119.694191:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333766656 00000100:00100000:1.0:1734016119.694204:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333766656 00002000:00100000:1.0:1734016119.694265:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7958528->7962623) req@ffff8800755b4a80 x1818247333766656/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016119.694278:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4a80 with x1818247333766656 ext(7958528->7962623) 00002000:00010000:1.0:1734016119.694285:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4a80 00000100:00100000:1.0:1734016119.694332:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8707 00000100:00100000:1.0:1734016119.694342:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333766656:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016119.694606:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333766656:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 263us (645us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016119.694614:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8707 00002000:00100000:1.0:1734016119.694621:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7958528->7962623) req@ffff8800755b4a80 x1818247333766656/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016119.694628:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4a80 with x1818247333766656 ext(7958528->7962623) 00002000:00010000:1.0:1734016119.694632:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4a80 00000100:00100000:0.0:1734016119.696982:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016119.697143:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333766912 00000100:00100000:3.0:1734016119.697156:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333766912 00002000:00100000:3.0:1734016119.697218:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7954432->7958527) req@ffff880075445880 x1818247333766912/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016119.697230:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075445880 with x1818247333766912 ext(7954432->7958527) 00002000:00010000:3.0:1734016119.697237:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075445880 00000100:00100000:3.0:1734016119.697379:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8708 00000100:00100000:3.0:1734016119.697388:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333766912:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016119.697656:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333766912:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 267us (689us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016119.697665:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8708 00002000:00100000:3.0:1734016119.697672:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (7954432->7958527) req@ffff880075445880 x1818247333766912/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/4536 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016119.697680:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075445880 with x1818247333766912 ext(7954432->7958527) 00002000:00010000:3.0:1734016119.697682:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075445880 00000100:00100000:0.0:1734016119.702192:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016119.702463:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333767040 00000100:00100000:1.0:1734016119.702482:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333767040 00002000:00100000:1.0:1734016119.702573:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7954432->7974402) req@ffff880075444a80 x1818247333767040/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016119.702591:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075444a80 with x1818247333767040 ext(7954432->7974402) 00002000:00010000:1.0:1734016119.702600:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075444a80 00000100:00100000:1.0:1734016119.702658:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8709 00000100:00100000:1.0:1734016119.702671:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333767040:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016119.707670:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333767040:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4987us (5486us total) trans 4294969451 rc 0/0 00000100:00100000:1.0:1734016119.707687:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8709 00002000:00100000:1.0:1734016119.707704:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (7954432->7974402) req@ffff880075444a80 x1818247333767040/t4294969451(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:80/0 lens 488/448 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016119.707716:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075444a80 with x1818247333767040 ext(7954432->7974402) 00002000:00010000:1.0:1734016119.707726:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075444a80 00000100:00100000:0.0:1734016119.710018:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.711152:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333767168 00000100:00100000:2.0:1734016119.711172:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333767168 00000100:00100000:2.0:1734016119.711295:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2219 00000100:00100000:2.0:1734016119.711307:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:9668:x1818247333767168:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:2.0:1734016119.712905:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:9668:x1818247333767168:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 1573us (2872us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016119.712924:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2219 00000100:00100000:0.0:1734016119.715737:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.715887:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333767296 00000100:00100000:2.0:1734016119.715910:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333767296 00000100:00100000:2.0:1734016119.716533:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11034 00000100:00100000:2.0:1734016119.716542:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333767296:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016119.718526:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969451 is committed 00000001:00080000:0.0:1734016119.718579:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969449 is committed 00000100:00100000:2.0:1734016119.718988:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333767296:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2440us (3266us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016119.719000:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11034 00000100:00100000:3.0:1734016119.723231:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.723311:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333767424 00000100:00100000:0.0:1734016119.723324:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333767424 00000100:00100000:0.0:1734016119.723396:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2220 00000100:00100000:0.0:1734016119.723404:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333767424:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016119.723434:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016119.723459:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27115c92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5da4 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.723564:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27115c99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016119.723580:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27115c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016119.723592:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27115c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:0.0:1734016119.723618:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 7974403 00000004:00200000:0.0:1734016119.723623:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016119.723643:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27115c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016119.723667:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581d40/0x5e3a3adc27115c92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5da4 expref: 22 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.724238:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27115c99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5da4 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.724247:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:0.0:1734016119.724249:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016119.724253:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:0.0:1734016119.724306:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+21:9668:x1818247333767424:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 903us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016119.724313:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2220 00000100:00100000:0.0:1734016119.731980:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.732093:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333767552 00000100:00100000:2.0:1734016119.732114:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333767552 00000100:00100000:2.0:1734016119.732214:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11035 00000100:00100000:2.0:1734016119.732226:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333767552:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016119.732261:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016119.732296:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115ca0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5dab expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016119.732396:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335312896:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016119.732496:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ee40 going to sleep for 11 seconds 00002000:00010000:2.0:1734016119.739996:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016119 -> 1734016120 00002000:00010000:2.0:1734016119.740014:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 800 -> 840 00000100:00100000:2.0:1734016119.740048:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335312896:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016119.740103:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115ca0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dab expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.740121:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115ca0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dab expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.741537:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016119.741641:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333767552:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9406us (9664us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016119.741654:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11035 00000100:00100000:3.0:1734016119.746054:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.746397:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333767680 00000100:00100000:2.0:1734016119.746411:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333767680 00000100:00100000:2.0:1734016119.747045:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11036 00000100:00100000:2.0:1734016119.747055:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333767680:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016119.747083:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016119.747104:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115ca7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5db2 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016119.747178:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335313024:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016119.747249:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016119.749546:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335313024:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016119.749592:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115ca7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5db2 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.749610:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115ca7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5db2 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.749869:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016119.749982:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333767680:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2925us (3941us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016119.749996:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11036 00000100:00100000:0.0:1734016119.754961:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.755092:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333767808 00000100:00100000:2.0:1734016119.755107:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333767808 00000100:00100000:2.0:1734016119.755377:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11037 00000100:00100000:2.0:1734016119.755388:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333767808:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016119.755420:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016119.755454:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115cae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5db9 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016119.755554:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335313152:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016119.756024:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016119.759940:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335313152:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016119.760001:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115cae lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5db9 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.760022:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27115cae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5db9 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.760052:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016119.760154:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333767808:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4767us (5212us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016119.760168:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11037 00000100:00100000:1.0:1734016119.762712:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.762837:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333768064 00000100:00100000:2.0:1734016119.762846:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333768064 00000100:00100000:2.0:1734016119.762929:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8710 00000100:00100000:2.0:1734016119.762938:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333768064:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:2.0:1734016119.762988:0:13914:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115cb5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.763016:0:13914:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115c8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d9d expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.763024:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016119.763026:0:13914:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016119.763029:0:13914:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115cb5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7368704->7417855] (req 7368704->7417855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.763070:0:13914:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115c8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d9d expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.763086:0:13914:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115c8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d9d expref: 5 pid: 8216 timeout: 486 lvb_type: 0 00000100:00100000:2.0:1734016119.763101:0:13914:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335313280:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016119.763182:0:13914:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016119.767481:0:13914:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13914:1818247335313280:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016119.767522:0:13914:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115cb5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7368704->7417855] (req 7368704->7417855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016119.768115:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.768354:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333768192 00000100:00100000:0.0:1734016119.768366:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333768192 00010000:00010000:0.0:1734016119.768414:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115c8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d9d expref: 6 pid: 8216 timeout: 486 lvb_type: 0 00000100:00100000:0.0:1734016119.768463:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3064 00000100:00100000:0.0:1734016119.768472:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5225c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333768192:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016119.768492:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016119.768523:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115c8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d9d expref: 6 pid: 8216 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1734016119.768535:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115c8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d9d expref: 6 pid: 8216 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1734016119.768569:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc27115c8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5d9d expref: 6 pid: 8216 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1734016119.768589:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016119.768591:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016119.768597:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115cb5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7368704->7417855] (req 7368704->7417855) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.768608:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115cb5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [7368704->7417855] (req 7368704->7417855) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.768654:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016119.768716:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5225c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333768192:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 245us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016119.768726:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3064 00010000:00010000:3.0:1734016119.769166:0:13914:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115cb5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7368704->7417855] (req 7368704->7417855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.769180:0:13914:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115cb5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7368704->7417855] (req 7368704->7417855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.773666:0:13914:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115cb5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7368704->7417855] (req 7368704->7417855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.773693:0:13914:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115cb5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7368704->7417855] (req 7368704->7417855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.773704:0:13914:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115cb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7368704->7417855] (req 7368704->7417855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.773713:0:13914:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc480 already unused, calling callback (ffffffffa080e100) 00010000:00010000:3.0:1734016119.773718:0:13914:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115cb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7368704->7417855] (req 7368704->7417855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.773729:0:13914:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115cb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7368704->7417855] (req 7368704->7417855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.773761:0:13914:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115cb5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7368704->7417855] (req 7368704->7417855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016119.773768:0:13914:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27115cb5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [7368704->7417855] (req 7368704->7417855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13914 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016119.775115:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333768064:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 12159us (12396us total) trans 0 rc 49152/49152 00000100:00100000:3.0:1734016119.775137:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8710 00000100:00100000:1.0:1734016119.778406:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.778513:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333768320 00000100:00100000:2.0:1734016119.778525:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333768320 00000100:00100000:2.0:1734016119.779191:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11038 00000100:00100000:2.0:1734016119.779202:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333768320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016119.779226:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016119.779256:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115cbc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5dc0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1734016119.779282:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 7974403, mtime: 0x675afc78, atime: 0x675afc77, ctime: 0x675afc78, blocks: 0x348 00010000:00010000:2.0:1734016119.779306:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016119.779309:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016119.779318:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115cbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dc0 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.779335:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115cbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dc0 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.779349:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016119.779416:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333768320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 215us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016119.779424:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11038 00000100:00100000:0.0:1734016119.804158:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.804258:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.804427:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333768576 00000100:00100000:2.0:1734016119.804445:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333768576 00002000:00100000:2.0:1734016119.804538:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff880073ad5500 x1818247333768576/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.804553:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5500 with x1818247333768576 ext(0->4194303) 00002000:00010000:2.0:1734016119.804562:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5500 00000100:00100000:2.0:1734016119.804600:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333768832 00000100:00100000:2.0:1734016119.804603:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333768832 00002000:00100000:2.0:1734016119.804616:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (4194304->7974911) req@ffff880073ad6a00 x1818247333768832/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:80/0 lens 488/0 e 0 to 0 dl 1734016130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.804626:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad6a00 with x1818247333768832 ext(4194304->7974911) 00002000:00010000:2.0:1734016119.804629:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad6a00 00000100:00100000:2.0:1734016119.804647:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8711 00000100:00100000:2.0:1734016119.804654:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333768576:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016119.805120:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8712 00000100:00100000:3.0:1734016119.805129:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333768832:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016119.886644:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333768576:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 81970us (82498us total) trans 0 rc 4194304/4194304 00000100:00100000:2.0:1734016119.886663:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8711 00002000:00100000:2.0:1734016119.886681:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff880073ad5500 x1818247333768576/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:80/0 lens 488/440 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.886694:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5500 with x1818247333768576 ext(0->4194303) 00002000:00010000:2.0:1734016119.886703:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5500 00000100:00100000:2.0:1734016119.923857:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333768832:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 118670us (119541us total) trans 0 rc 3780608/3780608 00000100:00100000:2.0:1734016119.923885:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8712 00002000:00100000:2.0:1734016119.923919:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (4194304->7974911) req@ffff880073ad6a00 x1818247333768832/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:80/0 lens 488/440 e 0 to 0 dl 1734016130 ref 1 fl Complete:/200/0 rc 3780608/3780608 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016119.923932:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad6a00 with x1818247333768832 ext(4194304->7974911) 00002000:00010000:2.0:1734016119.923941:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad6a00 00000100:00100000:3.0:1734016119.925850:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.927375:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333768960 00000100:00100000:2.0:1734016119.927399:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333768960 00000100:00100000:2.0:1734016119.927482:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2221 00000100:00100000:2.0:1734016119.927493:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:9668:x1818247333768960:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016119.927525:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016119.927557:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115cc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5dc7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.927701:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115cca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016119.927723:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115cca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016119.927738:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115cca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016119.927779:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 7974403 00000004:00200000:2.0:1734016119.927785:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016119.927827:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115cca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016119.927853:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115cc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dc7 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.930153:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115cca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dc7 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.930179:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016119.930182:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016119.930188:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016119.930873:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:9668:x1818247333768960:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3377us (5030us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016119.930897:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2221 00000100:00100000:1.0:1734016119.940150:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.940301:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333769088 00000100:00100000:2.0:1734016119.940318:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333769088 00000100:00100000:2.0:1734016119.940733:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11039 00000100:00100000:2.0:1734016119.940747:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333769088:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016119.940785:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016119.940858:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115cd1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5dce expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.940905:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016119.940907:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016119.940916:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115cd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dce expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.940938:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115cd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dce expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.940956:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016119.941331:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333769088:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 586us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016119.941343:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11039 00000100:00100000:0.0:1734016119.948295:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.948463:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333769216 00000100:00100000:2.0:1734016119.948481:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333769216 00000100:00100000:2.0:1734016119.948559:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11040 00000100:00100000:2.0:1734016119.948570:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333769216:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016119.948613:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016119.948646:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115cd8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5dd5 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.948700:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115cbc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dc0 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.948718:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115cd1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dce expref: 5 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.948725:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016119.948728:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016119.948732:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115cd8 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1961984->2027519] (req 1961984->2027519) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dd5 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.948780:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115cd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dce expref: 5 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.948794:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115cd1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dce expref: 5 pid: 7684 timeout: 487 lvb_type: 1 00000100:00100000:2.0:1734016119.948852:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335313408:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016119.948970:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115cbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dc0 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.948979:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115cbc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dc0 expref: 8 pid: 8216 timeout: 487 lvb_type: 1 00000100:00100000:2.0:1734016119.948990:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335313536:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016119.949013:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016119.953278:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335313408:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016119.953301:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335313536:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016119.953340:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115cd8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1961984->2027519] (req 1961984->2027519) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dd5 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016119.953364:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016119.961334:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:9668:x1818247333769216:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12735us (13034us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016119.961357:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11040 00000100:00100000:0.0:1734016119.961961:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.962091:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016119.962126:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333769472 00000100:00100000:0.0:1734016119.962142:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333769472 00010000:00010000:0.0:1734016119.962192:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115cbc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dc0 expref: 8 pid: 8216 timeout: 487 lvb_type: 1 00000100:00100000:0.0:1734016119.962223:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333769344 00000100:00100000:0.0:1734016119.962225:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333769344 00010000:00010000:0.0:1734016119.962234:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115cd1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dce expref: 6 pid: 7684 timeout: 487 lvb_type: 1 00000100:00100000:0.0:1734016119.962253:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3065 00000100:00100000:0.0:1734016119.962261:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333769472:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016119.962279:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016119.962311:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115cbc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dc0 expref: 8 pid: 8216 timeout: 487 lvb_type: 1 00010000:00010000:0.0:1734016119.962326:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115cbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dc0 expref: 8 pid: 8216 timeout: 487 lvb_type: 1 00010000:00010000:0.0:1734016119.962357:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115cbc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dc0 expref: 8 pid: 8216 timeout: 487 lvb_type: 1 00010000:00010000:0.0:1734016119.962381:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016119.962447:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333769472:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 186us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016119.962454:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3065 00000100:00100000:0.0:1734016119.962470:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3066 00000100:00100000:0.0:1734016119.962473:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333769344:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016119.962481:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016119.962488:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115cd1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dce expref: 6 pid: 7684 timeout: 487 lvb_type: 1 00010000:00010000:0.0:1734016119.962498:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115cd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dce expref: 6 pid: 7684 timeout: 487 lvb_type: 1 00010000:00010000:0.0:1734016119.962510:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115cd1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dce expref: 6 pid: 7684 timeout: 487 lvb_type: 1 00010000:00010000:0.0:1734016119.962518:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016119.962520:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016119.962529:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115cd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2027519) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dd5 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.962539:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115cd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2027519) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dd5 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016119.962582:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115cd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2027519) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dd5 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016119.962595:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335313664:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016119.962633:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800759ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016119.977041:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.977326:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335313664:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016119.977362:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016119.977429:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333769344:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 14952us (15336us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016119.977448:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3066 00000100:00100000:3.0:1734016119.979633:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333769600 00000100:00100000:3.0:1734016119.979654:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333769600 00000100:00100000:0.0:1734016119.981209:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11041 00000100:00100000:0.0:1734016119.981228:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333769600:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016119.981678:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7974403 -> 7974403 00002000:00010000:0.0:1734016119.981681:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016120 -> 1734016120 00002000:00010000:0.0:1734016119.981684:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016119 -> 1734016119 00002000:00010000:0.0:1734016119.981687:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016120 -> 1734016119 00002000:00010000:0.0:1734016119.981689:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 840 -> 968 00000100:00100000:0.0:1734016119.983554:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333769600:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 2311us (6515us total) trans 4294969452 rc 0/0 00000100:00100000:0.0:1734016119.983573:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11041 00000100:00100000:0.0:1734016119.988280:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016119.990191:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333769728 00000100:00100000:2.0:1734016119.990212:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333769728 00000100:00100000:2.0:1734016119.990306:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11042 00000100:00100000:2.0:1734016119.990316:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333769728:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016119.990348:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016119.990380:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115cdf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ddc expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016119.990472:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335313792:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016119.991042:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ec00 going to sleep for 11 seconds 00002000:00010000:2.0:1734016119.993869:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime: 1734016119 -> 1734016120 00002000:00010000:2.0:1734016119.993882:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016119 -> 1734016120 00000100:00100000:2.0:1734016119.993930:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335313792:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016119.993987:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115cdf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ddc expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.994006:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27115cdf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ddc expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016119.994039:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016119.994130:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333769728:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3812us (5868us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016119.997585:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11042 00000100:00100000:0.0:1734016120.000103:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.000260:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333769856 00000100:00100000:3.0:1734016120.000272:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333769856 00000100:00100000:3.0:1734016120.000326:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11043 00000100:00100000:3.0:1734016120.000335:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333769856:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016120.000359:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016120.000382:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115ce6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5de3 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016120.000462:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335313920:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016120.000545:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016120.002358:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335313920:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016120.002406:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115ce6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5de3 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.002421:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115ce6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5de3 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.002452:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016120.002939:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333769856:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2603us (2848us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016120.002952:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11043 00000100:00100000:1.0:1734016120.005991:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.006213:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333769984 00000100:00100000:3.0:1734016120.006228:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333769984 00000100:00080000:0.0:1734016120.007223:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016090 00000100:00100000:3.0:1734016120.007863:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11044 00000100:00100000:3.0:1734016120.008024:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333769984:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016120.008053:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016120.008076:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115ced lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5dea expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016120.008152:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335314048:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016120.008675:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016120.012279:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335314048:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016120.012339:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115ced lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dea expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.012356:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27115ced lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dea expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.012392:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016120.012453:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333769984:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4431us (6476us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016120.012463:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11044 00000100:00100000:2.0:1734016120.015129:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.015317:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333770112 00000100:00100000:3.0:1734016120.015330:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333770112 00000100:00100000:3.0:1734016120.015540:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11045 00000100:00100000:3.0:1734016120.015550:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333770112:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016120.015574:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016120.015594:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115cf4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5df1 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.015636:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115cd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2027519) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dd5 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.015644:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016120.015646:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016120.015650:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115cf4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5df1 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.015693:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115cd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2027519) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dd5 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.015706:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115cd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2027519) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dd5 expref: 7 pid: 7684 timeout: 487 lvb_type: 0 00000100:00100000:3.0:1734016120.015719:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335314176:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016120.015819:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016120.019354:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335314176:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016120.019394:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115cf4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5df1 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.019418:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016120.019485:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333770112:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3934us (4368us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016120.019497:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11045 00000100:00100000:1.0:1734016120.019785:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.020244:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333770240 00000100:00100000:3.0:1734016120.020253:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333770240 00010000:00010000:3.0:1734016120.020287:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115cd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2027519) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dd5 expref: 8 pid: 7684 timeout: 487 lvb_type: 0 00000100:00100000:3.0:1734016120.020565:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3067 00000100:00100000:3.0:1734016120.020574:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333770240:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016120.020591:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016120.020618:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115cd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1961984->2027519) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dd5 expref: 8 pid: 7684 timeout: 487 lvb_type: 0 00010000:00010000:3.0:1734016120.020632:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115cd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1961984->2027519) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dd5 expref: 8 pid: 7684 timeout: 487 lvb_type: 0 00010000:00010000:3.0:1734016120.020661:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115cd8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1961984->2027519) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dd5 expref: 8 pid: 7684 timeout: 487 lvb_type: 0 00010000:00010000:3.0:1734016120.020689:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016120.020691:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016120.020698:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115cf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 385024->389119) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5df1 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.020710:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115cf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 385024->389119) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5df1 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.020749:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115cf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5df1 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016120.020763:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78ce300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335314304:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016120.020843:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016120.025249:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78ce300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335314304:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016120.025287:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016120.026216:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016120.026327:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333770496 00000100:00100000:0.0:1734016120.026336:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333770496 00002000:00100000:0.0:1734016120.026413:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (385024->389119) req@ffff880073ad5f80 x1818247333770496/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016120.026431:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5f80 with x1818247333770496 ext(385024->389119) 00002000:00010000:0.0:1734016120.026437:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5f80 00000100:00100000:0.0:1734016120.026463:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8713 00000100:00100000:0.0:1734016120.026473:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333770496:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016120.026730:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333770496:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 259us (521us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016120.026737:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8713 00002000:00100000:0.0:1734016120.026744:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (385024->389119) req@ffff880073ad5f80 x1818247333770496/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016120.026750:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5f80 with x1818247333770496 ext(385024->389119) 00002000:00010000:0.0:1734016120.026752:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5f80 00000100:00100000:3.0:1734016120.027731:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333770240:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7146us (7936us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016120.027748:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3067 00000100:00100000:0.0:1734016120.031739:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.032001:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333770752 00000100:00100000:2.0:1734016120.032014:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333770752 00002000:00100000:2.0:1734016120.032075:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (380928->385023) req@ffff880073ad4700 x1818247333770752/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016120.032087:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4700 with x1818247333770752 ext(380928->385023) 00002000:00010000:2.0:1734016120.032094:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4700 00000100:00100000:2.0:1734016120.032123:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8714 00000100:00100000:2.0:1734016120.032131:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333770752:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016120.033268:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333770752:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1130us (1543us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016120.033282:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8714 00002000:00100000:2.0:1734016120.033295:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (380928->385023) req@ffff880073ad4700 x1818247333770752/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016120.033311:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4700 with x1818247333770752 ext(380928->385023) 00002000:00010000:2.0:1734016120.033315:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4700 00000100:00100000:1.0:1734016120.038053:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.038259:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333771008 00000100:00100000:2.0:1734016120.038276:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333771008 00002000:00100000:2.0:1734016120.038349:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (376832->380927) req@ffff88008719f800 x1818247333771008/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016120.038364:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719f800 with x1818247333771008 ext(376832->380927) 00002000:00010000:2.0:1734016120.038372:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719f800 00000100:00100000:2.0:1734016120.038577:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8715 00000100:00100000:2.0:1734016120.038587:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333771008:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016120.038878:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333771008:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 291us (846us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016120.039268:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8715 00002000:00100000:2.0:1734016120.039276:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (376832->380927) req@ffff88008719f800 x1818247333771008/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016120.039284:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719f800 with x1818247333771008 ext(376832->380927) 00002000:00010000:2.0:1734016120.039287:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719f800 00000100:00100000:3.0:1734016120.043140:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.043327:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333771264 00000100:00100000:2.0:1734016120.043342:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333771264 00002000:00100000:2.0:1734016120.043420:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (372736->376831) req@ffff8800a78ce300 x1818247333771264/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016120.043435:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78ce300 with x1818247333771264 ext(372736->376831) 00002000:00010000:2.0:1734016120.043444:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78ce300 00000100:00100000:2.0:1734016120.043647:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8716 00000100:00100000:2.0:1734016120.043660:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333771264:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016120.043965:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333771264:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 308us (845us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016120.043972:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8716 00002000:00100000:2.0:1734016120.043978:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (372736->376831) req@ffff8800a78ce300 x1818247333771264/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016120.043984:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78ce300 with x1818247333771264 ext(372736->376831) 00002000:00010000:2.0:1734016120.043987:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78ce300 00000100:00100000:1.0:1734016120.046901:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016120.047248:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333771520 00000100:00100000:0.0:1734016120.047266:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333771520 00002000:00100000:0.0:1734016120.047342:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (368640->372735) req@ffff88012b15d500 x1818247333771520/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016120.047354:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15d500 with x1818247333771520 ext(368640->372735) 00002000:00010000:0.0:1734016120.047362:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15d500 00000100:00100000:0.0:1734016120.047413:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8717 00000100:00100000:0.0:1734016120.047422:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333771520:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016120.047699:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333771520:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 277us (822us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016120.047708:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8717 00002000:00100000:0.0:1734016120.047715:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (368640->372735) req@ffff88012b15d500 x1818247333771520/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016120.047722:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15d500 with x1818247333771520 ext(368640->372735) 00002000:00010000:0.0:1734016120.047725:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15d500 00000100:00100000:1.0:1734016120.057743:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.058126:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333771776 00000100:00100000:2.0:1734016120.058139:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333771776 00002000:00100000:3.0:1734016120.059218:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (364544->368639) req@ffff88012b15df80 x1818247333771776/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016120.059233:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15df80 with x1818247333771776 ext(364544->368639) 00002000:00010000:3.0:1734016120.059256:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15df80 00000100:00100000:3.0:1734016120.059356:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8718 00000100:00100000:3.0:1734016120.059382:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333771776:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016120.059987:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333771776:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 620us (2269us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016120.059996:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8718 00002000:00100000:3.0:1734016120.060011:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (364544->368639) req@ffff88012b15df80 x1818247333771776/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016120.060019:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15df80 with x1818247333771776 ext(364544->368639) 00002000:00010000:3.0:1734016120.060023:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15df80 00000100:00100000:3.0:1734016120.065230:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016120.065361:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333772032 00000100:00100000:0.0:1734016120.065378:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333772032 00002000:00100000:0.0:1734016120.065449:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (360448->364543) req@ffff8800a78cf800 x1818247333772032/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016120.065460:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cf800 with x1818247333772032 ext(360448->364543) 00002000:00010000:0.0:1734016120.065467:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cf800 00000100:00100000:0.0:1734016120.065512:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8719 00000100:00100000:0.0:1734016120.065521:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333772032:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016120.065882:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333772032:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 359us (666us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016120.065901:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8719 00002000:00100000:0.0:1734016120.065910:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (360448->364543) req@ffff8800a78cf800 x1818247333772032/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016120.065918:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cf800 with x1818247333772032 ext(360448->364543) 00002000:00010000:0.0:1734016120.065922:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cf800 00000100:00100000:1.0:1734016120.072116:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.072841:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333772288 00000100:00100000:3.0:1734016120.072854:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333772288 00002000:00100000:3.0:1734016120.072928:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (356352->360447) req@ffff88012b15c380 x1818247333772288/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016120.072940:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15c380 with x1818247333772288 ext(356352->360447) 00002000:00010000:3.0:1734016120.072947:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15c380 00000100:00100000:3.0:1734016120.072984:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8720 00000100:00100000:3.0:1734016120.072994:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333772288:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016120.073290:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333772288:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 296us (1191us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016120.073301:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8720 00002000:00100000:3.0:1734016120.073307:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (356352->360447) req@ffff88012b15c380 x1818247333772288/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016120.073315:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15c380 with x1818247333772288 ext(356352->360447) 00002000:00010000:3.0:1734016120.073318:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15c380 00000100:00100000:1.0:1734016120.077101:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016120.077196:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333772416 00000100:00100000:0.0:1734016120.077212:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333772416 00002000:00100000:0.0:1734016120.077278:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (356352->389119) req@ffff88012b15dc00 x1818247333772416/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016120.077291:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15dc00 with x1818247333772416 ext(356352->389119) 00002000:00010000:0.0:1734016120.077297:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15dc00 00000100:00100000:0.0:1734016120.077345:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8721 00000100:00100000:0.0:1734016120.077353:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333772416:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016120.081535:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333772416:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4158us (4427us total) trans 4294969453 rc 0/0 00000100:00100000:0.0:1734016120.081556:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8721 00002000:00100000:0.0:1734016120.081579:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (356352->389119) req@ffff88012b15dc00 x1818247333772416/t4294969453(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/448 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016120.081593:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15dc00 with x1818247333772416 ext(356352->389119) 00002000:00010000:0.0:1734016120.081602:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15dc00 00000100:00100000:2.0:1734016120.084342:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.086025:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333772544 00000100:00100000:3.0:1734016120.086045:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333772544 00000100:00100000:3.0:1734016120.086132:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11046 00000100:00100000:3.0:1734016120.086144:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333772544:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:1.0:1734016120.088182:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969453 is committed 00000001:00080000:1.0:1734016120.088201:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969452 is committed 00000100:00100000:3.0:1734016120.089031:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333772544:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2883us (4702us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016120.089046:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11046 00000100:00100000:1.0:1734016120.091970:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.092857:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333772672 00000100:00100000:3.0:1734016120.092876:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333772672 00000100:00100000:3.0:1734016120.093484:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11047 00000100:00100000:3.0:1734016120.093500:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333772672:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016120.093528:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016120.093558:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115cfb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5df8 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016120.093667:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335314432:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016120.093893:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00002000:00010000:3.0:1734016120.096647:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 968 -> 1032 00000100:00100000:3.0:1734016120.096694:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335314432:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016120.096744:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115cfb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5df8 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.096760:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115cfb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5df8 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.096957:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016120.097026:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333772672:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3526us (5084us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016120.097037:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11047 00000100:00100000:2.0:1734016120.100710:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.101000:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333772800 00000100:00100000:3.0:1734016120.101015:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333772800 00000100:00100000:3.0:1734016120.101356:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11048 00000100:00100000:3.0:1734016120.101364:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333772800:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016120.101387:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016120.101413:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115d02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5dff expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016120.101505:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335314560:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016120.101595:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016120.103406:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335314560:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016120.103460:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115d02 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dff expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.103478:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27115d02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dff expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.104153:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:2.0:1734016120.104346:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333772800:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2976us (3650us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016120.104362:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11048 00000100:00100000:0.0:1734016120.107302:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.107472:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333772928 00000100:00100000:2.0:1734016120.107486:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333772928 00000100:00100000:2.0:1734016120.107597:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11049 00000100:00100000:2.0:1734016120.107611:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333772928:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016120.107642:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016120.107668:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115d09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e06 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016120.107748:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335314688:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016120.107863:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016120.110568:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335314688:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016120.110624:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115d09 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e06 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016120.110644:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115d09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e06 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016120.110681:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016120.110737:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333772928:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3129us (3447us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016120.110748:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11049 00000100:00100000:0.0:1734016120.113892:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.114317:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333773056 00000100:00100000:2.0:1734016120.114334:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333773056 00000100:00100000:2.0:1734016120.114404:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11050 00000100:00100000:2.0:1734016120.114413:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:9668:x1818247333773056:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016120.114441:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016120.114478:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115d10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e0d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.114528:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115cf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 385024->389119) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5df1 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.114537:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016120.114540:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016120.114545:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115d10 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e0d expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.114599:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115cf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 385024->389119) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5df1 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.114616:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115cf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 385024->389119) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5df1 expref: 5 pid: 8216 timeout: 487 lvb_type: 0 00000100:00100000:2.0:1734016120.114632:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335314816:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016120.114726:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0e480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016120.117458:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335314816:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016120.117513:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115d10 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e0d expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.117542:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016120.117617:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:9668:x1818247333773056:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3202us (3755us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016120.117631:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11050 00000100:00100000:0.0:1734016120.118141:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.118401:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333773184 00000100:00100000:3.0:1734016120.118412:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333773184 00010000:00010000:3.0:1734016120.118451:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115cf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5df1 expref: 6 pid: 8216 timeout: 487 lvb_type: 0 00000100:00100000:3.0:1734016120.118496:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3068 00000100:00100000:3.0:1734016120.118506:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333773184:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016120.118527:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016120.118556:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115cf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 385024->389119) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5df1 expref: 6 pid: 8216 timeout: 487 lvb_type: 0 00010000:00010000:3.0:1734016120.118570:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115cf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 385024->389119) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5df1 expref: 6 pid: 8216 timeout: 487 lvb_type: 0 00010000:00010000:3.0:1734016120.118612:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27115cf4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 385024->389119) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5df1 expref: 6 pid: 8216 timeout: 487 lvb_type: 0 00010000:00010000:3.0:1734016120.118636:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016120.118639:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016120.118648:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115d10 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e0d expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.118659:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115d10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e0d expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.118705:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115d10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e0d expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016120.118720:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335314944:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016120.118773:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016120.124286:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335314944:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016120.124319:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016120.124746:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333773184:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6238us (6603us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016120.124759:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3068 00000100:00100000:0.0:1734016120.124947:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.125110:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333773440 00000100:00100000:2.0:1734016120.125120:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333773440 00002000:00100000:2.0:1734016120.125167:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (344064->348159) req@ffff880073791500 x1818247333773440/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016120.125177:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073791500 with x1818247333773440 ext(344064->348159) 00002000:00010000:2.0:1734016120.125182:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073791500 00000100:00100000:2.0:1734016120.125492:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8722 00000100:00100000:2.0:1734016120.125500:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333773440:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016120.125674:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333773440:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 174us (728us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016120.125680:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8722 00002000:00100000:2.0:1734016120.125685:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (344064->348159) req@ffff880073791500 x1818247333773440/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016120.125692:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073791500 with x1818247333773440 ext(344064->348159) 00002000:00010000:2.0:1734016120.125695:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073791500 00000100:00100000:0.0:1734016120.128655:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.128760:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333773696 00000100:00100000:3.0:1734016120.128770:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333773696 00002000:00100000:3.0:1734016120.128840:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (339968->344063) req@ffff880073793800 x1818247333773696/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016120.128856:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073793800 with x1818247333773696 ext(339968->344063) 00002000:00010000:3.0:1734016120.128862:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073793800 00000100:00100000:3.0:1734016120.128901:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8723 00000100:00100000:3.0:1734016120.128908:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333773696:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016120.129414:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333773696:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 505us (770us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016120.129420:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8723 00002000:00100000:3.0:1734016120.129425:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (339968->344063) req@ffff880073793800 x1818247333773696/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016120.129432:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073793800 with x1818247333773696 ext(339968->344063) 00002000:00010000:3.0:1734016120.129434:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073793800 00000100:00100000:0.0:1734016120.132414:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.132645:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333773952 00000100:00100000:2.0:1734016120.132655:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333773952 00000100:00100000:2.0:1734016120.132742:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8724 00000100:00100000:2.0:1734016120.132751:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333773952:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:2.0:1734016120.132835:0:7689:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115d17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.132858:0:7689:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115d10 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e0d expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.132866:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016120.132869:0:7689:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016120.132873:0:7689:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115d17 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5869568->5898239] (req 5869568->5898239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.132934:0:7689:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115d10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e0d expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.132950:0:7689:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115d10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e0d expref: 7 pid: 8216 timeout: 487 lvb_type: 0 00000100:00100000:2.0:1734016120.132968:0:7689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335315072:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016120.133037:0:7689:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016120.135792:0:7689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:7689:1818247335315072:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016120.136486:0:7689:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115d17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5869568->5898239] (req 5869568->5898239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016120.139260:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.139873:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333774080 00000100:00100000:3.0:1734016120.139899:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333774080 00010000:00010000:3.0:1734016120.139963:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115d10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e0d expref: 8 pid: 8216 timeout: 487 lvb_type: 0 00000100:00100000:3.0:1734016120.140038:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3069 00000100:00100000:3.0:1734016120.140050:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333774080:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016120.140079:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016120.140111:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115d10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e0d expref: 8 pid: 8216 timeout: 487 lvb_type: 0 00010000:00010000:3.0:1734016120.140127:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115d10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e0d expref: 8 pid: 8216 timeout: 487 lvb_type: 0 00010000:00010000:3.0:1734016120.140162:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27115d10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e0d expref: 8 pid: 8216 timeout: 487 lvb_type: 0 00010000:00010000:3.0:1734016120.140204:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016120.140207:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016120.140212:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115d17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5869568->5898239] (req 5869568->5898239) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.140223:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115d17 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [5869568->5898239] (req 5869568->5898239) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.140262:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016120.140347:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333774080:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 298us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016120.140355:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3069 00010000:00010000:2.0:1734016120.140868:0:7689:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115d17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5869568->5898239] (req 5869568->5898239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.140899:0:7689:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115d17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5869568->5898239] (req 5869568->5898239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1734016120.152794:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969454 is committed 00002000:00010000:2.0:1734016120.153121:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1032 -> 1088 00010000:00010000:2.0:1734016120.153144:0:7689:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115d17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5869568->5898239] (req 5869568->5898239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.153161:0:7689:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115d17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5869568->5898239] (req 5869568->5898239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.153174:0:7689:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115d17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5869568->5898239] (req 5869568->5898239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.153182:0:7689:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd440 already unused, calling callback (ffffffffa080e100) 00010000:00010000:2.0:1734016120.153188:0:7689:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115d17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5869568->5898239] (req 5869568->5898239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.153210:0:7689:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115d17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5869568->5898239] (req 5869568->5898239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.153238:0:7689:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115d17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5869568->5898239] (req 5869568->5898239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.153244:0:7689:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd440/0x5e3a3adc27115d17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [5869568->5898239] (req 5869568->5898239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7689 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016120.156087:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333773952:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 23307us (23656us total) trans 4294969454 rc 0/0 00000100:00100000:2.0:1734016120.156116:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8724 00000100:00100000:0.0:1734016120.162262:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.162434:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333774208 00000100:00100000:2.0:1734016120.162455:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333774208 00000100:00100000:2.0:1734016120.162523:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11051 00000100:00100000:2.0:1734016120.162535:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333774208:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016120.162574:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016120.162614:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115d1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e14 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1734016120.162654:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 7974403, mtime: 0x675afc78, atime: 0x675afc78, ctime: 0x675afc78, blocks: 0x440 00010000:00010000:2.0:1734016120.162694:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016120.162697:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016120.162712:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115d1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e14 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016120.162745:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115d1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e14 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016120.162761:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016120.162920:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333774208:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 386us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016120.162930:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11051 00000100:00100000:0.0:1734016120.166233:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.166448:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333774464 00000100:00100000:2.0:1734016120.166460:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333774464 00000100:00100000:2.0:1734016120.166522:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2222 00000100:00100000:2.0:1734016120.166531:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:9668:x1818247333774464:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016120.166603:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016120.166646:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115cca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5dc7 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.167405:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016120.167410:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016120.167608:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115d25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016120.167623:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27115c99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5da4 expref: 20 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.167630:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115d25 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016120.167670:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27115c99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5da4 expref: 20 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.167685:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27115c99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5da4 expref: 20 pid: 6479 timeout: 487 lvb_type: 0 00000100:00100000:2.0:1734016120.167697:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335315200:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016120.168743:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016120.176615:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335315200:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016120.176656:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115d25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016120.177435:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.177911:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333774592 00000100:00100000:2.0:1734016120.177923:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333774592 00010000:00010000:2.0:1734016120.177979:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27115c99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5da4 expref: 21 pid: 6479 timeout: 487 lvb_type: 0 00000100:00100000:2.0:1734016120.178117:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3070 00000100:00100000:2.0:1734016120.178127:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+21:1982:x1818247333774592:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016120.178153:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016120.178162:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27115c99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5da4 expref: 21 pid: 6479 timeout: 487 lvb_type: 0 00010000:00010000:2.0:1734016120.178176:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27115c99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5da4 expref: 21 pid: 6479 timeout: 487 lvb_type: 0 00010000:00010000:2.0:1734016120.178209:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc27115c99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5da4 expref: 21 pid: 6479 timeout: 487 lvb_type: 0 00010000:00010000:2.0:1734016120.178292:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016120.178298:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115d25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016120.178310:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115d25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016120.178319:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115d25 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016120.178351:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016120.178533:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115d25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016120.178541:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115d25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:3.0:1734016120.178698:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968728 00000004:00010000:3.0:1734016120.178776:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075fc7b80 reply state ffff8800a7aca000 transno 4294968729 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115d25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016120.178785:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016120.179084:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:9668:x1818247333774464:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 12551us (12868us total) trans 4294968729 rc 0/0 00000100:00100000:3.0:1734016120.179095:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2222 00000020:00080000:3.0:1734016120.179103:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1734016120.180071:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+20:1982:x1818247333774592:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1936us (2629us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016120.180081:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3070 00000100:00100000:0.0:1734016120.181660:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1734016120.181749:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115d25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016120.181763:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115d25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016120.181775:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115d25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016120.181783:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd680 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016120.181790:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115d25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016120.181857:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115d25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016120.181895:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016120.181899:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016120.181904:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115d25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016120.181911:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115d25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:1.0:1734016120.183616:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333774720 00000100:00100000:1.0:1734016120.183643:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333774720 00000100:00100000:1.0:1734016120.183746:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11052 00000100:00100000:1.0:1734016120.183757:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:9668:x1818247333774720:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016120.183792:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016120.183839:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115d2c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e1b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016120.183895:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115d1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e14 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016120.183904:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016120.183906:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016120.183909:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115d2c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e1b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016120.183957:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115d1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e14 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016120.183974:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115d1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e14 expref: 6 pid: 8216 timeout: 487 lvb_type: 1 00000100:00100000:1.0:1734016120.183991:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335315328:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016120.184110:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016120.190074:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016120.190246:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335315328:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016120.190282:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115d2c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e1b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016120.190305:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d8c0, rc 0) 00000100:00100000:1.0:1734016120.190353:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:9668:x1818247333774720:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6599us (8705us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016120.190362:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11052 00000100:00100000:2.0:1734016120.190599:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333774848 00000100:00100000:2.0:1734016120.190610:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333774848 00010000:00010000:2.0:1734016120.190642:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115d1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e14 expref: 7 pid: 8216 timeout: 487 lvb_type: 1 00000100:00100000:2.0:1734016120.190999:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3071 00000100:00100000:2.0:1734016120.191007:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5226050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333774848:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016120.191026:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016120.191059:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115d1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e14 expref: 7 pid: 8216 timeout: 487 lvb_type: 1 00010000:00010000:2.0:1734016120.191073:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115d1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e14 expref: 7 pid: 8216 timeout: 487 lvb_type: 1 00010000:00010000:2.0:1734016120.191104:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115d1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e14 expref: 7 pid: 8216 timeout: 487 lvb_type: 1 00010000:00010000:2.0:1734016120.191140:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016120.191142:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016120.191150:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115d2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e1b expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.191159:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115d2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e1b expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016120.191201:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d8c0/0x5e3a3adc27115d2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e1b expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016120.191217:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335315456:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016120.191272:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016120.193599:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335315456:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016120.193625:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016120.193666:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5226050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333774848:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 2659us (3605us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016120.193677:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3071 00000100:00100000:0.0:1734016120.194043:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.194302:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333774976 00000100:00100000:3.0:1734016120.194311:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333774976 00002000:00010000:3.0:1734016120.194347:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6390889->18446744073709551615) 00002000:00100000:3.0:1734016120.194353:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7480 with x1818247333774976 ext(6390889->18446744073709551615) 00002000:00010000:3.0:1734016120.194367:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc7480. 00000100:00100000:3.0:1734016120.194390:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8725 00000100:00100000:3.0:1734016120.194397:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333774976:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016120.197934:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7974403 -> 6390889 00002000:00010000:3.0:1734016120.197949:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016120 -> 1734016120 00002000:00010000:3.0:1734016120.197951:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016120 -> 1734016120 00002000:00010000:3.0:1734016120.197954:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016120 -> 1734016120 00002000:00010000:3.0:1734016120.197956:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1088 -> 1048 00000100:00100000:3.0:1734016120.198077:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333774976:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 3670us (4026us total) trans 4294969455 rc 0/0 00000100:00100000:3.0:1734016120.198090:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8725 00002000:00010000:3.0:1734016120.198097:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (6390889->18446744073709551615) 00002000:00100000:3.0:1734016120.198100:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7480 with x1818247333774976 ext(6390889->18446744073709551615) 00002000:00010000:3.0:1734016120.198107:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc7480. 00000100:00100000:0.0:1734016120.201220:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.206000:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333775104 00000100:00100000:3.0:1734016120.206019:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333775104 00000100:00100000:3.0:1734016120.206122:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2223 00000100:00100000:3.0:1734016120.206131:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333775104:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016120.206158:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016120.206184:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115d33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e22 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.206340:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27115d3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016120.206359:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27115d3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016120.206375:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27115d3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016120.206413:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 6390889 00000004:00200000:3.0:1734016120.206419:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016120.206442:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27115d3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016120.206473:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115d33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e22 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.206499:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27115d3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e22 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.206509:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016120.206512:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016120.206516:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4b40, rc 0) 00000100:00100000:3.0:1734016120.206618:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+21:9668:x1818247333775104:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 487us (5414us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016120.206625:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2223 00000100:00100000:1.0:1734016120.210649:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.210779:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333775232 00000100:00100000:2.0:1734016120.210791:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333775232 00000100:00100000:2.0:1734016120.210906:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11053 00000100:00100000:2.0:1734016120.210916:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333775232:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016120.210944:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016120.210967:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115d41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e29 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016120.211038:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335315584:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016120.211118:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016120.217393:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335315584:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016120.217447:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115d41 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e29 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016120.217465:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27115d41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e29 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016120.217499:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016120.217582:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333775232:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6664us (6945us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016120.217593:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11053 00000100:00100000:0.0:1734016120.220767:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.225349:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333775360 00000100:00100000:2.0:1734016120.225372:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333775360 00000100:00100000:2.0:1734016120.225473:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11054 00000100:00100000:2.0:1734016120.225486:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333775360:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016120.225524:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016120.225563:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115d48 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e30 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016120.225646:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335315712:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016120.225737:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007bc0ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016120.228970:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335315712:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016120.229030:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115d48 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e30 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016120.229056:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27115d48 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e30 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016120.229076:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:3.0:1734016120.229519:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333775360:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4031us (8763us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016120.229533:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11054 00000100:00100000:0.0:1734016120.234058:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.234290:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333775488 00000100:00100000:3.0:1734016120.234309:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333775488 00000100:00100000:3.0:1734016120.234377:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11055 00000100:00100000:3.0:1734016120.234388:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333775488:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016120.234420:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016120.234454:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115d4f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e37 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016120.234544:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335315840:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016120.234643:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92180 going to sleep for 11 seconds 00000100:00100000:3.0:1734016120.238347:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335315840:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016120.238414:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115d4f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e37 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.238439:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27115d4f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e37 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.238467:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016120.238574:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333775488:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4186us (4546us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016120.238586:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11055 00000100:00100000:0.0:1734016120.240904:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.241069:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333775616 00000100:00100000:3.0:1734016120.241081:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333775616 00000100:00100000:3.0:1734016120.241129:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11056 00000100:00100000:3.0:1734016120.241136:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333775616:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016120.241160:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016120.241181:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115d56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e3e expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016120.241250:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335315968:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016120.242018:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92180 going to sleep for 11 seconds 00000100:00100000:3.0:1734016120.244588:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335315968:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016120.244661:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115d56 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e3e expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.244680:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27115d56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e3e expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.244700:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016120.244778:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333775616:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3639us (3900us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016120.244790:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11056 00000100:00100000:0.0:1734016120.248133:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016120.248283:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333775872 00000100:00100000:1.0:1734016120.248296:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333775872 00000100:00100000:1.0:1734016120.248375:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2224 00000100:00100000:1.0:1734016120.248385:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:9668:x1818247333775872:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016120.248671:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115d5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016120.248694:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27115d3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e22 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016120.248702:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115d5d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016120.248739:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27115d3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e22 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016120.248754:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27115d3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e22 expref: 20 pid: 6478 timeout: 487 lvb_type: 0 00000100:00100000:1.0:1734016120.248771:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335316096:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016120.248902:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016120.252458:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335316096:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016120.252498:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115d5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016120.252984:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.253973:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333776000 00000100:00100000:2.0:1734016120.253983:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333776000 00010000:00010000:2.0:1734016120.254024:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27115d3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e22 expref: 21 pid: 6478 timeout: 487 lvb_type: 0 00000100:00100000:2.0:1734016120.254071:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3072 00000100:00100000:2.0:1734016120.254078:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+21:1981:x1818247333776000:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016120.254096:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016120.254104:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27115d3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e22 expref: 21 pid: 6478 timeout: 487 lvb_type: 0 00010000:00010000:2.0:1734016120.254118:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27115d3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e22 expref: 21 pid: 6478 timeout: 487 lvb_type: 0 00010000:00010000:2.0:1734016120.254145:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27115d3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e22 expref: 21 pid: 6478 timeout: 487 lvb_type: 0 00010000:00010000:2.0:1734016120.254176:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:2.0:1734016120.254182:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115d5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016120.254195:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115d5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016120.254202:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115d5d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016120.254229:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016120.254279:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+20:1981:x1818247333776000:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 200us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016120.254285:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3072 00010000:00010000:0.0:1734016120.254363:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115d5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016120.254371:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115d5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:0.0:1734016120.254479:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968730 00000004:00010000:0.0:1734016120.254529:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075fc4380 reply state ffff880075571000 transno 4294968731 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115d5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016120.254536:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016120.254610:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:9668:x1818247333775872:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 6227us (6496us total) trans 4294968731 rc 0/0 00000100:00100000:0.0:1734016120.254617:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2224 00000020:00080000:0.0:1734016120.254621:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016120.257493:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.257746:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333776128 00000100:00100000:2.0:1734016120.257758:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333776128 00002000:00010000:2.0:1734016120.257832:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (8089321->18446744073709551615) 00002000:00100000:2.0:1734016120.257838:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc5500 with x1818247333776128 ext(8089321->18446744073709551615) 00002000:00010000:2.0:1734016120.257852:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc5500. 00000100:00100000:2.0:1734016120.257900:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8726 00000100:00100000:2.0:1734016120.257909:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333776128:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016120.258191:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 6390889 -> 8089321 00002000:00010000:2.0:1734016120.258197:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016120 -> 1734016120 00002000:00010000:2.0:1734016120.258200:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016120 -> 1734016120 00002000:00010000:2.0:1734016120.258202:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016120 -> 1734016120 00002000:00010000:2.0:1734016120.258204:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1048 -> 1048 00000100:00100000:2.0:1734016120.258271:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333776128:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 361us (788us total) trans 4294969456 rc 0/0 00000100:00100000:2.0:1734016120.258280:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8726 00002000:00010000:2.0:1734016120.258283:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/6 (8089321->18446744073709551615) 00002000:00100000:2.0:1734016120.258286:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc5500 with x1818247333776128 ext(8089321->18446744073709551615) 00002000:00010000:2.0:1734016120.258290:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc5500. 00010000:00010000:3.0:1734016120.258419:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115d5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016120.258433:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115d5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016120.258442:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115d5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016120.258449:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499d200 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016120.258456:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115d5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016120.258463:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115d5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016120.258485:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016120.258487:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016120.258491:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115d5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016120.258497:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115d5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016120.261449:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016120.261564:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333776384 00000100:00100000:1.0:1734016120.261575:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333776384 00002000:00100000:1.0:1734016120.261633:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8085504->8089599) req@ffff880075fc4700 x1818247333776384/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016120.261645:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc4700 with x1818247333776384 ext(8085504->8089599) 00002000:00010000:1.0:1734016120.261650:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc4700 00000100:00100000:1.0:1734016120.261742:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8727 00000100:00100000:1.0:1734016120.261749:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333776384:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016120.263219:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333776384:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1463us (1780us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016120.263230:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8727 00002000:00100000:1.0:1734016120.263240:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8085504->8089599) req@ffff880075fc4700 x1818247333776384/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016120.263249:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc4700 with x1818247333776384 ext(8085504->8089599) 00002000:00010000:1.0:1734016120.263253:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc4700 00000100:00100000:0.0:1734016120.266650:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016120.266975:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333776640 00000100:00100000:1.0:1734016120.266988:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333776640 00002000:00100000:1.0:1734016120.267051:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8081408->8085503) req@ffff880075fc6a00 x1818247333776640/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016120.267064:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc6a00 with x1818247333776640 ext(8081408->8085503) 00002000:00010000:1.0:1734016120.267072:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc6a00 00000100:00100000:2.0:1734016120.268667:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8728 00000100:00100000:2.0:1734016120.268680:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333776640:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016120.269093:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333776640:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 414us (2463us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016120.269102:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8728 00002000:00100000:2.0:1734016120.269114:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8081408->8085503) req@ffff880075fc6a00 x1818247333776640/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016120.269125:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc6a00 with x1818247333776640 ext(8081408->8085503) 00002000:00010000:2.0:1734016120.269132:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc6a00 00000100:00100000:0.0:1734016120.272672:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016120.272857:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333776896 00000100:00100000:1.0:1734016120.272873:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333776896 00002000:00100000:1.0:1734016120.272966:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8077312->8081407) req@ffff880075fc6680 x1818247333776896/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016120.272980:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc6680 with x1818247333776896 ext(8077312->8081407) 00002000:00010000:1.0:1734016120.272989:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc6680 00000100:00100000:1.0:1734016120.273319:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8729 00000100:00100000:1.0:1734016120.273332:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333776896:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016120.276834:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333776896:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 3465us (4154us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016120.276856:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8729 00002000:00100000:1.0:1734016120.276877:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8077312->8081407) req@ffff880075fc6680 x1818247333776896/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016120.276897:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc6680 with x1818247333776896 ext(8077312->8081407) 00002000:00010000:1.0:1734016120.276904:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc6680 00000100:00100000:0.0:1734016120.285447:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.285565:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333777152 00000100:00100000:2.0:1734016120.285578:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333777152 00002000:00100000:2.0:1734016120.285641:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8073216->8077311) req@ffff880075fc4a80 x1818247333777152/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016120.285653:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc4a80 with x1818247333777152 ext(8073216->8077311) 00002000:00010000:2.0:1734016120.285661:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc4a80 00000100:00100000:2.0:1734016120.285715:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8730 00000100:00100000:2.0:1734016120.285724:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333777152:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016120.286086:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333777152:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 361us (659us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016120.286095:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8730 00002000:00100000:2.0:1734016120.286102:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8073216->8077311) req@ffff880075fc4a80 x1818247333777152/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016120.286108:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc4a80 with x1818247333777152 ext(8073216->8077311) 00002000:00010000:2.0:1734016120.286113:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc4a80 00000100:00100000:0.0:1734016120.292527:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016120.292717:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333777408 00000100:00100000:1.0:1734016120.292738:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333777408 00002000:00100000:1.0:1734016120.292890:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8069120->8073215) req@ffff880075e51180 x1818247333777408/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016120.292904:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e51180 with x1818247333777408 ext(8069120->8073215) 00002000:00010000:1.0:1734016120.292911:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e51180 00000100:00100000:2.0:1734016120.294181:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8731 00000100:00100000:2.0:1734016120.294198:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333777408:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016120.294571:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333777408:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 375us (2066us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016120.294581:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8731 00002000:00100000:2.0:1734016120.294593:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8069120->8073215) req@ffff880075e51180 x1818247333777408/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016120.294604:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e51180 with x1818247333777408 ext(8069120->8073215) 00002000:00010000:2.0:1734016120.294609:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e51180 00000100:00100000:0.0:1734016120.304789:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016120.305123:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333777664 00000100:00100000:1.0:1734016120.305136:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333777664 00002000:00100000:1.0:1734016120.305190:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8065024->8069119) req@ffff880075e53800 x1818247333777664/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016120.305204:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e53800 with x1818247333777664 ext(8065024->8069119) 00002000:00010000:1.0:1734016120.305212:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e53800 00000100:00100000:1.0:1734016120.305260:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8732 00000100:00100000:1.0:1734016120.305268:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333777664:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016120.305538:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333777664:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 268us (763us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016120.305546:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8732 00002000:00100000:1.0:1734016120.305552:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8065024->8069119) req@ffff880075e53800 x1818247333777664/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016120.305560:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e53800 with x1818247333777664 ext(8065024->8069119) 00002000:00010000:1.0:1734016120.305563:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e53800 00000100:00100000:0.0:1734016120.311667:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.313937:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333777920 00000100:00100000:2.0:1734016120.313969:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333777920 00002000:00100000:3.0:1734016120.314201:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8060928->8065023) req@ffff880075e52300 x1818247333777920/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016120.314223:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e52300 with x1818247333777920 ext(8060928->8065023) 00002000:00010000:3.0:1734016120.314234:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e52300 00000100:00100000:3.0:1734016120.314290:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8733 00000100:00100000:3.0:1734016120.314305:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333777920:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016120.315784:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333777920:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1473us (4121us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016120.315819:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8733 00002000:00100000:3.0:1734016120.315832:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8060928->8065023) req@ffff880075e52300 x1818247333777920/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016120.315841:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e52300 with x1818247333777920 ext(8060928->8065023) 00002000:00010000:3.0:1734016120.315847:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e52300 00000100:00100000:0.0:1734016120.319870:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.320044:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333778176 00000100:00100000:3.0:1734016120.320061:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333778176 00002000:00100000:3.0:1734016120.320130:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8056832->8060927) req@ffff880075e51f80 x1818247333778176/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016120.320143:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e51f80 with x1818247333778176 ext(8056832->8060927) 00002000:00010000:3.0:1734016120.320151:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e51f80 00000100:00100000:3.0:1734016120.320703:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8734 00000100:00100000:3.0:1734016120.320714:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333778176:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016120.320991:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333778176:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 276us (1139us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016120.320999:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8734 00002000:00100000:3.0:1734016120.321007:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8056832->8060927) req@ffff880075e51f80 x1818247333778176/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016120.321016:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e51f80 with x1818247333778176 ext(8056832->8060927) 00002000:00010000:3.0:1734016120.321019:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e51f80 00000100:00100000:2.0:1734016120.323894:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016120.324254:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333778432 00000100:00100000:1.0:1734016120.324268:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333778432 00002000:00100000:1.0:1734016120.324316:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8052736->8056831) req@ffff88012e719c00 x1818247333778432/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016120.324328:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e719c00 with x1818247333778432 ext(8052736->8056831) 00002000:00010000:1.0:1734016120.324333:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e719c00 00000100:00100000:1.0:1734016120.324374:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8735 00000100:00100000:1.0:1734016120.324384:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333778432:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016120.324680:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333778432:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 296us (894us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016120.324690:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8735 00002000:00100000:1.0:1734016120.324697:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8052736->8056831) req@ffff88012e719c00 x1818247333778432/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016120.324706:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e719c00 with x1818247333778432 ext(8052736->8056831) 00002000:00010000:1.0:1734016120.324709:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e719c00 00000100:00100000:0.0:1734016120.331983:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.332194:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333778688 00000100:00100000:3.0:1734016120.332213:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333778688 00002000:00100000:3.0:1734016120.332293:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8048640->8052735) req@ffff880075e50380 x1818247333778688/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016120.332308:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50380 with x1818247333778688 ext(8048640->8052735) 00002000:00010000:3.0:1734016120.332317:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e50380 00000100:00100000:3.0:1734016120.332398:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8736 00000100:00100000:3.0:1734016120.332408:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333778688:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016120.332710:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333778688:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 302us (751us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016120.332720:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8736 00002000:00100000:3.0:1734016120.332726:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8048640->8052735) req@ffff880075e50380 x1818247333778688/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016120.332733:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50380 with x1818247333778688 ext(8048640->8052735) 00002000:00010000:3.0:1734016120.332736:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e50380 00000100:00100000:0.0:1734016120.335246:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016120.335378:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333778944 00000100:00100000:1.0:1734016120.335392:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333778944 00002000:00100000:1.0:1734016120.335468:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8044544->8048639) req@ffff880075e50700 x1818247333778944/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016120.335479:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50700 with x1818247333778944 ext(8044544->8048639) 00002000:00010000:1.0:1734016120.335485:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e50700 00000100:00100000:1.0:1734016120.335524:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8737 00000100:00100000:1.0:1734016120.335534:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333778944:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016120.335785:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333778944:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 252us (557us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016120.335793:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8737 00002000:00100000:1.0:1734016120.335841:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8044544->8048639) req@ffff880075e50700 x1818247333778944/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016120.335849:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50700 with x1818247333778944 ext(8044544->8048639) 00002000:00010000:1.0:1734016120.335852:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e50700 00000100:00100000:0.0:1734016120.340074:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.340279:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333779200 00000100:00100000:3.0:1734016120.340291:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333779200 00002000:00100000:3.0:1734016120.340353:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8040448->8044543) req@ffff880075e50000 x1818247333779200/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016120.340365:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50000 with x1818247333779200 ext(8040448->8044543) 00002000:00010000:3.0:1734016120.340373:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e50000 00000100:00100000:3.0:1734016120.340421:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8738 00000100:00100000:3.0:1734016120.340429:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333779200:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016120.340685:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333779200:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 255us (632us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016120.340693:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8738 00002000:00100000:3.0:1734016120.340700:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8040448->8044543) req@ffff880075e50000 x1818247333779200/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016120.340708:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50000 with x1818247333779200 ext(8040448->8044543) 00002000:00010000:3.0:1734016120.340711:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e50000 00000100:00100000:0.0:1734016120.343476:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016120.343653:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333779456 00000100:00100000:1.0:1734016120.343669:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333779456 00002000:00100000:1.0:1734016120.343735:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8036352->8040447) req@ffff880075e53100 x1818247333779456/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016120.343750:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e53100 with x1818247333779456 ext(8036352->8040447) 00002000:00010000:1.0:1734016120.343759:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e53100 00000100:00100000:1.0:1734016120.343860:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8739 00000100:00100000:1.0:1734016120.343868:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333779456:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016120.344138:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333779456:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 269us (687us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016120.344147:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8739 00002000:00100000:1.0:1734016120.344153:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8036352->8040447) req@ffff880075e53100 x1818247333779456/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016120.344160:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e53100 with x1818247333779456 ext(8036352->8040447) 00002000:00010000:1.0:1734016120.344163:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e53100 00000100:00100000:0.0:1734016120.347076:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.347419:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333779712 00000100:00100000:3.0:1734016120.347431:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333779712 00002000:00100000:3.0:1734016120.347488:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8032256->8036351) req@ffff880075e52680 x1818247333779712/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016120.347501:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e52680 with x1818247333779712 ext(8032256->8036351) 00002000:00010000:3.0:1734016120.347507:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e52680 00000100:00100000:3.0:1734016120.347902:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8740 00000100:00100000:3.0:1734016120.347912:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333779712:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016120.348222:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333779712:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 309us (1161us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016120.348231:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8740 00002000:00100000:3.0:1734016120.348238:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8032256->8036351) req@ffff880075e52680 x1818247333779712/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016120.348245:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e52680 with x1818247333779712 ext(8032256->8036351) 00002000:00010000:3.0:1734016120.348249:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e52680 00000100:00100000:0.0:1734016120.350660:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016120.350939:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333779968 00000100:00100000:1.0:1734016120.350950:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333779968 00002000:00100000:1.0:1734016120.351003:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8028160->8032255) req@ffff880075e52a00 x1818247333779968/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016120.351017:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e52a00 with x1818247333779968 ext(8028160->8032255) 00002000:00010000:1.0:1734016120.351024:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e52a00 00000100:00100000:1.0:1734016120.351068:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8741 00000100:00100000:1.0:1734016120.351076:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333779968:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016120.351310:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333779968:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 232us (660us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016120.351320:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8741 00002000:00100000:1.0:1734016120.351327:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8028160->8032255) req@ffff880075e52a00 x1818247333779968/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016120.351335:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e52a00 with x1818247333779968 ext(8028160->8032255) 00002000:00010000:1.0:1734016120.351338:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e52a00 00000100:00100000:0.0:1734016120.353382:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.353718:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333780224 00000100:00100000:3.0:1734016120.353729:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333780224 00002000:00100000:3.0:1734016120.353779:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8024064->8028159) req@ffff880075e50e00 x1818247333780224/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016120.353790:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50e00 with x1818247333780224 ext(8024064->8028159) 00002000:00010000:3.0:1734016120.353795:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e50e00 00000100:00100000:3.0:1734016120.353873:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8742 00000100:00100000:3.0:1734016120.353888:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333780224:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016120.354094:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333780224:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 213us (720us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016120.354102:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8742 00002000:00100000:3.0:1734016120.354108:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (8024064->8028159) req@ffff880075e50e00 x1818247333780224/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/4536 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016120.354115:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50e00 with x1818247333780224 ext(8024064->8028159) 00002000:00010000:3.0:1734016120.354118:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e50e00 00000100:00100000:0.0:1734016120.357321:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016120.357418:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333780352 00000100:00100000:1.0:1734016120.357430:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333780352 00002000:00100000:1.0:1734016120.357483:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8024064->8089320) req@ffff880075e50a80 x1818247333780352/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/0 e 0 to 0 dl 1734016131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016120.357495:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50a80 with x1818247333780352 ext(8024064->8089320) 00002000:00010000:1.0:1734016120.357502:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e50a80 00000100:00100000:1.0:1734016120.357549:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8743 00000100:00100000:1.0:1734016120.357561:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333780352:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016120.361542:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333780352:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 3970us (4217us total) trans 4294969457 rc 0/0 00000100:00100000:0.0:1734016120.361557:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8743 00002000:00100000:0.0:1734016120.361573:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (8024064->8089320) req@ffff880075e50a80 x1818247333780352/t4294969457(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:81/0 lens 488/448 e 0 to 0 dl 1734016131 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016120.361584:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50a80 with x1818247333780352 ext(8024064->8089320) 00002000:00010000:0.0:1734016120.361590:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075e50a80 00000100:00100000:0.0:1734016120.364916:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.365303:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333780480 00000100:00100000:2.0:1734016120.365315:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333780480 00000100:00100000:2.0:1734016120.365387:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2225 00000100:00100000:2.0:1734016120.365395:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:9668:x1818247333780480:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:2.0:1734016120.365569:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:9668:x1818247333780480:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 174us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016120.365577:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2225 00000100:00100000:0.0:1734016120.375681:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.376048:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333780608 00000100:00100000:3.0:1734016120.376063:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333780608 00000100:00100000:3.0:1734016120.376169:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11057 00000100:00100000:3.0:1734016120.376181:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333780608:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016120.380895:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969457 is committed 00000100:00100000:3.0:1734016120.381119:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333780608:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 4934us (5449us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016120.381134:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11057 00000100:00100000:0.0:1734016120.385012:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.385126:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333780736 00000100:00100000:3.0:1734016120.385135:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333780736 00000100:00100000:3.0:1734016120.385203:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2226 00000100:00100000:3.0:1734016120.385214:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:9668:x1818247333780736:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016120.385243:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016120.385271:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27115d64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e45 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.385370:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27115d6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016120.385385:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27115d6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016120.385398:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27115d6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016120.385424:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 8089321 00000004:00200000:3.0:1734016120.385429:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016120.385447:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27115d6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016120.385472:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27115d64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e45 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.385490:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4480/0x5e3a3adc27115d6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e45 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.385498:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016120.385501:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016120.385504:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4480, rc 0) 00000100:00100000:3.0:1734016120.388018:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:9668:x1818247333780736:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2791us (3005us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016120.388032:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2226 00000100:00100000:2.0:1734016120.391480:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.391562:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333780864 00000100:00100000:3.0:1734016120.391571:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333780864 00000100:00100000:3.0:1734016120.391674:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2227 00000100:00100000:3.0:1734016120.391680:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+20:9668:x1818247333780864:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016120.391697:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016120.391717:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27115d72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e4c expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.391985:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc27115d79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016120.391999:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc27115d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016120.392009:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc27115d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016120.392035:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 8089321 00000004:00200000:3.0:1734016120.392040:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016120.392054:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc27115d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016120.392074:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc27115d72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e4c expref: 22 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.392665:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7840/0x5e3a3adc27115d79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e4c expref: 21 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016120.392673:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88012a2b0d00) 00010000:00010000:3.0:1734016120.392676:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016120.392678:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7840, rc 0) 00000100:00100000:3.0:1734016120.393900:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+21:9668:x1818247333780864:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2214us (2465us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016120.393907:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2227 00000100:00100000:1.0:1734016120.398315:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.400906:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333780992 00000100:00100000:3.0:1734016120.400923:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333780992 00000100:00100000:3.0:1734016120.401049:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11058 00000100:00100000:3.0:1734016120.401060:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333780992:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016120.401084:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016120.401111:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115d80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e53 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016120.401185:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335316224:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016120.401287:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92cc0 going to sleep for 11 seconds 00002000:00010000:3.0:1734016120.404318:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks: 1048 -> 1176 00000100:00100000:3.0:1734016120.404343:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335316224:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016120.404377:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115d80 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e53 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.404389:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27115d80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e53 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.404412:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016120.404467:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333780992:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3409us (6180us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016120.404476:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11058 00000100:00100000:0.0:1734016120.406708:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.406920:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333781120 00000100:00100000:3.0:1734016120.406929:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333781120 00000100:00100000:3.0:1734016120.406995:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11059 00000100:00100000:3.0:1734016120.407002:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333781120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016120.407020:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016120.407038:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27115d87 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e5a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016120.407087:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335316352:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016120.407476:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016120.409631:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335316352:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016120.409659:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27115d87 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e5a expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.409672:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df58c0/0x5e3a3adc27115d87 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e5a expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.409696:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df58c0, rc 0) 00000100:00100000:3.0:1734016120.410554:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333781120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3548us (3849us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016120.410562:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11059 00000100:00100000:1.0:1734016120.413586:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.413751:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333781248 00000100:00100000:3.0:1734016120.413760:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333781248 00000100:00100000:3.0:1734016120.413833:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11060 00000100:00100000:3.0:1734016120.413840:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333781248:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016120.414089:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 8089321 -> 8089321 00002000:00010000:3.0:1734016120.414092:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1734016120 -> 1734016120 00002000:00010000:3.0:1734016120.414096:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1734016120 -> 1734016120 00002000:00010000:3.0:1734016120.414097:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1734016120 -> 1734016120 00002000:00010000:3.0:1734016120.414099:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1176 -> 1176 00000100:00100000:3.0:1734016120.414718:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333781248:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 876us (1138us total) trans 4294969458 rc 0/0 00000100:00100000:3.0:1734016120.414726:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11060 00000100:00100000:0.0:1734016120.416392:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.416833:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333781376 00000100:00100000:3.0:1734016120.416847:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333781376 00000100:00100000:3.0:1734016120.416903:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11061 00000100:00100000:3.0:1734016120.416910:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333781376:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016120.416937:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016120.416959:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115d8e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e61 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016120.417029:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335316480:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016120.417322:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92cc0 going to sleep for 11 seconds 00002000:00010000:3.0:1734016120.419154:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime: 1734016120 -> 1734016121 00000100:00100000:3.0:1734016120.419194:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335316480:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016120.419242:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115d8e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e61 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.419257:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27115d8e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e61 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.419269:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016120.419323:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333781376:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2412us (2940us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016120.419335:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11061 00000100:00100000:1.0:1734016120.422651:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016120.422775:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333781504 00000100:00100000:3.0:1734016120.422786:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333781504 00000100:00100000:3.0:1734016120.423468:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11062 00000100:00100000:3.0:1734016120.423476:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333781504:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016120.423500:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016120.423519:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115d95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e68 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016120.423582:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335316608:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016120.423697:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016120.425649:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335316608:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016120.425689:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115d95 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e68 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.425702:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4b40/0x5e3a3adc27115d95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e68 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016120.425714:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4b40, rc 0) 00000100:00100000:3.0:1734016120.425768:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333781504:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2291us (3129us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016120.425777:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11062 00000100:00100000:0.0:1734016120.428743:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.428891:0:6481:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333781760 00000100:00100000:2.0:1734016120.428900:0:6481:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333781760 00000100:00100000:2.0:1734016120.428960:0:6481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 36 00000100:00100000:2.0:1734016120.428968:0:6481:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c598caf-7141-4c19-8566-0b7731516db9+21:9668:x1818247333781760:12345-192.168.201.16@tcp:35:fsx.0 00000001:00080000:2.0:1734016120.429197:0:6481:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968732 00000100:00100000:2.0:1734016120.429310:0:6481:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c598caf-7141-4c19-8566-0b7731516db9+23:9668:x1818247333781760:12345-192.168.201.16@tcp:35:fsx.0 Request processed in 342us (573us total) trans 4294968733 rc 0/0 00000100:00100000:2.0:1734016120.429318:0:6481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 36 00000020:00080000:2.0:1734016120.429321:0:6481:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1734016120.431568:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.433478:0:6481:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333782016 00000100:00100000:2.0:1734016120.433492:0:6481:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333782016 00000100:00100000:2.0:1734016120.435075:0:6481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 37 00000100:00100000:2.0:1734016120.435091:0:6481:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:9668:x1818247333782016:12345-192.168.201.16@tcp:35:fsx.0 00000100:00100000:2.0:1734016120.435379:0:6481:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:9668:x1818247333782016:12345-192.168.201.16@tcp:35:fsx.0 Request processed in 292us (3821us total) trans 4294968734 rc 0/0 00000100:00100000:2.0:1734016120.435387:0:6481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 37 00000100:00100000:0.0:1734016120.456758:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016120.456834:0:6481:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333782272 00000100:00100000:2.0:1734016120.456846:0:6481:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333782272 00000100:00100000:2.0:1734016120.456915:0:6481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 38 00000100:00100000:2.0:1734016120.456922:0:6481:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c598caf-7141-4c19-8566-0b7731516db9+23:9668:x1818247333782272:12345-192.168.201.16@tcp:35:fsx.0 00000100:00100000:2.0:1734016120.457661:0:6481:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c598caf-7141-4c19-8566-0b7731516db9+24:9668:x1818247333782272:12345-192.168.201.16@tcp:35:fsx.0 Request processed in 736us (913us total) trans 4294968735 rc 0/0 00000100:00100000:2.0:1734016120.457669:0:6481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 38 00000100:00100000:2.0:1734016120.462634:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016120.462777:0:6481:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333782528 00000100:00100000:0.0:1734016120.462788:0:6481:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333782528 00000100:00100000:0.0:1734016120.462870:0:6481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 39 00000100:00100000:0.0:1734016120.462885:0:6481:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ee98050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c598caf-7141-4c19-8566-0b7731516db9+24:9668:x1818247333782528:12345-192.168.201.16@tcp:35:fsx.0 00000001:00080000:0.0:1734016120.463083:0:6481:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968736 00000100:00100000:0.0:1734016120.463184:0:6481:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ee98050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c598caf-7141-4c19-8566-0b7731516db9+26:9668:x1818247333782528:12345-192.168.201.16@tcp:35:fsx.0 Request processed in 306us (568us total) trans 4294968737 rc 0/0 00000100:00100000:0.0:1734016120.463195:0:6481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 39 00000020:00080000:0.0:1734016120.463200:0:6481:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1734016120.541643:0:6469:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1734016121.087751:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016121.088240:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016121.088288:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016121.088309:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016121.088465:0:6475:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333782656 00000100:00100000:2.0:1734016121.088480:0:6475:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333782656 00000100:00100000:1.0:1734016121.088564:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016121.088694:0:6475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 326 00000100:00100000:2.0:1734016121.088705:0:6475:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7611c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99867e87-1bc2-4e49-bd45-a757ae2fdd76+12:1981:x1818247333782656:12345-192.168.201.16@tcp:400:kworker.0 00000100:00080000:0.0:1734016121.088884:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016091 00000100:00100000:0.0:1734016121.088920:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333783168 00000100:00100000:0.0:1734016121.088924:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333783168 00000100:00100000:0.0:1734016121.088959:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333782784 00000100:00100000:0.0:1734016121.088961:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333782784 00000100:00100000:0.0:1734016121.088976:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 223 00000100:00100000:0.0:1734016121.088981:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:1981:x1818247333783168:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1734016121.089138:0:6475:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7611c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99867e87-1bc2-4e49-bd45-a757ae2fdd76+12:1981:x1818247333782656:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 433us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016121.089146:0:6475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 326 00000100:00100000:2.0:1734016121.089192:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 224 00000100:00100000:2.0:1734016121.089198:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+26:1981:x1818247333782784:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1734016121.089386:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:1981:x1818247333783168:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 405us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016121.089391:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 223 00000100:00100000:1.0:1734016121.089524:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016121.089561:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+26:1981:x1818247333782784:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 362us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016121.089566:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 224 00000100:00080000:2.0:1734016121.089735:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016091 00000100:00100000:3.0:1734016121.089890:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333782912 00000100:00100000:3.0:1734016121.089896:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333782912 00000100:00100000:0.0:1734016121.089921:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333783040 00000100:00100000:0.0:1734016121.089924:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333783040 00000100:00100000:3.0:1734016121.089929:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333783296 00000100:00100000:3.0:1734016121.089930:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333783296 00000100:00100000:3.0:1734016121.089943:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 160 00000100:00100000:0.0:1734016121.089947:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 161 00000100:00100000:3.0:1734016121.089948:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090249c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333782912:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1734016121.089951:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333783040:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1734016121.089977:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333783040:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 25us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016121.089977:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090249c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333782912:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 29us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016121.089982:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 160 00000100:00100000:0.0:1734016121.090048:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 161 00000100:00100000:0.0:1734016121.090057:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 162 00000100:00100000:0.0:1734016121.090060:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333783296:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1734016121.090081:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333783296:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 20us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016121.090085:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 162 00000100:00080000:2.0:1734016121.090181:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016091 00000100:00080000:2.0:1734016121.090183:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016091 00010000:00010000:3.0:1734016121.555557:0:8957:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1734016122.148271:0:3505:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3505:1818247335316864:0@lo:400:kworker.0 00000100:00100000:1.0:1734016122.148354:0:3505:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016122.148380:0:3505:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335317376:0@lo:400:kworker.0 00000100:00100000:1.0:1734016122.148402:0:3505:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016122.148422:0:3505:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1734016122.148427:0:3505:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3505:1818247335316992:0@lo:400:kworker.0 00000100:00100000:1.0:1734016122.148443:0:3505:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016122.148473:0:13913:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335317376 00000100:00100000:1.0:1734016122.148481:0:13913:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335317376 00000100:00100000:1.0:1734016122.148523:0:13913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1734016122.148530:0:13913:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335317376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016122.148578:0:13913:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335317376:12345-0@lo:400:kworker.0 Request processed in 48us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016122.148585:0:13913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:1.0:1734016122.148605:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016092 00000100:00100000:1.0:1734016122.148630:0:3505:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335317376:0@lo:400:kworker.0 00000100:00100000:1.0:1734016122.148661:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335316864 00000100:00100000:1.0:1734016122.148664:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335316864 00000100:00100000:3.0:1734016122.148733:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67a75f73-9674-4938-8c12-63813a36f078:3504:1818247335316736:0@lo:400:kworker.0 00000100:00100000:3.0:1734016122.148770:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1734016122.148788:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3504:1818247335317248:0@lo:400:kworker.0 00000100:00100000:3.0:1734016122.148838:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1734016122.148861:0:3504:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1734016122.148867:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335317120:0@lo:400:kworker.0 00000100:00100000:3.0:1734016122.148887:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1734016122.148907:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335317120 00000100:00100000:3.0:1734016122.148911:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335317120 00000100:00100000:3.0:1734016122.148934:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1734016122.148938:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335317120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1734016122.148965:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335317120:12345-0@lo:400:kworker.0 Request processed in 26us (77us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016122.148970:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:3.0:1734016122.148986:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016092 00000100:00100000:3.0:1734016122.149000:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335317120:0@lo:400:kworker.0 00000100:00100000:3.0:1734016122.149023:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335316992 00000100:00100000:3.0:1734016122.149025:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335316992 00000100:00100000:3.0:1734016122.149047:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335317248 00000100:00100000:3.0:1734016122.149049:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335317248 00000100:00100000:3.0:1734016122.149059:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1734016122.149063:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3505:x1818247335316864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1734016122.149091:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3505:x1818247335316864:12345-0@lo:400:kworker.0 Request processed in 26us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016122.149096:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1734016122.149106:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1734016122.149110:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3505:x1818247335316992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1734016122.149128:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3505:x1818247335316992:12345-0@lo:400:kworker.0 Request processed in 18us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016122.149132:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1734016122.149140:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1734016122.149143:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3504:x1818247335317248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1734016122.149163:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3504:x1818247335317248:12345-0@lo:400:kworker.0 Request processed in 20us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016122.149168:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:3.0:1734016122.149177:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016092 00000100:00100000:3.0:1734016122.149190:0:3505:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3505:1818247335316992:0@lo:400:kworker.0 00000100:00100000:3.0:1734016122.149198:0:3505:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3505:1818247335316864:0@lo:400:kworker.0 00000100:00100000:3.0:1734016122.149215:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3504:1818247335317248:0@lo:400:kworker.0 00000100:00100000:3.0:1734016122.149238:0:6474:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335316736 00000100:00100000:3.0:1734016122.149241:0:6474:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335316736 00000100:00100000:3.0:1734016122.149259:0:6474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1734016122.149263:0:6474:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7611850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a75f73-9674-4938-8c12-63813a36f078+18:3504:x1818247335316736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1734016122.149287:0:6474:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7611850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a75f73-9674-4938-8c12-63813a36f078+18:3504:x1818247335316736:12345-0@lo:400:kworker.0 Request processed in 24us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016122.149292:0:6474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00080000:3.0:1734016122.149318:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016092 00000100:00100000:3.0:1734016122.149335:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67a75f73-9674-4938-8c12-63813a36f078:3504:1818247335316736:0@lo:400:kworker.0 00000100:00100000:2.0:1734016122.196759:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335317504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1734016122.196897:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016122.208482:0:7686:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335317504 00000100:00100000:0.0:1734016122.208495:0:7686:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335317504 00000100:00100000:0.0:1734016122.208557:0:7686:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1734016122.208565:0:7686:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335317504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1734016122.208605:0:7686:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 980042304 pending 0 free 3923075072 avail 3691552768 00000100:00100000:0.0:1734016122.208718:0:7686:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335317504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (11821us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016122.208727:0:7686:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1734016122.208880:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335317504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1734016122.405704:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335317632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1734016122.405854:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1734016122.406142:0:7685:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335317632 00000100:00100000:2.0:1734016122.406152:0:7685:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335317632 00000100:00100000:2.0:1734016122.406195:0:7685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1734016122.406203:0:7685:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335317632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1734016122.406243:0:7685:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 490160704 pending 0 free 3923677184 avail 3692154880 00000100:00100000:2.0:1734016122.406289:0:7685:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335317632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016122.406296:0:7685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1734016122.406430:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335317632:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1734016122.591722:0:6468:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1734016122.619456:0:6461:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968737 is committed 00000001:00080000:0.0:1734016122.619481:0:6461:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968734 is committed 00010000:00010000:2.0:1734016123.573212:0:8958:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1734016124.578682:0:6469:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1734016125.578830:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969458 is committed 00010000:00010000:3.0:1734016125.579254:0:8957:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1734016126.097941:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016126.098002:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016126.098021:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016126.098049:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333783552 00000100:00100000:2.0:1734016126.098058:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016126.098070:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333783552 00000100:00100000:2.0:1734016126.098075:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016126.098115:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016126.098144:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333783808 00000100:00100000:2.0:1734016126.098147:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333783808 00000100:00100000:1.0:1734016126.098155:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333783936 00000100:00100000:1.0:1734016126.098157:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333783936 00000100:00100000:2.0:1734016126.098182:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333784064 00000100:00100000:1.0:1734016126.098183:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 228 00000100:00100000:2.0:1734016126.098184:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333784064 00000100:00100000:1.0:1734016126.098195:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333783552:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1734016126.098207:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333783680 00000100:00100000:2.0:1734016126.098209:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333783680 00000100:00100000:2.0:1734016126.098223:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 165 00000100:00100000:2.0:1734016126.098228:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333783808:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1734016126.098297:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333783808:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 69us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016126.098298:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333783552:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 106us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016126.098304:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 165 00000100:00100000:1.0:1734016126.098305:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 228 00000100:00100000:2.0:1734016126.098321:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 166 00000100:00100000:1.0:1734016126.098323:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 229 00000100:00100000:2.0:1734016126.098325:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333784064:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1734016126.098326:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333783936:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1734016126.098347:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333783936:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 20us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016126.098347:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333784064:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 21us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016126.098352:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 229 00000100:00100000:2.0:1734016126.098352:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 166 00000100:00100000:2.0:1734016126.098359:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 167 00000100:00100000:2.0:1734016126.098363:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333783680:12345-192.168.201.16@tcp:400:kworker.0 00000100:00080000:1.0:1734016126.098369:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016096 00000100:00080000:1.0:1734016126.098373:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016096 00000100:00080000:1.0:1734016126.098374:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016096 00000100:00100000:2.0:1734016126.098384:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333783680:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 20us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016126.098389:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 167 00000100:00100000:2.0:1734016126.098545:0:6475:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333783424 00000100:00100000:2.0:1734016126.098548:0:6475:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333783424 00000100:00100000:2.0:1734016126.098584:0:6475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 328 00000100:00100000:2.0:1734016126.098588:0:6475:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7611450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99867e87-1bc2-4e49-bd45-a757ae2fdd76+12:1982:x1818247333783424:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1734016126.098613:0:6475:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7611450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99867e87-1bc2-4e49-bd45-a757ae2fdd76+12:1982:x1818247333783424:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 25us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016126.098619:0:6475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 328 00000100:00080000:1.0:1734016126.099446:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016096 00000001:02000400:3.0:1734016126.182334:0:14356:0:(debug.c:681:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 16b: 2500 iterations of dual-mount fsx at small size ========================================================== 10:08:45 (1734016125) 00000100:00100000:2.0:1734016126.235357:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016126.235480:0:6482:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333784192 00000100:00100000:3.0:1734016126.235500:0:6482:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333784192 00000100:00100000:3.0:1734016126.235580:0:6482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 40 00000100:00100000:3.0:1734016126.235593:0:6482:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:10385:x1818247333784192:12345-192.168.201.16@tcp:33:lfs.0 00000004:00200000:3.0:1734016126.235719:0:6482:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1734016126.235727:0:6482:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:3.0:1734016126.235866:0:6482:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:10385:x1818247333784192:12345-192.168.201.16@tcp:33:lfs.0 Request processed in 275us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016126.235875:0:6482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 40 00010000:00010000:2.0:1734016126.581239:0:6468:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1734016127.086082:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016127.086204:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333784448 00000100:00100000:3.0:1734016127.086218:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333784448 00000100:00100000:3.0:1734016127.086288:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2228 00000100:00100000:3.0:1734016127.086298:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:10399:x1818247333784448:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:3.0:1734016127.086331:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016127.086336:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1734016127.086384:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27110a91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e2056 expref: 14 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016127.086433:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880073621f00) 00010000:00010000:3.0:1734016127.086440:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016127.086467:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27115d9c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e6f expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016127.086654:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27115da3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016127.086671:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e1c0/0x5e3a3adc2711000a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e178f expref: 11 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016127.086681:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27115da3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016127.086735:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e1c0/0x5e3a3adc2711000a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e178f expref: 11 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016127.086750:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e1c0/0x5e3a3adc2711000a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e178f expref: 11 pid: 6478 timeout: 494 lvb_type: 0 00000100:00100000:3.0:1734016127.086777:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335317760:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016127.086897:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737813c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016127.106431:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016127.110864:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333784576 00000100:00100000:1.0:1734016127.110879:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333784576 00010000:00010000:1.0:1734016127.110927:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e1c0/0x5e3a3adc2711000a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e178f expref: 12 pid: 6478 timeout: 494 lvb_type: 0 00000100:00100000:1.0:1734016127.110964:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3073 00000100:00100000:1.0:1734016127.110973:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333784576:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016127.110993:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016127.111000:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e1c0/0x5e3a3adc2711000a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e178f expref: 12 pid: 6478 timeout: 494 lvb_type: 0 00010000:00010000:1.0:1734016127.111013:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e1c0/0x5e3a3adc2711000a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e178f expref: 12 pid: 6478 timeout: 494 lvb_type: 0 00010000:00010000:1.0:1734016127.111039:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880073621f00) 00010000:00010000:1.0:1734016127.111044:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27115da3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016127.111053:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27115da3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016127.111061:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27115da3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016127.111085:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016127.111148:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333784576:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 175us (4729us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016127.111159:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3073 00010000:00010000:2.0:1734016127.112273:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e1c0/0x5e3a3adc2711000a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e178f expref: 11 pid: 6478 timeout: 494 lvb_type: 0 00000100:00100000:2.0:1734016127.112289:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335317760:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016127.112314:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27115da3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.112324:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27115da3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.112330:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27115da3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.112359:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115daa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.112370:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115daa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.112380:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115daa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.113009:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115db1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.113019:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115db1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.113026:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115db1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016127.113040:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 0 00010000:00010000:2.0:1734016127.113072:0:6478:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27115da3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.113080:0:6478:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27115da3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.113087:0:6478:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27115da3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.113094:0:6478:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4d80 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016127.113098:0:6478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27115da3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.113106:0:6478:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27115da3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.113118:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880073621f00) 00010000:00010000:2.0:1734016127.113121:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016127.113124:0:6478:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27115da3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.113128:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27115da3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000004:00010000:2.0:1734016127.113136:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012e718700 reply state ffff880073a02000 transno 4294968738 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115daa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016127.113149:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1734016127.113190:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27115d9c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e6f expref: 16 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016127.113211:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115db1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e6f expref: 15 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016127.113219:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff880129d12a00) 00010000:00010000:2.0:1734016127.113221:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016127.113224:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016127.113294:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+16:10399:x1818247333784448:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 26995us (27228us total) trans 4294968738 rc 0/0 00000100:00100000:2.0:1734016127.113304:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2228 00000100:00100000:2.0:1734016127.122075:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016127.122140:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333784832 00000100:00100000:2.0:1734016127.122155:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333784832 00000100:00100000:2.0:1734016127.122236:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2229 00000100:00100000:2.0:1734016127.122246:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+16:10399:x1818247333784832:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1734016127.122296:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016127.122329:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115dbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e76 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016127.122505:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115dc6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.122525:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115db1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e6f expref: 17 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016127.122540:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115dc6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.122582:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115db1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e6f expref: 17 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016127.122598:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115db1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e6f expref: 17 pid: 6478 timeout: 494 lvb_type: 0 00000100:00100000:2.0:1734016127.122612:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335317888:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016127.123591:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115daa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016127.123607:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115daa lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016127.123614:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115daa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016127.123622:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd680 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016127.123626:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115daa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016127.123637:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115daa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016127.123663:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc3ce3da0 (ffff880129d12d00) 00010000:00010000:3.0:1734016127.123667:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016127.123671:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115daa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016127.123676:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115daa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016127.134694:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016127.143371:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016127.144319:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333784960 00000100:00100000:2.0:1734016127.144334:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333784960 00010000:00010000:2.0:1734016127.144389:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115db1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e6f expref: 17 pid: 6478 timeout: 494 lvb_type: 0 00000100:00100000:2.0:1734016127.144433:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3074 00000100:00100000:2.0:1734016127.144441:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+17:1981:x1818247333784960:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016127.144460:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016127.144468:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115db1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e6f expref: 17 pid: 6478 timeout: 494 lvb_type: 0 00010000:00010000:2.0:1734016127.144481:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115db1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e6f expref: 17 pid: 6478 timeout: 494 lvb_type: 0 00010000:00010000:2.0:1734016127.144509:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff880129d12a00) 00010000:00010000:2.0:1734016127.144516:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115dc6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.144528:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115dc6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.144536:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115dc6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.144558:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016127.144625:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+17:1981:x1818247333784960:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 182us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016127.144632:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3074 00010000:00010000:2.0:1734016127.144689:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115db1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e6f expref: 16 pid: 6478 timeout: 494 lvb_type: 0 00000100:00100000:2.0:1734016127.144705:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335317888:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016127.144727:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115dc6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.144736:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115dc6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.144741:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115dc6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016127.144759:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 0 00000004:00080000:2.0:1734016127.145021:0:6478:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7:0x0], index 1: 0 00000004:00080000:2.0:1734016127.145029:0:6478:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1734016127.145127:0:6478:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115dc6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.145135:0:6478:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115dc6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.145141:0:6478:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115dc6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.145147:0:6478:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbf180 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016127.145150:0:6478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115dc6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.145156:0:6478:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115dc6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.145163:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff880129d12a00) 00010000:00010000:2.0:1734016127.145165:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1734016127.145168:0:6478:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115dc6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.145172:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115dc6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.145222:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115dbf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e76 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016127.145230:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115dbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e76 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016127.145241:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd440, rc 0) 00000100:00100000:2.0:1734016127.145265:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+15:10399:x1818247333784832:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 23020us (23212us total) trans 4294968739 rc 301/301 00000100:00100000:2.0:1734016127.145273:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2229 00000100:00100000:1.0:1734016127.148989:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016127.149037:0:6481:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333785216 00000100:00100000:1.0:1734016127.149051:0:6481:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333785216 00000100:00100000:1.0:1734016127.149115:0:6481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 41 00000100:00100000:1.0:1734016127.149126:0:6481:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c598caf-7141-4c19-8566-0b7731516db9+15:10399:x1818247333785216:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:1.0:1734016127.149484:0:6481:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c598caf-7141-4c19-8566-0b7731516db9+16:10399:x1818247333785216:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 359us (502us total) trans 4294968740 rc 0/0 00000100:00100000:1.0:1734016127.149492:0:6481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 41 00000100:00100000:2.0:1734016127.155418:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67a75f73-9674-4938-8c12-63813a36f078:3504:1818247335318016:0@lo:400:kworker.0 00000100:00100000:3.0:1734016127.155473:0:3505:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3505:1818247335318144:0@lo:400:kworker.0 00000100:00100000:2.0:1734016127.155513:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1734016127.155568:0:3505:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1734016127.155587:0:3505:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335318656:0@lo:400:kworker.0 00000100:00100000:3.0:1734016127.155614:0:3505:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1734016127.155645:0:3505:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1734016127.155650:0:3505:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3505:1818247335318272:0@lo:400:kworker.0 00000100:00100000:3.0:1734016127.155669:0:3505:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1734016127.156391:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3504:1818247335318528:0@lo:400:kworker.0 00000100:00100000:2.0:1734016127.156419:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1734016127.156439:0:3504:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1734016127.156445:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335318400:0@lo:400:kworker.0 00000100:00100000:2.0:1734016127.156466:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1734016127.156496:0:6474:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335318016 00000100:00100000:2.0:1734016127.156507:0:6474:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335318016 00000100:00100000:2.0:1734016127.156575:0:6474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1734016127.156583:0:6474:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7611050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a75f73-9674-4938-8c12-63813a36f078+18:3504:x1818247335318016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1734016127.156632:0:6474:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7611050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a75f73-9674-4938-8c12-63813a36f078+18:3504:x1818247335318016:12345-0@lo:400:kworker.0 Request processed in 50us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016127.156638:0:6474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1734016127.156682:0:13913:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335318656 00000100:00100000:2.0:1734016127.156685:0:13913:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335318656 00000100:00100000:2.0:1734016127.156709:0:13913:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335318400 00000100:00100000:2.0:1734016127.156711:0:13913:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335318400 00000100:00100000:2.0:1734016127.156726:0:13913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1734016127.156730:0:13913:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335318656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1734016127.156819:0:13913:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335318656:12345-0@lo:400:kworker.0 Request processed in 88us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016127.156825:0:13913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1734016127.156834:0:13913:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1734016127.156838:0:13913:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335318400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1734016127.156859:0:13913:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335318400:12345-0@lo:400:kworker.0 Request processed in 20us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016127.156863:0:13913:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:2.0:1734016127.156876:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016097 00000100:00080000:2.0:1734016127.156880:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016097 00000100:00080000:2.0:1734016127.156882:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016097 00000100:00100000:2.0:1734016127.156921:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335318400:0@lo:400:kworker.0 00000100:00100000:2.0:1734016127.156930:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67a75f73-9674-4938-8c12-63813a36f078:3504:1818247335318016:0@lo:400:kworker.0 00000100:00100000:1.0:1734016127.156950:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335318144 00000100:00100000:1.0:1734016127.156955:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335318144 00000100:00100000:2.0:1734016127.156955:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335318272 00000100:00100000:2.0:1734016127.156959:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335318272 00000100:00100000:1.0:1734016127.156987:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335318528 00000100:00100000:1.0:1734016127.156989:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335318528 00000100:00100000:3.0:1734016127.162762:0:3505:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335318656:0@lo:400:kworker.0 00000100:00100000:1.0:1734016127.166669:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1734016127.166693:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1734016127.166707:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3505:x1818247335318272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1734016127.166719:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1734016127.166731:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3504:x1818247335318528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1734016127.166873:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3505:x1818247335318272:12345-0@lo:400:kworker.0 Request processed in 168us (11201us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016127.166881:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1734016127.166881:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3505:x1818247335318144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016127.166920:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3505:x1818247335318144:12345-0@lo:400:kworker.0 Request processed in 239us (11352us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016127.166928:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1734016127.167036:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3504:1818247335318528:0@lo:400:kworker.0 00000100:00100000:2.0:1734016127.167102:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3504:x1818247335318528:12345-0@lo:400:kworker.0 Request processed in 374us (10681us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016127.167108:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00080000:2.0:1734016127.167140:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016097 00000100:00100000:0.0:1734016127.167162:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016127.167206:0:3505:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3505:1818247335318272:0@lo:400:kworker.0 00000100:00100000:2.0:1734016127.167217:0:3505:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3505:1818247335318144:0@lo:400:kworker.0 00000100:00100000:2.0:1734016127.167247:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333785344 00000100:00100000:2.0:1734016127.167254:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333785344 00000100:00100000:2.0:1734016127.167292:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2230 00000100:00100000:2.0:1734016127.167296:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+16:10399:x1818247333785344:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1734016127.167315:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016127.167338:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115dd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e7d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016127.167384:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115dd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e7d expref: 17 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016127.167438:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115dd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e7d expref: 17 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016127.167452:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff880129d12400) 00010000:00010000:2.0:1734016127.167454:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1734016127.167457:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016127.167488:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+17:10399:x1818247333785344:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 192us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016127.167494:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2230 00000100:00100000:3.0:1734016127.172339:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016127.173025:0:6482:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333785600 00000100:00100000:0.0:1734016127.173042:0:6482:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333785600 00000100:00100000:0.0:1734016127.173114:0:6482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 42 00000100:00100000:0.0:1734016127.173125:0:6482:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c598caf-7141-4c19-8566-0b7731516db9+17:10399:x1818247333785600:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:0.0:1734016127.173512:0:6482:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c598caf-7141-4c19-8566-0b7731516db9+18:10399:x1818247333785600:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 386us (1183us total) trans 4294968741 rc 0/0 00000100:00100000:0.0:1734016127.173522:0:6482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 42 00000100:00100000:1.0:1734016127.190474:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016127.195344:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333785728 00000100:00100000:3.0:1734016127.195362:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333785728 00000100:00100000:3.0:1734016127.195450:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2231 00000100:00100000:3.0:1734016127.195459:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:10400:x1818247333785728:12345-192.168.201.16@tcp:101:dd.0 00010000:00010000:3.0:1734016127.195498:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016127.195530:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115ddb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e84 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016127.195602:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115de2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016127.195616:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115de2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016127.195630:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115de2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016127.195696:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1734016127.195699:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016127.195724:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115de2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016127.195749:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115ddb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e84 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016127.195782:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115de2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e84 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016127.195791:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880073780000) 00010000:00010000:3.0:1734016127.195794:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1734016127.195797:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016127.195934:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+19:10400:x1818247333785728:12345-192.168.201.16@tcp:101:dd.0 Request processed in 475us (5483us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016127.195940:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2231 00000100:00100000:0.0:1734016127.201919:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016127.201955:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333785984 00000100:00100000:0.0:1734016127.201963:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333785984 00000100:00100000:0.0:1734016127.202023:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2232 00000100:00100000:0.0:1734016127.202032:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+19:10400:x1818247333785984:12345-192.168.201.16@tcp:101:dd.0 00010000:00010000:0.0:1734016127.202049:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016127.202052:0:6480:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1734016127.202076:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115de2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e84 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016127.202092:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880073780000) 00010000:00010000:0.0:1734016127.202103:0:6480:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016127.202115:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27115de9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e8b expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016127.202245:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115df0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202258:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115df0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202267:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115df0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202278:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115df7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202284:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115df7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202289:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115df7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202472:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27115dfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202480:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27115dfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202486:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27115dfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:0.0:1734016127.202498:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 0 00010000:00010000:0.0:1734016127.202582:0:6480:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115df0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202589:0:6480:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115df0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202594:0:6480:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115df0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202599:0:6480:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581f80 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016127.202604:0:6480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115df0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202610:0:6480:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115df0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202617:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800734aea00) 00010000:00010000:0.0:1734016127.202620:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016127.202622:0:6480:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115df0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202627:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115df0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202639:0:6480:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115df7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202643:0:6480:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115df7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202647:0:6480:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115df7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202651:0:6480:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7582d00 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016127.202653:0:6480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115df7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202657:0:6480:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115df7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202662:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc3ce3da0 (ffff8800734ae400) 00010000:00010000:0.0:1734016127.202663:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016127.202665:0:6480:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115df7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202669:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115df7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016127.202701:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27115de9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e8b expref: 21 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016127.202713:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27115dfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e8b expref: 20 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016127.202718:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff880129d12400) 00010000:00010000:0.0:1734016127.202720:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016127.202722:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:0.0:1734016127.203531:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+20:10400:x1818247333785984:12345-192.168.201.16@tcp:101:dd.0 Request processed in 1494us (1622us total) trans 4294968742 rc 0/0 00000100:00100000:0.0:1734016127.203539:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2232 00000100:00100000:0.0:1734016127.210744:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016127.210844:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333786112 00000100:00100000:1.0:1734016127.210860:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333786112 00000100:00100000:1.0:1734016127.210913:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2233 00000100:00100000:1.0:1734016127.210919:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+20:10400:x1818247333786112:12345-192.168.201.16@tcp:101:dd.0 00010000:00010000:1.0:1734016127.210941:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016127.210962:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e1c0/0x5e3a3adc27115e0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e92 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016127.210996:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115e13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016127.211009:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115e13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016127.211018:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115e13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016127.211106:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e1c0/0x5e3a3adc27115e0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e92 expref: 22 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016127.211118:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115e13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e92 expref: 21 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016127.211125:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff880129d12400) 00010000:00010000:1.0:1734016127.211127:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1734016127.211129:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016127.211172:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+21:10400:x1818247333786112:12345-192.168.201.16@tcp:101:dd.0 Request processed in 252us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016127.211180:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2233 00000100:00100000:0.0:1734016127.213356:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016127.214180:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333786368 00000100:00100000:2.0:1734016127.214195:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333786368 00000100:00100000:2.0:1734016127.214264:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2234 00000100:00100000:2.0:1734016127.214272:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+21:10400:x1818247333786368:12345-192.168.201.16@tcp:36:dd.0 00010000:00010000:2.0:1734016127.214339:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016127.214378:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581440/0x5e3a3adc27115dfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e8b expref: 21 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016127.214402:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff880129d12400) 00010000:00010000:2.0:1734016127.214407:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016127.214601:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.214612:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.214621:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:2.0:1734016127.214661:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968743 00000004:00010000:2.0:1734016127.214676:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800750c3480 reply state ffff8800a7acb000 transno 4294968744 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016127.214687:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016127.214819:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+23:10400:x1818247333786368:12345-192.168.201.16@tcp:36:dd.0 Request processed in 529us (1458us total) trans 4294968744 rc 0/0 00000100:00100000:2.0:1734016127.214826:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2234 00000020:00080000:2.0:1734016127.214830:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016127.218532:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016127.218623:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333786496 00000100:00100000:1.0:1734016127.218635:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333786496 00000100:00100000:1.0:1734016127.218841:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11063 00010000:00010000:2.0:1734016127.218847:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00000100:00100000:1.0:1734016127.218850:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:10400:x1818247333786496:12345-192.168.201.16@tcp:101:dd.0 00010000:00010000:2.0:1734016127.218860:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.218869:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.218875:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc900 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:1.0:1734016127.218880:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016127.218881:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.218890:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016127.218909:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27115e21 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5e99 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016127.218911:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff880129d12400) 00010000:00010000:2.0:1734016127.218915:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016127.218920:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e1a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016127.218927:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00002000:00010000:1.0:1734016127.218944:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1734016127.218976:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016127.218978:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016127.218987:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27115e21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e99 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016127.219007:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27115e21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e99 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016127.219019:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016127.219082:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:10400:x1818247333786496:12345-192.168.201.16@tcp:101:dd.0 Request processed in 232us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016127.219089:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11063 00000100:00100000:2.0:1734016127.220838:0:3505:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1734016127.220869:0:3505:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335318784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1734016127.220934:0:3505:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016127.222707:0:7686:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335318784 00000100:00100000:0.0:1734016127.222727:0:7686:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335318784 00000100:00100000:0.0:1734016127.222843:0:7686:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1734016127.222852:0:7686:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335318784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1734016127.222897:0:7686:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 980042304 pending 0 free 3923075072 avail 3691552768 00000100:00100000:0.0:1734016127.222975:0:7686:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335318784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (2042us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016127.222982:0:7686:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1734016127.223050:0:3505:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335318784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1734016127.234758:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016127.234826:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333786624 00000100:00100000:1.0:1734016127.234834:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333786624 00000100:00100000:1.0:1734016127.234879:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11064 00000100:00100000:1.0:1734016127.234886:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:10400:x1818247333786624:12345-192.168.201.16@tcp:101:dd.0 00010000:00010000:1.0:1734016127.234905:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016127.234924:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27115e28 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ea0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016127.234948:0:8216:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1734016127.234971:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016127.234974:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016127.234981:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27115e28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ea0 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016127.234997:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27115e28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ea0 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016127.235007:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016127.235055:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:10400:x1818247333786624:12345-192.168.201.16@tcp:101:dd.0 Request processed in 169us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016127.235062:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11064 00000100:00100000:0.0:1734016127.270885:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016127.270928:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333786752 00000100:00100000:0.0:1734016127.270941:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333786752 00002000:00010000:0.0:1734016127.270993:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/7 (0->18446744073709551615) 00002000:00100000:0.0:1734016127.271000:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0380 with x1818247333786752 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016127.271017:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c0380. 00000100:00100000:0.0:1734016127.271064:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8744 00000100:00100000:0.0:1734016127.271073:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333786752:12345-192.168.201.16@tcp:10:dd.0 00002000:00010000:0.0:1734016127.271267:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1734016127.271272:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb mtime from disk: 0 -> 1734016127 00002000:00010000:0.0:1734016127.271274:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1734016127.271276:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb ctime from disk: 0 -> 1734016127 00002000:00010000:0.0:1734016127.271277:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1734016127.271333:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333786752:12345-192.168.201.16@tcp:10:dd.0 Request processed in 261us (468us total) trans 4294969459 rc 0/0 00000100:00100000:0.0:1734016127.271339:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8744 00002000:00010000:0.0:1734016127.271342:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/7 (0->18446744073709551615) 00002000:00100000:0.0:1734016127.271345:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0380 with x1818247333786752 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016127.271348:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c0380. 00000100:00100000:0.0:1734016127.271397:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016127.271411:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333786880 00000100:00100000:0.0:1734016127.271414:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333786880 00002000:00010000:0.0:1734016127.271429:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1734016127.271431:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c2300 with x1818247333786880 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016127.271440:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c2300. 00000100:00100000:0.0:1734016127.271451:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8745 00000100:00100000:0.0:1734016127.271455:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333786880:12345-192.168.201.16@tcp:10:dd.0 00002000:00010000:0.0:1734016127.271544:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1734016127.271548:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1734016127 00002000:00010000:0.0:1734016127.271550:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1734016127.271552:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1734016127 00002000:00010000:0.0:1734016127.271555:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1734016127.271573:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333786880:12345-192.168.201.16@tcp:10:dd.0 Request processed in 116us (174us total) trans 4294967982 rc 0/0 00000100:00100000:0.0:1734016127.271578:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8745 00002000:00010000:0.0:1734016127.271581:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1734016127.271583:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c2300 with x1818247333786880 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016127.271586:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c2300. 00000100:00100000:0.0:1734016127.411649:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335318912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1734016127.411737:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1734016127.411897:0:7685:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335318912 00000100:00100000:2.0:1734016127.411905:0:7685:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335318912 00000100:00100000:2.0:1734016127.411951:0:7685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1734016127.411957:0:7685:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335318912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1734016127.411991:0:7685:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 490160704 pending 0 free 3923677184 avail 3692154880 00000100:00100000:2.0:1734016127.414532:0:7685:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335318912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2549us (2769us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016127.414553:0:7685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1734016127.417148:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335318912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1734016127.438744:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016127.441184:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333787136 00000100:00100000:2.0:1734016127.441199:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333787136 00002000:00100000:2.0:1734016127.441260:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x7:0x0] (0->4194303) req@ffff8800750c0a80 x1818247333787136/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:88/0 lens 488/0 e 0 to 0 dl 1734016138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1734016127.441270:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0a80 with x1818247333787136 ext(0->4194303) 00002000:00010000:2.0:1734016127.441276:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c0a80 00000100:00100000:2.0:1734016127.441631:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8746 00000100:00100000:2.0:1734016127.441638:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333787136:12345-192.168.201.16@tcp:4:dd.0 00010000:00010000:2.0:1734016127.584043:0:8958:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1734016127.669831:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333787136:12345-192.168.201.16@tcp:4:dd.0 Request processed in 228161us (231067us total) trans 4294969460 rc 0/0 00000100:00100000:0.0:1734016127.669843:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8746 00002000:00100000:0.0:1734016127.669853:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x7:0x0] (0->4194303) req@ffff8800750c0a80 x1818247333787136/t4294969460(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:88/0 lens 488/448 e 0 to 0 dl 1734016138 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1734016127.669861:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0a80 with x1818247333787136 ext(0->4194303) 00002000:00010000:0.0:1734016127.669866:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c0a80 00000100:00100000:0.0:1734016127.677088:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016127.677319:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333787264 00000100:00100000:1.0:1734016127.677328:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333787264 00000100:00100000:2.0:1734016127.679296:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2235 00000100:00100000:2.0:1734016127.679306:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+22:10400:x1818247333787264:12345-192.168.201.16@tcp:44:dd.0 00000001:00080000:0.0:1734016127.681210:0:6461:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968744 is committed 00000100:00100000:2.0:1734016127.682384:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+15:10400:x1818247333787264:12345-192.168.201.16@tcp:44:dd.0 Request processed in 3067us (5294us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016127.682397:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2235 00000100:00100000:0.0:1734016127.695223:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016127.695341:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333787392 00000100:00100000:2.0:1734016127.695351:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333787392 00000100:00100000:2.0:1734016127.695413:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11065 00000100:00100000:2.0:1734016127.695419:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333787392:12345-192.168.201.16@tcp:16:dd.0 00000001:00080000:0.0:1734016127.697031:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969460 is committed 00000100:00100000:2.0:1734016127.697909:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333787392:12345-192.168.201.16@tcp:16:dd.0 Request processed in 2479us (2686us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016127.697925:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11065 00000100:00100000:1.0:1734016127.912350:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016127.918653:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333787648 00000100:00100000:0.0:1734016127.918672:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333787648 00002000:00100000:0.0:1734016127.918740:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->4194303) req@ffff8800750d0700 x1818247333787648/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:88/0 lens 488/0 e 0 to 0 dl 1734016138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1734016127.918762:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d0700 with x1818247333787648 ext(0->4194303) 00002000:00010000:0.0:1734016127.918771:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750d0700 00000100:00100000:0.0:1734016127.918893:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8747 00000100:00100000:0.0:1734016127.918902:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333787648:12345-192.168.201.16@tcp:4:dd.0 00000100:00100000:1.0:1734016128.080743:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333787648:12345-192.168.201.16@tcp:4:dd.0 Request processed in 161824us (168390us total) trans 4294967983 rc 0/0 00000100:00100000:1.0:1734016128.080768:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8747 00002000:00100000:1.0:1734016128.080782:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->4194303) req@ffff8800750d0700 x1818247333787648/t4294967983(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:88/0 lens 488/448 e 0 to 0 dl 1734016138 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1734016128.080793:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d0700 with x1818247333787648 ext(0->4194303) 00002000:00010000:1.0:1734016128.080834:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750d0700 00000100:00100000:0.0:1734016128.086032:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016128.086166:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333787776 00000100:00100000:2.0:1734016128.086178:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333787776 00000100:00080000:0.0:1734016128.086302:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016098 00000100:00100000:2.0:1734016128.087296:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11066 00000100:00100000:2.0:1734016128.087309:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333787776:12345-192.168.201.16@tcp:16:dd.0 00000001:00080000:0.0:1734016128.097722:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294967983 is committed 00000100:00100000:2.0:1734016128.101017:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333787776:12345-192.168.201.16@tcp:16:dd.0 Request processed in 13700us (14989us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016128.101029:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11066 00000100:00100000:2.0:1734016128.105214:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016128.105925:0:6482:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333788032 00000100:00100000:0.0:1734016128.105936:0:6482:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333788032 00000100:00080000:2.0:1734016128.106567:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016098 00000100:00100000:0.0:1734016128.107163:0:6482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 43 00000100:00100000:0.0:1734016128.107173:0:6482:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c598caf-7141-4c19-8566-0b7731516db9+15:10400:x1818247333788032:12345-192.168.201.16@tcp:35:dd.0 00000001:00080000:0.0:1734016128.107392:0:6482:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968745 00000100:00100000:0.0:1734016128.109786:0:6482:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c598caf-7141-4c19-8566-0b7731516db9+17:10400:x1818247333788032:12345-192.168.201.16@tcp:35:dd.0 Request processed in 2603us (4570us total) trans 4294968746 rc 0/0 00000100:00100000:0.0:1734016128.109798:0:6482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 43 00000020:00080000:0.0:1734016128.109818:0:6482:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016128.141770:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016128.141933:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333788160 00000100:00100000:2.0:1734016128.141945:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333788160 00000100:00100000:2.0:1734016128.142020:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2236 00000100:00100000:2.0:1734016128.142028:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:10402:x1818247333788160:12345-192.168.201.16@tcp:101:dd.0 00010000:00010000:2.0:1734016128.142050:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016128.142076:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115e2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ea7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016128.142143:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115e36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.142157:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115e36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.142168:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115e36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016128.142217:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1734016128.142220:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016128.142243:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115e36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.142265:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115e2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ea7 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1734016128.142444:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016098 00010000:00010000:2.0:1734016128.153702:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115e36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ea7 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016128.153720:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b433d200) 00010000:00010000:2.0:1734016128.153723:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1734016128.153726:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016128.153839:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:10402:x1818247333788160:12345-192.168.201.16@tcp:101:dd.0 Request processed in 11808us (12098us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016128.153848:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2236 00000100:00100000:0.0:1734016128.161707:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016128.161843:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333788416 00000100:00100000:2.0:1734016128.161856:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333788416 00000100:00100000:2.0:1734016128.161924:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2237 00000100:00100000:2.0:1734016128.161935:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:10402:x1818247333788416:12345-192.168.201.16@tcp:101:dd.0 00010000:00010000:2.0:1734016128.161965:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016128.161970:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1734016128.162009:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115e36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ea7 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016128.162045:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b433d200) 00010000:00010000:2.0:1734016128.162064:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016128.162078:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115e3d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5eae expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016128.162244:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e44 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162258:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162268:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162284:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115e4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162291:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115e4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162297:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115e4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162364:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115e52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162370:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115e52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162377:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115e52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016128.162387:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 8388608 00010000:00010000:2.0:1734016128.162528:0:6478:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162539:0:6478:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e44 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162546:0:6478:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162554:0:6478:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc900 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016128.162559:0:6478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162568:0:6478:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162577:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b433d900) 00010000:00010000:2.0:1734016128.162580:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016128.162583:0:6478:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162588:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115e44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162596:0:6478:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115e4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162601:0:6478:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115e4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162606:0:6478:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115e4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162611:0:6478:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd440 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016128.162613:0:6478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115e4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162620:0:6478:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115e4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162625:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc3ce3da0 (ffff880129dc7800) 00010000:00010000:2.0:1734016128.162627:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016128.162629:0:6478:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115e4b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162633:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115e4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016128.162694:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115e3d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5eae expref: 14 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016128.162707:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115e52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5eae expref: 13 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016128.162715:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff880129d12400) 00010000:00010000:2.0:1734016128.162716:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016128.162719:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016128.162798:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:10402:x1818247333788416:12345-192.168.201.16@tcp:101:dd.0 Request processed in 864us (1103us total) trans 4294968747 rc 0/0 00000100:00100000:2.0:1734016128.162840:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2237 00000100:00100000:0.0:1734016128.168387:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016128.168536:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333788672 00000100:00100000:2.0:1734016128.168546:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333788672 00000100:00100000:2.0:1734016128.168603:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2238 00000100:00100000:2.0:1734016128.168611:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:10402:x1818247333788672:12345-192.168.201.16@tcp:36:dd.0 00010000:00010000:2.0:1734016128.168680:0:6480:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016128.168716:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115e52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5eae expref: 13 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016128.168738:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff880129d12400) 00010000:00010000:2.0:1734016128.168744:0:6480:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016128.168968:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115e60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016128.168981:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115e60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016128.168990:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115e60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000001:00080000:2.0:1734016128.169024:0:6480:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968748 00000004:00010000:2.0:1734016128.169040:0:6480:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800756a4700 reply state ffff88007588e000 transno 4294968749 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115e60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:2.0:1734016128.169047:0:6480:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016128.169126:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10402:x1818247333788672:12345-192.168.201.16@tcp:36:dd.0 Request processed in 515us (755us total) trans 4294968749 rc 0/0 00000100:00100000:2.0:1734016128.169132:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2238 00000020:00080000:2.0:1734016128.169137:0:6480:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1734016128.180597:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115e60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:3.0:1734016128.180615:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115e60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:3.0:1734016128.180622:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115e60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:3.0:1734016128.180628:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbdf80 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016128.180633:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115e60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:3.0:1734016128.180639:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115e60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:3.0:1734016128.180657:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff880129d12400) 00010000:00010000:3.0:1734016128.180659:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016128.180662:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115e60 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:3.0:1734016128.180666:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115e60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00000100:00100000:1.0:1734016128.182911:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016128.183144:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333788800 00000100:00100000:2.0:1734016128.183158:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333788800 00000100:00100000:2.0:1734016128.183229:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2239 00000100:00100000:2.0:1734016128.183239:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:10402:x1818247333788800:12345-192.168.201.16@tcp:101:dd.0 00010000:00010000:2.0:1734016128.183274:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016128.183299:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115e67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5eb5 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016128.183382:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115e67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5eb5 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016128.183399:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd680/0x5e3a3adc27115e67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5eb5 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016128.183421:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff880129d12400) 00010000:00010000:2.0:1734016128.183424:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1734016128.183428:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd680, rc 0) 00000100:00100000:2.0:1734016128.183530:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10402:x1818247333788800:12345-192.168.201.16@tcp:101:dd.0 Request processed in 290us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016128.183539:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2239 00000100:00100000:0.0:1734016128.188059:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016128.188134:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333788928 00000100:00100000:0.0:1734016128.188146:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333788928 00000100:00100000:0.0:1734016128.188253:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11067 00000100:00100000:0.0:1734016128.188266:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10402:x1818247333788928:12345-192.168.201.16@tcp:101:dd.0 00010000:00010000:0.0:1734016128.188295:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016128.188327:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27115e6e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ebc expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016128.188376:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27115e21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e99 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016128.188442:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016128.188446:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016128.188452:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27115e6e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ebc expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016128.188500:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27115e21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e99 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016128.188513:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27115e21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e99 expref: 6 pid: 8216 timeout: 495 lvb_type: 0 00000100:00100000:0.0:1734016128.188532:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335319040:192.168.201.16@tcp:104: 00000100:00080000:1.0:1734016128.188627:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016098 00000100:00100000:2.0:1734016128.188757:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016128.202488:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335319040:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016128.202524:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27115e6e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ebc expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016128.202543:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:2.0:1734016128.202584:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10402:x1818247333788928:12345-192.168.201.16@tcp:101:dd.0 Request processed in 14320us (14545us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016128.202593:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11067 00000100:00100000:1.0:1734016128.213558:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016128.214167:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333789056 00000100:00100000:0.0:1734016128.214177:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333789056 00010000:00010000:0.0:1734016128.214235:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27115e21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e99 expref: 7 pid: 8216 timeout: 495 lvb_type: 0 00000100:00080000:1.0:1734016128.214344:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016098 00000100:00100000:0.0:1734016128.215333:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3075 00000100:00100000:0.0:1734016128.215348:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333789056:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016128.215365:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016128.215373:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27115e21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e99 expref: 7 pid: 8216 timeout: 495 lvb_type: 0 00010000:00010000:0.0:1734016128.215387:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27115e21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e99 expref: 7 pid: 8216 timeout: 495 lvb_type: 0 00010000:00010000:0.0:1734016128.215413:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27115e21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e99 expref: 7 pid: 8216 timeout: 495 lvb_type: 0 00010000:00010000:0.0:1734016128.219348:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016128.219358:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016128.219379:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27115e6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ebc expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016128.219393:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27115e6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ebc expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016128.219658:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27115e6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ebc expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016128.219682:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335319168:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016128.219769:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016128.225272:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016128.225435:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333789184 00000100:00100000:2.0:1734016128.225447:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333789184 00000100:00100000:2.0:1734016128.225484:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11068 00000100:00100000:2.0:1734016128.225495:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:1980:x1818247333789184:12345-192.168.201.16@tcp:8:dd.0 00010000:00080000:2.0:1734016128.225536:0:7682:0:(ldlm_lib.c:1340:target_handle_connect()) lustre-OST0000: connection from 84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp t0 exp (null) cur 395 last 0 00000020:00000080:2.0:1734016128.225567:0:7682:0:(genops.c:1313:class_connect()) connect: client 84392f61-a30b-4a4c-b6a5-f13f1ae7284e, cookie 0x5e3a3adc27115e75 00002000:00100000:2.0:1734016128.225582:0:7682:0:(ofd_obd.c:151:ofd_parse_connect_data()) lustre-OST0000: cli 84392f61-a30b-4a4c-b6a5-f13f1ae7284e/ffff880073677800 ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 2100000 ocd_grant: 489881600 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1734016128.225592:0:7682:0:(ofd_obd.c:249:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:01000000:2.0:1734016128.225651:0:7682:0:(lprocfs_status_server.c:574:lprocfs_exp_setup()) using hash ffff8800a9977f00 00002000:00080000:2.0:1734016128.225660:0:7682:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1734016128.225683:0:7682:0:(import.c:86:import_set_state_nolock()) ffff880073677000 ÿÿÿÿ: changing import state from RECOVER to FULL 00000100:00100000:2.0:1734016128.225765:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1980:x1818247333789184:12345-192.168.201.16@tcp:8:dd.0 Request processed in 270us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016128.225771:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11068 00000100:00100000:1.0:1734016128.225980:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335319168:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016128.226001:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016128.226028:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333789056:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 10684us (12487us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016128.226038:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3075 00000100:00100000:0.0:1734016128.230981:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016128.231077:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333789312 00000100:00100000:2.0:1734016128.231088:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333789312 00000100:00100000:2.0:1734016128.231158:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11069 00000100:00100000:2.0:1734016128.231168:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10402:x1818247333789312:12345-192.168.201.16@tcp:101:dd.0 00010000:00010000:2.0:1734016128.231194:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016128.231216:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27115e7c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ec3 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016128.231254:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27115e28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ea0 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016128.231262:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016128.231265:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016128.231268:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27115e7c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ec3 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016128.231312:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27115e28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ea0 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016128.231328:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27115e28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ea0 expref: 6 pid: 8216 timeout: 495 lvb_type: 0 00000100:00100000:2.0:1734016128.231345:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335319296:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016128.231437:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016128.237510:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335319296:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016128.237546:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27115e7c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ec3 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016128.237566:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016128.237625:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10402:x1818247333789312:12345-192.168.201.16@tcp:101:dd.0 Request processed in 6458us (6655us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016128.237633:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11069 00000100:00100000:1.0:1734016128.248037:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016128.250603:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333789440 00000100:00100000:2.0:1734016128.250628:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333789440 00010000:00010000:2.0:1734016128.250706:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27115e28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ea0 expref: 7 pid: 8216 timeout: 495 lvb_type: 0 00000100:00100000:2.0:1734016128.250788:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3076 00000100:00100000:2.0:1734016128.250798:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333789440:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016128.250879:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016128.250886:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27115e28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ea0 expref: 7 pid: 8216 timeout: 495 lvb_type: 0 00010000:00010000:2.0:1734016128.250901:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27115e28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ea0 expref: 7 pid: 8216 timeout: 495 lvb_type: 0 00010000:00010000:2.0:1734016128.250933:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27115e28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ea0 expref: 7 pid: 8216 timeout: 495 lvb_type: 0 00010000:00010000:2.0:1734016128.252010:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016128.252015:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016128.252026:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27115e7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ec3 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016128.252037:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27115e7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ec3 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016128.252088:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27115e7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ec3 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016128.252105:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335319424:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016128.252200:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016128.254696:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335319424:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016128.254717:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016128.255400:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333789440:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4600us (7377us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016128.255413:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3076 00000100:00100000:0.0:1734016128.255427:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016128.255451:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333789568 00000100:00100000:1.0:1734016128.255456:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333789568 00002000:00010000:1.0:1734016128.255482:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/7 (0->18446744073709551615) 00002000:00100000:1.0:1734016128.255485:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7aac850 with x1818247333789568 ext(0->18446744073709551615) 00002000:00010000:1.0:1734016128.255494:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7aac850. 00000100:00100000:2.0:1734016128.256341:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016128.256547:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333789696 00000100:00100000:1.0:1734016128.256552:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333789696 00002000:00010000:1.0:1734016128.256574:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1734016128.256578:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71bb80 with x1818247333789696 ext(0->18446744073709551615) 00000100:00100000:0.0:1734016128.256583:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8748 00002000:00010000:1.0:1734016128.256586:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e71bb80. 00000100:00100000:0.0:1734016128.256590:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333789568:12345-192.168.201.16@tcp:10:dd.0 00000100:00100000:1.0:1734016128.256597:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8749 00000100:00100000:1.0:1734016128.256601:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333789696:12345-192.168.201.16@tcp:10:dd.0 00002000:00010000:0.0:1734016128.264249:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1734016128.264258:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb mtime from disk: 1734016127 -> 1734016128 00002000:00010000:0.0:1734016128.264261:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1734016128.264262:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb ctime from disk: 1734016127 -> 1734016128 00002000:00010000:0.0:1734016128.264264:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1734016128.264387:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333789568:12345-192.168.201.16@tcp:10:dd.0 Request processed in 7784us (8946us total) trans 4294969461 rc 0/0 00000100:00100000:0.0:1734016128.264401:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8748 00002000:00010000:0.0:1734016128.264409:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/7 (0->18446744073709551615) 00002000:00100000:0.0:1734016128.264413:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7aac850 with x1818247333789568 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016128.264420:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7aac850. 00000001:00080000:3.0:1734016128.281273:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294967984 is committed 00000001:00100000:3.0:1734016128.281287:0:7680:0:(tgt_lastrcvd.c:534:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 84392f61-a30b-4a4c-b6a5-f13f1ae7284e 00002000:00010000:1.0:1734016128.281461:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1734016128.281465:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1734016127 -> 1734016128 00002000:00010000:1.0:1734016128.281467:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1734016128.281469:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1734016127 -> 1734016128 00002000:00010000:1.0:1734016128.281471:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1734016128.281559:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333789696:12345-192.168.201.16@tcp:10:dd.0 Request processed in 24948us (25215us total) trans 4294967984 rc 0/0 00000100:00100000:1.0:1734016128.281570:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8749 00002000:00010000:1.0:1734016128.281578:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1734016128.281581:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71bb80 with x1818247333789696 ext(0->18446744073709551615) 00002000:00010000:1.0:1734016128.281586:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e71bb80. 00000100:00100000:0.0:1734016128.560261:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016128.561344:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333789952 00000100:00100000:1.0:1734016128.561360:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333789952 00002000:00100000:1.0:1734016128.561429:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x7:0x0] (0->4194303) req@ffff88012db08000 x1818247333789952/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:89/0 lens 488/0 e 0 to 0 dl 1734016139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1734016128.561441:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db08000 with x1818247333789952 ext(0->4194303) 00002000:00010000:1.0:1734016128.561447:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db08000 00000100:00100000:1.0:1734016128.561489:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8750 00000100:00100000:1.0:1734016128.561495:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333789952:12345-192.168.201.16@tcp:4:dd.0 00010000:00010000:2.0:1734016128.586776:0:6469:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1734016128.699961:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333789952:12345-192.168.201.16@tcp:4:dd.0 Request processed in 138453us (139699us total) trans 4294969462 rc 0/0 00000100:00100000:0.0:1734016128.699976:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8750 00002000:00100000:0.0:1734016128.699991:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x7:0x0] (0->4194303) req@ffff88012db08000 x1818247333789952/t4294969462(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:89/0 lens 488/448 e 0 to 0 dl 1734016139 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1734016128.700001:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db08000 with x1818247333789952 ext(0->4194303) 00002000:00010000:0.0:1734016128.700009:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db08000 00000100:00100000:0.0:1734016128.714255:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016128.714354:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333790080 00000100:00100000:2.0:1734016128.714368:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333790080 00000100:00100000:2.0:1734016128.714433:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2240 00000100:00100000:2.0:1734016128.714443:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10402:x1818247333790080:12345-192.168.201.16@tcp:44:dd.0 00000100:00100000:2.0:1734016128.715371:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10402:x1818247333790080:12345-192.168.201.16@tcp:44:dd.0 Request processed in 927us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016128.715381:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2240 00000100:00100000:2.0:1734016128.718380:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016128.720266:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333790208 00000100:00100000:0.0:1734016128.720279:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333790208 00000100:00100000:1.0:1734016128.720895:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11070 00000100:00100000:1.0:1734016128.720903:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333790208:12345-192.168.201.16@tcp:16:dd.0 00000001:00080000:1.0:1734016128.731875:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969462 is committed 00000100:00100000:2.0:1734016128.732943:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333790208:12345-192.168.201.16@tcp:16:dd.0 Request processed in 12028us (14561us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016128.732959:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11070 00000100:00100000:3.0:1734016128.905040:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016128.905957:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333790464 00000100:00100000:0.0:1734016128.905968:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333790464 00002000:00100000:0.0:1734016128.906037:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->4194303) req@ffff8800a78cc380 x1818247333790464/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:89/0 lens 488/0 e 0 to 0 dl 1734016139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1734016128.906050:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cc380 with x1818247333790464 ext(0->4194303) 00002000:00010000:0.0:1734016128.906057:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a78cc380 00000100:00100000:0.0:1734016128.906107:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8751 00000100:00100000:0.0:1734016128.906114:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333790464:12345-192.168.201.16@tcp:4:dd.0 00000100:00100000:1.0:1734016129.048180:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333790464:12345-192.168.201.16@tcp:4:dd.0 Request processed in 142041us (143130us total) trans 4294967985 rc 0/0 00000100:00100000:1.0:1734016129.048201:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8751 00002000:00100000:1.0:1734016129.048223:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->4194303) req@ffff8800a78cc380 x1818247333790464/t4294967985(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:89/0 lens 488/448 e 0 to 0 dl 1734016139 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1734016129.048235:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cc380 with x1818247333790464 ext(0->4194303) 00002000:00010000:1.0:1734016129.048242:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a78cc380 00000100:00100000:1.0:1734016129.055358:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.056638:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333790592 00000100:00100000:2.0:1734016129.056658:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333790592 00000100:00100000:2.0:1734016129.056743:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11071 00000100:00100000:2.0:1734016129.056752:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333790592:12345-192.168.201.16@tcp:16:dd.0 00000001:00080000:0.0:1734016129.058597:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294967985 is committed 00000100:00100000:2.0:1734016129.058842:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333790592:12345-192.168.201.16@tcp:16:dd.0 Request processed in 2084us (3491us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016129.058854:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11071 00000100:00100000:2.0:1734016129.067215:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016129.067486:0:6482:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333790848 00000100:00100000:0.0:1734016129.067497:0:6482:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333790848 00000100:00100000:0.0:1734016129.067557:0:6482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 44 00000100:00100000:0.0:1734016129.067564:0:6482:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10402:x1818247333790848:12345-192.168.201.16@tcp:35:dd.0 00000001:00080000:0.0:1734016129.067781:0:6482:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968750 00000100:00100000:0.0:1734016129.067931:0:6482:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:10402:x1818247333790848:12345-192.168.201.16@tcp:35:dd.0 Request processed in 367us (727us total) trans 4294968751 rc 0/0 00000100:00100000:0.0:1734016129.067938:0:6482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 44 00000020:00080000:0.0:1734016129.067943:0:6482:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1734016129.087295:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.089674:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333790976 00000100:00100000:2.0:1734016129.089694:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333790976 00000100:00100000:2.0:1734016129.089821:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2241 00000100:00100000:2.0:1734016129.089831:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+17:10404:x1818247333790976:12345-192.168.201.16@tcp:101:rm.0 00010000:00010000:2.0:1734016129.089873:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016129.089906:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27115e83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5eca expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.090001:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115e8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.090019:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115e8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.090035:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115e8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:2.0:1734016129.090094:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1734016129.090098:0:6480:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016129.090121:0:6480:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115e8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.090143:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27115e83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5eca expref: 19 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.090190:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115e8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5eca expref: 18 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.090200:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88007361b400) 00010000:00010000:2.0:1734016129.090204:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1734016129.090208:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016129.090295:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+18:10404:x1818247333790976:12345-192.168.201.16@tcp:101:rm.0 Request processed in 464us (3021us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016129.090302:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2241 00000100:00100000:0.0:1734016129.093282:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.093391:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333791104 00000100:00100000:2.0:1734016129.093402:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333791104 00000100:00100000:2.0:1734016129.093456:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2242 00000100:00100000:2.0:1734016129.093465:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:10404:x1818247333791104:12345-192.168.201.16@tcp:101:rm.0 00010000:00010000:2.0:1734016129.093493:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016129.093518:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115e91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ed1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.093586:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115e98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093599:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115e98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093614:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115e98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093627:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115e9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093632:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115e9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093637:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115e9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093713:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115ea6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093720:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093725:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016129.093771:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 8388608 00000004:00200000:2.0:1734016129.093776:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016129.093793:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093844:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093852:0:6478:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115e98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093862:0:6478:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115e98 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093866:0:6478:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115e98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093871:0:6478:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbf180 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016129.093873:0:6478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115e98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093880:0:6478:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115e98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093889:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88007361b400) 00010000:00010000:2.0:1734016129.093891:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016129.093894:0:6478:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115e98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093898:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115e98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093910:0:6478:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115e9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093914:0:6478:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115e9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093918:0:6478:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115e9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093921:0:6478:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcb40 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016129.093923:0:6478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115e9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093929:0:6478:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115e9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093934:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc3ce3da0 (ffff88007361bd00) 00010000:00010000:2.0:1734016129.093935:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016129.093936:0:6478:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115e9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093940:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115e9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.093962:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115e91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ed1 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.093973:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115ea6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ed1 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.093979:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff880129d12400) 00010000:00010000:2.0:1734016129.093980:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016129.093982:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd440, rc 0) 00000100:00100000:2.0:1734016129.094028:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+19:10404:x1818247333791104:12345-192.168.201.16@tcp:101:rm.0 Request processed in 565us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016129.094035:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2242 00000100:00100000:2.0:1734016129.097408:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.097445:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333791232 00000100:00100000:2.0:1734016129.097454:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333791232 00000100:00100000:2.0:1734016129.097487:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11072 00000100:00100000:2.0:1734016129.097493:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333791232:12345-192.168.201.16@tcp:101:rm.0 00010000:00010000:2.0:1734016129.097509:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016129.097524:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115ead lrc: 2/0,0 mode: --/PR res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ed8 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016129.097576:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335319552:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016129.097626:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016129.097657:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.097672:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333791360 00000100:00100000:2.0:1734016129.097675:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333791360 00000100:00100000:2.0:1734016129.097691:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11073 00000100:00100000:2.0:1734016129.097695:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333791360:12345-192.168.201.16@tcp:101:rm.0 00010000:00010000:2.0:1734016129.097701:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016129.097709:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115eb4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5edf expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016129.097729:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335319680:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016129.097755:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00002000:00010000:0.0:1734016129.100143:0:8216:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb size: 0 -> 4194304 00002000:00010000:0.0:1734016129.100154:0:8216:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb mtime: 1734016128 -> 1734016129 00002000:00010000:0.0:1734016129.100156:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb atime: 0 -> 1734016127 00002000:00010000:0.0:1734016129.100158:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb ctime: 1734016128 -> 1734016129 00002000:00010000:0.0:1734016129.100160:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb blocks: 0 -> 8192 00000100:00100000:0.0:1734016129.100191:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335319552:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016129.100243:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115ead lrc: 1/0,0 mode: --/PR res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ed8 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016129.100260:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27115ead lrc: 0/0,0 mode: --/PR res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ed8 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016129.100289:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:0.0:1734016129.100340:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333791232:12345-192.168.201.16@tcp:101:rm.0 Request processed in 2845us (2941us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016129.100355:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11072 00002000:00010000:3.0:1734016129.101430:0:7684:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size: 0 -> 4194304 00002000:00010000:3.0:1734016129.101436:0:7684:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime: 1734016128 -> 1734016129 00002000:00010000:3.0:1734016129.101439:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime: 0 -> 1734016127 00002000:00010000:3.0:1734016129.101441:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime: 1734016128 -> 1734016129 00002000:00010000:3.0:1734016129.101443:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks: 0 -> 8192 00000100:00100000:3.0:1734016129.101466:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335319680:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016129.101497:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115eb4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5edf expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016129.101510:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115eb4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5edf expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016129.101527:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:3.0:1734016129.101558:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333791360:12345-192.168.201.16@tcp:101:rm.0 Request processed in 3861us (3899us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016129.101567:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11073 00000100:00100000:2.0:1734016129.106214:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016129.106293:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333791616 00000100:00100000:0.0:1734016129.106307:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333791616 00000100:00100000:0.0:1734016129.106371:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2243 00000100:00100000:0.0:1734016129.106382:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+19:10404:x1818247333791616:12345-192.168.201.16@tcp:36:rm.0 00010000:00010000:0.0:1734016129.106472:0:6480:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1734016129.106511:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115ea6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ed1 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.106530:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27115e13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e92 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.106542:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115dd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5e7d expref: 17 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.106553:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff880129d12400) 00010000:00010000:0.0:1734016129.106564:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115e8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5eca expref: 16 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.106571:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88007361b400) 00010000:00010000:0.0:1734016129.106583:0:6480:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016129.106610:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115ebb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.106624:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115ebb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.106634:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115ebb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.106647:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115ec2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.106656:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.106663:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.106842:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115ec9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.106852:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115ec9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.106859:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115ec9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000040:00080000:0.0:1734016129.107155:0:6480:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1734016129.107163:0:6480:0:(osp_sync.c:1781:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396239361087ns, next at 397239359168ns, rc = 0 00000040:00080000:0.0:1734016129.107192:0:6480:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1734016129.107196:0:6480:0:(osp_sync.c:1781:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 396239395407ns, next at 397239393974ns, rc = 0 00010000:00010000:0.0:1734016129.107248:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115ed0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107256:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115ed0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107264:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115ed0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107272:0:6480:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115ed0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107277:0:6480:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115ed0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107286:0:6480:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115ed0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107292:0:6480:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115ed0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107299:0:6480:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581200 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016129.107303:0:6480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115ed0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107312:0:6480:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115ed0 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107320:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff880129d12400) 00010000:00010000:0.0:1734016129.107323:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1734016129.107326:0:6480:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115ed0 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107331:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115ed0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107361:0:6480:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115ec9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107366:0:6480:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115ec9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107371:0:6480:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115ec9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107375:0:6480:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7582f40 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016129.107379:0:6480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115ec9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107388:0:6480:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115ec9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107395:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff880129d12400) 00010000:00010000:0.0:1734016129.107397:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1734016129.107400:0:6480:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115ec9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107405:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115ec9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107511:0:6480:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115ebb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107516:0:6480:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115ebb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107521:0:6480:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115ebb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107524:0:6480:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7582d00 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016129.107526:0:6480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115ebb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107530:0:6480:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115ebb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107535:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88007371eb00) 00010000:00010000:0.0:1734016129.107536:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016129.107538:0:6480:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115ebb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.107541:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115ebb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00000004:00010000:0.0:1734016129.107552:0:6480:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880073ad7b80 reply state ffff8800a7a9b000 transno 4294968752 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:0.0:1734016129.107558:0:6480:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016129.107651:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+17:10404:x1818247333791616:12345-192.168.201.16@tcp:36:rm.0 Request processed in 1271us (1451us total) trans 4294968752 rc 0/0 00000100:00100000:0.0:1734016129.107657:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2243 00010000:00010000:2.0:1734016129.113136:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.113162:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115ec2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.113171:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115ec2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.113180:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581f80 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016129.113186:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115ec2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.113200:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115ec2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.113228:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc3ce3da0 (ffff88007371e300) 00010000:00010000:2.0:1734016129.113232:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016129.113237:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115ec2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.113244:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27115ec2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00000100:00100000:2.0:1734016129.125864:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016129.126089:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333791744 00000100:00100000:0.0:1734016129.126101:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333791744 00000100:00100000:0.0:1734016129.126160:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2244 00000100:00100000:0.0:1734016129.126168:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+16:10405:x1818247333791744:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:0.0:1734016129.126206:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016129.126231:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115ed7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ee6 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.126301:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115ede lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.126313:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115ede lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.126324:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115ede lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:0.0:1734016129.126379:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1734016129.126383:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016129.126403:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115ede lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.126426:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27115ed7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ee6 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.127175:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115ede lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ee6 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.127188:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88007371ec00) 00010000:00010000:0.0:1734016129.127191:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1734016129.127194:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582f40, rc 0) 00000100:00100000:0.0:1734016129.127288:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+17:10405:x1818247333791744:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 1119us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016129.127299:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2244 00000100:00100000:3.0:1734016129.132908:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.134607:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333792000 00000100:00100000:2.0:1734016129.134621:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333792000 00000100:00100000:2.0:1734016129.134692:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2245 00000100:00100000:2.0:1734016129.134700:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+17:10405:x1818247333792000:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:2.0:1734016129.134729:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016129.134742:0:6480:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1734016129.134772:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582f40/0x5e3a3adc27115ede lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ee6 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.134825:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88007371ec00) 00010000:00010000:2.0:1734016129.134839:0:6480:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016129.134855:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115ee5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5eed expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.134977:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115eec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.134991:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115eec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.135001:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115eec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.135013:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115ef3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.135019:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115ef3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.135026:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115ef3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.135443:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115efa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.135452:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115efa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.135457:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115efa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:2.0:1734016129.135468:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 0 00010000:00010000:2.0:1734016129.135489:0:6480:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115eec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.135495:0:6480:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115eec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.135500:0:6480:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115eec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.135506:0:6480:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd200 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016129.135509:0:6480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115eec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.135519:0:6480:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115eec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.135524:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88007361bf00) 00010000:00010000:2.0:1734016129.135527:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016129.135529:0:6480:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115eec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.135533:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115eec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00000004:00010000:2.0:1734016129.135539:0:6480:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800a78cd500 reply state ffff88007588d000 transno 4294968753 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115ef3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:2.0:1734016129.135545:0:6480:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1734016129.135565:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115ee5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5eed expref: 19 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.135576:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115efa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5eed expref: 18 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.135581:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88007361b900) 00010000:00010000:2.0:1734016129.135583:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016129.135585:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd440, rc 0) 00000100:00100000:2.0:1734016129.135675:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+19:10405:x1818247333792000:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 974us (2780us total) trans 4294968753 rc 0/0 00000100:00100000:2.0:1734016129.135682:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2245 00000100:00100000:3.0:1734016129.141890:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1734016129.141942:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115ef3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.141950:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115ef3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.141955:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115ef3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.141959:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcfc0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016129.141961:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115ef3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.141965:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115ef3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.141976:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc3ce3da0 (ffff88007361bb00) 00010000:00010000:2.0:1734016129.141977:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016129.141980:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115ef3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.141982:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115ef3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00000100:00100000:0.0:1734016129.142040:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333792256 00000100:00100000:0.0:1734016129.142049:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333792256 00000100:00100000:0.0:1734016129.142096:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2246 00000100:00100000:0.0:1734016129.142103:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:10405:x1818247333792256:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:0.0:1734016129.142131:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016129.142149:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115f08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ef4 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.142508:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115f0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.142520:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115efa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5eed expref: 19 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.142527:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115f0f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.142558:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115efa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5eed expref: 19 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.142575:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115efa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5eed expref: 19 pid: 6480 timeout: 496 lvb_type: 0 00000100:00100000:0.0:1734016129.142592:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db08700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335319808:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016129.142653:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f780 going to sleep for 11 seconds 00000100:00100000:0.0:1734016129.147309:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db08700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335319808:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016129.147363:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115f0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016129.148293:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016129.148688:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333792384 00000100:00100000:1.0:1734016129.148696:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333792384 00010000:00010000:1.0:1734016129.148745:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115efa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5eed expref: 20 pid: 6480 timeout: 496 lvb_type: 0 00000100:00100000:1.0:1734016129.148789:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3077 00000100:00100000:1.0:1734016129.148796:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+20:1982:x1818247333792384:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016129.148840:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016129.148846:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115efa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5eed expref: 20 pid: 6480 timeout: 496 lvb_type: 0 00010000:00010000:1.0:1734016129.148858:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115efa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5eed expref: 20 pid: 6480 timeout: 496 lvb_type: 0 00010000:00010000:1.0:1734016129.148885:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115efa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5eed expref: 20 pid: 6480 timeout: 496 lvb_type: 0 00010000:00010000:1.0:1734016129.148918:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88007361b900) 00010000:00010000:1.0:1734016129.148924:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115f0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016129.148935:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115f0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016129.148943:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115f0f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016129.148968:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016129.149037:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+19:1982:x1818247333792384:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 240us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016129.149046:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3077 00010000:00010000:0.0:1734016129.149464:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115f0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.149471:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115f0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:0.0:1734016129.149489:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 0 00000004:00080000:0.0:1734016129.149689:0:6478:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00000004:00080000:0.0:1734016129.149694:0:6478:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x8:0x0], index 1: 0 00010000:00010000:0.0:1734016129.149834:0:6478:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115f0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.149843:0:6478:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115f0f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.149848:0:6478:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115f0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.149852:0:6478:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a75818c0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016129.149857:0:6478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115f0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.149865:0:6478:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115f0f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.149874:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88007361b900) 00010000:00010000:0.0:1734016129.149876:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1734016129.149879:0:6478:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115f0f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.149883:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27115f0f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.149943:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115f08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ef4 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.149949:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581200/0x5e3a3adc27115f08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ef4 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.149959:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581200, rc 0) 00000100:00100000:0.0:1734016129.149989:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:10405:x1818247333792256:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 7886us (8108us total) trans 4294968754 rc 301/301 00000100:00100000:0.0:1734016129.149996:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2246 00000100:00100000:2.0:1734016129.153486:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016129.153662:0:6481:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333792640 00000100:00100000:3.0:1734016129.153671:0:6481:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333792640 00000100:00100000:3.0:1734016129.154014:0:6481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 45 00000100:00100000:3.0:1734016129.154023:0:6481:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:10405:x1818247333792640:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:3.0:1734016129.157608:0:6481:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c598caf-7141-4c19-8566-0b7731516db9+19:10405:x1818247333792640:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 3570us (4115us total) trans 4294968755 rc 0/0 00000100:00100000:3.0:1734016129.157622:0:6481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 45 00000100:00100000:0.0:1734016129.161423:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016129.161596:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333792768 00000100:00100000:1.0:1734016129.161610:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333792768 00000100:00100000:1.0:1734016129.161687:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2247 00000100:00100000:1.0:1734016129.161695:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+19:10405:x1818247333792768:12345-192.168.201.16@tcp:101:lfs.0 00010000:00010000:1.0:1734016129.161742:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016129.161772:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e1c0/0x5e3a3adc27115f1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5efb expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.161900:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e1c0/0x5e3a3adc27115f1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5efb expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.161920:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e1c0/0x5e3a3adc27115f1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5efb expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.161940:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016129.161943:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1734016129.161948:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e1c0, rc 0) 00000100:00100000:1.0:1734016129.162027:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+20:10405:x1818247333792768:12345-192.168.201.16@tcp:101:lfs.0 Request processed in 331us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016129.162036:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2247 00000100:00100000:0.0:1734016129.167683:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016129.167952:0:6482:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333793024 00000100:00100000:1.0:1734016129.167972:0:6482:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333793024 00000100:00100000:1.0:1734016129.168038:0:6482:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 46 00000100:00100000:1.0:1734016129.168046:0:6482:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c598caf-7141-4c19-8566-0b7731516db9+20:10405:x1818247333793024:12345-192.168.201.16@tcp:35:lfs.0 00000100:00100000:1.0:1734016129.168306:0:6482:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c598caf-7141-4c19-8566-0b7731516db9+21:10405:x1818247333793024:12345-192.168.201.16@tcp:35:lfs.0 Request processed in 260us (638us total) trans 4294968756 rc 0/0 00000100:00100000:1.0:1734016129.168313:0:6482:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 46 00000100:00100000:2.0:1734016129.189789:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016129.190014:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333793152 00000100:00100000:0.0:1734016129.190027:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333793152 00000100:00100000:0.0:1734016129.190106:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2248 00000100:00100000:0.0:1734016129.190116:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+21:10406:x1818247333793152:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016129.190158:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016129.190194:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27115f24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f02 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.190289:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27115f2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.190305:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27115f2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.190320:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27115f2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:0.0:1734016129.190446:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1734016129.190451:0:6480:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016129.190477:0:6480:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27115f2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.190500:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27115f24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f02 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.190536:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27115f2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f02 expref: 22 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.190546:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88007371e300) 00010000:00010000:0.0:1734016129.190550:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1734016129.190553:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:0.0:1734016129.190966:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+22:10406:x1818247333793152:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 849us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016129.190974:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2248 00000100:00100000:0.0:1734016129.201501:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.201604:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333793408 00000100:00100000:2.0:1734016129.201612:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333793408 00000100:00100000:2.0:1734016129.201665:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2249 00000100:00100000:2.0:1734016129.201671:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+22:10406:x1818247333793408:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016129.201691:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016129.201694:0:6480:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1734016129.201716:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27115f2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f02 expref: 22 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.201747:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88007371e300) 00010000:00010000:2.0:1734016129.201758:0:6480:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016129.201770:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115f32 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f09 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.202043:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115f39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202054:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115f39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202064:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115f39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202073:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115f40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202077:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115f40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202082:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115f40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202131:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115f47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202138:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115f47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202144:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115f47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:2.0:1734016129.202153:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 0 00010000:00010000:2.0:1734016129.202241:0:6480:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115f39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202247:0:6480:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115f39 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202253:0:6480:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115f39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202258:0:6480:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbdf80 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016129.202261:0:6480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115f39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202267:0:6480:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115f39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202273:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88007361b900) 00010000:00010000:2.0:1734016129.202275:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016129.202278:0:6480:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115f39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202282:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27115f39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202288:0:6480:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115f40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202292:0:6480:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115f40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202295:0:6480:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115f40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202299:0:6480:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcb40 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016129.202300:0:6480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115f40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202304:0:6480:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115f40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202312:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc3ce3da0 (ffff88007361ba00) 00010000:00010000:2.0:1734016129.202314:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016129.202316:0:6480:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115f40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202320:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27115f40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.202349:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27115f32 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f09 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.202359:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115f47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f09 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.202365:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016129.202367:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016129.202368:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016129.202442:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+23:10406:x1818247333793408:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 769us (948us total) trans 4294968757 rc 0/0 00000100:00100000:2.0:1734016129.202449:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2249 00000100:00100000:1.0:1734016129.208363:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.208479:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333793536 00000100:00100000:2.0:1734016129.208490:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333793536 00000100:00100000:2.0:1734016129.209392:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2250 00000100:00100000:2.0:1734016129.209406:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+23:10406:x1818247333793536:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016129.209449:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016129.209482:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27115f55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f10 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.209537:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115f5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.209552:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115f5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.209564:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115f5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.209699:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27115f55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f10 expref: 25 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.209723:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd440/0x5e3a3adc27115f5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f10 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.209740:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016129.209743:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1734016129.209746:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd440, rc 0) 00000100:00100000:2.0:1734016129.209848:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+24:10406:x1818247333793536:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 445us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016129.209854:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2250 00000100:00100000:3.0:1734016129.226244:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016129.228087:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333793792 00000100:00100000:0.0:1734016129.228109:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333793792 00000100:00100000:0.0:1734016129.228227:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2251 00000100:00100000:0.0:1734016129.228239:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+24:10406:x1818247333793792:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016129.228323:0:6480:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016129.228362:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27115f47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f09 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.228409:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:0.0:1734016129.228414:0:6480:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016129.228659:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27115f63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.228679:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27115f63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.228690:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27115f63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000001:00080000:0.0:1734016129.228752:0:6480:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968758 00000004:00010000:0.0:1734016129.228774:0:6480:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800a78cdf80 reply state ffff88007515d000 transno 4294968759 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27115f63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:0.0:1734016129.228782:0:6480:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016129.228962:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+26:10406:x1818247333793792:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 724us (2727us total) trans 4294968759 rc 0/0 00000100:00100000:0.0:1734016129.228971:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2251 00000020:00080000:0.0:1734016129.228977:0:6480:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1734016129.240517:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016129.240842:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333793920 00000100:00100000:3.0:1734016129.240853:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333793920 00000100:00100000:3.0:1734016129.240918:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11074 00000100:00100000:3.0:1734016129.240928:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:10406:x1818247333793920:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016129.240961:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016129.240989:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115f6a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f17 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1734016129.241016:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1734016129.241044:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016129.241046:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016129.241055:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115f6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f17 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.241070:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115f6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f17 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.241080:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016129.241139:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333793920:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 214us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016129.241146:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11074 00010000:00010000:2.0:1734016129.241881:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27115f63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.241894:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27115f63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.241903:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27115f63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.241910:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a75821c0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016129.241917:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27115f63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.241927:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27115f63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.241945:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016129.241948:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016129.241952:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27115f63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.241957:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27115f63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00000100:00100000:1.0:1734016129.243698:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016129.244292:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333794048 00000100:00100000:3.0:1734016129.244301:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333794048 00000100:00100000:3.0:1734016129.244352:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11075 00000100:00100000:3.0:1734016129.244360:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:10406:x1818247333794048:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016129.244378:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016129.244394:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115f71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f1e expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1734016129.244418:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1734016129.244438:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016129.244440:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016129.244446:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f1e expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.244458:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f1e expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.244466:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016129.244938:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333794048:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 576us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016129.244944:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11075 00000100:00100000:0.0:1734016129.250096:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016129.251508:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016129.251656:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333794176 00000100:00100000:3.0:1734016129.251670:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333794176 00002000:00010000:3.0:1734016129.251721:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00002000:00100000:3.0:1734016129.251727:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db09500 with x1818247333794176 ext(0->18446744073709551615) 00002000:00010000:3.0:1734016129.251750:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db09500. 00000100:00100000:3.0:1734016129.251773:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333794304 00000100:00100000:3.0:1734016129.251777:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333794304 00002000:00010000:3.0:1734016129.251791:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:3.0:1734016129.251794:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db0ad80 with x1818247333794304 ext(0->18446744073709551615) 00002000:00010000:3.0:1734016129.251825:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db0ad80. 00000100:00100000:3.0:1734016129.251842:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8752 00000100:00100000:3.0:1734016129.251850:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333794176:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016129.252110:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1734016129.252114:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1734016129 00002000:00010000:3.0:1734016129.252116:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1734016129.252118:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 0 -> 1734016129 00002000:00010000:3.0:1734016129.252120:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1734016129.252212:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333794176:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 361us (2130us total) trans 4294967986 rc 0/0 00000100:00100000:3.0:1734016129.252220:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8752 00002000:00010000:3.0:1734016129.252225:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00002000:00100000:3.0:1734016129.252229:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db09500 with x1818247333794176 ext(0->18446744073709551615) 00002000:00010000:3.0:1734016129.252234:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db09500. 00000100:00100000:3.0:1734016129.252257:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8753 00000100:00100000:3.0:1734016129.252261:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333794304:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016129.252370:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1734016129.252372:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 0 -> 1734016129 00002000:00010000:3.0:1734016129.252374:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1734016129.252377:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 0 -> 1734016129 00002000:00010000:3.0:1734016129.252379:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1734016129.252398:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333794304:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 136us (902us total) trans 4294969463 rc 0/0 00000100:00100000:3.0:1734016129.252404:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8753 00002000:00010000:3.0:1734016129.252407:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:3.0:1734016129.252409:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db0ad80 with x1818247333794304 ext(0->18446744073709551615) 00002000:00010000:3.0:1734016129.252412:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db0ad80. 00000100:00100000:1.0:1734016129.259377:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.259540:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333794432 00000100:00100000:2.0:1734016129.259558:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333794432 00000100:00100000:2.0:1734016129.259648:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2252 00000100:00100000:2.0:1734016129.259657:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:10406:x1818247333794432:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016129.259703:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016129.259750:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115f78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f25 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.259892:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115f7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.259912:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115f7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.259927:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115f7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016129.260003:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1734016129.260007:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016129.260045:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115f7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.260079:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27115f78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f25 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.260129:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115f7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f25 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.260141:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88007361b200) 00010000:00010000:2.0:1734016129.260146:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1734016129.260151:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016129.260243:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:10406:x1818247333794432:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 585us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016129.260251:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2252 00000100:00100000:1.0:1734016129.265357:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016129.265432:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333794688 00000100:00100000:0.0:1734016129.265443:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333794688 00000100:00100000:0.0:1734016129.265504:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2253 00000100:00100000:0.0:1734016129.265513:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:10406:x1818247333794688:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016129.265538:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016129.265542:0:6480:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1734016129.265576:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115f7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f25 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.265605:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88007361b200) 00010000:00010000:0.0:1734016129.265620:0:6480:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016129.265640:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27115f86 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f2c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.265788:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27115f8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.265822:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27115f8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.265831:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27115f8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.265841:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115f94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.265847:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115f94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.265852:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115f94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.265901:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27115f9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.265908:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27115f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.265913:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27115f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:0.0:1734016129.265922:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 0 00010000:00010000:0.0:1734016129.265996:0:6480:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27115f8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.266002:0:6480:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27115f8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.266008:0:6480:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27115f8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.266013:0:6480:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7581b00 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016129.266016:0:6480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27115f8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.266022:0:6480:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27115f8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.266028:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88007371ec00) 00010000:00010000:0.0:1734016129.266030:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016129.266033:0:6480:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27115f8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.266038:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27115f8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.266046:0:6480:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115f94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.266051:0:6480:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115f94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.266060:0:6480:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115f94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.266064:0:6480:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7582640 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016129.266066:0:6480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115f94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.266070:0:6480:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115f94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.266075:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc3ce3da0 (ffff88007371e700) 00010000:00010000:0.0:1734016129.266076:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016129.266078:0:6480:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115f94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.266082:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27115f94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.266107:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27115f86 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f2c expref: 20 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.266118:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27115f9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f2c expref: 19 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.266124:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:0.0:1734016129.266126:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016129.266128:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:0.0:1734016129.266184:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:10406:x1818247333794688:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 671us (842us total) trans 4294968760 rc 0/0 00000100:00100000:0.0:1734016129.266190:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2253 00000100:00100000:0.0:1734016129.272784:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.273021:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333794944 00000100:00100000:2.0:1734016129.273036:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333794944 00000100:00100000:2.0:1734016129.273096:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2254 00000100:00100000:2.0:1734016129.273106:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:10406:x1818247333794944:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016129.273164:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016129.273190:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580000/0x5e3a3adc27115f9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f2c expref: 19 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.273210:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016129.273214:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016129.273348:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115fa9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.273362:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.273371:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:2.0:1734016129.273407:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968761 00000004:00010000:2.0:1734016129.273424:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012db09880 reply state ffff88007bc4f000 transno 4294968762 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016129.273430:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016129.273530:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:10406:x1818247333794944:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 425us (758us total) trans 4294968762 rc 0/0 00000100:00100000:2.0:1734016129.273537:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2254 00000020:00080000:2.0:1734016129.273542:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016129.276068:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.276088:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115fa9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.276099:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115fa9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.276106:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd200 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016129.276111:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115fa9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.276119:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115fa9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.276142:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016129.276145:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016129.276151:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115fa9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.276160:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115fa9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016129.276692:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016129.277022:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333795072 00000100:00100000:1.0:1734016129.277035:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333795072 00000100:00100000:1.0:1734016129.277098:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2255 00000100:00100000:1.0:1734016129.277106:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:10406:x1818247333795072:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016129.277145:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016129.277165:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f180/0x5e3a3adc27115fb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f33 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.277232:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f180/0x5e3a3adc27115fb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f33 expref: 21 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.277246:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f180/0x5e3a3adc27115fb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f33 expref: 21 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.277265:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016129.277268:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1734016129.277270:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f180, rc 0) 00000100:00100000:1.0:1734016129.277340:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:10406:x1818247333795072:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 233us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016129.277348:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2255 00000100:00100000:1.0:1734016129.284930:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016129.285015:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333795200 00000100:00100000:3.0:1734016129.285024:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333795200 00000100:00100000:3.0:1734016129.285071:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11076 00000100:00100000:3.0:1734016129.285079:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333795200:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016129.285102:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016129.285125:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27115fb7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f3a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.285159:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115f6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f17 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.285167:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016129.285170:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016129.285176:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27115fb7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f3a expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.285217:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115f6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f17 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.285231:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115f6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f17 expref: 7 pid: 7684 timeout: 496 lvb_type: 0 00000100:00100000:3.0:1734016129.285246:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335319936:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016129.285344:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016129.300540:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016129.301375:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335319936:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016129.301445:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27115fb7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f3a expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.301474:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:0.0:1734016129.301579:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333795200:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 16498us (16657us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016129.301592:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11076 00000100:00100000:1.0:1734016129.303520:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333795328 00000100:00100000:1.0:1734016129.303535:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333795328 00010000:00010000:1.0:1734016129.303582:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115f6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f17 expref: 8 pid: 7684 timeout: 496 lvb_type: 0 00000100:00100000:1.0:1734016129.303617:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3078 00000100:00100000:1.0:1734016129.303624:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5226c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333795328:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016129.303640:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016129.303647:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115f6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f17 expref: 8 pid: 7684 timeout: 496 lvb_type: 0 00010000:00010000:1.0:1734016129.303659:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115f6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f17 expref: 8 pid: 7684 timeout: 496 lvb_type: 0 00010000:00010000:1.0:1734016129.303688:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115f6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f17 expref: 8 pid: 7684 timeout: 496 lvb_type: 0 00010000:00010000:1.0:1734016129.303739:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016129.303741:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016129.303748:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27115fb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f3a expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.303759:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27115fb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f3a expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.303852:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27115fb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f3a expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016129.303867:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335320064:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016129.303993:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c923c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016129.314416:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016129.314515:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333795456 00000100:00100000:0.0:1734016129.314529:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333795456 00000100:00100000:0.0:1734016129.314604:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11077 00000100:00100000:0.0:1734016129.314614:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333795456:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016129.314638:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016129.314663:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27115fbe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f41 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.314709:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f1e expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.314718:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016129.314720:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016129.314725:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27115fbe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f41 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.314770:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f1e expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.314785:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f1e expref: 7 pid: 7684 timeout: 496 lvb_type: 0 00000100:00100000:0.0:1734016129.314835:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335320192:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016129.314914:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335320064:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016129.314924:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fcc0 going to sleep for 11 seconds 00010000:00010000:1.0:1734016129.314938:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016129.314968:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5226c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333795328:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 11343us (14453us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016129.314979:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3078 00000100:00100000:0.0:1734016129.321478:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.321606:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335320192:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016129.321658:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27115fbe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f41 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.321688:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:1.0:1734016129.322022:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333795584 00000100:00100000:1.0:1734016129.322032:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333795584 00010000:00010000:1.0:1734016129.322067:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f1e expref: 8 pid: 7684 timeout: 496 lvb_type: 0 00000100:00100000:1.0:1734016129.322113:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3079 00000100:00100000:1.0:1734016129.322120:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b132d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333795584:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016129.322135:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016129.322140:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f1e expref: 8 pid: 7684 timeout: 496 lvb_type: 0 00010000:00010000:1.0:1734016129.322153:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f1e expref: 8 pid: 7684 timeout: 496 lvb_type: 0 00010000:00010000:1.0:1734016129.322182:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27115f71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f1e expref: 8 pid: 7684 timeout: 496 lvb_type: 0 00000100:00100000:2.0:1734016129.322786:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247333795456:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8170us (8386us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016129.322795:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11077 00010000:00010000:1.0:1734016129.323560:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016129.323567:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016129.323578:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27115fbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f41 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.323590:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27115fbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f41 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.323644:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27115fbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f41 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016129.323660:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335320320:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016129.323752:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92180 going to sleep for 11 seconds 00000100:00100000:0.0:1734016129.334053:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016129.334171:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.336159:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333795712 00000100:00100000:2.0:1734016129.336175:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333795712 00002000:00010000:2.0:1734016129.336220:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00002000:00100000:2.0:1734016129.336225:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b130380 with x1818247333795712 ext(0->18446744073709551615) 00002000:00010000:2.0:1734016129.336238:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b130380. 00000100:00100000:1.0:1734016129.336372:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335320320:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016129.336398:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016129.336750:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333795840 00000100:00100000:2.0:1734016129.336754:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333795840 00002000:00010000:2.0:1734016129.336769:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:2.0:1734016129.336771:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b131880 with x1818247333795840 ext(0->18446744073709551615) 00002000:00010000:2.0:1734016129.336778:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b131880. 00000100:00100000:1.0:1734016129.336830:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b132d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333795584:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 14708us (15371us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016129.336842:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3079 00000100:00100000:3.0:1734016129.337015:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8754 00000100:00100000:3.0:1734016129.337023:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333795712:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016129.337179:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1734016129.337182:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016129 -> 1734016129 00002000:00010000:3.0:1734016129.337184:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1734016129.337186:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016129 -> 1734016129 00002000:00010000:3.0:1734016129.337189:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1734016129.337218:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333795712:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 195us (3183us total) trans 4294967987 rc 0/0 00000100:00100000:3.0:1734016129.337226:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8754 00002000:00010000:3.0:1734016129.337229:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00002000:00100000:3.0:1734016129.337231:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b130380 with x1818247333795712 ext(0->18446744073709551615) 00002000:00010000:3.0:1734016129.337235:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b130380. 00000100:00100000:3.0:1734016129.337250:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8755 00000100:00100000:3.0:1734016129.337255:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333795840:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016129.337339:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1734016129.337341:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016129 -> 1734016129 00002000:00010000:3.0:1734016129.337343:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1734016129.337345:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016129 -> 1734016129 00002000:00010000:3.0:1734016129.337347:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1734016129.337365:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333795840:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 108us (3193us total) trans 4294969464 rc 0/0 00000100:00100000:3.0:1734016129.337371:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8755 00002000:00010000:3.0:1734016129.337374:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:3.0:1734016129.337376:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b131880 with x1818247333795840 ext(0->18446744073709551615) 00002000:00010000:3.0:1734016129.337380:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b131880. 00000100:00100000:0.0:1734016129.348464:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.348601:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333795968 00000100:00100000:2.0:1734016129.348617:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333795968 00000100:00100000:2.0:1734016129.348685:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2256 00000100:00100000:2.0:1734016129.348693:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+25:10406:x1818247333795968:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016129.348737:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016129.348765:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115fc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f48 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.348873:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115fcc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.348891:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115fcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.348904:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115fcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016129.348947:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1734016129.348951:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016129.348976:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115fcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.348996:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27115fc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f48 expref: 27 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.350352:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115fcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f48 expref: 26 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.350365:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88007361ba00) 00010000:00010000:2.0:1734016129.350367:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1734016129.350371:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016129.350964:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+26:10406:x1818247333795968:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2262us (2514us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016129.350978:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2256 00000100:00100000:0.0:1734016129.354763:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016129.361410:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333796224 00000100:00100000:3.0:1734016129.361427:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333796224 00000100:00100000:3.0:1734016129.361511:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2257 00000100:00100000:3.0:1734016129.361522:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+26:10406:x1818247333796224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016129.361557:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016129.361564:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1734016129.361609:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27115fcc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f48 expref: 26 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.361645:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88007361ba00) 00010000:00010000:3.0:1734016129.361662:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016129.361682:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27115fd3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f4f expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.361834:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115fda lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.361849:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115fda lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.361860:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115fda lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.361906:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115fe1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x82be31ad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.361911:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115fe1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x82be31ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.361917:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115fe1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x82be31ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00080000:3.0:1734016129.362308:0:6478:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7:0x0], index 0: 0 00010000:00010000:3.0:1734016129.362457:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115fe8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.362466:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.362475:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.362511:0:6478:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115fda lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.362517:0:6478:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115fda lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.362524:0:6478:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115fda lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.362531:0:6478:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df5b00 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016129.362533:0:6478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115fda lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.362541:0:6478:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115fda lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.362548:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b52c9300) 00010000:00010000:3.0:1734016129.362550:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016129.362552:0:6478:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115fda lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.362556:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27115fda lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000004:00010000:3.0:1734016129.362566:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012b133100 reply state ffff880075056000 transno 4294968763 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115fe1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x82be31ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016129.362572:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1734016129.362592:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27115fd3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f4f expref: 28 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.362615:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7a80/0x5e3a3adc27115fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f4f expref: 27 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.362622:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8800b52c9200) 00010000:00010000:3.0:1734016129.362624:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016129.362626:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7a80, rc 0) 00000100:00100000:3.0:1734016129.362697:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+28:10406:x1818247333796224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1177us (7951us total) trans 4294968763 rc 0/0 00000100:00100000:3.0:1734016129.362705:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2257 00010000:00010000:0.0:1734016129.368751:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115fe1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x82be31ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.368771:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115fe1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x82be31ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.368779:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115fe1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x82be31ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.368786:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4900 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016129.368790:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115fe1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x82be31ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.368837:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115fe1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x82be31ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.368858:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x82be31ad (ffff8800b52c9e00) 00010000:00010000:0.0:1734016129.368861:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016129.368866:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115fe1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x82be31ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.368870:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27115fe1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x82be31ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016129.371450:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016129.371630:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333796352 00000100:00100000:1.0:1734016129.371652:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333796352 00000100:00100000:1.0:1734016129.371758:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2258 00000100:00100000:1.0:1734016129.371770:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+27:10406:x1818247333796352:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016129.371878:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016129.371918:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc27115ff6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f56 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.372032:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27115ffd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016129.372049:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27115ffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016129.372065:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27115ffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:1.0:1734016129.372141:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1734016129.372145:0:6480:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016129.372171:0:6480:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27115ffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016129.372196:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc27115ff6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f56 expref: 29 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.372239:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27115ffd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f56 expref: 28 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.372249:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012a2b0800) 00010000:00010000:1.0:1734016129.372252:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1734016129.372255:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016129.372327:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+28:10406:x1818247333796352:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 558us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016129.372337:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2258 00000100:00100000:2.0:1734016129.379444:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016129.379778:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333796608 00000100:00100000:3.0:1734016129.379791:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333796608 00000100:00100000:3.0:1734016129.380225:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2259 00000100:00100000:3.0:1734016129.380232:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+28:10406:x1818247333796608:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016129.380256:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016129.380260:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1734016129.380289:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27115ffd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f56 expref: 28 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.380354:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012a2b0800) 00010000:00010000:3.0:1734016129.380369:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016129.380387:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116004 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f5d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.380487:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc2711600b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.380499:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc2711600b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.380507:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc2711600b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.380518:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116012 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1eb631b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.380524:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116012 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1eb631b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.380528:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116012 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1eb631b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00080000:3.0:1734016129.380908:0:6478:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x9:0x0], index 1: 0 00010000:00010000:3.0:1734016129.381032:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27116019 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.381040:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27116019 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.381045:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27116019 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.381078:0:6478:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc2711600b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.381083:0:6478:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc2711600b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.381087:0:6478:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc2711600b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.381092:0:6478:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df5440 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016129.381096:0:6478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc2711600b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.381103:0:6478:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc2711600b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.381109:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b52c9e00) 00010000:00010000:3.0:1734016129.381112:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016129.381114:0:6478:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc2711600b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.381118:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc2711600b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000004:00010000:3.0:1734016129.381128:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880073ad6680 reply state ffff880075057000 transno 4294968764 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116012 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1eb631b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016129.381134:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1734016129.381157:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116004 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f5d expref: 30 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.381173:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4b40/0x5e3a3adc27116019 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f5d expref: 29 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.381179:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8800b52c9000) 00010000:00010000:3.0:1734016129.381181:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016129.381183:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4b40, rc 0) 00000100:00100000:3.0:1734016129.382219:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+30:10406:x1818247333796608:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1980us (2783us total) trans 4294968764 rc 0/0 00000100:00100000:3.0:1734016129.382227:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2259 00010000:00010000:2.0:1734016129.388921:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116012 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1eb631b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.388946:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116012 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1eb631b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.388956:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116012 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1eb631b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.388964:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4d80 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016129.388970:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116012 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1eb631b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.388977:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116012 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1eb631b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.389004:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1eb631b1 (ffff8800b52c9300) 00010000:00010000:2.0:1734016129.389007:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016129.389012:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116012 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1eb631b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.389017:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116012 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1eb631b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.589587:0:8957:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1734016129.786101:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016129.786212:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333796864 00000100:00100000:0.0:1734016129.786227:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333796864 00000100:00100000:0.0:1734016129.786299:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2260 00000100:00100000:0.0:1734016129.786309:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:10406:x1818247333796864:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016129.786676:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116027 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.786699:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016129.786713:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:0.0:1734016129.786775:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968765 00000004:00010000:0.0:1734016129.786796:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880073ad4380 reply state ffff88007515c000 transno 4294968766 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016129.786840:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016129.786956:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:10406:x1818247333796864:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 647us (873us total) trans 4294968766 rc 0/0 00000100:00100000:0.0:1734016129.786965:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2260 00000020:00080000:0.0:1734016129.786971:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016129.790431:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.790451:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116027 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.790457:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116027 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.790462:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a75821c0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016129.790468:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116027 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.790477:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116027 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.790496:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016129.790499:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016129.790503:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116027 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.790508:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116027 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016129.795445:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.795574:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016129.795645:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333797120 00000100:00100000:0.0:1734016129.795659:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333797120 00000100:00100000:3.0:1734016129.795696:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333796992 00002000:00010000:0.0:1734016129.795706:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00000100:00100000:3.0:1734016129.795711:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333796992 00002000:00100000:0.0:1734016129.795713:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4000 with x1818247333797120 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016129.795738:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4000. 00002000:00010000:3.0:1734016129.795763:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00000100:00100000:0.0:1734016129.795767:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8756 00002000:00100000:3.0:1734016129.795767:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad6d80 with x1818247333796992 ext(0->18446744073709551615) 00000100:00100000:0.0:1734016129.795775:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333797120:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016129.795778:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073ad6d80. 00000100:00100000:3.0:1734016129.795861:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8757 00000100:00100000:3.0:1734016129.795869:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333796992:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016129.796019:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1734016129.796019:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1734016129.796023:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016129 -> 1734016130 00002000:00010000:3.0:1734016129.796023:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016129 -> 1734016130 00002000:00010000:3.0:1734016129.796025:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1734016129.796026:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1734016129.796027:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016129 -> 1734016130 00002000:00010000:3.0:1734016129.796027:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016129 -> 1734016130 00002000:00010000:0.0:1734016129.796030:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1734016129.796030:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1734016129.796106:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333796992:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 238us (531us total) trans 4294967988 rc 0/0 00000100:00100000:3.0:1734016129.796114:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8757 00002000:00010000:3.0:1734016129.796117:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00002000:00100000:3.0:1734016129.796119:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad6d80 with x1818247333796992 ext(0->18446744073709551615) 00002000:00010000:3.0:1734016129.796123:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073ad6d80. 00000100:00100000:0.0:1734016129.802940:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333797120:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 7149us (7492us total) trans 4294969465 rc 0/0 00000100:00100000:0.0:1734016129.802960:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8756 00002000:00010000:0.0:1734016129.802970:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:0.0:1734016129.802975:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4000 with x1818247333797120 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016129.802987:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad4000. 00000100:00100000:0.0:1734016129.809583:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.812225:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333797376 00000100:00100000:2.0:1734016129.812241:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333797376 00000100:00100000:2.0:1734016129.812323:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2261 00000100:00100000:2.0:1734016129.812333:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:10406:x1818247333797376:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016129.812531:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711602e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.812545:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711602e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.812557:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711602e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:2.0:1734016129.812595:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968767 00000004:00010000:2.0:1734016129.812612:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012b133b80 reply state ffff88007bc48000 transno 4294968768 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711602e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016129.812618:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016129.812755:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+26:10406:x1818247333797376:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 422us (3185us total) trans 4294968768 rc 0/0 00000100:00100000:2.0:1734016129.812763:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2261 00000020:00080000:2.0:1734016129.812769:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1734016129.828175:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016129.828220:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016129.828280:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333797504 00000100:00100000:0.0:1734016129.828291:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333797504 00002000:00010000:0.0:1734016129.828325:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (100000->18446744073709551615) 00002000:00100000:0.0:1734016129.828329:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15df80 with x1818247333797504 ext(100000->18446744073709551615) 00002000:00010000:0.0:1734016129.828341:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b15df80. 00000100:00100000:0.0:1734016129.828354:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333797632 00000100:00100000:0.0:1734016129.828356:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333797632 00002000:00010000:0.0:1734016129.828366:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:0.0:1734016129.828369:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15c380 with x1818247333797632 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016129.828375:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15c380. 00000100:00100000:0.0:1734016129.828385:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8758 00000100:00100000:0.0:1734016129.828392:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333797504:12345-192.168.201.16@tcp:10:fsx.0 00010000:00010000:2.0:1734016129.828505:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711602e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.828516:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711602e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.828525:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711602e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.828531:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc480 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016129.828536:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711602e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.828543:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711602e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.828559:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016129.828562:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016129.828567:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711602e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.828571:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711602e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00002000:00010000:0.0:1734016129.828626:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 100000 00002000:00010000:0.0:1734016129.828629:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016130 -> 1734016130 00002000:00010000:0.0:1734016129.828631:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1734016129.828633:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016130 -> 1734016130 00002000:00010000:0.0:1734016129.828635:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1734016129.828640:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8759 00000100:00100000:2.0:1734016129.828645:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333797632:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:0.0:1734016129.828680:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333797504:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 287us (518us total) trans 4294967989 rc 0/0 00000100:00100000:0.0:1734016129.828687:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8758 00002000:00010000:0.0:1734016129.828691:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (100000->18446744073709551615) 00002000:00100000:0.0:1734016129.828693:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15df80 with x1818247333797504 ext(100000->18446744073709551615) 00002000:00010000:0.0:1734016129.828697:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b15df80. 00002000:00010000:2.0:1734016129.828735:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1734016129.828738:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016130 -> 1734016130 00002000:00010000:2.0:1734016129.828739:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1734016129.828741:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016130 -> 1734016130 00002000:00010000:2.0:1734016129.828743:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1734016129.828761:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333797632:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 115us (541us total) trans 4294969466 rc 0/0 00000100:00100000:2.0:1734016129.828766:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8759 00002000:00010000:2.0:1734016129.828769:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:2.0:1734016129.828771:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15c380 with x1818247333797632 ext(0->18446744073709551615) 00002000:00010000:2.0:1734016129.828774:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15c380. 00000100:00100000:0.0:1734016129.835969:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016129.836314:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333797760 00000100:00100000:1.0:1734016129.836328:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333797760 00000100:00100000:1.0:1734016129.836385:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2262 00000100:00100000:1.0:1734016129.836394:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+25:10406:x1818247333797760:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016129.836422:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016129.836442:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27116035 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f64 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.836535:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc2711603c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016129.836547:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc2711603c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016129.836556:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc2711603c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:1.0:1734016129.836579:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 100000 00000004:00200000:1.0:1734016129.836583:0:6480:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016129.836597:0:6480:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc2711603c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016129.836619:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27116035 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f64 expref: 27 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.836646:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc2711603c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f64 expref: 26 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.836653:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016129.836656:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016129.836659:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016129.836714:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+26:10406:x1818247333797760:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 321us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016129.836732:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2262 00000100:00100000:0.0:1734016129.844424:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016129.844516:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333797888 00000100:00100000:3.0:1734016129.844526:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333797888 00000100:00100000:3.0:1734016129.844578:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2263 00000100:00100000:3.0:1734016129.844586:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+26:10406:x1818247333797888:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016129.844612:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016129.844633:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116043 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f6b expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.844669:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc2711604a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.844688:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc2711604a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.844699:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc2711604a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.844829:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116043 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f6b expref: 28 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.844858:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df58c0/0x5e3a3adc2711604a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f6b expref: 27 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.844865:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016129.844867:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1734016129.844870:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df58c0, rc 0) 00000100:00100000:3.0:1734016129.844929:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:10406:x1818247333797888:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 343us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016129.844935:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2263 00000100:00100000:0.0:1734016129.848389:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016129.848460:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333798144 00000100:00100000:1.0:1734016129.848472:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333798144 00000100:00100000:1.0:1734016129.848730:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2264 00000100:00100000:1.0:1734016129.848740:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:10406:x1818247333798144:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016129.848859:0:6480:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016129.848894:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc2711603c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f64 expref: 27 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.848924:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016129.848929:0:6480:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016129.849165:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27116051 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016129.849180:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27116051 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016129.849192:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27116051 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000001:00080000:1.0:1734016129.849234:0:6480:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968769 00000004:00010000:1.0:1734016129.849253:0:6480:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012b131180 reply state ffff8800a7684000 transno 4294968770 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27116051 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:1.0:1734016129.849259:0:6480:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016129.849344:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+29:10406:x1818247333798144:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 604us (972us total) trans 4294968770 rc 0/0 00000100:00100000:1.0:1734016129.849351:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2264 00000020:00080000:1.0:1734016129.849357:0:6480:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1734016129.859641:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.860491:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.860526:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333798272 00000100:00100000:2.0:1734016129.860536:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333798272 00002000:00010000:2.0:1734016129.860579:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00002000:00100000:2.0:1734016129.860584:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4a80 with x1818247333798272 ext(0->18446744073709551615) 00002000:00010000:2.0:1734016129.860603:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073ad4a80. 00000100:00100000:2.0:1734016129.860625:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333798400 00000100:00100000:2.0:1734016129.860629:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333798400 00002000:00010000:2.0:1734016129.860641:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:2.0:1734016129.860644:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5500 with x1818247333798400 ext(0->18446744073709551615) 00002000:00010000:2.0:1734016129.860652:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5500. 00010000:00010000:0.0:1734016129.860738:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27116051 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.860747:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27116051 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.860754:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27116051 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.860760:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499c900 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016129.860766:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27116051 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.860774:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27116051 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.860793:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:0.0:1734016129.860795:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016129.860820:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27116051 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:0.0:1734016129.860827:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27116051 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00000100:00100000:3.0:1734016129.861277:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8760 00000100:00100000:3.0:1734016129.861286:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333798272:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:2.0:1734016129.861289:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8761 00000100:00100000:2.0:1734016129.861294:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1983:x1818247333798400:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016129.861447:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1734016129.861450:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016130 -> 1734016130 00002000:00010000:2.0:1734016129.861452:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1734016129.861454:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016130 -> 1734016130 00002000:00010000:3.0:1734016129.861455:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 100000 -> 0 00002000:00010000:2.0:1734016129.861456:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1734016129.861457:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016130 -> 1734016130 00002000:00010000:3.0:1734016129.861459:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1734016129.861461:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016130 -> 1734016130 00002000:00010000:3.0:1734016129.861462:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1734016129.862120:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1983:x1818247333798400:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 822us (1627us total) trans 4294969467 rc 0/0 00000100:00100000:2.0:1734016129.862130:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8761 00002000:00010000:2.0:1734016129.862136:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:2.0:1734016129.862138:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5500 with x1818247333798400 ext(0->18446744073709551615) 00002000:00010000:2.0:1734016129.862145:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5500. 00000100:00100000:3.0:1734016129.862423:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1983:x1818247333798272:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1130us (2789us total) trans 4294967990 rc 0/0 00000100:00100000:3.0:1734016129.862436:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8760 00002000:00010000:3.0:1734016129.862439:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00002000:00100000:3.0:1734016129.862441:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4a80 with x1818247333798272 ext(0->18446744073709551615) 00002000:00010000:3.0:1734016129.862447:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073ad4a80. 00000100:00100000:0.0:1734016129.866137:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.866289:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333798528 00000100:00100000:2.0:1734016129.866305:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333798528 00000100:00100000:2.0:1734016129.866373:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11078 00000100:00100000:2.0:1734016129.866381:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333798528:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016129.866407:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016129.866440:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116058 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f72 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.866482:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27115fb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f3a expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.866489:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016129.866491:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016129.866495:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116058 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f72 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.866544:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27115fb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f3a expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.866555:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27115fb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f3a expref: 10 pid: 7684 timeout: 496 lvb_type: 0 00000100:00100000:2.0:1734016129.866576:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335320448:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016129.867405:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016129.869851:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335320448:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016129.869902:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116058 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f72 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.869929:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016129.870402:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333798528:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4018us (4276us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016129.870416:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11078 00000100:00100000:1.0:1734016129.870731:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016129.870938:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333798656 00000100:00100000:0.0:1734016129.870948:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333798656 00010000:00010000:0.0:1734016129.870979:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27115fb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f3a expref: 11 pid: 7684 timeout: 496 lvb_type: 0 00000100:00100000:0.0:1734016129.871028:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3080 00000100:00100000:0.0:1734016129.871038:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333798656:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016129.871061:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016129.871086:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27115fb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f3a expref: 11 pid: 7684 timeout: 496 lvb_type: 0 00010000:00010000:0.0:1734016129.871101:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27115fb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f3a expref: 11 pid: 7684 timeout: 496 lvb_type: 0 00010000:00010000:0.0:1734016129.871139:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27115fb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f3a expref: 11 pid: 7684 timeout: 496 lvb_type: 0 00010000:00010000:0.0:1734016129.871169:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016129.871173:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016129.871182:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116058 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f72 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.871193:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116058 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f72 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.871242:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116058 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f72 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016129.871258:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335320576:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016129.871319:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016129.877582:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335320576:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016129.877620:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016129.877690:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333798656:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6651us (6965us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016129.877705:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3080 00000100:00100000:0.0:1734016129.880170:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.880350:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333798784 00000100:00100000:2.0:1734016129.880363:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333798784 00000100:00100000:2.0:1734016129.880423:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11079 00000100:00100000:2.0:1734016129.880432:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333798784:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016129.880768:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1734016129.880771:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016130 -> 1734016129 00002000:00010000:2.0:1734016129.880773:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1734016129.880775:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016130 -> 1734016129 00002000:00010000:2.0:1734016129.880776:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 0 -> 8192 00000100:00100000:2.0:1734016129.880909:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333798784:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 475us (748us total) trans 4294967991 rc 0/0 00000100:00100000:2.0:1734016129.880918:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11079 00000100:00100000:0.0:1734016129.882898:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016129.883051:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333799040 00000100:00100000:3.0:1734016129.883060:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333799040 00000100:00100000:3.0:1734016129.883245:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2265 00000100:00100000:3.0:1734016129.883250:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+29:10406:x1818247333799040:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016129.883503:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711605f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.883522:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711605f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.883538:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711605f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:3.0:1734016129.883576:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968771 00000004:00010000:3.0:1734016129.883586:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800756a5c00 reply state ffff880075054000 transno 4294968772 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711605f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016129.883590:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016129.883689:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+32:10406:x1818247333799040:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 437us (801us total) trans 4294968772 rc 0/0 00000100:00100000:3.0:1734016129.883704:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2265 00000020:00080000:3.0:1734016129.883710:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016129.885046:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711605f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.885065:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711605f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.885072:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711605f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.885078:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df7cc0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016129.885083:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711605f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.885091:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711605f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.885111:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016129.885119:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016129.885126:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711605f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.885133:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711605f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:1.0:1734016129.885303:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016129.885405:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333799168 00000100:00100000:0.0:1734016129.885417:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333799168 00000100:00100000:0.0:1734016129.885474:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11080 00000100:00100000:0.0:1734016129.885484:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333799168:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016129.885507:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016129.885529:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27116066 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f79 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.885564:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27115fbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f41 expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.885572:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016129.885574:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016129.885577:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27116066 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f79 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.885615:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27115fbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f41 expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016129.885633:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27115fbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f41 expref: 11 pid: 7684 timeout: 497 lvb_type: 0 00000100:00100000:0.0:1734016129.885648:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335320704:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016129.885711:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016129.887358:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335320704:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016129.887397:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27116066 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f79 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.887412:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:2.0:1734016129.887462:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333799168:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1978us (2161us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016129.887470:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11080 00000100:00100000:0.0:1734016129.889944:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016129.890293:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333799296 00000100:00100000:1.0:1734016129.890305:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333799296 00010000:00010000:1.0:1734016129.890351:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27115fbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f41 expref: 12 pid: 7684 timeout: 497 lvb_type: 0 00000100:00100000:1.0:1734016129.890381:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3081 00000100:00100000:1.0:1734016129.890389:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333799296:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016129.890409:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016129.890414:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27115fbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f41 expref: 12 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:1.0:1734016129.890430:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27115fbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f41 expref: 12 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:1.0:1734016129.890458:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27115fbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f41 expref: 12 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:1.0:1734016129.890475:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016129.890476:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016129.890484:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27116066 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f79 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.890493:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27116066 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f79 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.890537:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27116066 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f79 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016129.890552:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335320832:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016129.890615:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92180 going to sleep for 11 seconds 00000100:00100000:1.0:1734016129.895587:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335320832:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016129.895622:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016129.895690:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333799296:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5299us (5902us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016129.895706:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3081 00000100:00100000:0.0:1734016129.900244:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016129.900312:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.900572:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333799552 00000100:00100000:2.0:1734016129.900590:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333799552 00002000:00010000:2.0:1734016129.900661:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:2.0:1734016129.900667:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6680 with x1818247333799552 ext(0->18446744073709551615) 00002000:00010000:2.0:1734016129.900684:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a6680. 00000100:00100000:2.0:1734016129.900731:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333799424 00000100:00100000:2.0:1734016129.900735:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333799424 00002000:00010000:2.0:1734016129.900750:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00002000:00100000:2.0:1734016129.900752:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6a00 with x1818247333799424 ext(0->18446744073709551615) 00002000:00010000:2.0:1734016129.900763:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756a6a00. 00000100:00100000:2.0:1734016129.900777:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8762 00000100:00100000:2.0:1734016129.900790:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333799552:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:1.0:1734016129.901126:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8763 00000100:00100000:1.0:1734016129.901135:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333799424:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016129.901335:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 0 00002000:00010000:1.0:1734016129.901339:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016129 -> 1734016130 00002000:00010000:1.0:1734016129.901341:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1734016129.901343:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016129 -> 1734016130 00002000:00010000:1.0:1734016129.901344:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 8192 -> 0 00000100:00100000:1.0:1734016129.901404:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333799424:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 268us (1090us total) trans 4294967992 rc 0/0 00000100:00100000:1.0:1734016129.901412:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8763 00002000:00010000:1.0:1734016129.901416:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00002000:00100000:1.0:1734016129.901419:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6a00 with x1818247333799424 ext(0->18446744073709551615) 00002000:00010000:1.0:1734016129.901423:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756a6a00. 00002000:00010000:2.0:1734016129.901489:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1734016129.901492:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016130 -> 1734016130 00002000:00010000:2.0:1734016129.901494:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1734016129.901496:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016130 -> 1734016130 00002000:00010000:2.0:1734016129.901497:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1734016129.901520:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333799552:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 735us (1291us total) trans 4294969468 rc 0/0 00000100:00100000:2.0:1734016129.901526:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8762 00002000:00010000:2.0:1734016129.901529:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:2.0:1734016129.901531:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6680 with x1818247333799552 ext(0->18446744073709551615) 00002000:00010000:2.0:1734016129.901535:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a6680. 00000100:00100000:0.0:1734016129.908599:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.909274:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333799680 00000100:00100000:2.0:1734016129.909286:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333799680 00000100:00100000:2.0:1734016129.909340:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11081 00000100:00100000:2.0:1734016129.909349:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:10406:x1818247333799680:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016129.909380:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016129.909401:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711606d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f80 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.909443:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116058 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f72 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.909451:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016129.909454:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016129.909458:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711606d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f80 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.909495:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116058 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f72 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.909505:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116058 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f72 expref: 9 pid: 7684 timeout: 497 lvb_type: 0 00000100:00100000:2.0:1734016129.909519:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335320960:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016129.911667:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016129.915592:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335320960:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016129.915646:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711606d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f80 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.915668:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016129.915760:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:10406:x1818247333799680:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6410us (7174us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016129.915776:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11081 00000100:00100000:0.0:1734016129.915917:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.916852:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333799808 00000100:00100000:2.0:1734016129.916863:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333799808 00010000:00010000:2.0:1734016129.916900:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116058 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f72 expref: 10 pid: 7684 timeout: 497 lvb_type: 0 00000100:00100000:2.0:1734016129.917317:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3082 00000100:00100000:2.0:1734016129.917327:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333799808:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016129.917349:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016129.917387:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116058 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f72 expref: 10 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1734016129.917406:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116058 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f72 expref: 10 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1734016129.917440:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116058 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f72 expref: 10 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1734016129.918179:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016129.918182:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016129.918192:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711606d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f80 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.918203:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711606d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f80 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.918401:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711606d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f80 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016129.918425:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335321088:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016129.918524:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737810c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016129.921742:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335321088:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016129.921783:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016129.921867:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333799808:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4538us (5950us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016129.921880:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3082 00000100:00100000:0.0:1734016129.922090:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.922376:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333799936 00000100:00100000:2.0:1734016129.922384:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333799936 00000100:00100000:2.0:1734016129.922416:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11082 00000100:00100000:2.0:1734016129.922422:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333799936:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016129.922598:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1734016129.922601:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016130 -> 1734016130 00002000:00010000:2.0:1734016129.922603:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1734016129.922605:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016130 -> 1734016130 00002000:00010000:2.0:1734016129.922608:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1734016129.924103:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247333799936:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1670us (2002us total) trans 4294967993 rc 0/0 00000100:00100000:3.0:1734016129.924116:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11082 00000100:00100000:0.0:1734016129.927258:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016129.928136:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333800192 00000100:00100000:1.0:1734016129.928155:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333800192 00000100:00100000:1.0:1734016129.928373:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2266 00000100:00100000:1.0:1734016129.928383:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+28:10406:x1818247333800192:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016129.928649:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116074 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016129.928668:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116074 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016129.928681:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116074 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000001:00080000:1.0:1734016129.928733:0:6480:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968773 00000004:00010000:1.0:1734016129.928752:0:6480:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800756a7b80 reply state ffff8800735d5000 transno 4294968774 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116074 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:1.0:1734016129.928759:0:6480:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016129.929269:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+31:10406:x1818247333800192:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 885us (2028us total) trans 4294968774 rc 0/0 00000100:00100000:1.0:1734016129.929277:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2266 00000020:00080000:1.0:1734016129.929283:0:6480:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016129.932289:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1734016129.933689:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116074 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.933707:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116074 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.933716:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116074 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.933733:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499dd40 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016129.933740:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116074 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.933750:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116074 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.933784:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016129.933788:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016129.933793:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116074 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.933815:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116074 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00000100:00100000:3.0:1734016129.934013:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333800320 00000100:00100000:3.0:1734016129.934033:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333800320 00000100:00100000:3.0:1734016129.934293:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11083 00000100:00100000:3.0:1734016129.934305:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:10406:x1818247333800320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016129.934343:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016129.934374:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711607b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f87 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.934419:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27116066 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f79 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.934429:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016129.934433:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016129.934438:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711607b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f87 expref: 12 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.934488:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27116066 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f79 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.934504:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27116066 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f79 expref: 8 pid: 8216 timeout: 497 lvb_type: 0 00000100:00100000:3.0:1734016129.934522:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335321216:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016129.935243:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737810c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016129.939652:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335321216:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016129.939728:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711607b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f87 expref: 12 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.939755:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016129.939873:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:10406:x1818247333800320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5569us (7595us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016129.939886:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11083 00000100:00100000:0.0:1734016129.941081:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016129.941217:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333800448 00000100:00100000:3.0:1734016129.941226:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333800448 00010000:00010000:3.0:1734016129.941254:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27116066 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f79 expref: 9 pid: 8216 timeout: 497 lvb_type: 0 00000100:00100000:3.0:1734016129.941282:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3083 00000100:00100000:3.0:1734016129.941287:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333800448:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016129.941301:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016129.941308:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27116066 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f79 expref: 9 pid: 8216 timeout: 497 lvb_type: 0 00010000:00010000:3.0:1734016129.941322:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27116066 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f79 expref: 9 pid: 8216 timeout: 497 lvb_type: 0 00010000:00010000:3.0:1734016129.941349:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27116066 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f79 expref: 9 pid: 8216 timeout: 497 lvb_type: 0 00010000:00010000:3.0:1734016129.942598:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016129.942604:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016129.942612:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711607b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f87 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.942622:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711607b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f87 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.942661:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711607b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f87 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016129.942675:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335321344:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016129.942739:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737810c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016129.947309:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016129.947439:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016129.947492:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333800704 00000100:00100000:0.0:1734016129.947504:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333800704 00002000:00010000:0.0:1734016129.947561:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:0.0:1734016129.947566:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a4a80 with x1818247333800704 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016129.947583:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a4a80. 00000100:00100000:0.0:1734016129.947614:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333800576 00000100:00100000:0.0:1734016129.947618:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333800576 00002000:00010000:0.0:1734016129.947632:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00002000:00100000:0.0:1734016129.947635:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a4000 with x1818247333800576 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016129.947649:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756a4000. 00000100:00100000:0.0:1734016129.947671:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8764 00000100:00100000:0.0:1734016129.947680:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247333800704:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016129.947939:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1734016129.947943:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016130 -> 1734016130 00002000:00010000:0.0:1734016129.947946:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1734016129.947948:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016130 -> 1734016130 00002000:00010000:0.0:1734016129.947950:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1734016129.948006:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1981:x1818247333800704:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 327us (721us total) trans 4294969469 rc 0/0 00000100:00100000:0.0:1734016129.948012:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8764 00002000:00010000:0.0:1734016129.948015:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:0.0:1734016129.948017:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a4a80 with x1818247333800704 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016129.948021:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a4a80. 00000100:00100000:0.0:1734016129.948038:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8765 00000100:00100000:0.0:1734016129.948043:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247333800576:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016129.948106:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1734016129.948108:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016130 -> 1734016130 00002000:00010000:0.0:1734016129.948110:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1734016129.948111:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016130 -> 1734016130 00002000:00010000:0.0:1734016129.948113:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1734016129.948126:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1981:x1818247333800576:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 82us (688us total) trans 4294967994 rc 0/0 00000100:00100000:0.0:1734016129.948130:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8765 00002000:00010000:0.0:1734016129.948132:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00002000:00100000:0.0:1734016129.948134:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a4000 with x1818247333800576 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016129.948137:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756a4000. 00000100:00100000:3.0:1734016129.948858:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335321344:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016129.948887:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016129.948921:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333800448:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7632us (7844us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016129.948933:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3083 00000100:00100000:0.0:1734016129.953351:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016129.954058:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333800960 00000100:00100000:1.0:1734016129.954073:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333800960 00000100:00100000:1.0:1734016129.954742:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2267 00000100:00100000:1.0:1734016129.954752:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+30:10406:x1818247333800960:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016129.955144:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116082 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016129.955169:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116082 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016129.955184:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116082 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000001:00080000:1.0:1734016129.955229:0:6480:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968775 00000004:00010000:1.0:1734016129.955244:0:6480:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800756a5f80 reply state ffff8800735d1000 transno 4294968776 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116082 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:1.0:1734016129.955250:0:6480:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016129.955368:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+33:10406:x1818247333800960:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 616us (2031us total) trans 4294968776 rc 0/0 00000100:00100000:1.0:1734016129.955376:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2267 00000020:00080000:1.0:1734016129.955380:0:6480:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1734016129.961102:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1734016129.961409:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116082 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.961424:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116082 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.961432:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116082 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.961439:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499dd40 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016129.961444:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116082 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.961453:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116082 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.961478:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016129.961481:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016129.961487:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116082 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016129.961492:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116082 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00000100:00100000:1.0:1734016129.961714:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016129.961856:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333801088 00000100:00100000:0.0:1734016129.961868:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333801088 00002000:00010000:0.0:1734016129.961920:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00002000:00100000:0.0:1734016129.961925:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15d180 with x1818247333801088 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016129.961938:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b15d180. 00000100:00100000:0.0:1734016129.961970:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333801216 00000100:00100000:0.0:1734016129.961974:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333801216 00002000:00010000:0.0:1734016129.961987:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:0.0:1734016129.961989:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15c700 with x1818247333801216 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016129.961998:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15c700. 00000100:00100000:0.0:1734016129.962018:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8766 00000100:00100000:0.0:1734016129.962025:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1981:x1818247333801088:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016129.962196:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1734016129.962199:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016130 -> 1734016130 00002000:00010000:0.0:1734016129.962202:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1734016129.962204:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016130 -> 1734016130 00002000:00010000:0.0:1734016129.962206:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1734016129.962254:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1981:x1818247333801088:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 228us (1167us total) trans 4294967995 rc 0/0 00000100:00100000:0.0:1734016129.962262:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8766 00002000:00010000:0.0:1734016129.962266:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00002000:00100000:0.0:1734016129.962268:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15d180 with x1818247333801088 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016129.962271:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b15d180. 00000100:00100000:0.0:1734016129.962286:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8767 00000100:00100000:0.0:1734016129.962290:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1982:x1818247333801216:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016129.962359:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1734016129.962361:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016130 -> 1734016130 00002000:00010000:0.0:1734016129.962363:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1734016129.962365:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016130 -> 1734016130 00002000:00010000:0.0:1734016129.962367:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1734016129.962385:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1982:x1818247333801216:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 93us (671us total) trans 4294969470 rc 0/0 00000100:00100000:0.0:1734016129.962390:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8767 00002000:00010000:0.0:1734016129.962392:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:0.0:1734016129.962394:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15c700 with x1818247333801216 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016129.962397:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15c700. 00000100:00100000:0.0:1734016129.965973:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016129.966159:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333801344 00000100:00100000:3.0:1734016129.966170:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333801344 00000100:00100000:3.0:1734016129.966248:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11084 00000100:00100000:3.0:1734016129.966257:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247333801344:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016129.966294:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016129.966327:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116089 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f8e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.966376:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711606d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f80 expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.966386:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016129.966388:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016129.966393:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116089 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f8e expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.966433:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711606d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f80 expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.966447:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711606d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f80 expref: 13 pid: 8216 timeout: 497 lvb_type: 0 00000100:00100000:3.0:1734016129.966461:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335321472:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016129.967346:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737810c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016129.971474:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016129.971998:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335321472:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016129.972048:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116089 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f8e expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016129.972076:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016129.972152:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:10406:x1818247333801344:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5897us (6192us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016129.972166:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11084 00000100:00100000:2.0:1734016129.972699:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333801472 00000100:00100000:2.0:1734016129.972711:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333801472 00010000:00010000:2.0:1734016129.972752:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711606d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f80 expref: 14 pid: 8216 timeout: 497 lvb_type: 0 00000100:00100000:2.0:1734016129.972791:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3084 00000100:00100000:2.0:1734016129.972797:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1981:x1818247333801472:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016129.972833:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016129.972885:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711606d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f80 expref: 14 pid: 8216 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1734016129.972901:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711606d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f80 expref: 14 pid: 8216 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1734016129.972935:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711606d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f80 expref: 14 pid: 8216 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1734016129.972957:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016129.972960:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016129.972970:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116089 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f8e expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.972979:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116089 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f8e expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.973017:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116089 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f8e expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016129.973030:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335321600:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016129.973077:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016129.979397:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.979539:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335321600:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016129.979567:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016129.979626:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1981:x1818247333801472:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6828us (8165us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016129.979639:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3084 00000100:00100000:3.0:1734016129.979750:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333801600 00000100:00100000:3.0:1734016129.979757:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333801600 00000100:00100000:3.0:1734016129.979825:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11085 00000100:00100000:3.0:1734016129.979832:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333801600:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016129.980137:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1734016129.980141:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016130 -> 1734016130 00002000:00010000:3.0:1734016129.980143:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1734016129.980145:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016130 -> 1734016129 00002000:00010000:3.0:1734016129.980146:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 0 -> 8192 00000100:00100000:3.0:1734016129.980168:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333801600:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 337us (790us total) trans 4294967996 rc 0/0 00000100:00100000:3.0:1734016129.980174:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11085 00000100:00100000:0.0:1734016129.983277:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016129.983497:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333801856 00000100:00100000:3.0:1734016129.983509:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333801856 00000100:00100000:3.0:1734016129.984169:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2268 00000100:00100000:3.0:1734016129.984179:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+31:10406:x1818247333801856:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016129.984444:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116090 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.984467:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116090 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016129.984483:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116090 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:3.0:1734016129.984525:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968777 00000004:00010000:3.0:1734016129.984542:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800756ef100 reply state ffff880075052000 transno 4294968778 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116090 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016129.984550:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016129.984659:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+34:10406:x1818247333801856:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 481us (1396us total) trans 4294968778 rc 0/0 00000100:00100000:3.0:1734016129.984666:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2268 00000020:00080000:3.0:1734016129.984671:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016129.987129:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116090 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.987148:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116090 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.987153:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116090 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.987159:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4240 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016129.987164:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116090 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.987172:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116090 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.987193:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016129.987196:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016129.987202:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116090 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016129.987207:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116090 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016129.988542:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016129.988902:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333801984 00000100:00100000:1.0:1734016129.988916:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333801984 00000100:00100000:1.0:1734016129.988978:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11086 00000100:00100000:1.0:1734016129.988986:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333801984:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016129.989014:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016129.989036:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116097 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f95 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.989067:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711607b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f87 expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.989076:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016129.989079:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016129.989082:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116097 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f95 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.989121:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711607b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f87 expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.989132:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711607b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f87 expref: 13 pid: 8216 timeout: 497 lvb_type: 0 00000100:00100000:1.0:1734016129.989144:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335321728:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016129.989200:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016129.991383:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335321728:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016129.991423:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116097 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f95 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016129.991447:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016129.991508:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247333801984:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2522us (2978us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016129.991519:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11086 00000100:00100000:0.0:1734016129.994528:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016129.994658:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333802112 00000100:00100000:2.0:1734016129.994670:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333802112 00010000:00010000:2.0:1734016129.994712:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711607b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f87 expref: 14 pid: 8216 timeout: 497 lvb_type: 0 00000100:00100000:2.0:1734016129.994769:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3085 00000100:00100000:2.0:1734016129.994778:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5227050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1982:x1818247333802112:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016129.994797:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016129.994929:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711607b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f87 expref: 14 pid: 8216 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1734016129.994945:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711607b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f87 expref: 14 pid: 8216 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1734016129.994975:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711607b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f87 expref: 14 pid: 8216 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1734016129.994998:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016129.995000:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016129.995008:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116097 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f95 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.995018:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116097 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f95 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016129.995064:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116097 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f95 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016129.995080:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335321856:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016129.995411:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016130.001394:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335321856:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016130.001431:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016130.001489:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5227050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1982:x1818247333802112:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6710us (6970us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016130.001502:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3085 00000100:00100000:0.0:1734016130.002172:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016130.002310:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.002411:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333802368 00000100:00100000:1.0:1734016130.002420:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333802368 00002000:00010000:1.0:1734016130.002470:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:1.0:1734016130.002475:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ec700 with x1818247333802368 ext(0->18446744073709551615) 00002000:00010000:1.0:1734016130.002487:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ec700. 00000100:00100000:1.0:1734016130.002503:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333802240 00000100:00100000:1.0:1734016130.002505:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333802240 00002000:00010000:1.0:1734016130.002516:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00002000:00100000:1.0:1734016130.002520:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756edf80 with x1818247333802240 ext(0->18446744073709551615) 00002000:00010000:1.0:1734016130.002528:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756edf80. 00000100:00100000:1.0:1734016130.002540:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8768 00000100:00100000:1.0:1734016130.002546:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333802368:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016130.002698:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1734016130.002702:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016130 -> 1734016130 00002000:00010000:1.0:1734016130.002704:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1734016130.002706:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016130 -> 1734016130 00002000:00010000:1.0:1734016130.002708:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1734016130.002751:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333802368:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 206us (581us total) trans 4294969471 rc 0/0 00000100:00100000:1.0:1734016130.002758:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8768 00002000:00010000:1.0:1734016130.002761:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:1.0:1734016130.002763:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ec700 with x1818247333802368 ext(0->18446744073709551615) 00002000:00010000:1.0:1734016130.002766:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ec700. 00000100:00100000:1.0:1734016130.002779:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8769 00000100:00100000:1.0:1734016130.002783:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333802240:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016130.002877:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1734016130.002879:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016130 -> 1734016130 00002000:00010000:1.0:1734016130.002881:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1734016130.002882:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016129 -> 1734016130 00002000:00010000:1.0:1734016130.002884:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 8192 -> 8192 00000100:00100000:1.0:1734016130.002899:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333802240:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 115us (589us total) trans 4294967997 rc 0/0 00000100:00100000:1.0:1734016130.002903:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8769 00002000:00010000:1.0:1734016130.002905:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00002000:00100000:1.0:1734016130.002908:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756edf80 with x1818247333802240 ext(0->18446744073709551615) 00002000:00010000:1.0:1734016130.002912:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756edf80. 00000100:00080000:0.0:1734016130.003570:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016100 00000100:00080000:0.0:1734016130.003575:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016100 00000100:00100000:0.0:1734016130.005781:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.006595:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333802496 00000100:00100000:1.0:1734016130.006610:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333802496 00000100:00100000:1.0:1734016130.006706:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2269 00000100:00100000:1.0:1734016130.006726:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+33:10406:x1818247333802496:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016130.006765:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016130.006824:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499eac0/0x5e3a3adc2711609e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5f9c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.006972:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc271160a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016130.006996:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc271160a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016130.007011:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc271160a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:1.0:1734016130.007048:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 0 00000004:00200000:1.0:1734016130.007053:0:6480:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016130.007074:0:6480:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc271160a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016130.007107:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499eac0/0x5e3a3adc2711609e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f9c expref: 35 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.007132:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc271160a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f9c expref: 34 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.007143:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016130.007147:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016130.007151:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00080000:0.0:1734016130.007261:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016100 00000100:00100000:1.0:1734016130.011068:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+34:10406:x1818247333802496:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4333us (5284us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016130.011086:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2269 00000100:00100000:0.0:1734016130.016033:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.016166:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333802624 00000100:00100000:1.0:1734016130.016177:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333802624 00000100:00100000:1.0:1734016130.016291:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11087 00000100:00100000:1.0:1734016130.016300:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333802624:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016130.016322:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016130.016348:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271160ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5fa3 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1734016130.016377:0:7684:0:(ofd_lvb.c:169:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1734016130.016402:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016130.016404:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016130.016413:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271160ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fa3 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.016427:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499eac0/0x5e3a3adc271160ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fa3 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.016439:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499eac0, rc 0) 00000100:00100000:1.0:1734016130.017103:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333802624:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 802us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016130.017111:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11087 00000100:00100000:0.0:1734016130.021935:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.022054:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333802880 00000100:00100000:1.0:1734016130.022067:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333802880 00000100:00100000:1.0:1734016130.022177:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2270 00000100:00100000:1.0:1734016130.022184:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+32:10406:x1818247333802880:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016130.022429:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc271160b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016130.022451:0:6480:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc271160a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f9c expref: 33 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.022459:0:6480:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc271160b3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016130.022498:0:6480:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc271160a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f9c expref: 33 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.022510:0:6480:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc271160a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f9c expref: 33 pid: 6480 timeout: 497 lvb_type: 0 00000100:00100000:1.0:1734016130.022526:0:6480:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1818247335321984:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016130.022588:0:6480:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7900 going to sleep for 11 seconds 00000100:00080000:0.0:1734016130.022650:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016100 00000100:00100000:1.0:1734016130.028043:0:6480:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1818247335321984:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016130.028124:0:6480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc271160b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:0.0:1734016130.028866:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016130.028984:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333803008 00000100:00100000:2.0:1734016130.028993:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333803008 00010000:00010000:2.0:1734016130.029028:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc271160a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f9c expref: 34 pid: 6480 timeout: 497 lvb_type: 0 00000100:00100000:2.0:1734016130.029076:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3086 00000100:00100000:2.0:1734016130.029085:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+34:1982:x1818247333803008:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016130.029105:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016130.029113:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc271160a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f9c expref: 34 pid: 6480 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1734016130.029124:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc271160a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f9c expref: 34 pid: 6480 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1734016130.029152:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc271160a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f9c expref: 34 pid: 6480 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1734016130.029187:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016130.029193:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc271160b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016130.029204:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc271160b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016130.029213:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc271160b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016130.029236:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016130.029281:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+33:1982:x1818247333803008:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 196us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016130.029289:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3086 00010000:00010000:1.0:1734016130.029570:0:6480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc271160b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016130.029578:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc271160b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000001:00080000:1.0:1734016130.029678:0:6480:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968779 00000004:00010000:1.0:1734016130.029734:0:6480:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800756eea00 reply state ffff8800735d7000 transno 4294968780 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc271160b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:1.0:1734016130.029743:0:6480:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016130.029826:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+35:10406:x1818247333802880:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 7641us (7907us total) trans 4294968780 rc 0/0 00000100:00100000:1.0:1734016130.029833:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2270 00000020:00080000:1.0:1734016130.029837:0:6480:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016130.034957:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc271160b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016130.034975:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc271160b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016130.034983:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc271160b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016130.034990:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499db00 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016130.034996:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc271160b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016130.035005:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc271160b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016130.035027:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016130.035030:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016130.035035:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc271160b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016130.035040:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc271160b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00000100:00100000:0.0:1734016130.035336:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.035591:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333803136 00000100:00100000:1.0:1734016130.035604:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333803136 00000100:00100000:1.0:1734016130.035869:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11088 00000100:00100000:1.0:1734016130.035879:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:10406:x1818247333803136:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016130.035896:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016130.035915:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5faa expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.035949:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116089 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f8e expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.035955:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016130.035958:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016130.035961:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160ba lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5faa expref: 14 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.035998:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116089 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f8e expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.036009:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116089 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f8e expref: 11 pid: 8216 timeout: 497 lvb_type: 0 00000100:00100000:1.0:1734016130.036025:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335322112:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016130.036098:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00080000:0.0:1734016130.036154:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016100 00000100:00100000:1.0:1734016130.038430:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335322112:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016130.038470:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160ba lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5faa expref: 14 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.038489:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016130.039297:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:10406:x1818247333803136:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3411us (4493us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016130.039313:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11088 00000100:00100000:0.0:1734016130.041580:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.041678:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333803264 00000100:00100000:1.0:1734016130.041689:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333803264 00010000:00010000:1.0:1734016130.041746:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116089 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f8e expref: 12 pid: 8216 timeout: 497 lvb_type: 0 00000100:00100000:1.0:1734016130.041787:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3087 00000100:00100000:1.0:1734016130.041796:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333803264:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016130.041846:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016130.041867:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116089 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f8e expref: 12 pid: 8216 timeout: 497 lvb_type: 0 00010000:00010000:1.0:1734016130.041878:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116089 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f8e expref: 12 pid: 8216 timeout: 497 lvb_type: 0 00010000:00010000:1.0:1734016130.041902:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116089 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f8e expref: 12 pid: 8216 timeout: 497 lvb_type: 0 00010000:00010000:1.0:1734016130.041926:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016130.041927:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016130.041933:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5faa expref: 13 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.041941:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5faa expref: 13 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.041972:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5faa expref: 13 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016130.041983:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335322240:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016130.042048:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016130.044952:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335322240:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016130.044980:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016130.045115:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.045356:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333803264:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3558us (3786us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016130.045368:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3087 00000100:00100000:1.0:1734016130.045420:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333803392 00000100:00100000:1.0:1734016130.045427:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333803392 00000100:00100000:1.0:1734016130.045483:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11089 00000100:00100000:1.0:1734016130.045489:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:10406:x1818247333803392:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016130.045511:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016130.045535:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271160c1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5fb1 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.045570:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116097 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f95 expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.045578:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016130.045581:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016130.045585:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271160c1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fb1 expref: 14 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.045616:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116097 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f95 expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.045628:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116097 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f95 expref: 10 pid: 7684 timeout: 497 lvb_type: 0 00000100:00100000:1.0:1734016130.045641:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335322368:192.168.201.16@tcp:104: 00000100:00080000:0.0:1734016130.045705:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016100 00000100:00100000:1.0:1734016130.046290:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016130.050691:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335322368:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016130.050769:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271160c1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fb1 expref: 14 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.050826:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016130.050904:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:10406:x1818247333803392:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5411us (5787us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016130.050920:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11089 00000100:00100000:0.0:1734016130.053302:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.053770:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333803520 00000100:00100000:1.0:1734016130.053781:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333803520 00010000:00010000:1.0:1734016130.053943:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116097 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f95 expref: 11 pid: 7684 timeout: 497 lvb_type: 0 00000100:00100000:0.0:1734016130.054293:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3088 00000100:00100000:0.0:1734016130.054302:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333803520:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016130.054323:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016130.054354:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116097 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f95 expref: 11 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:0.0:1734016130.054368:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116097 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f95 expref: 11 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:0.0:1734016130.054397:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116097 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5f95 expref: 11 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:0.0:1734016130.054418:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016130.054422:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016130.054430:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271160c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fb1 expref: 13 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016130.054440:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271160c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fb1 expref: 13 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016130.054485:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271160c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fb1 expref: 13 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016130.054502:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335322496:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016130.054596:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016130.061471:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016130.061626:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.061790:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333803776 00000100:00100000:1.0:1734016130.061825:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333803776 00002000:00010000:1.0:1734016130.061876:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (872707->18446744073709551615) 00002000:00100000:1.0:1734016130.061883:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ed180 with x1818247333803776 ext(872707->18446744073709551615) 00002000:00010000:1.0:1734016130.061905:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ed180. 00000100:00100000:1.0:1734016130.061938:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333803648 00000100:00100000:1.0:1734016130.061942:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333803648 00002000:00010000:1.0:1734016130.061956:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:1.0:1734016130.061958:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ee680 with x1818247333803648 ext(4194304->18446744073709551615) 00002000:00010000:1.0:1734016130.061972:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756ee680. 00000100:00100000:1.0:1734016130.061998:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8770 00000100:00100000:1.0:1734016130.062009:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1981:x1818247333803776:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016130.062358:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 872707 00002000:00010000:1.0:1734016130.062362:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016130 -> 1734016130 00002000:00010000:1.0:1734016130.062364:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1734016130.062366:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016130 -> 1734016130 00002000:00010000:1.0:1734016130.062368:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1734016130.062436:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1981:x1818247333803776:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 427us (987us total) trans 4294969472 rc 0/0 00000100:00100000:1.0:1734016130.062445:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8770 00002000:00010000:1.0:1734016130.062449:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (872707->18446744073709551615) 00002000:00100000:1.0:1734016130.062452:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ed180 with x1818247333803776 ext(872707->18446744073709551615) 00002000:00010000:1.0:1734016130.062456:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ed180. 00000100:00100000:1.0:1734016130.062480:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8771 00000100:00100000:1.0:1734016130.062484:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1981:x1818247333803648:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016130.062575:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1734016130.062578:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016130 -> 1734016130 00002000:00010000:1.0:1734016130.062580:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1734016130.062582:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016130 -> 1734016130 00002000:00010000:1.0:1734016130.062584:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 8192 -> 8192 00000100:00100000:1.0:1734016130.062599:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1981:x1818247333803648:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 114us (973us total) trans 4294967998 rc 0/0 00000100:00100000:1.0:1734016130.062605:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8771 00002000:00010000:1.0:1734016130.062608:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:1.0:1734016130.062610:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ee680 with x1818247333803648 ext(4194304->18446744073709551615) 00002000:00010000:1.0:1734016130.062614:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756ee680. 00000100:00100000:2.0:1734016130.062764:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335322496:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016130.062794:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016130.062835:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333803520:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 8534us (9551us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016130.062845:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3088 00000100:00100000:0.0:1734016130.066209:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.066385:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333803904 00000100:00100000:1.0:1734016130.066397:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333803904 00000100:00100000:1.0:1734016130.066677:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2271 00000100:00100000:1.0:1734016130.066688:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+34:10406:x1818247333803904:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016130.066734:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016130.066758:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc271160c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5fb8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.066899:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc271160cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016130.066920:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc271160cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016130.066930:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc271160cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:1.0:1734016130.066954:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 5067011 00000004:00200000:1.0:1734016130.066957:0:6480:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016130.066971:0:6480:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc271160cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016130.066990:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc271160c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fb8 expref: 36 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.067006:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc271160cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fb8 expref: 35 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.067013:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016130.067016:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016130.067019:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016130.067066:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+35:10406:x1818247333803904:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 380us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016130.067073:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2271 00000100:00100000:0.0:1734016130.070597:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.070686:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333804032 00000100:00100000:1.0:1734016130.070694:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333804032 00000100:00100000:1.0:1734016130.071064:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11090 00000100:00100000:1.0:1734016130.071075:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:10406:x1818247333804032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016130.071097:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016130.071115:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc271160d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5fbf expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.071143:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5faa expref: 14 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.071153:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016130.071156:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016130.071161:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc271160d6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1163264->1167359] (req 1163264->1167359) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fbf expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.071198:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5faa expref: 14 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.071212:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5faa expref: 14 pid: 7684 timeout: 497 lvb_type: 0 00000100:00100000:1.0:1734016130.071227:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335322624:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016130.071912:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016130.076493:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335322624:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016130.076533:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc271160d6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1163264->1167359] (req 1163264->1167359) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fbf expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.076555:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016130.076622:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:10406:x1818247333804032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5548us (6031us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016130.076633:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11090 00000100:00100000:0.0:1734016130.077256:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016130.077411:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333804160 00000100:00100000:2.0:1734016130.077420:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333804160 00010000:00010000:2.0:1734016130.077449:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5faa expref: 15 pid: 7684 timeout: 497 lvb_type: 0 00000100:00100000:2.0:1734016130.077478:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3089 00000100:00100000:2.0:1734016130.077485:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247333804160:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016130.077500:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016130.077525:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5faa expref: 15 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1734016130.077537:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5faa expref: 15 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1734016130.077558:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5faa expref: 15 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1734016130.077587:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016130.077589:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016130.077596:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc271160d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1167359) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fbf expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.077606:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc271160d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1167359) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fbf expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.077633:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc271160d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1167359) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fbf expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016130.077644:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335322752:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016130.077685:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706d80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016130.081074:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016130.081270:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335322752:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016130.081309:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016130.081368:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1982:x1818247333804160:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3881us (4112us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016130.081384:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3089 00000100:00100000:1.0:1734016130.081567:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333804416 00000100:00100000:1.0:1734016130.081575:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333804416 00002000:00100000:1.0:1734016130.081630:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (1163264->1167359) req@ffff88007345ed80 x1818247333804416/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:91/0 lens 488/0 e 0 to 0 dl 1734016141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016130.081640:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345ed80 with x1818247333804416 ext(1163264->1167359) 00002000:00010000:1.0:1734016130.081645:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007345ed80 00000100:00100000:1.0:1734016130.081678:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8772 00000100:00100000:1.0:1734016130.081687:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333804416:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016130.081952:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333804416:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 266us (891us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016130.081959:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8772 00002000:00100000:1.0:1734016130.081964:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (1163264->1167359) req@ffff88007345ed80 x1818247333804416/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:91/0 lens 488/4536 e 0 to 0 dl 1734016141 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016130.081971:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345ed80 with x1818247333804416 ext(1163264->1167359) 00002000:00010000:1.0:1734016130.081975:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007345ed80 00000100:00100000:0.0:1734016130.086730:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.086827:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333804544 00000100:00100000:1.0:1734016130.086837:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333804544 00000100:00100000:1.0:1734016130.086887:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11091 00000100:00100000:1.0:1734016130.086894:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1981:x1818247333804544:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016130.086911:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016130.086928:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5fc6 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.086947:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016130.086949:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016130.086956:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fc6 expref: 15 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.086973:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fc6 expref: 15 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.086984:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016130.087021:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1981:x1818247333804544:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 127us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016130.087026:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11091 00000100:00100000:0.0:1734016130.095626:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.096031:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333804800 00000100:00100000:3.0:1734016130.096046:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333804800 00002000:00100000:3.0:1734016130.096113:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (1073152->1077247) req@ffff88007345c700 x1818247333804800/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:91/0 lens 488/0 e 0 to 0 dl 1734016141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016130.096126:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345c700 with x1818247333804800 ext(1073152->1077247) 00002000:00010000:3.0:1734016130.096132:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007345c700 00000100:00100000:3.0:1734016130.096171:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8773 00000100:00100000:3.0:1734016130.096178:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247333804800:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016130.096400:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247333804800:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 222us (793us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016130.096409:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8773 00002000:00100000:3.0:1734016130.096414:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (1073152->1077247) req@ffff88007345c700 x1818247333804800/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:91/0 lens 488/4536 e 0 to 0 dl 1734016141 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016130.096420:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345c700 with x1818247333804800 ext(1073152->1077247) 00002000:00010000:3.0:1734016130.096424:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007345c700 00000100:00100000:0.0:1734016130.099895:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.100161:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333805056 00000100:00100000:1.0:1734016130.100171:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333805056 00002000:00100000:1.0:1734016130.100217:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (1077248->1081343) req@ffff8800849b4e00 x1818247333805056/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:91/0 lens 488/0 e 0 to 0 dl 1734016141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016130.100226:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b4e00 with x1818247333805056 ext(1077248->1081343) 00002000:00010000:1.0:1734016130.100231:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800849b4e00 00000100:00100000:1.0:1734016130.100269:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8774 00000100:00100000:1.0:1734016130.100276:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247333805056:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016130.100435:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247333805056:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 158us (548us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016130.100442:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8774 00002000:00100000:1.0:1734016130.100448:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (1077248->1081343) req@ffff8800849b4e00 x1818247333805056/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:91/0 lens 488/4536 e 0 to 0 dl 1734016141 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016130.100453:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b4e00 with x1818247333805056 ext(1077248->1081343) 00002000:00010000:1.0:1734016130.100457:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800849b4e00 00000100:00100000:0.0:1734016130.103725:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.103924:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333805184 00000100:00100000:3.0:1734016130.103935:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333805184 00000100:00100000:3.0:1734016130.103986:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2272 00000100:00100000:3.0:1734016130.103993:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+33:10406:x1818247333805184:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.104016:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.104035:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271160e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5fcd expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.104125:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271160eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016130.104136:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271160eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016130.104146:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271160eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016130.104167:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 5067011 00000004:00200000:3.0:1734016130.104170:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016130.104181:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271160eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016130.104198:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271160e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fcd expref: 35 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.104226:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271160eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fcd expref: 34 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.104233:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016130.104235:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016130.104238:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016130.104278:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+34:10406:x1818247333805184:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 285us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016130.104284:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2272 00000100:00100000:0.0:1734016130.107333:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.107696:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333805312 00000100:00100000:3.0:1734016130.107710:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333805312 00000100:00100000:3.0:1734016130.108157:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11092 00000100:00100000:3.0:1734016130.108165:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333805312:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.108188:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.108207:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271160f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5fd4 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016130.108274:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335322880:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016130.108343:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781d80 going to sleep for 11 seconds 00002000:00010000:3.0:1734016130.110384:0:8216:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size: 872707 -> 1943305 00002000:00010000:3.0:1734016130.110396:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 0 -> 1734016130 00002000:00010000:3.0:1734016130.110401:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:3.0:1734016130.110424:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335322880:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016130.110474:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271160f2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fd4 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.110488:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271160f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fd4 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.110503:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016130.110579:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333805312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2413us (3259us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016130.110593:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11092 00000100:00100000:0.0:1734016130.119870:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.120097:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333805440 00000100:00100000:3.0:1734016130.120117:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333805440 00000100:00100000:3.0:1734016130.120183:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11093 00000100:00100000:3.0:1734016130.120194:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333805440:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.120227:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.120256:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271160f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5fdb expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016130.120349:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335323008:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016130.120590:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781d80 going to sleep for 11 seconds 00000100:00100000:3.0:1734016130.129213:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335323008:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016130.129274:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271160f9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fdb expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.129292:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc271160f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fdb expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.129320:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016130.129401:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333805440:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9209us (9606us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016130.129411:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11093 00000100:00100000:0.0:1734016130.132368:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.132520:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333805568 00000100:00100000:3.0:1734016130.132538:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333805568 00000100:00100000:3.0:1734016130.132620:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11094 00000100:00100000:3.0:1734016130.132629:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333805568:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.132663:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.132697:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116100 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5fe2 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016130.132789:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335323136:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016130.132949:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781d80 going to sleep for 11 seconds 00000100:00100000:3.0:1734016130.141371:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335323136:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016130.141415:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116100 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fe2 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.141432:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116100 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fe2 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.141450:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016130.142285:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333805568:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9653us (9941us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016130.142297:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11094 00000100:00100000:0.0:1734016130.147984:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.148514:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333805696 00000100:00100000:3.0:1734016130.148525:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333805696 00000100:00100000:1.0:1734016130.150164:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11095 00000100:00100000:1.0:1734016130.150181:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333805696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016130.150204:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016130.150225:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27116107 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5fe9 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016130.150300:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335323264:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016130.150397:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016130.154112:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335323264:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016130.154157:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27116107 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fe9 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.154177:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27116107 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fe9 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.154201:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016130.154293:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333805696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4112us (6318us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016130.154307:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11095 00000100:00100000:0.0:1734016130.170849:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.171024:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333805952 00000100:00100000:3.0:1734016130.171040:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333805952 00002000:00100000:3.0:1734016130.171117:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff8800849b4000 x1818247333805952/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:91/0 lens 504/0 e 0 to 0 dl 1734016141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016130.171130:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b4000 with x1818247333805952 ext(0->4194303) 00002000:00010000:3.0:1734016130.171138:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800849b4000 00000100:00100000:3.0:1734016130.171165:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8775 00000100:00100000:3.0:1734016130.171173:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333805952:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016130.258033:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333805952:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 86823us (87204us total) trans 0 rc 4190208/4190208 00000100:00100000:0.0:1734016130.258060:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8775 00002000:00100000:0.0:1734016130.258090:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff8800849b4000 x1818247333805952/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:91/0 lens 504/440 e 0 to 0 dl 1734016141 ref 1 fl Complete:/200/0 rc 4190208/4190208 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016130.258107:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b4000 with x1818247333805952 ext(0->4194303) 00002000:00010000:0.0:1734016130.258116:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800849b4000 00000100:00100000:0.0:1734016130.263922:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.264054:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333806080 00000100:00100000:1.0:1734016130.264068:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333806080 00000100:00100000:1.0:1734016130.264160:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11096 00000100:00100000:1.0:1734016130.264169:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333806080:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016130.264199:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016130.264236:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc2711610e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ff0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016130.264344:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335323392:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016130.264472:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016130.267187:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335323392:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016130.267225:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc2711610e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ff0 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.267242:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc2711610e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ff0 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.267267:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016130.267340:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333806080:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3171us (3434us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016130.267350:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11096 00000100:00100000:2.0:1734016130.270889:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.272847:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333806208 00000100:00100000:1.0:1734016130.272878:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333806208 00000100:00100000:1.0:1734016130.272958:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11097 00000100:00100000:1.0:1734016130.273183:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333806208:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016130.273216:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016130.273245:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27116115 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ff7 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016130.273322:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335323520:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016130.273422:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016130.276475:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335323520:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016130.276519:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27116115 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ff7 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.276533:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27116115 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ff7 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.276672:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016130.280040:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333806208:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6841us (9150us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016130.280056:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11097 00000100:00100000:1.0:1734016130.284032:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016130.284229:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333806336 00000100:00100000:2.0:1734016130.284244:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333806336 00000100:00100000:2.0:1734016130.284320:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11098 00000100:00100000:2.0:1734016130.284328:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333806336:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016130.284357:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016130.284380:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711611c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e5ffe expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016130.284464:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335323648:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016130.284971:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706d80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016130.288889:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335323648:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016130.288958:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711611c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ffe expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016130.288976:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711611c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ffe expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016130.289001:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:0.0:1734016130.289086:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333806336:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4756us (5075us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016130.289095:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11098 00000100:00100000:2.0:1734016130.294298:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016130.294447:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333806464 00000100:00100000:0.0:1734016130.294459:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333806464 00000100:00100000:0.0:1734016130.294523:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11099 00000100:00100000:0.0:1734016130.294532:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:10406:x1818247333806464:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016130.294553:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016130.294576:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27116123 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6005 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016130.294611:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271160c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fb1 expref: 14 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016130.294618:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016130.294620:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016130.294625:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27116123 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [1593344->1597439] (req 1593344->1597439) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6005 expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016130.294658:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271160c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fb1 expref: 14 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016130.294673:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271160c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fb1 expref: 14 pid: 7684 timeout: 497 lvb_type: 0 00000100:00100000:0.0:1734016130.294687:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335323776:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016130.294773:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016130.298314:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335323776:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016130.298369:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27116123 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [1593344->1597439] (req 1593344->1597439) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6005 expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016130.298406:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581b00, rc 0) 00000100:00100000:0.0:1734016130.298491:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:10406:x1818247333806464:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3957us (4198us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016130.298502:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11099 00000100:00100000:2.0:1734016130.299983:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016130.300064:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333806592 00000100:00100000:0.0:1734016130.300076:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333806592 00002000:00100000:0.0:1734016130.300139:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (1937408->1943304) req@ffff88012b132d80 x1818247333806592/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:91/0 lens 6392/0 e 0 to 0 dl 1734016141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016130.300151:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b132d80 with x1818247333806592 ext(1937408->1943304) 00010000:00010000:0.0:1734016130.300165:0:7688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271160c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fb1 expref: 15 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:0.0:1734016130.300180:0:7688:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271160c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fb1 expref: 15 pid: 7684 timeout: 497 lvb_type: 0 00002000:00010000:0.0:1734016130.300187:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b132d80 00000100:00100000:0.0:1734016130.300233:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 283 00000100:00100000:0.0:1734016130.300244:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247333806592:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016130.302584:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1982:x1818247333806592:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 2320us (2592us total) trans 4294969473 rc 0/0 00000100:00100000:0.0:1734016130.302608:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 283 00002000:00100000:0.0:1734016130.302628:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (1937408->1943304) req@ffff88012b132d80 x1818247333806592/t4294969473(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:91/0 lens 6392/448 e 0 to 0 dl 1734016141 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016130.302646:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b132d80 with x1818247333806592 ext(1937408->1943304) 00010000:00010000:0.0:1734016130.302661:0:7688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271160c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fb1 expref: 17 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:0.0:1734016130.302687:0:7688:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271160c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fb1 expref: 17 pid: 7684 timeout: 497 lvb_type: 0 00002000:00010000:0.0:1734016130.302693:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b132d80 00000100:00100000:2.0:1734016130.306138:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016130.306277:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333806720 00000100:00100000:0.0:1734016130.306292:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333806720 00010000:00010000:0.0:1734016130.306343:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271160c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fb1 expref: 17 pid: 7684 timeout: 497 lvb_type: 0 00000100:00100000:0.0:1734016130.306391:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3090 00000100:00100000:0.0:1734016130.306398:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1984:x1818247333806720:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016130.306417:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1734016130.306445:0:7698:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 1 -> 16 00010000:00010000:0.0:1734016130.306453:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271160c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fb1 expref: 17 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:0.0:1734016130.306466:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271160c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fb1 expref: 17 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:0.0:1734016130.306498:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271160c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fb1 expref: 17 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:0.0:1734016130.307105:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016130.307110:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016130.307125:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27116123 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->1597439) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6005 expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016130.307140:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27116123 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->1597439) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6005 expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016130.307210:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27116123 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->1597439) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6005 expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016130.307233:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335323904:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016130.307764:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016130.315470:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335323904:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016130.315496:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016130.315994:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1984:x1818247333806720:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9592us (9874us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016130.316006:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3090 00000100:00100000:2.0:1734016130.316115:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016130.316344:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333806976 00000100:00100000:0.0:1734016130.316350:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333806976 00002000:00100000:0.0:1734016130.316378:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (0->1945599) req@ffff8800756a7480 x1818247333806976/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:91/0 lens 488/0 e 0 to 0 dl 1734016141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016130.316386:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a7480 with x1818247333806976 ext(0->1945599) 00002000:00010000:0.0:1734016130.316390:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a7480 00000100:00100000:0.0:1734016130.316405:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8776 00000100:00100000:0.0:1734016130.316411:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333806976:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016130.346078:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333806976:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 29652us (29949us total) trans 0 rc 1945600/1945600 00000100:00100000:0.0:1734016130.346093:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8776 00002000:00100000:0.0:1734016130.346109:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (0->1945599) req@ffff8800756a7480 x1818247333806976/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:91/0 lens 488/440 e 0 to 0 dl 1734016141 ref 1 fl Complete:/200/0 rc 1945600/1945600 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016130.346121:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a7480 with x1818247333806976 ext(0->1945599) 00002000:00010000:0.0:1734016130.346128:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a7480 00000100:00100000:0.0:1734016130.354587:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016130.354782:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333807104 00000100:00100000:2.0:1734016130.354842:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333807104 00000100:00100000:2.0:1734016130.355728:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11100 00000100:00100000:2.0:1734016130.355742:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1984:x1818247333807104:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016130.355771:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016130.355838:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711612a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e600c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.355875:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016130.355878:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016130.355891:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711612a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e600c expref: 17 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016130.355909:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711612a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e600c expref: 17 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016130.355920:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016130.356004:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1984:x1818247333807104:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 266us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016130.356011:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11100 00000100:00100000:0.0:1734016130.360048:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.360204:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333807232 00000100:00100000:3.0:1734016130.360221:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333807232 00000100:00100000:3.0:1734016130.360294:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11101 00000100:00100000:3.0:1734016130.360304:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:10406:x1818247333807232:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.360333:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.360359:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116131 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6013 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.360400:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27116123 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1593344->1597439) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6005 expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.360413:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711612a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e600c expref: 16 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.360420:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016130.360422:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016130.360427:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116131 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [1060864->1064959] (req 1060864->1064959) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6013 expref: 12 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.360475:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711612a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e600c expref: 16 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.360493:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711612a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e600c expref: 16 pid: 7684 timeout: 497 lvb_type: 1 00000100:00100000:3.0:1734016130.360518:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335324032:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016130.360629:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27116123 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1593344->1597439) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6005 expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.360638:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27116123 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1593344->1597439) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6005 expref: 12 pid: 7684 timeout: 497 lvb_type: 0 00000100:00100000:3.0:1734016130.360647:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335324160:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016130.360670:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781d80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016130.372065:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.373273:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335324160:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016130.375407:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333807360 00000100:00100000:1.0:1734016130.375423:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333807360 00010000:00010000:1.0:1734016130.375480:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27116123 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1593344->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6005 expref: 13 pid: 7684 timeout: 497 lvb_type: 0 00000100:00100000:1.0:1734016130.375532:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3091 00000100:00100000:1.0:1734016130.375539:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333807360:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016130.375551:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016130.375575:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27116123 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1593344->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6005 expref: 13 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:1.0:1734016130.375585:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27116123 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1593344->1597439) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6005 expref: 13 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:1.0:1734016130.375606:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27116123 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1593344->1597439) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6005 expref: 13 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:1.0:1734016130.375640:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016130.375722:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333807360:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 173us (3665us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016130.375729:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3091 00000100:00100000:1.0:1734016130.379570:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016130.379647:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333807488 00000100:00100000:2.0:1734016130.379658:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333807488 00010000:00010000:2.0:1734016130.379719:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711612a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e600c expref: 17 pid: 7684 timeout: 497 lvb_type: 1 00000100:00100000:2.0:1734016130.379762:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3092 00000100:00100000:2.0:1734016130.379772:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5225850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1981:x1818247333807488:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016130.379795:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016130.379849:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711612a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e600c expref: 17 pid: 7684 timeout: 497 lvb_type: 1 00010000:00010000:2.0:1734016130.379864:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711612a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e600c expref: 17 pid: 7684 timeout: 497 lvb_type: 1 00010000:00010000:2.0:1734016130.379939:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016130.379941:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016130.379952:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116131 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1064959) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6013 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.379964:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116131 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1064959) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6013 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.380012:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116131 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1064959) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6013 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016130.380028:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335324288:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016130.380199:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711612a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e600c expref: 17 pid: 7684 timeout: 497 lvb_type: 1 00000100:00100000:2.0:1734016130.381188:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016130.383700:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335324032:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016130.383769:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116131 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1064959) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6013 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.383791:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016130.383887:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:10406:x1818247333807232:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 23584us (23851us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016130.383898:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11101 00000100:00100000:3.0:1734016130.385303:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335324288:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016130.385337:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016130.385383:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5225850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1981:x1818247333807488:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5612us (5834us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016130.385396:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3092 00000100:00100000:0.0:1734016130.387942:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.388492:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333807616 00000100:00100000:3.0:1734016130.388509:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333807616 00000100:00100000:3.0:1734016130.388686:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11102 00000100:00100000:3.0:1734016130.388696:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333807616:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016130.388976:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 1943305 -> 1943305 00002000:00010000:3.0:1734016130.388980:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016130 -> 1734016130 00002000:00010000:3.0:1734016130.388982:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016130 -> 0 00002000:00010000:3.0:1734016130.388984:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016130 -> 1734016130 00002000:00010000:3.0:1734016130.388986:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:3.0:1734016130.390134:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333807616:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1428us (2192us total) trans 4294969474 rc 0/0 00000100:00100000:3.0:1734016130.390146:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11102 00000100:00100000:0.0:1734016130.393040:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.393345:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333807744 00000100:00100000:3.0:1734016130.393362:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333807744 00000100:00100000:3.0:1734016130.393596:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11103 00000100:00100000:3.0:1734016130.393611:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333807744:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.393657:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.393690:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116138 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e601a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016130.393775:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335324416:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016130.394240:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781c00 going to sleep for 11 seconds 00002000:00010000:3.0:1734016130.396903:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 0 -> 1734016130 00002000:00010000:3.0:1734016130.396918:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016130 -> 1734016131 00000100:00100000:3.0:1734016130.396953:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335324416:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016130.397013:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116138 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e601a expref: 17 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.397034:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116138 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e601a expref: 17 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.397049:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016130.397111:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333807744:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3504us (4093us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016130.397126:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11103 00000100:00100000:1.0:1734016130.401103:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.401223:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333807872 00000100:00100000:3.0:1734016130.401233:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333807872 00000100:00100000:3.0:1734016130.401423:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11104 00000100:00100000:3.0:1734016130.401430:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333807872:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.401456:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.401477:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711613f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6021 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016130.401530:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335324544:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016130.402131:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016130.404427:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335324544:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016130.404481:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711613f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6021 expref: 17 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.404503:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711613f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6021 expref: 17 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.404524:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016130.405154:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333807872:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3719us (4057us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016130.405165:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11104 00000100:00100000:0.0:1734016130.410269:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.410488:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333808000 00000100:00100000:3.0:1734016130.410504:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333808000 00000100:00100000:3.0:1734016130.410655:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11105 00000100:00100000:3.0:1734016130.410668:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333808000:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.410721:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.410749:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27116146 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6028 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016130.411272:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335324672:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016130.411403:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016130.413609:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335324672:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016130.413653:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27116146 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6028 expref: 17 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.413666:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27116146 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6028 expref: 17 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.413686:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016130.413754:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333808000:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3088us (3519us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016130.413765:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11105 00000100:00100000:0.0:1734016130.417326:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.417454:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333808128 00000100:00100000:3.0:1734016130.417463:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333808128 00000100:00100000:3.0:1734016130.417526:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11106 00000100:00100000:3.0:1734016130.417534:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333808128:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.417562:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.417584:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc2711614d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e602f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016130.417690:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335324800:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016130.417828:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016130.421193:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335324800:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016130.421255:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc2711614d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e602f expref: 17 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.421274:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc2711614d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e602f expref: 17 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.421569:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016130.421764:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333808128:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4225us (4453us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016130.421779:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11106 00000100:00100000:0.0:1734016130.430035:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.430225:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333808256 00000100:00100000:3.0:1734016130.430239:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333808256 00000100:00100000:3.0:1734016130.432285:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11107 00000100:00100000:3.0:1734016130.432305:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333808256:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.432338:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.432374:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116154 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6036 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016130.432451:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335324928:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016130.432584:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016130.441081:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335324928:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016130.441148:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116154 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6036 expref: 17 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.441167:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116154 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6036 expref: 17 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.441964:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016130.442558:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333808256:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10252us (12531us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016130.442570:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11107 00000100:00100000:0.0:1734016130.453005:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.453208:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333808384 00000100:00100000:3.0:1734016130.453228:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333808384 00000100:00100000:3.0:1734016130.453671:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11108 00000100:00100000:3.0:1734016130.453689:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333808384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.453726:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.453758:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711615b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e603d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.453855:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116131 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1064959) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6013 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.453865:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016130.453867:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016130.453872:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711615b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [2965504->2973695] (req 2965504->2973695) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e603d expref: 17 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.453921:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116131 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1064959) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6013 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.453938:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116131 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1064959) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6013 expref: 11 pid: 8216 timeout: 497 lvb_type: 0 00000100:00100000:3.0:1734016130.453953:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335325056:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016130.454061:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781c00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016130.465061:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016130.465266:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333808512 00000100:00100000:2.0:1734016130.465278:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333808512 00010000:00010000:2.0:1734016130.465327:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116131 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6013 expref: 12 pid: 8216 timeout: 497 lvb_type: 0 00000100:00100000:2.0:1734016130.465379:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3093 00000100:00100000:2.0:1734016130.465389:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333808512:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016130.465412:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016130.465439:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116131 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6013 expref: 12 pid: 8216 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1734016130.465455:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116131 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1064959) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6013 expref: 12 pid: 8216 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1734016130.465492:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016130.465495:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016130.465503:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711615b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2965504->2973695) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e603d expref: 17 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.465511:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711615b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2965504->2973695) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e603d expref: 17 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.465549:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711615b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2965504->2973695) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e603d expref: 17 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016130.465568:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335325184:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016130.465632:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1734016130.467461:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116131 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1064959) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6013 expref: 12 pid: 8216 timeout: 497 lvb_type: 0 00000100:00100000:3.0:1734016130.467487:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335325056:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016130.467517:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711615b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->2973695) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e603d expref: 17 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.467534:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016130.467598:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:10406:x1818247333808384:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 13913us (14620us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016130.467609:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11108 00000100:00100000:2.0:1734016130.473013:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335325184:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016130.473047:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016130.473116:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333808512:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7726us (8071us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016130.473143:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3093 00000100:00100000:0.0:1734016130.474020:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.474464:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333808640 00000100:00100000:3.0:1734016130.474474:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333808640 00000100:00100000:3.0:1734016130.474527:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11109 00000100:00100000:3.0:1734016130.474535:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1981:x1818247333808640:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016130.474907:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 1943305 -> 2973464 00002000:00010000:3.0:1734016130.474911:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016130 -> 1734016130 00002000:00010000:3.0:1734016130.474913:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016130 -> 0 00002000:00010000:3.0:1734016130.474915:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016131 -> 1734016130 00002000:00010000:3.0:1734016130.474916:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 16 -> 32 00000100:00100000:3.0:1734016130.474969:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:1981:x1818247333808640:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 433us (952us total) trans 4294969475 rc 0/0 00000100:00100000:3.0:1734016130.474975:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11109 00000100:00100000:0.0:1734016130.486731:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016130.486858:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333808768 00000100:00100000:2.0:1734016130.486871:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333808768 00000100:00100000:2.0:1734016130.486944:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11110 00000100:00100000:2.0:1734016130.486954:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333808768:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016130.486980:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016130.487006:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116162 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6044 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016130.487078:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335325312:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016130.487163:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706cc0 going to sleep for 11 seconds 00002000:00010000:2.0:1734016130.492791:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 0 -> 1734016130 00002000:00010000:2.0:1734016130.492844:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016130 -> 1734016131 00000100:00100000:2.0:1734016130.492888:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335325312:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016130.492944:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116162 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6044 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016130.492965:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116162 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6044 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016130.493160:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016130.493485:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333808768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6525us (6767us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016130.493497:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11110 00000100:00100000:1.0:1734016130.504187:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016130.505960:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333808896 00000100:00100000:2.0:1734016130.505975:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333808896 00000100:00100000:2.0:1734016130.506073:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11111 00000100:00100000:2.0:1734016130.506088:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333808896:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016130.506113:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016130.506135:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27116169 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e604b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016130.506220:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335325440:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016130.506319:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016130.513833:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335325440:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016130.513900:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27116169 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e604b expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016130.513923:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27116169 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e604b expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016130.513965:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016130.514055:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333808896:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7971us (9885us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016130.514069:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11111 00000100:00100000:0.0:1734016130.524038:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016130.524179:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333809024 00000100:00100000:2.0:1734016130.524197:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333809024 00000100:00100000:2.0:1734016130.524268:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11112 00000100:00100000:2.0:1734016130.524277:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10406:x1818247333809024:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016130.524300:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016130.524323:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116170 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6052 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.524354:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc271160d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1163264->1167359) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fbf expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.524361:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fc6 expref: 16 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016130.524370:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016130.524372:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016130.524375:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116170 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [1155072->1159167] (req 1155072->1159167) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6052 expref: 16 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.524410:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fc6 expref: 16 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016130.524424:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fc6 expref: 16 pid: 7684 timeout: 497 lvb_type: 1 00000100:00100000:2.0:1734016130.524438:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335325568:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016130.524535:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc271160d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1163264->1167359) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fbf expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.524544:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc271160d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1163264->1167359) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fbf expref: 11 pid: 7684 timeout: 497 lvb_type: 0 00000100:00100000:2.0:1734016130.524553:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335325696:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016130.524575:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016130.527668:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335325568:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016130.527687:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335325696:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016130.527740:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116170 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [1155072->1159167] (req 1155072->1159167) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6052 expref: 16 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.527780:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016130.527907:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333809024:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3628us (3886us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016130.527921:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11112 00000100:00100000:0.0:1734016130.548633:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016130.554725:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.554910:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333809152 00000100:00100000:1.0:1734016130.554922:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333809152 00010000:00010000:1.0:1734016130.554973:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fc6 expref: 16 pid: 7684 timeout: 497 lvb_type: 1 00000100:00100000:1.0:1734016130.555005:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333809280 00000100:00100000:1.0:1734016130.555008:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333809280 00010000:00010000:1.0:1734016130.555019:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc271160d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1163264->1167359) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fbf expref: 12 pid: 7684 timeout: 497 lvb_type: 0 00000100:00100000:1.0:1734016130.555037:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3094 00000100:00100000:1.0:1734016130.555046:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1981:x1818247333809152:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016130.555069:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016130.555102:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fc6 expref: 16 pid: 7684 timeout: 497 lvb_type: 1 00010000:00010000:1.0:1734016130.555116:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fc6 expref: 16 pid: 7684 timeout: 497 lvb_type: 1 00010000:00010000:1.0:1734016130.555155:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc271160dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fc6 expref: 16 pid: 7684 timeout: 497 lvb_type: 1 00010000:00010000:1.0:1734016130.555182:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016130.555286:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1981:x1818247333809152:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 239us (6672us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016130.555294:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3094 00000100:00100000:3.0:1734016130.555298:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3095 00000100:00100000:3.0:1734016130.555303:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333809280:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016130.555311:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016130.555321:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc271160d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1163264->1167359) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fbf expref: 12 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:3.0:1734016130.555332:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc271160d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1163264->1167359) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fbf expref: 12 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:3.0:1734016130.555344:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc271160d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1163264->1167359) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fbf expref: 12 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:3.0:1734016130.555357:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016130.555359:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016130.555367:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116170 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1159167) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6052 expref: 14 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.555375:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116170 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1159167) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6052 expref: 14 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.555409:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116170 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1159167) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6052 expref: 14 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016130.555424:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335325824:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016130.555489:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781c00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016130.569039:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016130.569125:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333809536 00000100:00100000:0.0:1734016130.569138:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333809536 00002000:00100000:0.0:1734016130.569201:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (1126400->1191935) req@ffff8800756a5880 x1818247333809536/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:91/0 lens 488/0 e 0 to 0 dl 1734016141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016130.569216:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a5880 with x1818247333809536 ext(1126400->1191935) 00002000:00010000:0.0:1734016130.569223:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756a5880 00000100:00100000:0.0:1734016130.569266:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8777 00000100:00100000:0.0:1734016130.569275:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1983:x1818247333809536:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016130.569895:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335325824:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016130.569921:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016130.570005:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333809280:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 14699us (15311us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016130.570019:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3095 00000100:00100000:2.0:1734016130.572310:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1983:x1818247333809536:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 3019us (3273us total) trans 0 rc 65536/65536 00000100:00100000:2.0:1734016130.572328:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8777 00002000:00100000:2.0:1734016130.572347:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (1126400->1191935) req@ffff8800756a5880 x1818247333809536/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:91/0 lens 488/440 e 0 to 0 dl 1734016141 ref 1 fl Complete:/200/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016130.572360:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a5880 with x1818247333809536 ext(1126400->1191935) 00002000:00010000:2.0:1734016130.572368:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756a5880 00000100:00100000:0.0:1734016130.577117:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016130.577251:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333809664 00000100:00100000:2.0:1734016130.577262:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333809664 00002000:00100000:2.0:1734016130.577313:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (1155072->1163263) req@ffff880075444380 x1818247333809664/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:91/0 lens 8680/0 e 0 to 0 dl 1734016141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016130.577324:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075444380 with x1818247333809664 ext(1155072->1163263) 00002000:00010000:2.0:1734016130.577332:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075444380 00000100:00100000:2.0:1734016130.578002:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8778 00000100:00100000:2.0:1734016130.578011:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1983:x1818247333809664:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016130.586316:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1983:x1818247333809664:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 8283us (9192us total) trans 4294967999 rc 0/0 00000100:00100000:2.0:1734016130.586334:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8778 00002000:00100000:2.0:1734016130.586354:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (1155072->1163263) req@ffff880075444380 x1818247333809664/t4294967999(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:91/0 lens 8680/448 e 0 to 0 dl 1734016141 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016130.586366:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075444380 with x1818247333809664 ext(1155072->1163263) 00002000:00010000:2.0:1734016130.586375:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075444380 00010000:00010000:2.0:1734016130.592143:0:6468:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1734016130.594585:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.594697:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333809792 00000100:00100000:1.0:1734016130.594714:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333809792 00000100:00100000:1.0:1734016130.594776:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2273 00000100:00100000:1.0:1734016130.594789:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+35:10406:x1818247333809792:12345-192.168.201.16@tcp:44:fsx.0 00000001:00080000:3.0:1734016130.596629:0:6461:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968780 is committed 00000001:00080000:3.0:1734016130.596643:0:6461:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968778 is committed 00000004:00080000:3.0:1734016130.596690:0:6461:0:(osp_sync.c:1746:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:3.0:1734016130.596700:0:6461:0:(osp_sync.c:1746:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:2.0:1734016130.604958:0:3506:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1734016130.604993:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335326080:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1734016130.605113:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1734016130.605182:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335326080 00000100:00100000:2.0:1734016130.605199:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335326080 00000100:00080000:2.0:1734016130.605230:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016100 00000100:00100000:2.0:1734016130.605287:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11113 00000100:00100000:2.0:1734016130.605299:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335326080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1734016130.605345:0:7684:0:(ofd_dev.c:1768:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:7 count 1 00010000:00010000:2.0:1734016130.605393:0:7684:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116177 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.605423:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27115e6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ebc expref: 17 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.605431:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016130.605434:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016130.605439:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116177 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.605473:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27115e6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ebc expref: 17 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.605491:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27115e6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ebc expref: 17 pid: 7682 timeout: 497 lvb_type: 0 00000100:00100000:2.0:1734016130.605503:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335326208:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016130.605567:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016130.606811:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335325952:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1734016130.606874:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1734016130.606959:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335325952 00000100:00100000:2.0:1734016130.606965:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335325952 00000100:00080000:2.0:1734016130.606985:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016100 00000100:00100000:2.0:1734016130.607026:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11114 00000100:00100000:2.0:1734016130.607035:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335325952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1734016130.607076:0:8216:0:(ofd_dev.c:1768:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1734016130.607108:0:8216:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711617e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.607131:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27115e7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ec3 expref: 16 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.607139:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016130.607141:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016130.607144:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711617e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.607179:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27115e7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ec3 expref: 16 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.607193:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27115e7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ec3 expref: 16 pid: 8216 timeout: 497 lvb_type: 0 00000100:00100000:2.0:1734016130.607210:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335326336:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016130.607259:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016130.608259:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335326208:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016130.608290:0:7684:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116177 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016130.608719:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10406:x1818247333809792:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 13931us (14140us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016130.608731:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2273 00000100:00100000:0.0:1734016130.614751:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.615065:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333809920 00000100:00100000:1.0:1734016130.615078:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333809920 00000100:00100000:1.0:1734016130.615149:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11115 00000100:00100000:1.0:1734016130.615158:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1983:x1818247333809920:12345-192.168.201.16@tcp:16:fsx.0 00000100:00100000:3.0:1734016130.620924:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335326336:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016130.620978:0:8216:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711617e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1734016130.625747:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294967999 is committed 00000001:00080000:2.0:1734016130.625783:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294967997 is committed 00000100:00100000:1.0:1734016130.626838:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333809920:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 11670us (12092us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016130.626853:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11115 00000100:00100000:0.0:1734016130.627360:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.627472:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333810048 00000100:00100000:3.0:1734016130.627483:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333810048 00010000:00010000:3.0:1734016130.627519:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27115e7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ec3 expref: 7 pid: 8216 timeout: 497 lvb_type: 0 00000100:00100000:3.0:1734016130.627759:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3096 00000100:00100000:3.0:1734016130.627766:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333810048:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016130.627785:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016130.627791:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27115e7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ec3 expref: 7 pid: 8216 timeout: 497 lvb_type: 0 00010000:00010000:3.0:1734016130.627820:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27115e7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ec3 expref: 7 pid: 8216 timeout: 497 lvb_type: 0 00010000:00010000:3.0:1734016130.627845:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27115e7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ec3 expref: 7 pid: 8216 timeout: 497 lvb_type: 0 00010000:00010000:3.0:1734016130.627891:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016130.627893:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016130.627898:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711617e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.627910:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711617e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.627948:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016130.627977:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333810048:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 211us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016130.627982:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3096 00010000:00010000:2.0:1734016130.627997:0:8216:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711617e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.628006:0:8216:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711617e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.628014:0:8216:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711617e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.628020:0:8216:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711617e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.628028:0:8216:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711617e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.628035:0:8216:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc900 already unused, calling callback (ffffffffa080e100) 00010000:00010000:2.0:1734016130.628039:0:8216:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711617e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.628048:0:8216:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711617e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.628064:0:8216:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711617e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.628070:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711617e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016130.630159:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016130.630268:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.630351:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333810176 00000100:00100000:1.0:1734016130.630364:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333810176 00000100:00100000:1.0:1734016130.630417:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333810304 00000100:00100000:1.0:1734016130.630419:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333810304 00000100:00100000:1.0:1734016130.630434:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11116 00000100:00100000:1.0:1734016130.630444:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333810176:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016130.630476:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016130.630500:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc27116185 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6059 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016130.630558:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335326464:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016130.630615:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016130.631108:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3504:x1818247335325952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24068us (24229us total) trans 4294968000 rc 0/0 00000100:00100000:2.0:1734016130.631118:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11114 00000100:00100000:2.0:1734016130.631145:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11117 00000100:00100000:2.0:1734016130.631149:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333810304:12345-192.168.201.16@tcp:101:fsx.0 00000004:00080000:1.0:1734016130.631157:0:3504:0:(osp_sync.c:561:osp_sync_interpret()) reply req ffff880075445c00/2, rc 0, transno 704 00010000:00010000:2.0:1734016130.631159:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1734016130.631164:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335325952:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1734016130.631173:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711618c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6060 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016130.631207:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335326592:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016130.631248:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016130.640022:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016130.640137:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333810432 00000100:00100000:2.0:1734016130.640154:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333810432 00010000:00010000:2.0:1734016130.640207:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27115e6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ebc expref: 18 pid: 7682 timeout: 497 lvb_type: 0 00002000:00010000:1.0:1734016130.640245:0:7682:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime: 1734016130 -> 1734016131 00000100:00100000:2.0:1734016130.640248:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3097 00002000:00010000:1.0:1734016130.640251:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 0 -> 1734016131 00002000:00010000:1.0:1734016130.640253:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016130 -> 1734016131 00000100:00100000:2.0:1734016130.640260:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:1981:x1818247333810432:12345-192.168.201.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1734016130.640276:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335326464:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016130.640281:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016130.640287:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27115e6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ebc expref: 18 pid: 7682 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1734016130.640301:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27115e6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ebc expref: 18 pid: 7682 timeout: 497 lvb_type: 0 00010000:00010000:1.0:1734016130.640322:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc27116185 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6059 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016130.640327:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27115e6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5ebc expref: 18 pid: 7682 timeout: 497 lvb_type: 0 00010000:00010000:1.0:1734016130.640336:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc27116185 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6059 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016130.640342:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016130.640344:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016130.640348:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00010000:00010000:2.0:1734016130.640349:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116177 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.640359:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116177 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016130.640387:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016130.640414:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1981:x1818247333810432:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 155us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016130.640421:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3097 00002000:00010000:3.0:1734016130.640467:0:8216:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016130 -> 1734016131 00002000:00010000:3.0:1734016130.640471:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016130 -> 1734016131 00000100:00100000:3.0:1734016130.640481:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335326592:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016130.640498:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711618c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6060 expref: 12 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.640507:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711618c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6060 expref: 12 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.640520:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:1.0:1734016130.640563:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333810176:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10120us (10420us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016130.640574:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11116 00010000:00010000:0.0:1734016130.640642:0:7684:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116177 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016130.640651:0:7684:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116177 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016130.640662:0:7684:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116177 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016130.640669:0:7684:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116177 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016130.640680:0:7684:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116177 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016130.640687:0:7684:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcb40 already unused, calling callback (ffffffffa080e100) 00010000:00010000:0.0:1734016130.640694:0:7684:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116177 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016130.640702:0:7684:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116177 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016130.640720:0:7684:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116177 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016130.640726:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116177 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016130.647261:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333810304:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 16081us (16963us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016130.647281:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11117 00000100:00100000:2.0:1734016130.653424:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.656266:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3506:x1818247335326080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 50958us (51145us total) trans 4294969476 rc 0/0 00000100:00100000:1.0:1734016130.656284:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11113 00000004:00080000:3.0:1734016130.657841:0:3506:0:(osp_sync.c:561:osp_sync_interpret()) reply req ffff8800756a7100/2, rc 0, transno 2180 00000100:00100000:3.0:1734016130.657852:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335326080:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1734016130.658492:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.665256:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333810560 00000100:00100000:0.0:1734016130.665320:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333810688 00000100:00100000:0.0:1734016130.665331:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333810688 00000100:00100000:3.0:1734016130.665942:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333810560 00000100:00100000:0.0:1734016130.667242:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11118 00000100:00100000:0.0:1734016130.667264:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333810688:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016130.667306:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016130.667344:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27116193 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e606e expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016130.667454:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335326720:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016130.667601:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016130.667642:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11119 00000100:00100000:0.0:1734016130.667651:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333810560:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016130.667668:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016130.667689:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7581680/0x5e3a3adc2711619a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6067 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016130.667735:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335326848:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016130.667756:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016130.677263:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335326848:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016130.677348:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581680/0x5e3a3adc2711619a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6067 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.677373:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581680/0x5e3a3adc2711619a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6067 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.677394:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581680, rc 0) 00000100:00100000:1.0:1734016130.677498:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333810560:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9845us (24083us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016130.677514:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11119 00000100:00100000:0.0:1734016130.677897:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335326720:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016130.677926:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27116193 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e606e expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016130.677937:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27116193 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e606e expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016130.677946:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:0.0:1734016130.677983:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333810688:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10727us (19498us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016130.677988:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11118 00000100:00100000:3.0:1734016130.685455:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016130.686240:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333810944 00000100:00100000:2.0:1734016130.686252:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333810944 00002000:00100000:2.0:1734016130.686299:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (229376->233471) req@ffff88012e718a80 x1818247333810944/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:91/0 lens 488/0 e 0 to 0 dl 1734016141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016130.686308:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e718a80 with x1818247333810944 ext(229376->233471) 00002000:00010000:2.0:1734016130.686315:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e718a80 00000100:00100000:2.0:1734016130.686662:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8779 00000100:00100000:2.0:1734016130.686673:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1983:x1818247333810944:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016130.686953:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1983:x1818247333810944:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 280us (1512us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016130.686961:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8779 00002000:00100000:2.0:1734016130.686966:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (229376->233471) req@ffff88012e718a80 x1818247333810944/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:91/0 lens 488/4536 e 0 to 0 dl 1734016141 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016130.686973:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e718a80 with x1818247333810944 ext(229376->233471) 00002000:00010000:2.0:1734016130.686977:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e718a80 00000100:00100000:3.0:1734016130.696349:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.696543:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333811072 00000100:00100000:1.0:1734016130.696556:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333811072 00002000:00100000:1.0:1734016130.696614:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (229376->233471) req@ffff88012e71b480 x1818247333811072/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:91/0 lens 4584/0 e 0 to 0 dl 1734016141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016130.696629:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71b480 with x1818247333811072 ext(229376->233471) 00002000:00010000:1.0:1734016130.696635:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e71b480 00000100:00100000:1.0:1734016130.696666:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8780 00000100:00100000:1.0:1734016130.696675:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1984:x1818247333811072:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016130.700107:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:1984:x1818247333811072:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 3413us (3750us total) trans 4294969477 rc 0/0 00000100:00100000:1.0:1734016130.700131:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8780 00002000:00100000:1.0:1734016130.700151:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (229376->233471) req@ffff88012e71b480 x1818247333811072/t4294969477(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:91/0 lens 4584/448 e 0 to 0 dl 1734016141 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016130.700161:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71b480 with x1818247333811072 ext(229376->233471) 00002000:00010000:1.0:1734016130.700172:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e71b480 00000100:00100000:0.0:1734016130.708020:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016130.708162:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333811200 00000100:00100000:2.0:1734016130.708175:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333811200 00000100:00100000:2.0:1734016130.708244:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11120 00000100:00100000:2.0:1734016130.708254:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:1983:x1818247333811200:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016130.715300:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969477 is committed 00000001:00080000:0.0:1734016130.715348:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969476 is committed 00000001:00080000:0.0:1734016130.715359:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969474 is committed 00000100:00100000:2.0:1734016130.716298:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333811200:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 8032us (8281us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016130.716317:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11120 00000100:00100000:0.0:1734016130.718955:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016130.724188:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016130.724262:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333811456 00000100:00100000:0.0:1734016130.724278:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333811456 00000100:00100000:0.0:1734016130.724341:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333811328 00000100:00100000:0.0:1734016130.724344:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333811328 00000100:00100000:0.0:1734016130.724382:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11121 00000100:00100000:0.0:1734016130.724392:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333811456:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016130.724417:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016130.724440:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc271161a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e607c expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016130.724519:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335326976:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016130.724592:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016130.724728:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11122 00000100:00100000:0.0:1734016130.724733:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333811328:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016130.724742:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016130.724755:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a75818c0/0x5e3a3adc271161a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6075 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016130.724888:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335327104:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016130.724915:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00002000:00010000:2.0:1734016130.733712:0:7683:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 32 -> 40 00000100:00100000:2.0:1734016130.733749:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335326976:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016130.733836:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc271161a1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e607c expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016130.733852:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc271161a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e607c expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016130.733899:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581200, rc 0) 00000100:00100000:2.0:1734016130.733969:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333811456:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9576us (15021us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016130.733979:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11121 00000100:00100000:1.0:1734016130.737828:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335327104:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016130.737893:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a75818c0/0x5e3a3adc271161a8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6075 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.737917:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a75818c0/0x5e3a3adc271161a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6075 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.737952:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75818c0, rc 0) 00000100:00100000:1.0:1734016130.738050:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333811328:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 13311us (13880us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016130.738063:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11122 00000100:00100000:0.0:1734016130.746130:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016130.746319:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.746533:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333811712 00000100:00100000:1.0:1734016130.746548:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333811712 00000100:00100000:1.0:1734016130.746699:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333811584 00000100:00100000:1.0:1734016130.746701:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333811584 00000100:00100000:1.0:1734016130.746883:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11123 00000100:00100000:1.0:1734016130.746891:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333811712:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016130.746908:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016130.746928:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc271161af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e608a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016130.746984:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335327232:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016130.747037:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016130.747161:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11124 00000100:00100000:3.0:1734016130.747167:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333811584:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.747176:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.747189:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc271161b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6083 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016130.747220:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335327360:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016130.747245:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016130.755466:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335327360:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016130.755514:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc271161b6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6083 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.755529:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc271161b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6083 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1734016130.755696:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335327232:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016130.755729:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc271161af lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e608a expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.755738:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc271161af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e608a expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.755766:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00010000:00010000:3.0:1734016130.757044:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016130.757101:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333811584:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9928us (10776us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016130.757116:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11124 00000100:00100000:1.0:1734016130.761214:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333811712:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 14296us (15073us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016130.761229:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11123 00000100:00100000:3.0:1734016130.764395:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.766833:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333811840 00000100:00100000:1.0:1734016130.766849:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333811840 00000100:00100000:1.0:1734016130.766909:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11125 00000100:00100000:1.0:1734016130.766917:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333811840:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016130.767076:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1734016130.767080:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016131 -> 1734016131 00002000:00010000:1.0:1734016130.767082:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016131 -> 0 00002000:00010000:1.0:1734016130.767083:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016131 -> 1734016130 00002000:00010000:1.0:1734016130.767085:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 8192 -> 8192 00000100:00100000:1.0:1734016130.767147:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333811840:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 229us (2769us total) trans 4294968001 rc 0/0 00000100:00100000:1.0:1734016130.767158:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11125 00000100:00100000:0.0:1734016130.774018:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016130.774098:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.774246:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333811968 00000100:00100000:1.0:1734016130.774262:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333811968 00000100:00100000:1.0:1734016130.774337:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333812096 00000100:00100000:1.0:1734016130.774341:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333812096 00000100:00100000:1.0:1734016130.774369:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11126 00000100:00100000:1.0:1734016130.774379:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333811968:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016130.774421:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016130.774453:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc271161bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6091 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016130.774552:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335327488:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016130.774657:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016130.774758:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11127 00000100:00100000:2.0:1734016130.774766:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333812096:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016130.774778:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016130.774795:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271161c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6098 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016130.774866:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335327616:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016130.774895:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706c00 going to sleep for 11 seconds 00002000:00010000:1.0:1734016130.781138:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 0 -> 1734016131 00002000:00010000:1.0:1734016130.781153:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016130 -> 1734016131 00000100:00100000:1.0:1734016130.781195:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335327488:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016130.781264:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc271161bd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6091 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.781284:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc271161bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6091 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1734016130.781434:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335327616:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016130.781456:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271161c4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6098 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016130.781466:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271161c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6098 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.781905:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016130.781992:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333811968:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7613us (7993us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016130.782010:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11126 00010000:00010000:2.0:1734016130.783030:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016130.783075:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333812096:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8306us (8974us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016130.783084:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11127 00000100:00100000:1.0:1734016130.788253:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.788322:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016130.788395:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333812224 00000100:00100000:0.0:1734016130.788412:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333812224 00000100:00100000:0.0:1734016130.788474:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333812352 00000100:00100000:0.0:1734016130.788476:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333812352 00000100:00100000:0.0:1734016130.788500:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11128 00000100:00100000:0.0:1734016130.788510:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333812224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016130.788531:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016130.788550:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7582f40/0x5e3a3adc271161cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e609f expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016130.788619:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335327744:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016130.788694:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016130.788837:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11129 00000100:00100000:0.0:1734016130.788842:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333812352:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016130.788850:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016130.788862:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc271161d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e60a6 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016130.788893:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335327872:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016130.788913:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016130.792859:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335327872:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016130.792908:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc271161d2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60a6 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016130.792922:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc271161d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60a6 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016130.792933:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582d00, rc 0) 00000100:00100000:2.0:1734016130.792985:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333812352:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4141us (4661us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016130.792996:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11129 00000100:00100000:1.0:1734016130.793105:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335327744:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016130.793126:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7582f40/0x5e3a3adc271161cb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e609f expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.793135:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7582f40/0x5e3a3adc271161cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e609f expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.794081:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582f40, rc 0) 00000100:00100000:1.0:1734016130.794126:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333812224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5614us (5889us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016130.794136:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11128 00000100:00100000:0.0:1734016130.799061:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016130.799133:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.799252:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333812480 00000100:00100000:1.0:1734016130.799271:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333812480 00000100:00100000:1.0:1734016130.799327:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333812608 00000100:00100000:1.0:1734016130.799330:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333812608 00000100:00100000:1.0:1734016130.799348:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11130 00000100:00100000:1.0:1734016130.799357:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333812480:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016130.799380:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016130.799408:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499ef40/0x5e3a3adc271161d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e60ad expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016130.799481:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335328000:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016130.799559:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016130.799624:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11131 00000100:00100000:2.0:1734016130.799630:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333812608:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016130.799639:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016130.799650:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271161e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e60b4 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016130.799682:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335328128:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016130.799719:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706c00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016130.803859:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335328000:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016130.803904:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499ef40/0x5e3a3adc271161d9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60ad expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.803920:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499ef40/0x5e3a3adc271161d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60ad expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016130.803953:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016130.804019:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333812480:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4662us (4980us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016130.804031:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11130 00000100:00100000:3.0:1734016130.804774:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335328128:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016130.804841:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271161e0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60b4 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.804855:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271161e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60b4 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.805048:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:3.0:1734016130.805080:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333812608:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5448us (5945us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016130.805089:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11131 00000100:00100000:0.0:1734016130.812871:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.813317:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333812736 00000100:00100000:3.0:1734016130.813331:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333812736 00000100:00100000:3.0:1734016130.813443:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11132 00000100:00100000:3.0:1734016130.813451:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:10406:x1818247333812736:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.813486:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.813517:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271161e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e60bb expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.813575:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116170 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1159167) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6052 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.813584:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016130.813587:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016130.813591:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271161e7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3801088->3805183] (req 3801088->3805183) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60bb expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.813640:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116170 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1159167) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6052 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.813658:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116170 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1159167) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6052 expref: 6 pid: 7684 timeout: 497 lvb_type: 0 00000100:00100000:3.0:1734016130.813681:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335328256:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016130.814248:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016130.817459:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335328256:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016130.817527:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271161e7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3801088->3805183] (req 3801088->3805183) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60bb expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.817559:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016130.817667:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333812736:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4214us (4809us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016130.817679:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11132 00000100:00100000:0.0:1734016130.831267:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.831737:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333812864 00000100:00100000:3.0:1734016130.831753:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333812864 00010000:00010000:3.0:1734016130.831843:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116170 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6052 expref: 7 pid: 7684 timeout: 497 lvb_type: 0 00000100:00100000:3.0:1734016130.831898:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3098 00000100:00100000:3.0:1734016130.831906:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333812864:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016130.831927:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016130.831959:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116170 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6052 expref: 7 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:3.0:1734016130.831976:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116170 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1159167) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6052 expref: 7 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:3.0:1734016130.832016:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116170 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1159167) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6052 expref: 7 pid: 7684 timeout: 497 lvb_type: 0 00010000:00010000:3.0:1734016130.832139:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016130.832143:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016130.832155:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271161e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3801088->3805183) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60bb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.832167:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271161e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3801088->3805183) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60bb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.832224:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271161e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3801088->3805183) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60bb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016130.832240:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335328384:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016130.832324:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016130.836941:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335328384:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016130.837003:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016130.837106:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333812864:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5197us (5859us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016130.837131:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3098 00000100:00100000:0.0:1734016130.838455:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.838615:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333813120 00000100:00100000:1.0:1734016130.838625:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333813120 00002000:00100000:1.0:1734016130.838674:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (3801088->3805183) req@ffff8801369f0e00 x1818247333813120/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:91/0 lens 488/0 e 0 to 0 dl 1734016141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016130.838686:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f0e00 with x1818247333813120 ext(3801088->3805183) 00002000:00010000:1.0:1734016130.838693:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801369f0e00 00000100:00100000:1.0:1734016130.838739:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8781 00000100:00100000:1.0:1734016130.838745:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333813120:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016130.838964:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333813120:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 218us (517us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016130.838971:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8781 00002000:00100000:1.0:1734016130.838976:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (3801088->3805183) req@ffff8801369f0e00 x1818247333813120/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:91/0 lens 488/4536 e 0 to 0 dl 1734016141 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016130.838991:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f0e00 with x1818247333813120 ext(3801088->3805183) 00002000:00010000:1.0:1734016130.838994:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801369f0e00 00000100:00100000:0.0:1734016130.844661:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.844838:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333813376 00000100:00100000:3.0:1734016130.844851:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333813376 00002000:00100000:3.0:1734016130.844932:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (3805184->3809279) req@ffff8801369f1880 x1818247333813376/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:91/0 lens 488/0 e 0 to 0 dl 1734016141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016130.844950:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1880 with x1818247333813376 ext(3805184->3809279) 00002000:00010000:3.0:1734016130.844957:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801369f1880 00000100:00100000:1.0:1734016130.846168:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8782 00000100:00100000:1.0:1734016130.846187:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333813376:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016130.846476:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333813376:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 292us (1829us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016130.846483:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8782 00002000:00100000:1.0:1734016130.846494:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (3805184->3809279) req@ffff8801369f1880 x1818247333813376/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:91/0 lens 488/4536 e 0 to 0 dl 1734016141 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016130.846502:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1880 with x1818247333813376 ext(3805184->3809279) 00002000:00010000:1.0:1734016130.846507:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801369f1880 00000100:00100000:0.0:1734016130.851090:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.851477:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333813504 00000100:00100000:1.0:1734016130.851487:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333813504 00002000:00100000:1.0:1734016130.851539:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (3801088->3809279) req@ffff8801369f1c00 x1818247333813504/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:91/0 lens 8680/0 e 0 to 0 dl 1734016141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016130.851549:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1c00 with x1818247333813504 ext(3801088->3809279) 00002000:00010000:1.0:1734016130.851556:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801369f1c00 00000100:00100000:3.0:1734016130.851667:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8783 00000100:00100000:3.0:1734016130.851675:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333813504:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016130.852764:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333813504:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1085us (1688us total) trans 4294968002 rc 0/0 00000100:00100000:3.0:1734016130.852773:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8783 00002000:00100000:3.0:1734016130.852782:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (3801088->3809279) req@ffff8801369f1c00 x1818247333813504/t4294968002(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:91/0 lens 8680/448 e 0 to 0 dl 1734016141 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016130.852792:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1c00 with x1818247333813504 ext(3801088->3809279) 00002000:00010000:3.0:1734016130.852796:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801369f1c00 00000100:00100000:0.0:1734016130.854615:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.854775:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333813632 00000100:00100000:1.0:1734016130.854788:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333813632 00000100:00100000:1.0:1734016130.854902:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2274 00000100:00100000:1.0:1734016130.854912:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+18:10406:x1818247333813632:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:1.0:1734016130.855068:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+18:10406:x1818247333813632:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 157us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016130.855080:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2274 00000100:00100000:0.0:1734016130.859101:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.859244:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333813760 00000100:00100000:3.0:1734016130.859260:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333813760 00000100:00100000:3.0:1734016130.859687:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11133 00000100:00100000:3.0:1734016130.859698:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333813760:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016130.867628:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968002 is committed 00000001:00080000:0.0:1734016130.867647:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968001 is committed 00000001:00080000:0.0:1734016130.867661:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968000 is committed 00000100:00100000:3.0:1734016130.867916:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333813760:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 8212us (8829us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016130.867930:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11133 00000100:00100000:0.0:1734016130.870334:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.870435:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333813888 00000100:00100000:3.0:1734016130.870449:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333813888 00000100:00100000:3.0:1734016130.870517:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11134 00000100:00100000:3.0:1734016130.870530:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333813888:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.870557:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.870583:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc271161ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e60c2 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016130.870674:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335328512:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016130.870751:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781c00 going to sleep for 11 seconds 00002000:00010000:3.0:1734016130.873902:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks: 8192 -> 8200 00000100:00100000:3.0:1734016130.873940:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335328512:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016130.873994:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc271161ee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60c2 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.874015:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc271161ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60c2 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.874033:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016130.874102:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333813888:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3571us (3779us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016130.874114:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11134 00000100:00100000:0.0:1734016130.879637:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.879873:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333814016 00000100:00100000:3.0:1734016130.879885:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333814016 00000100:00100000:3.0:1734016130.879950:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11135 00000100:00100000:3.0:1734016130.879959:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333814016:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.879983:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.880011:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271161f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e60c9 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016130.880081:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335328640:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016130.880161:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016130.887979:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335328640:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016130.888016:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271161f5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60c9 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.888032:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271161f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60c9 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.888371:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016130.888436:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333814016:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8475us (8808us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016130.888444:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11135 00000100:00100000:0.0:1734016130.892080:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.893001:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333814144 00000100:00100000:3.0:1734016130.893023:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333814144 00000100:00100000:3.0:1734016130.894384:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11136 00000100:00100000:3.0:1734016130.894395:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333814144:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.894419:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.894445:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc271161fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e60d0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016130.894507:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335328768:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016130.894590:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016130.913965:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335328768:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016130.914028:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc271161fc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60d0 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.914053:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc271161fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60d0 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.914559:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016130.914943:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333814144:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 20545us (22878us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016130.914955:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11136 00000100:00100000:0.0:1734016130.929223:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.929480:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333814272 00000100:00100000:3.0:1734016130.929496:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333814272 00000100:00100000:3.0:1734016130.929574:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11137 00000100:00100000:3.0:1734016130.929584:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333814272:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.929623:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.929662:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116203 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e60d7 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016130.929771:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335328896:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016130.930625:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016130.939186:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335328896:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016130.939224:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116203 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60d7 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.939242:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116203 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60d7 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.939278:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016130.939340:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333814272:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9756us (10134us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016130.939350:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11137 00000100:00100000:0.0:1734016130.944342:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.944483:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333814400 00000100:00100000:3.0:1734016130.944493:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333814400 00000100:00100000:3.0:1734016130.944568:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11138 00000100:00100000:3.0:1734016130.944861:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333814400:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.944893:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.944921:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711620a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e60de expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016130.945007:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335329024:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016130.945092:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016130.948551:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335329024:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016130.948602:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711620a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60de expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.948621:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711620a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60de expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.948659:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016130.948734:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333814400:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4155us (4409us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016130.948749:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11138 00000100:00100000:0.0:1734016130.954590:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.955148:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333814528 00000100:00100000:3.0:1734016130.955162:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333814528 00000100:00100000:3.0:1734016130.957253:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11139 00000100:00100000:3.0:1734016130.957276:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333814528:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.957318:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.957350:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116211 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e60e5 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016130.957445:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335329152:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016130.957563:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016130.964646:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335329152:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016130.964718:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116211 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60e5 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.964733:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116211 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60e5 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016130.964767:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016130.964872:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333814528:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7599us (10289us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016130.964885:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11139 00000100:00100000:0.0:1734016130.968028:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.968113:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333814784 00000100:00100000:3.0:1734016130.968126:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333814784 00000100:00100000:3.0:1734016130.968199:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2275 00000100:00100000:3.0:1734016130.968208:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10406:x1818247333814784:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016130.968365:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016130.968520:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc271160cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fb8 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.968542:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016130.968545:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016130.968792:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116218 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016130.968835:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271160eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fcd expref: 17 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.968842:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116218 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016130.968880:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271160eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fcd expref: 17 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.968893:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271160eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fcd expref: 17 pid: 6478 timeout: 498 lvb_type: 0 00000100:00100000:3.0:1734016130.968908:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335329280:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016130.969004:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781b40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016130.981454:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.981524:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333814912 00000100:00100000:3.0:1734016130.981538:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333814912 00010000:00010000:3.0:1734016130.981574:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271160eb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fcd expref: 18 pid: 6478 timeout: 498 lvb_type: 0 00000100:00100000:3.0:1734016130.981611:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3099 00000100:00100000:3.0:1734016130.981620:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5227850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247333814912:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016130.981644:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016130.981650:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271160eb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fcd expref: 18 pid: 6478 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1734016130.981662:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271160eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fcd expref: 18 pid: 6478 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1734016130.981686:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016130.981690:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116218 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016130.981710:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116218 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016130.981718:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116218 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016130.981746:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016130.981797:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5227850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247333814912:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 177us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016130.981822:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3099 00010000:00010000:3.0:1734016130.981893:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271160eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e5fcd expref: 17 pid: 6478 timeout: 498 lvb_type: 0 00000100:00100000:3.0:1734016130.981903:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335329280:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016130.981923:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116218 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016130.981932:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116218 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016130.981938:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116218 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:3.0:1734016130.982020:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968781 00000004:00010000:3.0:1734016130.982056:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007bd3df80 reply state ffff880074b08000 transno 4294968782 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116218 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016130.982062:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016130.982119:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:10406:x1818247333814784:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 13912us (14104us total) trans 4294968782 rc 0/0 00000100:00100000:3.0:1734016130.982125:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2275 00000020:00080000:3.0:1734016130.982128:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016130.984383:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116218 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016130.984401:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116218 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016130.984410:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116218 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016130.984421:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df5440 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016130.984426:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116218 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016130.984432:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116218 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016130.984451:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016130.984455:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016130.984460:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116218 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016130.984465:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116218 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016130.985413:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016130.985522:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333815040 00000100:00100000:3.0:1734016130.985533:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333815040 00000100:00100000:3.0:1734016130.985597:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11140 00000100:00100000:3.0:1734016130.985605:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:10406:x1818247333815040:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016130.985623:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016130.985642:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc2711621f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e60ec expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.985673:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271161e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3801088->3805183) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60bb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.985681:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016130.985683:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016130.985687:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc2711621f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60ec expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.985731:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271161e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3801088->3805183) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60bb expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.985745:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271161e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3801088->3805183) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60bb expref: 6 pid: 8216 timeout: 498 lvb_type: 0 00000100:00100000:3.0:1734016130.985759:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335329408:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016130.985860:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016130.989640:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335329408:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016130.989681:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc2711621f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60ec expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016130.989699:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016130.989756:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333815040:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4151us (4352us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016130.989764:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11140 00000100:00100000:2.0:1734016130.995250:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016130.995359:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333815168 00000100:00100000:1.0:1734016130.995373:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333815168 00010000:00010000:1.0:1734016130.995419:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271161e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3801088->3805183) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60bb expref: 7 pid: 8216 timeout: 498 lvb_type: 0 00000100:00100000:1.0:1734016130.995470:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3100 00000100:00100000:1.0:1734016130.995479:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333815168:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016130.995501:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016130.995528:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271161e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3801088->3805183) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60bb expref: 7 pid: 8216 timeout: 498 lvb_type: 0 00010000:00010000:1.0:1734016130.995541:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271161e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3801088->3805183) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60bb expref: 7 pid: 8216 timeout: 498 lvb_type: 0 00010000:00010000:1.0:1734016130.995572:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271161e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3801088->3805183) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60bb expref: 7 pid: 8216 timeout: 498 lvb_type: 0 00010000:00010000:1.0:1734016130.996920:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016130.996926:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016130.996937:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc2711621f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60ec expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.996947:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc2711621f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60ec expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016130.996994:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc2711621f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60ec expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016130.997008:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335329536:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016130.998970:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016131.004958:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335329536:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016131.004991:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016131.005069:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333815168:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9589us (9832us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016131.005081:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3100 00000100:00100000:0.0:1734016131.006646:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016131.007645:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016131.007785:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333815296 00000100:00100000:1.0:1734016131.007834:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333815296 00002000:00010000:1.0:1734016131.007904:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:1.0:1734016131.007909:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3f480 with x1818247333815296 ext(4194304->18446744073709551615) 00002000:00010000:1.0:1734016131.007930:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007bd3f480. 00000100:00100000:1.0:1734016131.007957:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333815424 00000100:00100000:1.0:1734016131.007959:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333815424 00002000:00010000:1.0:1734016131.007971:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (572034->18446744073709551615) 00002000:00100000:1.0:1734016131.007974:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3d500 with x1818247333815424 ext(572034->18446744073709551615) 00002000:00010000:1.0:1734016131.007984:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3d500. 00000100:00100000:1.0:1734016131.008003:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8784 00000100:00100000:1.0:1734016131.008010:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333815296:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016131.008247:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1734016131.008251:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016131 -> 1734016131 00002000:00010000:1.0:1734016131.008254:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016131 -> 1734016131 00002000:00010000:1.0:1734016131.008256:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016131 -> 1734016131 00002000:00010000:1.0:1734016131.008258:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 8200 -> 8200 00000100:00100000:1.0:1734016131.008322:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333815296:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 312us (1682us total) trans 4294968003 rc 0/0 00000100:00100000:1.0:1734016131.008329:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8784 00002000:00010000:1.0:1734016131.008332:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:1.0:1734016131.008334:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3f480 with x1818247333815296 ext(4194304->18446744073709551615) 00002000:00010000:1.0:1734016131.008338:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007bd3f480. 00000100:00100000:1.0:1734016131.008358:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8785 00000100:00100000:1.0:1734016131.008362:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333815424:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016131.009657:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 2973464 -> 572034 00002000:00010000:1.0:1734016131.009663:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016131 -> 1734016131 00002000:00010000:1.0:1734016131.009666:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016131 -> 1734016130 00002000:00010000:1.0:1734016131.009668:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016131 -> 1734016131 00002000:00010000:1.0:1734016131.009670:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 40 -> 8 00000100:00100000:1.0:1734016131.009714:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333815424:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1338us (2062us total) trans 4294969478 rc 0/0 00000100:00100000:1.0:1734016131.009720:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8785 00002000:00010000:1.0:1734016131.009723:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (572034->18446744073709551615) 00002000:00100000:1.0:1734016131.009725:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3d500 with x1818247333815424 ext(572034->18446744073709551615) 00002000:00010000:1.0:1734016131.009731:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3d500. 00000100:00100000:2.0:1734016131.017911:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.019108:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333815552 00000100:00100000:3.0:1734016131.019125:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333815552 00000100:00100000:3.0:1734016131.019218:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2276 00000100:00100000:3.0:1734016131.019227:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333815552:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016131.019272:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016131.019301:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116226 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e60f3 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.019455:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711622d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016131.019471:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711622d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016131.019486:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711622d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016131.019517:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 4766338 00000004:00200000:3.0:1734016131.019522:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016131.019544:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711622d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016131.019569:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116226 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60f3 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.019607:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711622d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60f3 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.019618:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016131.019621:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016131.019624:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016131.019695:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:10406:x1818247333815552:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 468us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016131.019710:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2276 00000100:00100000:2.0:1734016131.024617:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.025948:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333815680 00000100:00100000:3.0:1734016131.025964:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333815680 00000100:00100000:3.0:1734016131.027124:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11141 00000100:00100000:3.0:1734016131.027143:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:10406:x1818247333815680:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016131.027190:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016131.027239:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116234 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e60fa expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.027308:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc2711621f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60ec expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.027321:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016131.027324:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016131.027330:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116234 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [4022272->4030463] (req 4022272->4030463) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60fa expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.027395:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc2711621f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60ec expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.027414:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc2711621f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60ec expref: 6 pid: 8216 timeout: 498 lvb_type: 0 00000100:00100000:3.0:1734016131.027432:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335329664:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016131.027620:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781c00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016131.033665:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016131.034354:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333815808 00000100:00100000:1.0:1734016131.034366:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333815808 00010000:00010000:1.0:1734016131.034404:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc2711621f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60ec expref: 7 pid: 8216 timeout: 498 lvb_type: 0 00000100:00100000:1.0:1734016131.034467:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3101 00000100:00100000:1.0:1734016131.034475:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333815808:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016131.034497:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016131.034529:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc2711621f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60ec expref: 7 pid: 8216 timeout: 498 lvb_type: 0 00010000:00010000:1.0:1734016131.034544:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc2711621f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60ec expref: 7 pid: 8216 timeout: 498 lvb_type: 0 00010000:00010000:1.0:1734016131.034577:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016131.034579:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016131.034589:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116234 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4022272->4030463) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60fa expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.034600:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116234 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4022272->4030463) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60fa expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.034654:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116234 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4022272->4030463) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60fa expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016131.034670:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335329792:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016131.034765:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00010000:00010000:3.0:1734016131.035257:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc2711621f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60ec expref: 7 pid: 8216 timeout: 498 lvb_type: 0 00000100:00100000:3.0:1734016131.035333:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335329664:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016131.035368:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116234 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4022272->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60fa expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.035380:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016131.035435:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333815680:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8294us (11214us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016131.035446:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11141 00000100:00100000:1.0:1734016131.043611:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335329792:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016131.043646:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016131.043730:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333815808:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9253us (10077us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016131.043745:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3101 00000100:00100000:0.0:1734016131.049443:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.049629:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333816064 00000100:00100000:2.0:1734016131.049642:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333816064 00002000:00100000:2.0:1734016131.049709:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff88007bd3d180 x1818247333816064/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:92/0 lens 488/0 e 0 to 0 dl 1734016142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016131.049720:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3d180 with x1818247333816064 ext(0->4194303) 00002000:00010000:2.0:1734016131.049726:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007bd3d180 00000100:00100000:2.0:1734016131.049774:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8786 00000100:00100000:2.0:1734016131.049783:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333816064:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016131.112533:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.112735:0:6475:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333816192 00000100:00100000:3.0:1734016131.112759:0:6475:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333816192 00000100:00100000:3.0:1734016131.112946:0:6475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 330 00000100:00100000:3.0:1734016131.112959:0:6475:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7610c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99867e87-1bc2-4e49-bd45-a757ae2fdd76+12:1981:x1818247333816192:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:3.0:1734016131.114221:0:6475:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7610c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99867e87-1bc2-4e49-bd45-a757ae2fdd76+12:1981:x1818247333816192:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 1256us (1713us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016131.114235:0:6475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 330 00000100:00080000:0.0:1734016131.124948:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016101 00000100:00100000:0.0:1734016131.126592:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333816064:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 76787us (77148us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1734016131.126614:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8786 00002000:00100000:0.0:1734016131.126638:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff88007bd3d180 x1818247333816064/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:92/0 lens 488/440 e 0 to 0 dl 1734016142 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016131.126653:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3d180 with x1818247333816064 ext(0->4194303) 00002000:00010000:0.0:1734016131.126662:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007bd3d180 00000100:00100000:0.0:1734016131.140521:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016131.143133:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333816320 00000100:00100000:1.0:1734016131.143166:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333816320 00000100:00100000:1.0:1734016131.143304:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2277 00000100:00100000:1.0:1734016131.143317:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+17:10406:x1818247333816320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016131.143353:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016131.143387:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711623b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6101 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.143542:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27116242 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016131.143560:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27116242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016131.143577:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27116242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:1.0:1734016131.143606:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 4766338 00000004:00200000:1.0:1734016131.143612:0:6480:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016131.143634:0:6480:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27116242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016131.143665:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711623b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6101 expref: 19 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.143709:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27116242 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6101 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.143722:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016131.143725:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016131.143728:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016131.143878:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+18:10406:x1818247333816320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 563us (3373us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016131.143886:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2277 00000100:00100000:0.0:1734016131.147477:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.148906:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333816448 00000100:00100000:3.0:1734016131.148932:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333816448 00000100:00100000:3.0:1734016131.149024:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11142 00000100:00100000:3.0:1734016131.149034:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333816448:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016131.149058:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016131.149079:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116249 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6108 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016131.149150:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335329920:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016131.149221:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00002000:00010000:3.0:1734016131.156193:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016130 -> 1734016131 00000100:00100000:3.0:1734016131.156237:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335329920:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016131.156284:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116249 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6108 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.156299:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116249 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6108 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.156440:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016131.156623:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333816448:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7587us (9160us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016131.156638:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11142 00000100:00100000:0.0:1734016131.170626:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.170763:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333816576 00000100:00100000:3.0:1734016131.170783:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333816576 00000100:00100000:3.0:1734016131.170936:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11143 00000100:00100000:3.0:1734016131.170948:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333816576:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016131.170971:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016131.170996:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116250 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e610f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016131.171073:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335330048:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016131.171160:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016131.182076:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335330048:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016131.182156:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116250 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e610f expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.182181:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116250 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e610f expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.182222:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016131.182388:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333816576:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11436us (11776us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016131.182412:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11143 00000100:00100000:0.0:1734016131.194771:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.195065:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333816704 00000100:00100000:3.0:1734016131.195079:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333816704 00000100:00100000:3.0:1734016131.195664:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11144 00000100:00100000:3.0:1734016131.195675:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090249450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333816704:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016131.195715:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016131.195744:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116257 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6116 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016131.195844:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335330176:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016131.196537:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016131.199315:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335330176:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016131.199380:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116257 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6116 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.199401:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116257 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6116 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.199423:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016131.199489:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090249450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333816704:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3815us (4740us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016131.199501:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11144 00000100:00100000:0.0:1734016131.212229:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.212432:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333816832 00000100:00100000:3.0:1734016131.212445:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333816832 00000100:00100000:3.0:1734016131.212512:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11145 00000100:00100000:3.0:1734016131.212521:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333816832:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016131.212546:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016131.212569:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711625e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e611d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016131.212636:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335330304:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016131.213712:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016131.217110:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335330304:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016131.217155:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711625e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e611d expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.217171:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711625e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e611d expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.217199:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016131.217264:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333816832:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4743us (5050us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016131.217275:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11145 00000100:00100000:2.0:1734016131.219786:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.229773:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333816960 00000100:00100000:3.0:1734016131.229822:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333816960 00000100:00100000:3.0:1734016131.229954:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11146 00000100:00100000:3.0:1734016131.229967:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333816960:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016131.230004:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016131.230043:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116265 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6124 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.230085:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016131.230088:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016131.230102:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116265 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6124 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.230127:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116265 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6124 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.230147:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016131.230250:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333816960:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 285us (10483us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016131.230257:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11146 00000100:00100000:2.0:1734016131.240768:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016131.240902:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333817216 00000100:00100000:0.0:1734016131.240918:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333817216 00002000:00100000:0.0:1734016131.240982:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (2670592->2674687) req@ffff8800756ece00 x1818247333817216/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:92/0 lens 488/0 e 0 to 0 dl 1734016142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016131.240995:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ece00 with x1818247333817216 ext(2670592->2674687) 00002000:00010000:0.0:1734016131.241003:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756ece00 00000100:00100000:0.0:1734016131.242575:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8787 00000100:00100000:0.0:1734016131.242596:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333817216:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016131.242908:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333817216:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 316us (2159us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016131.242915:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8787 00002000:00100000:0.0:1734016131.242926:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (2670592->2674687) req@ffff8800756ece00 x1818247333817216/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:92/0 lens 488/4536 e 0 to 0 dl 1734016142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016131.242938:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ece00 with x1818247333817216 ext(2670592->2674687) 00002000:00010000:0.0:1734016131.242945:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756ece00 00000100:00100000:0.0:1734016131.247018:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.247270:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333817472 00000100:00100000:2.0:1734016131.247294:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333817472 00002000:00100000:2.0:1734016131.247384:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (2674688->2678783) req@ffff880075886a00 x1818247333817472/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:92/0 lens 488/0 e 0 to 0 dl 1734016142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016131.247398:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075886a00 with x1818247333817472 ext(2674688->2678783) 00002000:00010000:2.0:1734016131.247407:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075886a00 00000100:00100000:2.0:1734016131.248258:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8788 00000100:00100000:2.0:1734016131.248274:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333817472:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016131.248648:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333817472:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 376us (1653us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016131.248661:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8788 00002000:00100000:2.0:1734016131.248672:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (2674688->2678783) req@ffff880075886a00 x1818247333817472/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:92/0 lens 488/4536 e 0 to 0 dl 1734016142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016131.248681:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075886a00 with x1818247333817472 ext(2674688->2678783) 00002000:00010000:2.0:1734016131.248687:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075886a00 00000100:00100000:2.0:1734016131.258411:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016131.258531:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333817600 00000100:00100000:1.0:1734016131.258545:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333817600 00000100:00100000:1.0:1734016131.258634:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11147 00000100:00100000:1.0:1734016131.258645:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333817600:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016131.258680:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016131.258721:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc2711626c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e612b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016131.258853:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335330432:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016131.258960:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016131.261007:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335330432:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016131.261060:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc2711626c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e612b expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016131.261081:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc2711626c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e612b expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016131.261116:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016131.261193:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333817600:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2550us (2795us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016131.261205:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11147 00000100:00100000:0.0:1734016131.269190:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016131.269482:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333817728 00000100:00100000:1.0:1734016131.269496:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333817728 00000100:00100000:1.0:1734016131.269898:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11148 00000100:00100000:1.0:1734016131.269913:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333817728:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016131.269947:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016131.269984:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27116273 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6132 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016131.270083:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335330560:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016131.270163:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016131.275398:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335330560:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016131.275474:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27116273 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6132 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016131.275496:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27116273 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6132 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016131.275549:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016131.275652:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333817728:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5740us (6482us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016131.275665:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11148 00000100:00100000:2.0:1734016131.281410:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016131.281520:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333817984 00000100:00100000:0.0:1734016131.281538:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333817984 00002000:00100000:0.0:1734016131.281623:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (1458176->1462271) req@ffff8800756ed500 x1818247333817984/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:92/0 lens 488/0 e 0 to 0 dl 1734016142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016131.281637:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ed500 with x1818247333817984 ext(1458176->1462271) 00002000:00010000:0.0:1734016131.281646:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756ed500 00000100:00100000:3.0:1734016131.282844:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8789 00000100:00100000:3.0:1734016131.282858:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333817984:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016131.283356:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333817984:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 497us (1968us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016131.283369:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8789 00002000:00100000:3.0:1734016131.283379:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (1458176->1462271) req@ffff8800756ed500 x1818247333817984/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:92/0 lens 488/4536 e 0 to 0 dl 1734016142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016131.283391:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ed500 with x1818247333817984 ext(1458176->1462271) 00002000:00010000:3.0:1734016131.283399:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756ed500 00000100:00100000:0.0:1734016131.287323:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016131.287641:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333818112 00000100:00100000:1.0:1734016131.287668:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333818112 00000100:00100000:1.0:1734016131.288215:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11149 00000100:00100000:1.0:1734016131.288228:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333818112:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016131.288260:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016131.288297:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711627a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6139 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016131.288395:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335330688:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016131.288516:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016131.292287:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335330688:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016131.292366:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711627a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6139 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016131.292391:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711627a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6139 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016131.292865:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016131.293230:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333818112:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4999us (5921us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016131.293244:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11149 00000100:00100000:2.0:1734016131.298144:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016131.298258:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333818240 00000100:00100000:1.0:1734016131.298274:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333818240 00000100:00100000:1.0:1734016131.299179:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11150 00000100:00100000:1.0:1734016131.299194:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333818240:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016131.299223:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016131.299251:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27116281 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6140 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016131.299334:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335330816:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016131.300259:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016131.312382:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335330816:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016131.312445:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27116281 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6140 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016131.312466:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27116281 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6140 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016131.312492:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016131.312584:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333818240:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 13392us (14458us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016131.312597:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11150 00000100:00100000:2.0:1734016131.322681:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.322844:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333818496 00000100:00100000:3.0:1734016131.322856:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333818496 00000100:00100000:3.0:1734016131.322960:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2278 00000100:00100000:3.0:1734016131.322969:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:10406:x1818247333818496:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016131.323034:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016131.323067:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27116242 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6101 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.324676:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016131.324689:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016131.326234:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116288 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016131.326271:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711622d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60f3 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.326280:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116288 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016131.326345:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711622d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60f3 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.326364:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711622d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60f3 expref: 16 pid: 6478 timeout: 498 lvb_type: 0 00000100:00100000:3.0:1734016131.326382:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335330944:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016131.326503:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737813c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016131.337262:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335330944:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016131.337315:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116288 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016131.337973:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016131.338110:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333818624 00000100:00100000:1.0:1734016131.338119:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333818624 00010000:00010000:1.0:1734016131.338168:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711622d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60f3 expref: 17 pid: 6478 timeout: 498 lvb_type: 0 00000100:00100000:1.0:1734016131.338215:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3102 00000100:00100000:1.0:1734016131.338224:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1981:x1818247333818624:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016131.338250:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016131.338260:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711622d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60f3 expref: 17 pid: 6478 timeout: 498 lvb_type: 0 00010000:00010000:1.0:1734016131.338276:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711622d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60f3 expref: 17 pid: 6478 timeout: 498 lvb_type: 0 00010000:00010000:1.0:1734016131.338315:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711622d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60f3 expref: 17 pid: 6478 timeout: 498 lvb_type: 0 00010000:00010000:1.0:1734016131.338356:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016131.338362:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116288 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016131.338376:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116288 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016131.338386:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116288 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016131.338427:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016131.338488:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1981:x1818247333818624:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 263us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016131.338497:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3102 00010000:00010000:3.0:1734016131.339022:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116288 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016131.339038:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116288 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:3.0:1734016131.339226:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968783 00000004:00010000:3.0:1734016131.339312:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800756ef480 reply state ffff880075f70000 transno 4294968784 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116288 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016131.339321:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016131.340835:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+20:10406:x1818247333818496:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 17817us (18123us total) trans 4294968784 rc 0/0 00000100:00100000:3.0:1734016131.340855:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2278 00000020:00080000:3.0:1734016131.340869:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1734016131.349182:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116288 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016131.349211:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116288 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016131.349221:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116288 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016131.349231:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4900 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016131.349241:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116288 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016131.349253:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116288 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016131.349284:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:0.0:1734016131.349287:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016131.349294:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116288 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016131.349299:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116288 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016131.349461:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016131.349612:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333818752 00000100:00100000:1.0:1734016131.349624:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333818752 00000100:00100000:1.0:1734016131.349680:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11151 00000100:00100000:1.0:1734016131.349689:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333818752:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016131.349728:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016131.349753:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711628f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6147 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.349792:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116234 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4022272->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60fa expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.349826:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116265 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6124 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016131.349834:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016131.349837:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016131.349841:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711628f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6147 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.349887:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116265 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6124 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016131.349904:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116265 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6124 expref: 6 pid: 8216 timeout: 498 lvb_type: 1 00000100:00100000:1.0:1734016131.349920:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335331072:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016131.350033:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116234 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4022272->4030463) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60fa expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.350043:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116234 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4022272->4030463) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60fa expref: 8 pid: 8216 timeout: 498 lvb_type: 0 00000100:00100000:1.0:1734016131.350052:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335331200:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016131.350071:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016131.361671:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016131.362263:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335331072:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016131.362291:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335331200:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016131.362347:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711628f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6147 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.362378:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016131.362491:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333818752:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12801us (13037us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016131.362506:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11151 00000100:00100000:2.0:1734016131.363108:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333818880 00000100:00100000:2.0:1734016131.363123:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333818880 00010000:00010000:2.0:1734016131.363184:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116265 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6124 expref: 7 pid: 8216 timeout: 498 lvb_type: 1 00000100:00100000:2.0:1734016131.363257:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3103 00000100:00100000:2.0:1734016131.363267:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075887b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333818880:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016131.363302:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016131.363348:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116265 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6124 expref: 7 pid: 8216 timeout: 498 lvb_type: 1 00010000:00010000:2.0:1734016131.363364:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116265 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6124 expref: 7 pid: 8216 timeout: 498 lvb_type: 1 00010000:00010000:2.0:1734016131.363418:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116265 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6124 expref: 7 pid: 8216 timeout: 498 lvb_type: 1 00010000:00010000:2.0:1734016131.363462:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016131.363513:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075887b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333818880:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 247us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016131.363522:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3103 00000100:00100000:0.0:1734016131.369502:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016131.369981:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333819008 00000100:00100000:1.0:1734016131.370000:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333819008 00010000:00010000:1.0:1734016131.370071:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116234 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4022272->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60fa expref: 8 pid: 8216 timeout: 498 lvb_type: 0 00000100:00100000:1.0:1734016131.370130:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3104 00000100:00100000:1.0:1734016131.370141:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333819008:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016131.370168:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016131.370202:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116234 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4022272->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60fa expref: 8 pid: 8216 timeout: 498 lvb_type: 0 00010000:00010000:1.0:1734016131.370216:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116234 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4022272->4030463) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60fa expref: 8 pid: 8216 timeout: 498 lvb_type: 0 00010000:00010000:1.0:1734016131.370257:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116234 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4022272->4030463) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e60fa expref: 8 pid: 8216 timeout: 498 lvb_type: 0 00010000:00010000:1.0:1734016131.370298:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016131.370305:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016131.370315:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711628f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6147 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.370329:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711628f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6147 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.370385:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711628f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6147 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016131.370402:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335331328:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016131.370511:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016131.375771:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016131.376048:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335331328:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016131.376072:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016131.376134:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333819008:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5994us (6662us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016131.376147:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3104 00000100:00100000:2.0:1734016131.378141:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333819136 00000100:00100000:2.0:1734016131.378167:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333819136 00000100:00100000:2.0:1734016131.378281:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11152 00000100:00100000:2.0:1734016131.378296:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333819136:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.378337:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.378380:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116296 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e614e expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.378439:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711615b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->2973695) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e603d expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.378452:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016131.378455:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016131.378459:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116296 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e614e expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.378524:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711615b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->2973695) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e603d expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.378542:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711615b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->2973695) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e603d expref: 7 pid: 8216 timeout: 498 lvb_type: 0 00000100:00100000:2.0:1734016131.378557:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335331456:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016131.378691:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:0.0:1734016131.384144:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016131.384319:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333819264 00000100:00100000:1.0:1734016131.384329:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333819264 00010000:00010000:1.0:1734016131.384369:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711615b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e603d expref: 8 pid: 8216 timeout: 498 lvb_type: 0 00000100:00100000:1.0:1734016131.384413:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3105 00000100:00100000:1.0:1734016131.384422:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333819264:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016131.384439:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016131.384463:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711615b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2965504->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e603d expref: 8 pid: 8216 timeout: 498 lvb_type: 0 00010000:00010000:1.0:1734016131.384480:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711615b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2965504->2973695) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e603d expref: 8 pid: 8216 timeout: 498 lvb_type: 0 00010000:00010000:1.0:1734016131.384509:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016131.384511:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016131.384517:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116296 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e614e expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.384526:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116296 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e614e expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.384564:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116296 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e614e expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016131.384576:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335331584:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016131.384633:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00010000:00010000:2.0:1734016131.384970:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711615b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2965504->2973695) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e603d expref: 8 pid: 8216 timeout: 498 lvb_type: 0 00000100:00100000:2.0:1734016131.384994:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335331456:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016131.385026:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116296 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e614e expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.385036:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016131.385066:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333819136:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6773us (9309us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016131.385074:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11152 00000100:00100000:0.0:1734016131.387874:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335331584:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016131.387906:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016131.387974:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333819264:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3551us (3844us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016131.387994:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3105 00000100:00100000:0.0:1734016131.389502:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.389753:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333819392 00000100:00100000:3.0:1734016131.389766:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333819392 00002000:00010000:3.0:1734016131.389874:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:3.0:1734016131.389881:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075886d80 with x1818247333819392 ext(4194304->18446744073709551615) 00002000:00010000:3.0:1734016131.389904:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075886d80. 00000100:00100000:3.0:1734016131.389941:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8790 00000100:00100000:3.0:1734016131.389952:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333819392:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016131.390203:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1734016131.390208:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016131 -> 1734016131 00002000:00010000:3.0:1734016131.390209:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016131 -> 1734016131 00002000:00010000:3.0:1734016131.390211:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016131 -> 1734016131 00002000:00010000:3.0:1734016131.390213:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 8200 -> 8200 00000100:00100000:3.0:1734016131.390294:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333819392:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 343us (800us total) trans 4294968004 rc 0/0 00000100:00100000:3.0:1734016131.390302:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8790 00002000:00010000:3.0:1734016131.390306:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:3.0:1734016131.390309:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075886d80 with x1818247333819392 ext(4194304->18446744073709551615) 00002000:00010000:3.0:1734016131.390312:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075886d80. 00000100:00100000:2.0:1734016131.391052:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016131.391719:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333819520 00000100:00100000:0.0:1734016131.391728:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333819520 00002000:00010000:0.0:1734016131.391757:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (1594718->18446744073709551615) 00002000:00100000:0.0:1734016131.391762:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ee300 with x1818247333819520 ext(1594718->18446744073709551615) 00002000:00010000:0.0:1734016131.391772:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ee300. 00000100:00100000:0.0:1734016131.391833:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8791 00000100:00100000:0.0:1734016131.391841:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333819520:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016131.392051:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 572034 -> 1594718 00002000:00010000:0.0:1734016131.392054:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016131 -> 1734016131 00002000:00010000:0.0:1734016131.392056:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016131 -> 1734016130 00002000:00010000:0.0:1734016131.392058:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016131 -> 1734016131 00002000:00010000:0.0:1734016131.392059:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1734016131.392097:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333819520:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 257us (1048us total) trans 4294969479 rc 0/0 00000100:00100000:0.0:1734016131.392103:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8791 00002000:00010000:0.0:1734016131.392106:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (1594718->18446744073709551615) 00002000:00100000:0.0:1734016131.392108:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ee300 with x1818247333819520 ext(1594718->18446744073709551615) 00002000:00010000:0.0:1734016131.392111:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ee300. 00000100:00100000:0.0:1734016131.397971:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.398124:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333819776 00000100:00100000:2.0:1734016131.398138:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333819776 00002000:00100000:2.0:1734016131.398195:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (0->1597439) req@ffff880075885c00 x1818247333819776/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:92/0 lens 488/0 e 0 to 0 dl 1734016142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016131.398206:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075885c00 with x1818247333819776 ext(0->1597439) 00002000:00010000:2.0:1734016131.398213:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075885c00 00000100:00100000:2.0:1734016131.398247:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8792 00000100:00100000:2.0:1734016131.398255:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333819776:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016131.421710:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333819776:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 23432us (23732us total) trans 0 rc 1597440/1597440 00000100:00100000:2.0:1734016131.421725:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8792 00002000:00100000:2.0:1734016131.421741:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (0->1597439) req@ffff880075885c00 x1818247333819776/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:92/0 lens 488/440 e 0 to 0 dl 1734016142 ref 1 fl Complete:/200/0 rc 1597440/1597440 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016131.421752:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075885c00 with x1818247333819776 ext(0->1597439) 00002000:00010000:2.0:1734016131.421759:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075885c00 00000100:00100000:0.0:1734016131.426712:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.427605:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333819904 00000100:00100000:2.0:1734016131.427634:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333819904 00002000:00100000:2.0:1734016131.427743:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (1589248->1594717) req@ffff880075885180 x1818247333819904/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:92/0 lens 5960/0 e 0 to 0 dl 1734016142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016131.427760:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075885180 with x1818247333819904 ext(1589248->1594717) 00002000:00010000:2.0:1734016131.427769:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075885180 00000100:00100000:2.0:1734016131.427854:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8793 00000100:00100000:2.0:1734016131.427867:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333819904:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016131.429756:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333819904:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1865us (3065us total) trans 4294969480 rc 0/0 00000100:00100000:2.0:1734016131.429784:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8793 00002000:00100000:2.0:1734016131.429851:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (1589248->1594717) req@ffff880075885180 x1818247333819904/t4294969480(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:92/0 lens 5960/448 e 0 to 0 dl 1734016142 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016131.429863:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075885180 with x1818247333819904 ext(1589248->1594717) 00002000:00010000:2.0:1734016131.429874:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075885180 00000100:00100000:0.0:1734016131.432367:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.432492:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333820032 00000100:00100000:3.0:1734016131.432503:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333820032 00000100:00100000:3.0:1734016131.433172:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2279 00000100:00100000:3.0:1734016131.433182:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+19:10406:x1818247333820032:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:3.0:1734016131.433364:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+19:10406:x1818247333820032:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 182us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016131.433373:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2279 00000100:00100000:0.0:1734016131.435115:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.435236:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333820160 00000100:00100000:2.0:1734016131.435248:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333820160 00000100:00100000:2.0:1734016131.435564:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11153 00000100:00100000:2.0:1734016131.435574:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333820160:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016131.437663:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969480 is committed 00000001:00080000:0.0:1734016131.437722:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969478 is committed 00000100:00100000:2.0:1734016131.438409:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333820160:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2821us (3292us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016131.438426:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11153 00000100:00100000:0.0:1734016131.441608:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.441865:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333820288 00000100:00100000:3.0:1734016131.441884:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333820288 00000100:00100000:3.0:1734016131.441990:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2280 00000100:00100000:3.0:1734016131.442002:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+19:10406:x1818247333820288:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016131.442053:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016131.442093:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711629d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6155 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.442280:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271162a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016131.442302:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271162a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016131.442329:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271162a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016131.442375:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 5789022 00000004:00200000:3.0:1734016131.442380:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016131.442405:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271162a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016131.442445:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711629d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6155 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.442496:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271162a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6155 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.442508:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016131.442513:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016131.442521:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016131.442602:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+20:10406:x1818247333820288:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 603us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016131.442613:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2280 00000100:00100000:0.0:1734016131.448009:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.448195:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333820544 00000100:00100000:2.0:1734016131.448216:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333820544 00002000:00100000:2.0:1734016131.448317:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (3960832->3964927) req@ffff88007487f800 x1818247333820544/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:92/0 lens 488/0 e 0 to 0 dl 1734016142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016131.448334:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487f800 with x1818247333820544 ext(3960832->3964927) 00002000:00010000:2.0:1734016131.448342:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007487f800 00000100:00100000:2.0:1734016131.448390:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8794 00000100:00100000:2.0:1734016131.448403:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333820544:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016131.448758:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333820544:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 355us (777us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016131.448766:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8794 00002000:00100000:2.0:1734016131.448773:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (3960832->3964927) req@ffff88007487f800 x1818247333820544/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:92/0 lens 488/4536 e 0 to 0 dl 1734016142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016131.448782:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487f800 with x1818247333820544 ext(3960832->3964927) 00002000:00010000:2.0:1734016131.448786:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007487f800 00000100:00100000:0.0:1734016131.452457:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016131.452781:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333820672 00000100:00100000:1.0:1734016131.452850:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333820672 00000100:00100000:1.0:1734016131.452963:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2281 00000100:00100000:1.0:1734016131.452976:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333820672:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016131.453022:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016131.453065:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc271162ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e615c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.453228:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc271162b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016131.453255:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc271162b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016131.453271:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc271162b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:1.0:1734016131.453308:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 5789022 00000004:00200000:1.0:1734016131.453313:0:6480:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016131.453336:0:6480:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc271162b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016131.453364:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f840/0x5e3a3adc271162ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e615c expref: 18 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.453391:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc271162b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e615c expref: 17 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.453402:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016131.453405:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016131.453410:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016131.453484:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:10406:x1818247333820672:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 512us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016131.453493:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2281 00000100:00100000:0.0:1734016131.457559:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.458192:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333820800 00000100:00100000:2.0:1734016131.458211:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333820800 00000100:00100000:1.0:1734016131.462217:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.462796:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333820928 00000100:00100000:2.0:1734016131.462826:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333820928 00000100:00100000:2.0:1734016131.462900:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11154 00000100:00100000:2.0:1734016131.462913:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333820800:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.462950:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.462980:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271162b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6163 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016131.463100:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335331712:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016131.463227:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737063c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016131.463254:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11155 00000100:00100000:2.0:1734016131.463258:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333820928:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.463268:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.463283:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271162c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e616a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016131.463322:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335331840:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016131.463345:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00002000:00010000:3.0:1734016131.467334:0:7684:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016131 -> 1734016132 00002000:00010000:3.0:1734016131.467351:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016130 -> 1734016132 00002000:00010000:3.0:1734016131.467353:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016131 -> 1734016132 00002000:00010000:3.0:1734016131.467356:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 8 -> 24 00000100:00100000:3.0:1734016131.467395:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335331840:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016131.467469:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271162c0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e616a expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.467496:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc271162c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e616a expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1734016131.468149:0:7682:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime: 1734016131 -> 1734016132 00002000:00010000:2.0:1734016131.468156:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016131 -> 1734016132 00002000:00010000:2.0:1734016131.468158:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016131 -> 1734016132 00000100:00100000:2.0:1734016131.468186:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335331712:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016131.468216:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271162b9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6163 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.468232:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271162b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6163 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.468287:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016131.468381:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333820800:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5468us (10834us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016131.468398:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11154 00010000:00010000:3.0:1734016131.468600:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:3.0:1734016131.468632:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333820928:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5371us (6435us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016131.468642:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11155 00000100:00100000:0.0:1734016131.472406:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016131.472458:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.472582:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333821184 00000100:00100000:3.0:1734016131.472595:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333821184 00000100:00100000:3.0:1734016131.472640:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333821056 00000100:00100000:3.0:1734016131.472643:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333821056 00000100:00100000:3.0:1734016131.472674:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11156 00000100:00100000:3.0:1734016131.472683:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333821184:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016131.472719:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016131.472746:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271162c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6178 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016131.473047:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11157 00000100:00100000:0.0:1734016131.473053:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333821056:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016131.473063:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016131.473075:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7581f80/0x5e3a3adc271162ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6171 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016131.473111:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335332096:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016131.473205:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016131.473340:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335331968:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016131.473365:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737810c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016131.475415:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335332096:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016131.475492:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581f80/0x5e3a3adc271162ce lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6171 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.475518:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581f80/0x5e3a3adc271162ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6171 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.475540:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00000100:00100000:2.0:1734016131.475634:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333821056:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2576us (3170us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016131.475648:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11157 00000100:00100000:3.0:1734016131.475865:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335331968:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016131.475917:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271162c7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6178 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.475930:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271162c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6178 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.475944:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016131.475971:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333821184:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3289us (3584us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016131.475978:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11156 00000100:00100000:0.0:1734016131.480414:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016131.481654:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.483033:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333821312 00000100:00100000:3.0:1734016131.483061:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333821312 00000100:00100000:3.0:1734016131.483146:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333821440 00000100:00100000:3.0:1734016131.483149:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333821440 00000100:00100000:3.0:1734016131.483205:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11158 00000100:00100000:3.0:1734016131.483216:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333821312:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016131.483256:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016131.483290:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc271162d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e617f expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016131.483389:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335332224:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016131.483530:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737810c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016131.483563:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11159 00000100:00100000:3.0:1734016131.483567:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333821440:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016131.483577:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016131.483595:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271162dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6186 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016131.483629:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335332352:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016131.483653:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016131.487346:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335332352:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016131.487411:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271162dc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6186 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.487437:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271162dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6186 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.487474:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:2.0:1734016131.487553:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333821440:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3981us (5902us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016131.487565:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11159 00000100:00100000:3.0:1734016131.487767:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335332224:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016131.487795:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc271162d5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e617f expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.487850:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc271162d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e617f expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.487868:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016131.487891:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333821312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4678us (7492us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016131.487898:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11158 00000100:00100000:0.0:1734016131.492428:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016131.492487:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.492776:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333821696 00000100:00100000:2.0:1734016131.492792:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333821696 00000100:00100000:2.0:1734016131.492895:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333821568 00000100:00100000:2.0:1734016131.492899:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333821568 00000100:00100000:2.0:1734016131.492933:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11160 00000100:00100000:2.0:1734016131.492944:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333821696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.492979:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.493026:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271162e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6194 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016131.493125:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335332480:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016131.493245:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737063c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016131.493290:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11161 00000100:00100000:2.0:1734016131.493297:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333821568:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.493308:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.493323:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271162ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e618d expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016131.493361:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335332608:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016131.493389:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016131.495663:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335332480:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016131.495716:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271162e3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6194 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.495731:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271162e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6194 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.495756:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016131.495825:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333821696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2882us (3411us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016131.495834:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11160 00000100:00100000:3.0:1734016131.499400:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335332608:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016131.499450:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271162ea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e618d expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.499467:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271162ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e618d expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.499488:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:3.0:1734016131.499571:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333821568:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6272us (7081us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016131.499581:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11161 00000100:00100000:0.0:1734016131.510083:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.510263:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333821824 00000100:00100000:3.0:1734016131.510278:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333821824 00000100:00100000:3.0:1734016131.510628:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11162 00000100:00100000:3.0:1734016131.510638:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333821824:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016131.510675:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016131.510714:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271162f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e619b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.510764:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711628f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6147 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.510775:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016131.510778:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016131.510782:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271162f1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2011136->2019327] (req 2011136->2019327) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e619b expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.510860:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711628f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6147 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.513784:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711628f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6147 expref: 7 pid: 7684 timeout: 498 lvb_type: 0 00000100:00100000:3.0:1734016131.513926:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335332736:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016131.515267:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737810c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016131.520162:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335332736:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016131.520207:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271162f1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2011136->2019327] (req 2011136->2019327) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e619b expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.520227:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016131.521940:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333821824:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11290us (11864us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016131.521952:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11162 00000100:00100000:1.0:1734016131.522394:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.522815:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333821952 00000100:00100000:3.0:1734016131.522827:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333821952 00010000:00010000:3.0:1734016131.522868:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711628f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6147 expref: 8 pid: 7684 timeout: 498 lvb_type: 0 00000100:00100000:3.0:1734016131.523497:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3106 00000100:00100000:3.0:1734016131.523508:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5225450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333821952:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016131.523531:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016131.523561:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711628f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6147 expref: 8 pid: 7684 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1734016131.523577:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711628f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6147 expref: 8 pid: 7684 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1734016131.523615:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711628f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6147 expref: 8 pid: 7684 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1734016131.523647:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016131.523650:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016131.523661:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271162f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2019327) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e619b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.523672:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271162f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2019327) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e619b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.523737:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271162f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2019327) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e619b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016131.523754:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335332864:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016131.525369:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737810c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016131.532487:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335332864:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016131.532533:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016131.532620:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5225450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333821952:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9112us (10226us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016131.532637:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3106 00000100:00100000:0.0:1734016131.542043:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.542198:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333822208 00000100:00100000:2.0:1734016131.542213:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333822208 00002000:00100000:2.0:1734016131.542280:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff88007487ce00 x1818247333822208/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:92/0 lens 488/0 e 0 to 0 dl 1734016142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016131.542291:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487ce00 with x1818247333822208 ext(0->4194303) 00002000:00010000:2.0:1734016131.542297:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007487ce00 00000100:00100000:2.0:1734016131.542327:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8795 00000100:00100000:2.0:1734016131.542335:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333822208:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016131.590698:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333822208:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 48337us (48650us total) trans 0 rc 4194304/4194304 00000100:00100000:3.0:1734016131.590715:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8795 00002000:00100000:3.0:1734016131.590731:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff88007487ce00 x1818247333822208/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:92/0 lens 488/440 e 0 to 0 dl 1734016142 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016131.590744:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487ce00 with x1818247333822208 ext(0->4194303) 00002000:00010000:3.0:1734016131.590750:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007487ce00 00000100:00100000:0.0:1734016131.596369:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.596528:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333822336 00000100:00100000:3.0:1734016131.596547:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333822336 00000100:00100000:3.0:1734016131.596646:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11163 00000100:00100000:3.0:1734016131.596665:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333822336:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016131.596720:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016131.596762:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271162f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e61a2 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016131.596979:0:8958:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1734016131.597417:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016131.597421:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016131.597432:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271162f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a2 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.597451:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271162f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a2 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.597474:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016131.598073:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333822336:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1411us (1727us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016131.598083:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11163 00000100:00100000:2.0:1734016131.601766:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.602070:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333822592 00000100:00100000:3.0:1734016131.602083:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333822592 00000100:00100000:1.0:1734016131.603254:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2282 00000100:00100000:1.0:1734016131.603268:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+20:10406:x1818247333822592:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016131.603368:0:6480:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016131.603409:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271162a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6155 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.603459:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016131.603466:0:6480:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016131.603742:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc271162ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016131.603759:0:6480:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc271162b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e615c expref: 16 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.603769:0:6480:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc271162ff lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016131.603848:0:6480:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc271162b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e615c expref: 16 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016131.603865:0:6480:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc271162b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e615c expref: 16 pid: 6480 timeout: 498 lvb_type: 0 00000100:00100000:1.0:1734016131.603882:0:6480:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1818247335332992:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016131.604000:0:6480:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016131.607281:0:6480:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1818247335332992:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016131.607340:0:6480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc271162ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:2.0:1734016131.607731:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.607868:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333822720 00000100:00100000:3.0:1734016131.607880:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333822720 00010000:00010000:3.0:1734016131.607925:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc271162b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e615c expref: 17 pid: 6480 timeout: 498 lvb_type: 0 00000100:00100000:3.0:1734016131.607963:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3107 00000100:00100000:3.0:1734016131.607970:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1982:x1818247333822720:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016131.607992:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016131.608001:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc271162b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e615c expref: 17 pid: 6480 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1734016131.608014:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc271162b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e615c expref: 17 pid: 6480 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1734016131.608042:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc271162b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e615c expref: 17 pid: 6480 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1734016131.608071:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016131.608076:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc271162ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:3.0:1734016131.608090:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc271162ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 00010000:00010000:3.0:1734016131.608097:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc271162ff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 00010000:00010000:3.0:1734016131.608120:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016131.608161:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333822720:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 190us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016131.608168:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3107 00010000:00010000:3.0:1734016131.608260:0:6480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc271162ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:3.0:1734016131.608266:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc271162ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000001:00080000:3.0:1734016131.608364:0:6480:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968785 00000004:00010000:3.0:1734016131.608413:0:6480:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007345fb80 reply state ffff8801309f0000 transno 4294968786 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc271162ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:3.0:1734016131.608420:0:6480:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016131.608489:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+22:10406:x1818247333822592:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 5224us (6745us total) trans 4294968786 rc 0/0 00000100:00100000:3.0:1734016131.608495:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2282 00000020:00080000:3.0:1734016131.608499:0:6480:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016131.612046:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc271162ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016131.612070:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc271162ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016131.612077:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc271162ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016131.612084:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499cb40 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016131.612089:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc271162ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016131.612098:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc271162ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016131.612122:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016131.612125:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016131.612129:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc271162ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016131.612134:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc271162ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00000100:00100000:1.0:1734016131.612292:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.612378:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333822848 00000100:00100000:2.0:1734016131.612393:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333822848 00000100:00100000:2.0:1734016131.612467:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11164 00000100:00100000:2.0:1734016131.612475:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333822848:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.612504:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.612531:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116306 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e61a9 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.612567:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271162f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2019327) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e619b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.612578:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271162f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a2 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.612585:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016131.612588:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016131.612593:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116306 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a9 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.612635:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271162f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a2 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.612651:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271162f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a2 expref: 9 pid: 7684 timeout: 498 lvb_type: 1 00000100:00100000:2.0:1734016131.612664:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335333120:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016131.612768:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271162f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2019327) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e619b expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.612777:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271162f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2019327) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e619b expref: 6 pid: 7684 timeout: 498 lvb_type: 0 00000100:00100000:2.0:1734016131.612786:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335333248:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016131.612850:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737063c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016131.620423:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016131.620493:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016131.620549:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333823104 00000100:00100000:0.0:1734016131.620566:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333823104 00010000:00010000:0.0:1734016131.620632:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271162f1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e619b expref: 7 pid: 7684 timeout: 498 lvb_type: 0 00000100:00100000:0.0:1734016131.620675:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333822976 00000100:00100000:0.0:1734016131.620677:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333822976 00010000:00010000:0.0:1734016131.620701:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271162f8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a2 expref: 10 pid: 7684 timeout: 498 lvb_type: 1 00000100:00100000:0.0:1734016131.620730:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3108 00000100:00100000:0.0:1734016131.620740:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333823104:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016131.620764:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016131.620839:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271162f1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2011136->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e619b expref: 7 pid: 7684 timeout: 498 lvb_type: 0 00010000:00010000:0.0:1734016131.620854:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271162f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2011136->2019327) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e619b expref: 7 pid: 7684 timeout: 498 lvb_type: 0 00010000:00010000:0.0:1734016131.620901:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016131.620953:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333823104:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 215us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016131.620962:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3108 00000100:00100000:0.0:1734016131.620983:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3109 00000100:00100000:0.0:1734016131.620987:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333822976:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016131.620994:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016131.620999:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271162f8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a2 expref: 10 pid: 7684 timeout: 498 lvb_type: 1 00010000:00010000:0.0:1734016131.621016:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271162f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a2 expref: 10 pid: 7684 timeout: 498 lvb_type: 1 00010000:00010000:0.0:1734016131.621028:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016131.621030:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016131.621037:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116306 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a9 expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016131.621047:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116306 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a9 expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016131.621088:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116306 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a9 expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016131.621102:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073945c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335333376:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016131.621141:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1734016131.622719:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271162f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a2 expref: 10 pid: 7684 timeout: 498 lvb_type: 1 00000100:00100000:2.0:1734016131.622756:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335333120:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016131.622771:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271162f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2019327) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e619b expref: 6 pid: 7684 timeout: 498 lvb_type: 0 00000100:00100000:2.0:1734016131.622779:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335333248:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016131.622847:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116306 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a9 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.622861:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016131.623057:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247333822848:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10579us (10768us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016131.623069:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11164 00000100:00100000:2.0:1734016131.625611:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016131.625719:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073945c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335333376:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016131.625756:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016131.627402:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333822976:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6392us (6887us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016131.627425:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3109 00000100:00100000:2.0:1734016131.629869:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.629988:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333823360 00000100:00100000:3.0:1734016131.630003:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333823360 00002000:00010000:3.0:1734016131.630076:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:3.0:1734016131.630082:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad6a00 with x1818247333823360 ext(0->18446744073709551615) 00002000:00010000:3.0:1734016131.630100:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad6a00. 00000100:00100000:3.0:1734016131.630138:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333823232 00000100:00100000:3.0:1734016131.630143:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333823232 00002000:00010000:3.0:1734016131.630160:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (3462410->18446744073709551615) 00002000:00100000:3.0:1734016131.630164:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4700 with x1818247333823232 ext(3462410->18446744073709551615) 00002000:00010000:3.0:1734016131.630178:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073ad4700. 00000100:00100000:3.0:1734016131.630200:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8796 00000100:00100000:3.0:1734016131.630209:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333823360:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016131.632296:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 1594718 -> 0 00002000:00010000:3.0:1734016131.632306:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016132 -> 1734016132 00002000:00010000:3.0:1734016131.632308:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016132 -> 1734016131 00002000:00010000:3.0:1734016131.632310:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016132 -> 1734016132 00002000:00010000:3.0:1734016131.632311:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 24 -> 0 00000100:00100000:3.0:1734016131.632394:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333823360:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 2180us (6795us total) trans 4294969481 rc 0/0 00000100:00100000:3.0:1734016131.632406:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8796 00002000:00010000:3.0:1734016131.632414:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:3.0:1734016131.632417:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad6a00 with x1818247333823360 ext(0->18446744073709551615) 00002000:00010000:3.0:1734016131.632423:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad6a00. 00000100:00100000:3.0:1734016131.632449:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8797 00000100:00100000:3.0:1734016131.632456:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333823232:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016131.633254:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 3462410 00002000:00010000:3.0:1734016131.633260:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016132 -> 1734016132 00002000:00010000:3.0:1734016131.633262:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016132 -> 1734016131 00002000:00010000:3.0:1734016131.633263:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016132 -> 1734016132 00002000:00010000:3.0:1734016131.633265:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 8200 -> 6776 00000100:00100000:3.0:1734016131.633295:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333823232:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 838us (3451us total) trans 4294968005 rc 0/0 00000100:00100000:3.0:1734016131.633303:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8797 00002000:00010000:3.0:1734016131.633306:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (3462410->18446744073709551615) 00002000:00100000:3.0:1734016131.633310:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad4700 with x1818247333823232 ext(3462410->18446744073709551615) 00002000:00010000:3.0:1734016131.633315:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073ad4700. 00000100:00100000:3.0:1734016131.640675:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.643326:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333823488 00000100:00100000:2.0:1734016131.643347:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333823488 00000100:00100000:2.0:1734016131.643454:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2283 00000100:00100000:2.0:1734016131.643465:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333823488:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.643506:0:6480:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.643545:0:6480:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711630d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e61b0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.643686:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116314 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016131.643718:0:6480:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116314 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016131.643731:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116314 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000004:00200000:2.0:1734016131.643767:0:6480:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 3462410 00000004:00200000:2.0:1734016131.643772:0:6480:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016131.643796:0:6480:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116314 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016131.643846:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711630d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61b0 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.643889:0:6480:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116314 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61b0 expref: 17 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.643898:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016131.643901:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016131.643905:0:6480:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016131.643992:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:10406:x1818247333823488:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 527us (3329us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016131.644000:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2283 00000100:00100000:3.0:1734016131.648248:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.650567:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333823616 00000100:00100000:2.0:1734016131.650591:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333823616 00000100:00100000:3.0:1734016131.651413:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.659208:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333823744 00000100:00100000:2.0:1734016131.659234:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333823744 00000100:00100000:2.0:1734016131.659350:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11165 00000100:00100000:2.0:1734016131.659360:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333823616:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.659395:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.659426:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711631b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e61b7 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016131.659519:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335333504:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016131.659632:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737063c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016131.659679:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11166 00000100:00100000:2.0:1734016131.659684:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333823744:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.659701:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.659712:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116322 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e61be expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016131.659738:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335333632:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016131.659756:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00002000:00010000:2.0:1734016131.661990:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016131 -> 1734016132 00000100:00100000:2.0:1734016131.662022:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335333504:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016131.662060:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711631b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61b7 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.662075:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711631b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61b7 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.662089:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00002000:00010000:3.0:1734016131.662774:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016131 -> 1734016132 00000100:00100000:3.0:1734016131.662791:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335333632:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016131.662857:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116322 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61be expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.662867:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116322 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61be expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.662876:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016131.662971:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333823616:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3611us (14736us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016131.662985:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11165 00000100:00100000:3.0:1734016131.663293:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333823744:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3606us (11885us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016131.663299:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11166 00000100:00100000:0.0:1734016131.670224:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016131.670297:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016131.670361:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333824000 00000100:00100000:0.0:1734016131.670374:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333824000 00000100:00100000:0.0:1734016131.670428:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333823872 00000100:00100000:0.0:1734016131.670431:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333823872 00000100:00100000:0.0:1734016131.670461:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11167 00000100:00100000:0.0:1734016131.670472:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333824000:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016131.670505:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016131.670537:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27116329 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e61cc expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016131.670633:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073946680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335333760:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016131.670729:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016131.670755:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11168 00000100:00100000:0.0:1734016131.670760:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333823872:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016131.670770:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016131.670783:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7583180/0x5e3a3adc27116330 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e61c5 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016131.670838:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073945f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335333888:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016131.670865:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016131.673863:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073946680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335333760:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016131.673925:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27116329 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61cc expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016131.673942:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27116329 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61cc expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016131.673959:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:1.0:1734016131.674029:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333824000:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3556us (3821us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016131.674041:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11167 00000100:00100000:0.0:1734016131.675426:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073945f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335333888:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016131.675464:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7583180/0x5e3a3adc27116330 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61c5 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016131.675480:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7583180/0x5e3a3adc27116330 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61c5 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016131.676342:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:1.0:1734016131.676861:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333823872:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6094us (6557us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016131.677537:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11168 00000100:00100000:0.0:1734016131.684777:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.685162:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333824256 00000100:00100000:2.0:1734016131.685180:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333824256 00000100:00100000:2.0:1734016131.685307:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2284 00000100:00100000:2.0:1734016131.685321:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:10406:x1818247333824256:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016131.685403:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016131.685445:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116314 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61b0 expref: 17 pid: 6480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.685468:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016131.685473:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016131.685746:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116337 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.685763:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116337 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.685774:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116337 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:2.0:1734016131.689253:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968787 00000004:00010000:2.0:1734016131.689358:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880073945f80 reply state ffff8800756f3000 transno 4294968788 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116337 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016131.689372:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016131.689574:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:10406:x1818247333824256:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 4248us (4813us total) trans 4294968788 rc 0/0 00000100:00100000:2.0:1734016131.689586:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2284 00000020:00080000:2.0:1734016131.689597:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1734016131.692364:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116337 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016131.692392:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116337 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016131.692408:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116337 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016131.692417:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcfc0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016131.692425:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116337 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016131.692436:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116337 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016131.692460:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:0.0:1734016131.692463:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016131.692468:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116337 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016131.692473:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116337 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:1.0:1734016131.694151:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.695022:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333824384 00000100:00100000:2.0:1734016131.695039:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333824384 00000100:00100000:2.0:1734016131.695116:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11169 00000100:00100000:2.0:1734016131.695128:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333824384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.695165:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.695198:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711633e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e61d3 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.695253:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116306 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a9 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.695266:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016131.695269:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016131.695273:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711633e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61d3 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.695320:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116306 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a9 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.695336:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116306 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a9 expref: 8 pid: 7683 timeout: 498 lvb_type: 0 00000100:00100000:2.0:1734016131.695350:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335334016:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016131.695458:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737063c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016131.700777:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335334016:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016131.700870:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711633e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61d3 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.700918:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016131.701148:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333824384:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6021us (7016us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016131.701166:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11169 00000100:00100000:1.0:1734016131.701476:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.701654:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333824512 00000100:00100000:2.0:1734016131.701668:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333824512 00010000:00010000:2.0:1734016131.701718:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116306 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a9 expref: 9 pid: 7683 timeout: 498 lvb_type: 0 00000100:00100000:2.0:1734016131.701756:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3110 00000100:00100000:2.0:1734016131.701767:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333824512:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016131.701794:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016131.702478:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116306 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a9 expref: 9 pid: 7683 timeout: 498 lvb_type: 0 00010000:00010000:2.0:1734016131.702492:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116306 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a9 expref: 9 pid: 7683 timeout: 498 lvb_type: 0 00010000:00010000:2.0:1734016131.702517:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116306 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61a9 expref: 9 pid: 7683 timeout: 498 lvb_type: 0 00010000:00010000:2.0:1734016131.702532:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016131.702534:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016131.702539:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711633e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61d3 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.702555:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711633e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61d3 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.702593:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711633e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61d3 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016131.702609:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335334144:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016131.702698:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737063c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016131.705596:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335334144:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016131.705631:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016131.705730:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333824512:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3959us (4251us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016131.705745:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3110 00000100:00100000:0.0:1734016131.706295:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.706648:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333824640 00000100:00100000:2.0:1734016131.706660:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333824640 00000100:00100000:2.0:1734016131.706724:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11170 00000100:00100000:2.0:1734016131.706733:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333824640:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.706763:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.706790:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116345 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e61da expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.707086:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116296 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e614e expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.707104:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016131.707107:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016131.707113:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116345 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61da expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.707159:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116296 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e614e expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.707173:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116296 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e614e expref: 8 pid: 7684 timeout: 498 lvb_type: 0 00000100:00100000:2.0:1734016131.707186:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335334272:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016131.707851:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737063c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016131.711222:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.711334:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335334272:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016131.711372:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116345 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61da expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.711391:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:3.0:1734016131.711584:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333824768 00000100:00100000:3.0:1734016131.711590:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333824768 00010000:00010000:3.0:1734016131.711619:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116296 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e614e expref: 9 pid: 7684 timeout: 498 lvb_type: 0 00000100:00100000:2.0:1734016131.712505:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333824640:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5768us (6208us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016131.712517:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11170 00000100:00100000:3.0:1734016131.713127:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3111 00000100:00100000:3.0:1734016131.713140:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333824768:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016131.713165:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016131.713208:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116296 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e614e expref: 9 pid: 7684 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1734016131.713226:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116296 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e614e expref: 9 pid: 7684 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1734016131.713259:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116296 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e614e expref: 9 pid: 7684 timeout: 498 lvb_type: 0 00010000:00010000:3.0:1734016131.713295:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016131.713297:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016131.713305:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116345 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61da expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.713315:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116345 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61da expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016131.713370:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116345 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61da expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016131.713386:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335334400:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016131.713478:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016131.718536:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335334400:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016131.718588:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016131.718671:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333824768:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5531us (7462us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016131.718699:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3111 00000100:00100000:0.0:1734016131.718982:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016131.719083:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016131.719114:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333825024 00000100:00100000:0.0:1734016131.719124:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333825024 00002000:00010000:0.0:1734016131.719183:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (2736444->18446744073709551615) 00002000:00100000:0.0:1734016131.719189:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073944a80 with x1818247333825024 ext(2736444->18446744073709551615) 00002000:00010000:0.0:1734016131.719204:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073944a80. 00000100:00100000:0.0:1734016131.719225:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333824896 00000100:00100000:0.0:1734016131.719228:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333824896 00002000:00010000:0.0:1734016131.719242:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:0.0:1734016131.719244:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073947480 with x1818247333824896 ext(4194304->18446744073709551615) 00002000:00010000:0.0:1734016131.719259:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073947480. 00000100:00100000:0.0:1734016131.719273:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8798 00000100:00100000:0.0:1734016131.719281:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333825024:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016131.719667:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 2736444 00002000:00010000:0.0:1734016131.719671:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016132 -> 1734016132 00002000:00010000:0.0:1734016131.719674:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016132 -> 1734016131 00002000:00010000:0.0:1734016131.719676:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016132 -> 1734016132 00002000:00010000:0.0:1734016131.719679:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1734016131.719721:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333825024:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 440us (742us total) trans 4294969482 rc 0/0 00000100:00100000:0.0:1734016131.719728:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8798 00002000:00010000:0.0:1734016131.719731:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (2736444->18446744073709551615) 00002000:00100000:0.0:1734016131.719734:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073944a80 with x1818247333825024 ext(2736444->18446744073709551615) 00002000:00010000:0.0:1734016131.719737:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073944a80. 00000100:00100000:0.0:1734016131.719751:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8799 00000100:00100000:0.0:1734016131.719756:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333824896:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016131.719932:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 3462410 -> 4194304 00002000:00010000:0.0:1734016131.719935:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016132 -> 1734016132 00002000:00010000:0.0:1734016131.719937:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016132 -> 1734016131 00002000:00010000:0.0:1734016131.719939:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016132 -> 1734016132 00002000:00010000:0.0:1734016131.719941:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 6776 -> 6776 00000100:00100000:0.0:1734016131.719958:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333824896:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 201us (876us total) trans 4294968006 rc 0/0 00000100:00100000:0.0:1734016131.719964:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8799 00002000:00010000:0.0:1734016131.719967:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:0.0:1734016131.719969:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073947480 with x1818247333824896 ext(4194304->18446744073709551615) 00002000:00010000:0.0:1734016131.719973:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073947480. 00000100:00100000:0.0:1734016131.725743:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.725874:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333825152 00000100:00100000:2.0:1734016131.725886:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333825152 00000100:00100000:2.0:1734016131.725955:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2285 00000100:00100000:2.0:1734016131.725963:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:10406:x1818247333825152:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.726009:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.726041:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711634c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e61e1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.726176:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116353 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.726191:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.726206:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016131.726233:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 6930748 00000004:00200000:2.0:1734016131.726237:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016131.726256:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.726279:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711634c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61e1 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.728276:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116353 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61e1 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.728305:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016131.728308:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016131.728314:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016131.729000:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:10406:x1818247333825152:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3033us (3273us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016131.729014:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2285 00000100:00100000:0.0:1734016131.734012:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.734362:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333825280 00000100:00100000:2.0:1734016131.734384:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333825280 00000100:00100000:2.0:1734016131.734465:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2286 00000100:00100000:2.0:1734016131.734477:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+21:10406:x1818247333825280:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.734546:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.734588:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711635a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e61e8 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.734855:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116361 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.734893:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.734914:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016131.734961:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 6930748 00000004:00200000:2.0:1734016131.734968:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016131.734997:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.735029:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711635a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61e8 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.736457:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116361 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61e8 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.736473:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016131.736475:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016131.736479:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016131.737109:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+22:10406:x1818247333825280:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2629us (3315us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016131.737124:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2286 00000100:00100000:0.0:1734016131.747947:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016131.748224:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.748320:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333825408 00000100:00100000:2.0:1734016131.748339:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333825408 00000100:00100000:2.0:1734016131.748406:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333825536 00000100:00100000:2.0:1734016131.748409:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333825536 00000100:00100000:2.0:1734016131.749455:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11171 00000100:00100000:2.0:1734016131.749468:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333825408:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.749506:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.749539:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116368 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e61ef expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016131.749641:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335334528:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016131.749745:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737063c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016131.749872:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11172 00000100:00100000:0.0:1734016131.749881:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333825536:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016131.749899:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016131.749916:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc2711636f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e61f6 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016131.749955:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073946300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335334656:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016131.749982:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541ff00 going to sleep for 11 seconds 00002000:00010000:2.0:1734016131.760369:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016131 -> 1734016132 00000100:00100000:2.0:1734016131.760428:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335334528:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016131.760496:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116368 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61ef expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.760516:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116368 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61ef expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.760582:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016131.760708:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333825408:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11241us (12792us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016131.760722:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11171 00002000:00010000:2.0:1734016131.770922:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016131 -> 1734016132 00000100:00100000:2.0:1734016131.770968:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073946300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335334656:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016131.771026:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc2711636f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61f6 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.771046:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7583180/0x5e3a3adc2711636f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61f6 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.771090:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:2.0:1734016131.774146:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333825536:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 24236us (25911us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016131.774169:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11172 00000100:00100000:0.0:1734016131.776990:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016131.777075:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.777146:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333825792 00000100:00100000:3.0:1734016131.777168:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333825792 00000100:00100000:3.0:1734016131.777234:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333825664 00000100:00100000:3.0:1734016131.777237:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333825664 00000100:00100000:3.0:1734016131.777274:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11173 00000100:00100000:3.0:1734016131.777285:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333825792:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016131.777310:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016131.777333:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116376 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6204 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016131.777408:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335334784:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016131.777417:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11174 00000100:00100000:2.0:1734016131.777428:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333825664:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.777445:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.777466:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711637d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e61fd expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016131.777496:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016131.777523:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335334912:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016131.777568:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737063c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016131.782524:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335334784:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016131.782573:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116376 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6204 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.782586:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116376 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6204 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.782610:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016131.782677:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333825792:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5393us (5709us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016131.782685:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11173 00000100:00100000:2.0:1734016131.786351:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335334912:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016131.786425:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711637d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61fd expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.786450:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711637d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61fd expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.786497:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016131.786606:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333825664:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9176us (9527us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016131.786619:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11174 00000100:00100000:2.0:1734016131.790470:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.790533:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016131.840485:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333825920 00000100:00100000:0.0:1734016131.840500:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333825920 00000100:00100000:0.0:1734016131.840550:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333826048 00000100:00100000:0.0:1734016131.840553:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333826048 00000100:00100000:0.0:1734016131.840586:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11175 00000100:00100000:0.0:1734016131.840594:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333825920:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016131.840620:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016131.840645:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7580900/0x5e3a3adc27116384 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e620b expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016131.840717:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073946680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335335040:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016131.840793:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016131.840833:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11176 00000100:00100000:0.0:1734016131.840839:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333826048:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016131.840847:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016131.840856:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc2711638b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6212 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016131.840884:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073945c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335335168:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016131.840903:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1734016131.854498:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073945c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335335168:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016131.854554:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc2711638b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6212 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016131.854569:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc2711638b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6212 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016131.854600:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581d40, rc 0) 00000100:00100000:1.0:1734016131.854663:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333826048:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 13823us (64128us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016131.854671:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11176 00000100:00100000:2.0:1734016131.854918:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073946680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335335040:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016131.854935:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7580900/0x5e3a3adc27116384 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e620b expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.854943:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7580900/0x5e3a3adc27116384 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e620b expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.854956:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580900, rc 0) 00000100:00100000:2.0:1734016131.854980:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333825920:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 14387us (64526us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016131.854985:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11175 00000100:00100000:0.0:1734016131.860227:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.860384:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333826176 00000100:00100000:2.0:1734016131.860405:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333826176 00000100:00100000:2.0:1734016131.860491:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11177 00000100:00100000:2.0:1734016131.860499:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333826176:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.860527:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.860556:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116392 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6219 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016131.860642:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335335296:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016131.860774:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737063c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016131.861795:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016131.861887:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333826304 00000100:00100000:1.0:1734016131.861896:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333826304 00000100:00100000:1.0:1734016131.861954:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11178 00000100:00100000:1.0:1734016131.861962:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333826304:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016131.861980:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016131.861997:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27116399 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6220 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016131.862053:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335335424:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016131.862111:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016131.872994:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335335296:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016131.873052:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116392 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6219 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016131.873070:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116392 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6219 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016131.873101:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:0.0:1734016131.873159:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333826176:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12660us (12951us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016131.873170:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11177 00000100:00100000:1.0:1734016131.882652:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335335424:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016131.882725:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27116399 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6220 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016131.882743:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27116399 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6220 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016131.882782:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016131.882891:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333826304:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 20927us (21097us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016131.882906:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11178 00000100:00100000:0.0:1734016131.886721:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.888645:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333826560 00000100:00100000:2.0:1734016131.888658:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333826560 00000100:00100000:2.0:1734016131.888723:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2287 00000100:00100000:2.0:1734016131.888731:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:10406:x1818247333826560:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016131.888791:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016131.888843:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116353 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61e1 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.889242:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016131.889247:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016131.889427:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271163a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.889441:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116361 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61e8 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.889448:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271163a0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.889486:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116361 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61e8 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.889498:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116361 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61e8 expref: 21 pid: 6478 timeout: 499 lvb_type: 0 00000100:00100000:2.0:1734016131.889511:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335335552:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016131.889599:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016131.892381:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.892459:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333826688 00000100:00100000:3.0:1734016131.892469:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333826688 00000100:00100000:2.0:1734016131.892474:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335335552:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016131.892502:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116361 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61e8 expref: 22 pid: 6478 timeout: 499 lvb_type: 0 00010000:00010000:2.0:1734016131.892510:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271163a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016131.892547:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3112 00000100:00100000:3.0:1734016131.892558:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+22:1981:x1818247333826688:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016131.892573:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016131.892578:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116361 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61e8 expref: 22 pid: 6478 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1734016131.892589:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116361 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61e8 expref: 22 pid: 6478 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1734016131.892617:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116361 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61e8 expref: 22 pid: 6478 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1734016131.892634:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016131.892640:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271163a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016131.892648:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271163a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016131.892654:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271163a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016131.892682:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016131.892718:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271163a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.892724:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271163a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016131.892727:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+21:1981:x1818247333826688:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 169us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016131.892733:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3112 00000001:00080000:2.0:1734016131.892885:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968789 00000004:00010000:2.0:1734016131.892941:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075874e00 reply state ffff8800756f1000 transno 4294968790 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271163a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016131.892949:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016131.893067:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:10406:x1818247333826560:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 4335us (6357us total) trans 4294968790 rc 0/0 00000100:00100000:2.0:1734016131.893075:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2287 00000020:00080000:2.0:1734016131.893080:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016131.895931:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271163a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.895943:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271163a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.895949:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271163a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.895954:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc240 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016131.895958:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271163a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.895967:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271163a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.895980:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016131.895982:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016131.895986:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271163a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.895990:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271163a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016131.900965:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016131.901067:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.901171:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333826816 00000100:00100000:2.0:1734016131.901181:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333826816 00002000:00010000:2.0:1734016131.901218:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:2.0:1734016131.901222:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075874700 with x1818247333826816 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1734016131.901234:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075874700. 00000100:00100000:2.0:1734016131.901251:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333826944 00000100:00100000:2.0:1734016131.901254:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333826944 00002000:00010000:2.0:1734016131.901263:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (2679399->18446744073709551615) 00002000:00100000:2.0:1734016131.901265:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075876d80 with x1818247333826944 ext(2679399->18446744073709551615) 00002000:00010000:2.0:1734016131.901272:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075876d80. 00000100:00100000:2.0:1734016131.901306:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8800 00000100:00100000:2.0:1734016131.901312:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333826816:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016131.901447:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1734016131.901451:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016132 -> 1734016132 00002000:00010000:2.0:1734016131.901453:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016132 -> 1734016131 00002000:00010000:2.0:1734016131.901455:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016132 -> 1734016132 00002000:00010000:2.0:1734016131.901457:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 6776 -> 6776 00000100:00100000:2.0:1734016131.901509:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333826816:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 196us (560us total) trans 4294968007 rc 0/0 00000100:00100000:2.0:1734016131.901517:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8800 00002000:00010000:2.0:1734016131.901521:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:2.0:1734016131.901523:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075874700 with x1818247333826816 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1734016131.901527:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075874700. 00000100:00100000:2.0:1734016131.901544:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8801 00000100:00100000:2.0:1734016131.901548:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333826944:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016131.901724:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 2736444 -> 2679399 00002000:00010000:2.0:1734016131.901727:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016132 -> 1734016132 00002000:00010000:2.0:1734016131.901729:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016132 -> 1734016131 00002000:00010000:2.0:1734016131.901731:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016132 -> 1734016132 00002000:00010000:2.0:1734016131.901733:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1734016131.901750:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333826944:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 200us (682us total) trans 4294969483 rc 0/0 00000100:00100000:2.0:1734016131.901756:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8801 00002000:00010000:2.0:1734016131.901758:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (2679399->18446744073709551615) 00002000:00100000:2.0:1734016131.901760:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075876d80 with x1818247333826944 ext(2679399->18446744073709551615) 00002000:00010000:2.0:1734016131.901764:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075876d80. 00000100:00100000:0.0:1734016131.907795:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.908016:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333827072 00000100:00100000:2.0:1734016131.908035:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333827072 00000100:00100000:2.0:1734016131.908130:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2288 00000100:00100000:2.0:1734016131.908139:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:10406:x1818247333827072:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.908182:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.908200:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271163a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6227 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.908341:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271163ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.908360:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271163ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.908376:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271163ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016131.908407:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 6873703 00000004:00200000:2.0:1734016131.908413:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016131.908435:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271163ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.908460:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271163a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6227 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.908497:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271163ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6227 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.908507:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016131.908511:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016131.908514:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016131.908598:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:10406:x1818247333827072:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 459us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016131.908606:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2288 00000100:00100000:0.0:1734016131.911061:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016131.911241:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333827200 00000100:00100000:1.0:1734016131.911257:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333827200 00000100:00100000:1.0:1734016131.911336:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11179 00000100:00100000:1.0:1734016131.911348:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333827200:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016131.911718:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1734016131.911721:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016132 -> 1734016132 00002000:00010000:1.0:1734016131.911724:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016131 -> 1734016131 00002000:00010000:1.0:1734016131.911727:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016132 -> 1734016132 00002000:00010000:1.0:1734016131.911729:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 6776 -> 6776 00000100:00100000:1.0:1734016131.911923:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333827200:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 575us (882us total) trans 4294968008 rc 0/0 00000100:00100000:1.0:1734016131.911931:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11179 00000100:00100000:0.0:1734016131.915022:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.916943:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333827328 00000100:00100000:2.0:1734016131.916965:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333827328 00000100:00100000:2.0:1734016131.917047:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2289 00000100:00100000:2.0:1734016131.917054:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+21:10406:x1818247333827328:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.917088:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.917120:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271163b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e622e expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.917252:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271163bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.917271:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271163bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.917284:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271163bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016131.917315:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 6873703 00000004:00200000:2.0:1734016131.917320:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016131.917339:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271163bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016131.917365:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271163b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e622e expref: 23 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.917386:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271163bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e622e expref: 22 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016131.917396:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016131.917400:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016131.917403:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016131.917474:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+22:10406:x1818247333827328:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 419us (2468us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016131.917482:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2289 00000100:00100000:2.0:1734016131.925451:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016131.926703:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333827456 00000100:00100000:0.0:1734016131.926723:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333827456 00000100:00100000:2.0:1734016131.927674:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.927750:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333827584 00000100:00100000:2.0:1734016131.927757:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333827584 00000100:00100000:0.0:1734016131.927841:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11180 00000100:00100000:0.0:1734016131.927855:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333827456:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016131.927895:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016131.927932:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7581d40/0x5e3a3adc271163c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6235 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016131.928038:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075876a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335335680:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016131.928152:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:2.0:1734016131.928846:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11181 00000100:00100000:2.0:1734016131.928855:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333827584:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.928873:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.928897:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271163ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e623c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016131.928949:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335335808:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016131.929007:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00002000:00010000:3.0:1734016131.937151:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016131 -> 1734016132 00000100:00100000:3.0:1734016131.937203:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335335808:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016131.937247:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271163ca lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e623c expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.937269:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271163ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e623c expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.937291:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:3.0:1734016131.937357:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333827584:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8501us (9695us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016131.937369:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11181 00002000:00010000:2.0:1734016131.937498:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016131 -> 1734016132 00000100:00100000:2.0:1734016131.937517:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075876a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335335680:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016131.937539:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581d40/0x5e3a3adc271163c3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6235 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.937550:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581d40/0x5e3a3adc271163c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6235 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.937565:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581d40, rc 0) 00000100:00100000:2.0:1734016131.937589:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333827456:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9738us (12158us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016131.937595:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11180 00000100:00100000:0.0:1734016131.941455:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016131.941521:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016131.941652:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333827840 00000100:00100000:3.0:1734016131.941665:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333827840 00000100:00100000:3.0:1734016131.942074:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333827712 00000100:00100000:3.0:1734016131.942078:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333827712 00000100:00100000:2.0:1734016131.942311:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11182 00000100:00100000:2.0:1734016131.942324:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333827840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016131.942365:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016131.942399:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271163d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e624a expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016131.942492:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335335936:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016131.942587:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016131.942947:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11183 00000100:00100000:3.0:1734016131.942954:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333827712:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016131.942966:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016131.942981:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271163d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6243 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016131.943023:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335336064:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016131.943053:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016131.948730:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335335936:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016131.948814:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271163d1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e624a expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.948837:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271163d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e624a expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016131.948858:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:3.0:1734016131.949142:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335336064:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016131.949180:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271163d8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6243 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.949192:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271163d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6243 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016131.949206:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:2.0:1734016131.949520:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333827840:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7196us (8081us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016131.949531:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11182 00000100:00100000:3.0:1734016131.949734:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333827712:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6778us (8210us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016131.949741:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11183 00000100:00100000:0.0:1734016131.960453:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016131.960661:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333828096 00000100:00100000:2.0:1734016131.960680:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333828096 00002000:00100000:2.0:1734016131.960758:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (0->2957311) req@ffff880075875c00 x1818247333828096/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:92/0 lens 488/0 e 0 to 0 dl 1734016142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016131.960771:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075875c00 with x1818247333828096 ext(0->2957311) 00002000:00010000:2.0:1734016131.960778:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075875c00 00000100:00100000:2.0:1734016131.960877:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8802 00000100:00100000:2.0:1734016131.960888:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333828096:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016132.020401:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333828096:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 59494us (59950us total) trans 0 rc 2682880/2682880 00000100:00100000:3.0:1734016132.020418:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8802 00002000:00100000:3.0:1734016132.020438:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (0->2957311) req@ffff880075875c00 x1818247333828096/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:92/0 lens 488/440 e 0 to 0 dl 1734016142 ref 1 fl Complete:/200/0 rc 2682880/2682880 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016132.020448:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075875c00 with x1818247333828096 ext(0->2957311) 00002000:00010000:3.0:1734016132.020456:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075875c00 00000100:00100000:0.0:1734016132.027711:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.027847:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333828224 00000100:00100000:3.0:1734016132.027866:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333828224 00000100:00100000:2.0:1734016132.029720:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11184 00000100:00100000:2.0:1734016132.029739:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333828224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.029787:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.029857:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271163df lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6251 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.029930:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711633e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61d3 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.029940:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016132.029944:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016132.029948:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271163df lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2359296->2367487] (req 2359296->2367487) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6251 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.030008:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711633e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61d3 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.030029:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711633e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61d3 expref: 9 pid: 7684 timeout: 499 lvb_type: 0 00000100:00100000:2.0:1734016132.030047:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335336192:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016132.030196:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706780 going to sleep for 11 seconds 00000100:00080000:0.0:1734016132.031232:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016102 00000100:00100000:2.0:1734016132.035616:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335336192:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016132.035693:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271163df lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2359296->2367487] (req 2359296->2367487) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6251 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.035729:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016132.035914:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247333828224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6175us (8230us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016132.035927:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11184 00000100:00100000:0.0:1734016132.036534:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.036695:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333828352 00000100:00100000:2.0:1734016132.036705:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333828352 00010000:00010000:2.0:1734016132.036767:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711633e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61d3 expref: 10 pid: 7684 timeout: 499 lvb_type: 0 00000100:00080000:0.0:1734016132.037172:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016102 00000100:00100000:2.0:1734016132.037696:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3113 00000100:00100000:2.0:1734016132.037706:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5225050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333828352:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016132.037731:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016132.037770:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711633e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61d3 expref: 10 pid: 7684 timeout: 499 lvb_type: 0 00010000:00010000:2.0:1734016132.037787:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711633e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61d3 expref: 10 pid: 7684 timeout: 499 lvb_type: 0 00010000:00010000:2.0:1734016132.037845:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711633e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61d3 expref: 10 pid: 7684 timeout: 499 lvb_type: 0 00010000:00010000:2.0:1734016132.037887:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016132.037890:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016132.037902:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271163df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2367487) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6251 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.037920:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271163df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2367487) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6251 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.037971:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271163df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2367487) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6251 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.037989:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335336320:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016132.038090:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.044116:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335336320:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016132.044176:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016132.044285:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5225050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333828352:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6575us (7804us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016132.044306:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3113 00000100:00100000:0.0:1734016132.050375:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.051175:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333828608 00000100:00100000:3.0:1734016132.051196:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333828608 00002000:00100000:3.0:1734016132.051286:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (2359296->2363391) req@ffff880075877480 x1818247333828608/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 488/0 e 0 to 0 dl 1734016143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016132.051298:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075877480 with x1818247333828608 ext(2359296->2363391) 00002000:00010000:3.0:1734016132.051305:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075877480 00000100:00100000:3.0:1734016132.051409:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8803 00000100:00100000:3.0:1734016132.051419:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333828608:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016132.051793:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333828608:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 375us (1441us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016132.051829:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8803 00002000:00100000:3.0:1734016132.051836:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (2359296->2363391) req@ffff880075877480 x1818247333828608/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 488/4536 e 0 to 0 dl 1734016143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016132.051844:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075877480 with x1818247333828608 ext(2359296->2363391) 00002000:00010000:3.0:1734016132.051847:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075877480 00000100:00100000:0.0:1734016132.066466:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.066703:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333828864 00000100:00100000:2.0:1734016132.066720:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333828864 00002000:00100000:2.0:1734016132.066796:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (2363392->2367487) req@ffff880075877800 x1818247333828864/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 488/0 e 0 to 0 dl 1734016143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.066920:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075877800 with x1818247333828864 ext(2363392->2367487) 00002000:00010000:2.0:1734016132.066928:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075877800 00000100:00100000:2.0:1734016132.066978:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8804 00000100:00100000:2.0:1734016132.066990:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333828864:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016132.067283:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333828864:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 293us (843us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016132.067297:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8804 00002000:00100000:2.0:1734016132.067304:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (2363392->2367487) req@ffff880075877800 x1818247333828864/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 488/4536 e 0 to 0 dl 1734016143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.067313:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075877800 with x1818247333828864 ext(2363392->2367487) 00002000:00010000:2.0:1734016132.067316:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075877800 00000100:00100000:0.0:1734016132.071256:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.071406:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333828992 00000100:00100000:2.0:1734016132.071423:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333828992 00000100:00100000:2.0:1734016132.071530:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11185 00000100:00100000:2.0:1734016132.071543:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333828992:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.071585:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.071620:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271163e6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6258 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.071736:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335336448:192.168.201.16@tcp:106: 00000100:00080000:0.0:1734016132.071961:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016102 00000100:00100000:2.0:1734016132.073171:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00002000:00010000:2.0:1734016132.078060:0:7682:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size: 2679399 -> 2958095 00002000:00010000:2.0:1734016132.078077:0:7682:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:2.0:1734016132.078120:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335336448:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.078189:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271163e6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6258 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.078213:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271163e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6258 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.078249:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016132.078336:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333828992:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6796us (7104us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.078349:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11185 00000100:00100000:0.0:1734016132.082967:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.086669:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333829120 00000100:00100000:2.0:1734016132.086709:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333829120 00000100:00100000:2.0:1734016132.086842:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11186 00000100:00100000:2.0:1734016132.086855:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333829120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.086897:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.086941:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271163ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e625f expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.087073:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012db0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335336576:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.087256:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.091638:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012db0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335336576:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.091704:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271163ed lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e625f expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.091721:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271163ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e625f expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.091754:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016132.091875:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333829120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5020us (8931us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.091886:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11186 00000100:00100000:0.0:1734016132.105718:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016132.109156:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333829376 00000100:00100000:1.0:1734016132.109192:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333829376 00000100:00100000:1.0:1734016132.109366:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2290 00000100:00100000:1.0:1734016132.109382:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+22:10406:x1818247333829376:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016132.109504:0:6480:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016132.109562:0:6480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271163bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e622e expref: 22 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016132.109633:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016132.109641:0:6480:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1734016132.110274:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016102 00010000:00010000:1.0:1734016132.110852:0:6480:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271163f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016132.110883:0:6480:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271163ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6227 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016132.110893:0:6480:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271163f4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016132.110948:0:6480:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271163ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6227 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016132.110965:0:6480:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271163ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6227 expref: 20 pid: 6478 timeout: 499 lvb_type: 0 00000100:00100000:1.0:1734016132.110982:0:6480:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1818247335336704:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016132.111128:0:6480:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016132.120910:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016132.122967:0:6480:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1818247335336704:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016132.123040:0:6480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271163f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:2.0:1734016132.123382:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333829504 00000100:00100000:2.0:1734016132.123396:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333829504 00010000:00010000:2.0:1734016132.123486:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271163ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6227 expref: 21 pid: 6478 timeout: 499 lvb_type: 0 00000100:00080000:0.0:1734016132.124052:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016102 00000100:00100000:2.0:1734016132.124195:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3114 00000100:00100000:2.0:1734016132.124207:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:1981:x1818247333829504:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016132.124245:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016132.124257:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271163ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6227 expref: 21 pid: 6478 timeout: 499 lvb_type: 0 00010000:00010000:2.0:1734016132.124276:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271163ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6227 expref: 21 pid: 6478 timeout: 499 lvb_type: 0 00010000:00010000:2.0:1734016132.124319:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271163ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6227 expref: 21 pid: 6478 timeout: 499 lvb_type: 0 00010000:00010000:2.0:1734016132.124361:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016132.124369:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271163f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016132.124385:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271163f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016132.124397:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271163f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016132.124433:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016132.124524:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:1981:x1818247333829504:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 317us (3635us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016132.124532:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3114 00010000:00010000:1.0:1734016132.124608:0:6480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271163f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00010000:00010000:1.0:1734016132.124619:0:6480:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271163f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000001:00080000:1.0:1734016132.124883:0:6480:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968791 00000004:00010000:1.0:1734016132.124990:0:6480:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075876a00 reply state ffff8801309f3000 transno 4294968792 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271163f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 00000100:00100000:1.0:1734016132.125003:0:6480:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016132.125142:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c598caf-7141-4c19-8566-0b7731516db9+24:10406:x1818247333829376:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 15764us (19456us total) trans 4294968792 rc 0/0 00000100:00100000:1.0:1734016132.125154:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2290 00000020:00080000:1.0:1734016132.125162:0:6480:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016132.129068:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1734016132.129242:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271163f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016132.129258:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271163f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016132.129266:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271163f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016132.129274:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499d440 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016132.129282:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271163f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016132.129291:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271163f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016132.129321:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016132.129325:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016132.129333:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271163f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00010000:00010000:2.0:1734016132.129338:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc271163f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 00000100:00100000:3.0:1734016132.129651:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333829632 00000100:00100000:3.0:1734016132.129668:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333829632 00000100:00100000:3.0:1734016132.129778:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11187 00000100:00100000:3.0:1734016132.129792:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333829632:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.129852:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.129883:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271163fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6266 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.129939:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116345 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61da expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.129949:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016132.129953:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016132.129959:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271163fb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6266 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.130010:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116345 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61da expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.130033:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116345 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61da expref: 8 pid: 7684 timeout: 499 lvb_type: 0 00000100:00100000:3.0:1734016132.130053:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335336832:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016132.133331:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737816c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016132.140258:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.140490:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333829760 00000100:00100000:2.0:1734016132.140511:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333829760 00002000:00100000:2.0:1734016132.140651:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (2957312->2958094) req@ffff88012b15ea00 x1818247333829760/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:93/0 lens 1272/0 e 0 to 0 dl 1734016143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.140665:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15ea00 with x1818247333829760 ext(2957312->2958094) 00010000:00010000:2.0:1734016132.140694:0:7688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116345 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61da expref: 9 pid: 7684 timeout: 499 lvb_type: 0 00010000:00010000:2.0:1734016132.140718:0:7688:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116345 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61da expref: 9 pid: 7684 timeout: 499 lvb_type: 0 00002000:00010000:2.0:1734016132.140729:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b15ea00 00000100:00100000:2.0:1734016132.140784:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 284 00000100:00100000:2.0:1734016132.140795:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333829760:12345-192.168.201.16@tcp:4:fsx.0 00000100:00080000:0.0:1734016132.142491:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016102 00000100:00100000:3.0:1734016132.142696:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335336832:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016132.142757:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271163fb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6266 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.142790:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016132.142954:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247333829632:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 13162us (13910us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.142967:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11187 00000100:00100000:2.0:1734016132.144167:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333829760:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 3363us (3928us total) trans 4294969484 rc 0/0 00000100:00100000:2.0:1734016132.144182:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 284 00002000:00100000:2.0:1734016132.144201:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (2957312->2958094) req@ffff88012b15ea00 x1818247333829760/t4294969484(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:93/0 lens 1272/448 e 0 to 0 dl 1734016143 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.144211:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15ea00 with x1818247333829760 ext(2957312->2958094) 00010000:00010000:2.0:1734016132.144224:0:13914:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116345 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61da expref: 11 pid: 7684 timeout: 499 lvb_type: 0 00010000:00010000:2.0:1734016132.144242:0:13914:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116345 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61da expref: 11 pid: 7684 timeout: 499 lvb_type: 0 00002000:00010000:2.0:1734016132.144249:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b15ea00 00000100:00100000:0.0:1734016132.153560:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.153980:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333829888 00000100:00100000:3.0:1734016132.154000:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333829888 00010000:00010000:3.0:1734016132.154067:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116345 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61da expref: 11 pid: 7684 timeout: 499 lvb_type: 0 00000100:00100000:3.0:1734016132.154137:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3115 00000100:00100000:3.0:1734016132.154151:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1983:x1818247333829888:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016132.154180:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1734016132.154219:0:6465:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:3.0:1734016132.154227:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116345 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61da expref: 11 pid: 7684 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1734016132.154253:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116345 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61da expref: 11 pid: 7684 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1734016132.154301:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116345 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e61da expref: 11 pid: 7684 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1734016132.154342:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016132.154346:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016132.154355:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271163fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6266 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.154368:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271163fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6266 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.154416:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271163fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6266 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016132.154434:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e718e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335336960:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016132.154557:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737816c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016132.158228:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016132.158275:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.158315:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333830144 00000100:00100000:2.0:1734016132.158334:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333830144 00002000:00010000:2.0:1734016132.158417:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:2.0:1734016132.158424:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15d500 with x1818247333830144 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1734016132.158445:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15d500. 00000100:00100000:2.0:1734016132.158481:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333830016 00000100:00100000:2.0:1734016132.158484:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333830016 00000100:00100000:3.0:1734016132.158492:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e718e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335336960:192.168.201.16@tcp:105: 00002000:00010000:2.0:1734016132.158499:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4656153->18446744073709551615) 00002000:00100000:2.0:1734016132.158504:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15c000 with x1818247333830016 ext(4656153->18446744073709551615) 00002000:00010000:2.0:1734016132.158515:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b15c000. 00010000:00010000:3.0:1734016132.158529:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016132.158531:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8805 00000100:00100000:2.0:1734016132.158540:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333830144:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:3.0:1734016132.158598:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333829888:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4448us (5060us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.158610:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3115 00000100:00100000:3.0:1734016132.158660:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8806 00000100:00100000:3.0:1734016132.158666:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333830016:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016132.158916:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 4656153 00002000:00010000:3.0:1734016132.158921:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016132 -> 1734016132 00002000:00010000:3.0:1734016132.158922:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016132 -> 1734016131 00002000:00010000:3.0:1734016132.158924:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016132 -> 1734016132 00002000:00010000:3.0:1734016132.158927:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 6776 -> 6776 00000100:00100000:3.0:1734016132.158950:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333830016:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 282us (674us total) trans 4294968009 rc 0/0 00000100:00100000:3.0:1734016132.158957:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8806 00002000:00010000:3.0:1734016132.158960:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4656153->18446744073709551615) 00002000:00100000:3.0:1734016132.158962:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15c000 with x1818247333830016 ext(4656153->18446744073709551615) 00002000:00010000:3.0:1734016132.158965:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b15c000. 00002000:00010000:2.0:1734016132.159143:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 2958095 -> 4194304 00002000:00010000:2.0:1734016132.159147:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016132 -> 1734016132 00002000:00010000:2.0:1734016132.159151:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016132 -> 1734016132 00002000:00010000:2.0:1734016132.159153:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016132 -> 1734016132 00002000:00010000:2.0:1734016132.159155:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1734016132.159183:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333830144:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 643us (975us total) trans 4294969485 rc 0/0 00000100:00100000:2.0:1734016132.159188:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8805 00002000:00010000:2.0:1734016132.159190:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:2.0:1734016132.159192:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15d500 with x1818247333830144 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1734016132.159196:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15d500. 00000100:00100000:1.0:1734016132.163244:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3504:1818247335337344:0@lo:400:kworker.0 00000100:00100000:1.0:1734016132.163384:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016132.163433:0:3504:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1734016132.163438:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3504:1818247335337216:0@lo:400:kworker.0 00000100:00100000:1.0:1734016132.163460:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016132.163472:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335337728:0@lo:400:kworker.0 00000100:00100000:1.0:1734016132.163500:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016132.163547:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335337344 00000100:00100000:1.0:1734016132.163561:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335337344 00000100:00100000:1.0:1734016132.163631:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335337216 00000100:00100000:1.0:1734016132.163634:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335337216 00000100:00100000:1.0:1734016132.163654:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1734016132.163664:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3504:x1818247335337344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016132.163747:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3504:x1818247335337344:12345-0@lo:400:kworker.0 Request processed in 85us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016132.163757:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1734016132.163784:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1734016132.163787:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3504:x1818247335337216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016132.163838:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3504:x1818247335337216:12345-0@lo:400:kworker.0 Request processed in 49us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016132.163843:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1734016132.163897:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3504:1818247335337216:0@lo:400:kworker.0 00000100:00100000:1.0:1734016132.163907:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3504:1818247335337344:0@lo:400:kworker.0 00000100:00100000:2.0:1734016132.164012:0:3505:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335337472:0@lo:400:kworker.0 00000100:00100000:3.0:1734016132.164012:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67a75f73-9674-4938-8c12-63813a36f078:3506:1818247335337088:0@lo:400:kworker.0 00000100:00080000:0.0:1734016132.164108:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016102 00000100:00100000:0.0:1734016132.164163:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335337728 00000100:00100000:0.0:1734016132.164167:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335337728 00000100:00100000:0.0:1734016132.164222:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1734016132.164227:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335337728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1734016132.164293:0:3505:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1734016132.164336:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335337472 00000100:00100000:2.0:1734016132.164339:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335337472 00000100:00100000:3.0:1734016132.164345:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1734016132.164369:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3506:1818247335337600:0@lo:400:kworker.0 00000100:00100000:2.0:1734016132.164370:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1734016132.164373:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335337472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1734016132.164394:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1734016132.164405:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335337472:12345-0@lo:400:kworker.0 Request processed in 30us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016132.164412:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1734016132.164424:0:6474:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335337088 00000100:00100000:3.0:1734016132.164426:0:6474:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335337088 00000100:00100000:2.0:1734016132.164434:0:3505:0:(client.c:2968:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968000 gen 2 00000004:00080000:2.0:1734016132.164443:0:3505:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880075445c00, transno 4294968000 00000100:00100000:2.0:1734016132.164453:0:3505:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335337472:0@lo:400:kworker.0 00000100:00100000:3.0:1734016132.164458:0:6474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1734016132.164462:0:6474:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7610850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a75f73-9674-4938-8c12-63813a36f078+18:3506:x1818247335337088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1734016132.164501:0:6474:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7610850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a75f73-9674-4938-8c12-63813a36f078+18:3506:x1818247335337088:12345-0@lo:400:kworker.0 Request processed in 38us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.164509:0:6474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1734016132.164541:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67a75f73-9674-4938-8c12-63813a36f078:3506:1818247335337088:0@lo:400:kworker.0 00000100:00100000:0.0:1734016132.164700:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335337600 00000100:00100000:0.0:1734016132.164705:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335337600 00000100:00100000:0.0:1734016132.164727:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1734016132.164732:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3506:x1818247335337600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1734016132.164780:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3506:x1818247335337600:12345-0@lo:400:kworker.0 Request processed in 48us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016132.164785:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1734016132.164839:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335337728:12345-0@lo:400:kworker.0 Request processed in 612us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016132.164846:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:0.0:1734016132.164865:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016102 00000100:00080000:0.0:1734016132.164868:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016102 00000100:00080000:0.0:1734016132.164870:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016102 00000100:00080000:0.0:1734016132.164872:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016102 00000100:00100000:1.0:1734016132.164935:0:3504:0:(client.c:2968:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969476 gen 2 00000004:00080000:1.0:1734016132.164939:0:3504:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800756a7100, transno 4294969476 00000100:00100000:1.0:1734016132.164948:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335337728:0@lo:400:kworker.0 00000100:00100000:3.0:1734016132.165006:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3506:1818247335337600:0@lo:400:kworker.0 00000100:00100000:0.0:1734016132.168087:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.168200:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.168406:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333830528 00000100:00100000:2.0:1734016132.168430:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333830528 00002000:00100000:2.0:1734016132.168529:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (1597440->4194303) req@ffff880074939880 x1818247333830528/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 488/0 e 0 to 0 dl 1734016143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.168544:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074939880 with x1818247333830528 ext(1597440->4194303) 00002000:00010000:2.0:1734016132.168553:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074939880 00000100:00100000:2.0:1734016132.168607:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333830656 00000100:00100000:2.0:1734016132.168611:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333830656 00002000:00100000:2.0:1734016132.168638:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (4648960->4653055) req@ffff88007493b800 x1818247333830656/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 488/0 e 0 to 0 dl 1734016143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.168647:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007493b800 with x1818247333830656 ext(4648960->4653055) 00002000:00010000:2.0:1734016132.168650:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007493b800 00000100:00100000:2.0:1734016132.168674:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8807 00000100:00100000:2.0:1734016132.168695:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333830528:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016132.172010:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8808 00000100:00100000:1.0:1734016132.172040:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333830656:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016132.172462:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333830656:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 428us (4260us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016132.172472:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8808 00002000:00100000:1.0:1734016132.172483:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (4648960->4653055) req@ffff88007493b800 x1818247333830656/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 488/4536 e 0 to 0 dl 1734016143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016132.172494:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007493b800 with x1818247333830656 ext(4648960->4653055) 00002000:00010000:1.0:1734016132.172500:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007493b800 00000100:00100000:0.0:1734016132.178186:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.190317:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333830912 00000100:00100000:2.0:1734016132.190352:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333830912 00002000:00100000:2.0:1734016132.190450:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (4194304->4657151) req@ffff880074938000 x1818247333830912/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 504/0 e 0 to 0 dl 1734016143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.190465:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074938000 with x1818247333830912 ext(4194304->4657151) 00002000:00010000:2.0:1734016132.190473:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880074938000 00000100:00100000:2.0:1734016132.190518:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8809 00000100:00100000:2.0:1734016132.190530:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333830912:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016132.222584:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333830528:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 53865us (54495us total) trans 0 rc 2596864/2596864 00000100:00100000:3.0:1734016132.222611:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8807 00002000:00100000:3.0:1734016132.222638:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (1597440->4194303) req@ffff880074939880 x1818247333830528/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 488/440 e 0 to 0 dl 1734016143 ref 1 fl Complete:/200/0 rc 2596864/2596864 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016132.222652:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074939880 with x1818247333830528 ext(1597440->4194303) 00002000:00010000:3.0:1734016132.222662:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074939880 00000100:00100000:2.0:1734016132.230224:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333830912:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 39680us (52041us total) trans 0 rc 458752/458752 00000100:00100000:2.0:1734016132.230238:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8809 00002000:00100000:2.0:1734016132.230254:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (4194304->4657151) req@ffff880074938000 x1818247333830912/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 504/440 e 0 to 0 dl 1734016143 ref 1 fl Complete:/200/0 rc 458752/458752 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.230265:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074938000 with x1818247333830912 ext(4194304->4657151) 00002000:00010000:2.0:1734016132.230271:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880074938000 00000100:00100000:3.0:1734016132.234393:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335337856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1734016132.234511:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1734016132.236220:0:7685:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335337856 00000100:00100000:2.0:1734016132.236239:0:7685:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335337856 00000100:00100000:2.0:1734016132.236326:0:7685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1734016132.236338:0:7685:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335337856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1734016132.236385:0:7685:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 980070976 pending 28672 free 3923075072 avail 3691552768 00000100:00100000:2.0:1734016132.236467:0:7685:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335337856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (1957us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016132.236475:0:7685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1734016132.236705:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335337856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1734016132.238428:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.238657:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333831040 00000100:00100000:2.0:1734016132.238676:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333831040 00002000:00100000:2.0:1734016132.238914:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (2359296->4656152) req@ffff880074938700 x1818247333831040/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 504/0 e 0 to 0 dl 1734016143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.238927:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074938700 with x1818247333831040 ext(2359296->4656152) 00002000:00010000:2.0:1734016132.238935:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880074938700 00000100:00100000:2.0:1734016132.238982:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8810 00000100:00100000:2.0:1734016132.238990:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333831040:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016132.244216:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247333831040:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 5192us (5777us total) trans 4294968010 rc 0/0 00000100:00100000:2.0:1734016132.244245:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8810 00002000:00100000:2.0:1734016132.244275:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (2359296->4656152) req@ffff880074938700 x1818247333831040/t4294968010(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 504/448 e 0 to 0 dl 1734016143 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.244290:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074938700 with x1818247333831040 ext(2359296->4656152) 00002000:00010000:2.0:1734016132.244300:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880074938700 00000100:00100000:0.0:1734016132.247562:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.247758:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333831168 00000100:00100000:2.0:1734016132.247778:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333831168 00000100:00100000:2.0:1734016132.248098:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2291 00000100:00100000:2.0:1734016132.248109:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+23:10406:x1818247333831168:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:2.0:1734016132.248360:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+23:10406:x1818247333831168:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 253us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016132.248370:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2291 00000100:00100000:2.0:1734016132.251591:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.251708:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333831296 00000100:00100000:0.0:1734016132.251723:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333831296 00000100:00100000:0.0:1734016132.251797:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11188 00000100:00100000:0.0:1734016132.251836:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333831296:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016132.253485:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968010 is committed 00000001:00080000:0.0:1734016132.253522:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968008 is committed 00000100:00100000:2.0:1734016132.254047:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333831296:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2200us (2462us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016132.254068:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11188 00000100:00100000:0.0:1734016132.258173:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.258320:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333831424 00000100:00100000:2.0:1734016132.258335:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333831424 00000100:00100000:2.0:1734016132.258558:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2292 00000100:00100000:2.0:1734016132.258570:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:10406:x1818247333831424:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.258612:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.258648:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116402 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e626d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.259092:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116409 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.259110:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.259123:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016132.259162:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 8850457 00000004:00200000:2.0:1734016132.259168:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016132.259187:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.259217:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116402 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e626d expref: 22 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.259239:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116409 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e626d expref: 21 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.259250:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016132.259254:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016132.259257:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016132.259899:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:10406:x1818247333831424:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1327us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016132.259908:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2292 00000100:00100000:0.0:1734016132.264246:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.264472:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333831552 00000100:00100000:2.0:1734016132.264482:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333831552 00000100:00100000:2.0:1734016132.264540:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11189 00000100:00100000:2.0:1734016132.264548:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090249050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333831552:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.264570:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.264591:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116410 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6274 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.264660:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335337984:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.264747:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706c00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016132.266055:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.266188:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333831680 00000100:00100000:2.0:1734016132.266195:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333831680 00000100:00100000:2.0:1734016132.266250:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11190 00000100:00100000:2.0:1734016132.266258:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333831680:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.266274:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.266293:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116417 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e627b expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.266350:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335338112:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.266404:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00002000:00010000:2.0:1734016132.268881:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016131 -> 1734016132 00002000:00010000:2.0:1734016132.268900:0:7683:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks: 6776 -> 6792 00000100:00100000:2.0:1734016132.268934:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335337984:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.268993:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116410 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6274 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.269016:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116410 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6274 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.269397:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016132.269476:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090249050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333831552:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4925us (5249us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.269494:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11189 00000100:00100000:3.0:1734016132.270421:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335338112:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016132.270461:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116417 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e627b expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.270472:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116417 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e627b expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.270491:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:3.0:1734016132.270530:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333831680:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4273us (4486us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016132.270537:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11190 00000100:00100000:2.0:1734016132.273955:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.274370:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.274451:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333831808 00000100:00100000:0.0:1734016132.274468:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333831808 00000100:00100000:0.0:1734016132.274527:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333831936 00000100:00100000:0.0:1734016132.274528:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333831936 00000100:00100000:0.0:1734016132.275244:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11191 00000100:00100000:0.0:1734016132.275256:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333831808:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016132.275283:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016132.275311:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7581d40/0x5e3a3adc2711641e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6282 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016132.275388:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335338240:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016132.275466:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.275548:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11192 00000100:00100000:2.0:1734016132.275556:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333831936:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.275565:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.275578:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116425 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6289 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.275612:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335338368:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.275634:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706c00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.278764:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335338240:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.278878:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581d40/0x5e3a3adc2711641e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6282 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.278899:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581d40/0x5e3a3adc2711641e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6282 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.278925:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581d40, rc 0) 00000100:00100000:2.0:1734016132.278998:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333831808:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3741us (5070us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.279012:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11191 00000100:00100000:3.0:1734016132.279659:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335338368:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016132.279700:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116425 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6289 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.279712:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116425 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6289 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.279732:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:3.0:1734016132.279776:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333831936:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4220us (5405us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016132.279783:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11192 00000100:00100000:0.0:1734016132.282488:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.282620:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333832192 00000100:00100000:2.0:1734016132.282631:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333832192 00000100:00100000:2.0:1734016132.282691:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2293 00000100:00100000:2.0:1734016132.282699:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+23:10406:x1818247333832192:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016132.283365:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711642c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.283382:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116409 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e626d expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.283389:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711642c lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.283425:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116409 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e626d expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.283440:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116409 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e626d expref: 20 pid: 6478 timeout: 499 lvb_type: 0 00000100:00100000:2.0:1734016132.283454:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335338496:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016132.284294:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706900 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.288317:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335338496:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016132.288360:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711642c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016132.288949:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.289098:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333832320 00000100:00100000:3.0:1734016132.289111:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333832320 00010000:00010000:3.0:1734016132.289166:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116409 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e626d expref: 21 pid: 6478 timeout: 499 lvb_type: 0 00000100:00100000:3.0:1734016132.289220:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3116 00000100:00100000:3.0:1734016132.289232:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:1982:x1818247333832320:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016132.289261:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016132.289270:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116409 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e626d expref: 21 pid: 6478 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1734016132.289287:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116409 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e626d expref: 21 pid: 6478 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1734016132.289328:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116409 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e626d expref: 21 pid: 6478 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1734016132.289361:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016132.289367:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711642c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.289383:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711642c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.289393:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711642c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.289426:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016132.289513:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:1982:x1818247333832320:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 280us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.289521:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3116 00010000:00010000:3.0:1734016132.289573:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711642c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.289581:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711642c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:3.0:1734016132.289737:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968793 00000004:00010000:3.0:1734016132.289831:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880074939f80 reply state ffff880075600000 transno 4294968794 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711642c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016132.289841:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016132.289927:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+26:10406:x1818247333832192:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 7227us (7451us total) trans 4294968794 rc 0/0 00000100:00100000:3.0:1734016132.289933:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2293 00000020:00080000:3.0:1734016132.289937:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1734016132.293492:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016132.293567:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1734016132.293654:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711642c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.293668:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711642c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.293677:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711642c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.293698:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbdf80 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016132.293705:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711642c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.293718:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711642c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.293746:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016132.293750:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016132.293754:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711642c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.293759:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711642c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016132.294052:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333832448 00000100:00100000:3.0:1734016132.294066:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333832448 00002000:00010000:3.0:1734016132.294125:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (5244325->18446744073709551615) 00002000:00100000:3.0:1734016132.294131:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cfb80 with x1818247333832448 ext(5244325->18446744073709551615) 00002000:00010000:3.0:1734016132.294146:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a78cfb80. 00000100:00100000:3.0:1734016132.294175:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333832576 00000100:00100000:3.0:1734016132.294177:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333832576 00002000:00010000:3.0:1734016132.294193:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:3.0:1734016132.294195:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cf800 with x1818247333832576 ext(4194304->18446744073709551615) 00002000:00010000:3.0:1734016132.294204:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cf800. 00000100:00100000:3.0:1734016132.295307:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8811 00000100:00100000:3.0:1734016132.295319:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333832448:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016132.295644:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4656153 -> 5244325 00002000:00010000:3.0:1734016132.295648:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016132 -> 1734016132 00002000:00010000:3.0:1734016132.295651:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016132 -> 1734016132 00002000:00010000:3.0:1734016132.295653:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016132 -> 1734016132 00002000:00010000:3.0:1734016132.295655:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 6792 -> 6792 00000100:00100000:2.0:1734016132.295792:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8812 00000100:00100000:2.0:1734016132.295812:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333832576:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016132.295926:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1734016132.295931:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016132 -> 1734016132 00002000:00010000:2.0:1734016132.295932:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016132 -> 1734016132 00002000:00010000:2.0:1734016132.295934:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016132 -> 1734016132 00002000:00010000:2.0:1734016132.295936:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1734016132.296245:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333832448:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 925us (2777us total) trans 4294968011 rc 0/0 00000100:00100000:3.0:1734016132.296254:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8811 00002000:00010000:3.0:1734016132.296259:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (5244325->18446744073709551615) 00002000:00100000:3.0:1734016132.296263:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cfb80 with x1818247333832448 ext(5244325->18446744073709551615) 00002000:00010000:3.0:1734016132.296272:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a78cfb80. 00000100:00100000:2.0:1734016132.296357:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333832576:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 556us (2788us total) trans 4294969486 rc 0/0 00000100:00100000:2.0:1734016132.296364:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8812 00002000:00010000:2.0:1734016132.296367:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:2.0:1734016132.296369:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cf800 with x1818247333832576 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1734016132.296374:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a78cf800. 00000100:00100000:0.0:1734016132.300195:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.300351:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333832832 00000100:00100000:2.0:1734016132.300365:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333832832 00002000:00100000:2.0:1734016132.300450:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (4657152->5246975) req@ffff88007493a680 x1818247333832832/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 488/0 e 0 to 0 dl 1734016143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.300463:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007493a680 with x1818247333832832 ext(4657152->5246975) 00002000:00010000:2.0:1734016132.300470:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007493a680 00000100:00100000:2.0:1734016132.300978:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8813 00000100:00100000:2.0:1734016132.300988:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333832832:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016132.311199:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333832832:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 10199us (11015us total) trans 0 rc 589824/589824 00000100:00100000:2.0:1734016132.311214:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8813 00002000:00100000:2.0:1734016132.311229:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (4657152->5246975) req@ffff88007493a680 x1818247333832832/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 488/440 e 0 to 0 dl 1734016143 ref 1 fl Complete:/200/0 rc 589824/589824 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.311238:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007493a680 with x1818247333832832 ext(4657152->5246975) 00002000:00010000:2.0:1734016132.311243:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007493a680 00000100:00100000:1.0:1734016132.315314:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.315490:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333832960 00000100:00100000:2.0:1734016132.315504:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333832960 00002000:00100000:2.0:1734016132.315572:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (5242880->5244324) req@ffff8800a78cc000 x1818247333832960/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 1936/0 e 0 to 0 dl 1734016143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.315585:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cc000 with x1818247333832960 ext(5242880->5244324) 00002000:00010000:2.0:1734016132.315593:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a78cc000 00000100:00100000:2.0:1734016132.316606:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8814 00000100:00100000:2.0:1734016132.316619:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333832960:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016132.318825:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333832960:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 2180us (3502us total) trans 4294968012 rc 0/0 00000100:00100000:2.0:1734016132.318843:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8814 00002000:00100000:2.0:1734016132.318864:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (5242880->5244324) req@ffff8800a78cc000 x1818247333832960/t4294968012(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 1936/448 e 0 to 0 dl 1734016143 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.318875:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cc000 with x1818247333832960 ext(5242880->5244324) 00002000:00010000:2.0:1734016132.318883:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a78cc000 00000100:00100000:0.0:1734016132.326002:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.326270:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333833088 00000100:00100000:3.0:1734016132.326285:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333833088 00000100:00100000:3.0:1734016132.326358:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2294 00000100:00100000:3.0:1734016132.326367:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+25:10406:x1818247333833088:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:3.0:1734016132.326578:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+25:10406:x1818247333833088:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 212us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.326587:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2294 00000100:00100000:1.0:1734016132.331901:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.332053:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333833216 00000100:00100000:3.0:1734016132.332072:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333833216 00000100:00100000:3.0:1734016132.332182:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11193 00000100:00100000:3.0:1734016132.332192:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333833216:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016132.335932:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968012 is committed 00000100:00100000:3.0:1734016132.336785:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333833216:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 4583us (4896us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.336834:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11193 00000100:00100000:1.0:1734016132.344025:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.344093:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333833344 00000100:00100000:0.0:1734016132.344109:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333833344 00000100:00100000:0.0:1734016132.344167:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2295 00000100:00100000:0.0:1734016132.344175:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+25:10406:x1818247333833344:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016132.344207:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016132.344236:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27116433 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6290 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016132.344409:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc2711643a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016132.344428:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc2711643a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016132.344441:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc2711643a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:0.0:1734016132.344472:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 9438629 00000004:00200000:0.0:1734016132.344477:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016132.344497:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc2711643a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016132.344529:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc27116433 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6290 expref: 27 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016132.344558:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc2711643a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6290 expref: 26 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016132.344566:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:0.0:1734016132.344569:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016132.344573:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:0.0:1734016132.344635:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+26:10406:x1818247333833344:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 461us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016132.344646:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2295 00000100:00100000:1.0:1734016132.358949:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.359201:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333833472 00000100:00100000:3.0:1734016132.359214:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333833472 00000100:00100000:3.0:1734016132.359436:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2296 00000100:00100000:3.0:1734016132.359447:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:10406:x1818247333833472:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.359480:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.359521:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116441 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6297 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.359666:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116448 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.359692:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.359704:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016132.359737:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 9438629 00000004:00200000:3.0:1734016132.359742:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016132.359761:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.359784:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116441 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6297 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.359849:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116448 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6297 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.359860:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016132.359863:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016132.359868:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016132.359934:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:10406:x1818247333833472:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 490us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.359944:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2296 00000100:00100000:0.0:1734016132.368968:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.369059:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.369202:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333833600 00000100:00100000:3.0:1734016132.369217:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333833600 00000100:00100000:3.0:1734016132.369289:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333833728 00000100:00100000:3.0:1734016132.369291:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333833728 00000100:00100000:3.0:1734016132.369325:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11194 00000100:00100000:3.0:1734016132.369337:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333833600:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.369377:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.369413:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc2711644f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e629e expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016132.369518:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335338624:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.369697:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11195 00000100:00100000:2.0:1734016132.369704:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333833728:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.369715:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.369730:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116456 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e62a5 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.369772:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335338752:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016132.371198:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.371276:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706900 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.378073:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335338752:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.378145:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116456 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62a5 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.378167:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116456 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62a5 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.378190:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016132.378262:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333833728:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8554us (9199us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.378275:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11195 00002000:00010000:3.0:1734016132.379086:0:7682:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks: 6792 -> 6800 00000100:00100000:3.0:1734016132.379107:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335338624:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016132.379138:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc2711644f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e629e expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.379149:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc2711644f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e629e expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.379164:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016132.379192:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333833600:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9857us (10250us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016132.379198:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11194 00000100:00100000:0.0:1734016132.383084:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.383151:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.384170:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333833856 00000100:00100000:3.0:1734016132.384189:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333833856 00000100:00100000:3.0:1734016132.384258:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333833984 00000100:00100000:3.0:1734016132.384261:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333833984 00000100:00100000:3.0:1734016132.386419:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11196 00000100:00100000:3.0:1734016132.386435:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333833856:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.386468:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.386509:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc2711645d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e62ac expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016132.386599:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335338880:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016132.386748:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.386904:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11197 00000100:00100000:2.0:1734016132.386917:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333833984:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.386932:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.386949:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27116464 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e62b3 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.386993:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335339008:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.387019:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016132.394207:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335338880:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016132.394279:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc2711645d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62ac expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.394304:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc2711645d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62ac expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.394327:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016132.394411:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333833856:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7977us (11343us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016132.394428:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11196 00000100:00100000:2.0:1734016132.395724:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335339008:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.395765:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27116464 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62b3 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.395779:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27116464 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62b3 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.395858:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016132.395910:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333833984:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8995us (12757us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.395919:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11197 00000100:00100000:0.0:1734016132.405973:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.406042:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.406094:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333834112 00000100:00100000:0.0:1734016132.406106:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333834112 00000100:00100000:0.0:1734016132.406165:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333834240 00000100:00100000:0.0:1734016132.406167:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333834240 00000100:00100000:0.0:1734016132.406190:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11198 00000100:00100000:0.0:1734016132.406199:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333834112:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016132.406233:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016132.406268:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7581440/0x5e3a3adc2711646b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e62ba expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016132.406356:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335339136:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016132.406434:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016132.406458:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11199 00000100:00100000:0.0:1734016132.406462:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333834240:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016132.406473:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016132.406486:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27116472 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e62c1 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016132.406514:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335339264:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016132.406539:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00002000:00010000:2.0:1734016132.411878:0:7682:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime: 1734016132 -> 1734016133 00002000:00010000:2.0:1734016132.411894:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016132 -> 1734016133 00000100:00100000:2.0:1734016132.411937:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335339136:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.411999:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581440/0x5e3a3adc2711646b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62ba expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.412027:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581440/0x5e3a3adc2711646b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62ba expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.412045:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:2.0:1734016132.412133:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333834112:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5934us (6175us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.412147:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11198 00002000:00010000:1.0:1734016132.413779:0:7684:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016132 -> 1734016133 00002000:00010000:1.0:1734016132.413788:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016132 -> 1734016133 00000100:00100000:1.0:1734016132.413826:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335339264:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016132.413884:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27116472 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62c1 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016132.413906:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc27116472 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62c1 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016132.413954:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00000100:00100000:1.0:1734016132.414043:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333834240:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7577us (7999us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016132.414056:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11199 00000100:00100000:2.0:1734016132.419109:0:3505:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335339392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1734016132.419215:0:3505:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016132.419315:0:7686:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335339392 00000100:00100000:1.0:1734016132.419328:0:7686:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335339392 00000100:00100000:1.0:1734016132.419379:0:7686:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1734016132.419389:0:7686:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335339392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1734016132.419430:0:7686:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 28672 granted 511251008 pending 0 free 3920207872 avail 3688591360 00000100:00100000:1.0:1734016132.419490:0:7686:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335339392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016132.419497:0:7686:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1734016132.420381:0:3505:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335339392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1734016132.422299:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.422415:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016132.422632:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333834368 00000100:00100000:1.0:1734016132.422649:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333834368 00000100:00100000:1.0:1734016132.422726:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333834496 00000100:00100000:1.0:1734016132.422728:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333834496 00000100:00100000:1.0:1734016132.422755:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11200 00000100:00100000:1.0:1734016132.422767:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333834368:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016132.422796:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016132.422869:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc27116479 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e62c8 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016132.422955:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335339520:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016132.423034:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016132.423125:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11201 00000100:00100000:3.0:1734016132.423133:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333834496:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.423149:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.423164:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116480 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e62cf expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016132.423201:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335339648:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016132.423228:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781a80 going to sleep for 11 seconds 00000100:00100000:1.0:1734016132.428845:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335339520:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016132.428899:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc27116479 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62c8 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016132.428918:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc27116479 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62c8 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016132.428937:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016132.428989:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333834368:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6224us (6703us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016132.428998:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11200 00000100:00100000:3.0:1734016132.429102:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335339648:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016132.429125:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116480 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62cf expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.429134:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116480 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62cf expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.429147:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016132.429166:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333834496:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6034us (6751us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016132.429172:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11201 00000100:00100000:0.0:1734016132.434752:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.436566:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333834752 00000100:00100000:2.0:1734016132.436585:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333834752 00000100:00100000:2.0:1734016132.436668:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2297 00000100:00100000:2.0:1734016132.436685:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+26:10406:x1818247333834752:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016132.436760:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016132.436828:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc2711643a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6290 expref: 26 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.436861:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016132.436866:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016132.437125:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116487 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016132.437149:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116448 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6297 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.437162:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116487 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016132.437215:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116448 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6297 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.437232:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116448 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6297 expref: 20 pid: 6478 timeout: 499 lvb_type: 0 00000100:00100000:2.0:1734016132.437244:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335339776:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016132.437350:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016132.442196:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.442321:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335339776:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016132.442360:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116487 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:3.0:1734016132.443481:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333834880 00000100:00100000:3.0:1734016132.443493:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333834880 00010000:00010000:3.0:1734016132.443539:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116448 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6297 expref: 21 pid: 6478 timeout: 499 lvb_type: 0 00000100:00100000:3.0:1734016132.443623:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3117 00000100:00100000:3.0:1734016132.443632:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:1982:x1818247333834880:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016132.443653:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016132.443660:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116448 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6297 expref: 21 pid: 6478 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1734016132.443673:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116448 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6297 expref: 21 pid: 6478 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1734016132.443709:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116448 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6297 expref: 21 pid: 6478 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1734016132.443938:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016132.443944:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116487 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016132.443954:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016132.443962:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116487 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016132.444089:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016132.444185:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016132.444192:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:0.0:1734016132.444300:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968795 00000004:00010000:0.0:1734016132.444357:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007bd28e00 reply state ffff880075601000 transno 4294968796 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016132.444364:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016132.444453:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:1982:x1818247333834880:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 820us (2270us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.444461:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3117 00000100:00100000:0.0:1734016132.444827:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+28:10406:x1818247333834752:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 8151us (10092us total) trans 4294968796 rc 0/0 00000100:00100000:0.0:1734016132.444832:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2297 00000020:00080000:0.0:1734016132.444835:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016132.454048:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.454128:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1734016132.454531:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016132.454546:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116487 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016132.454554:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116487 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016132.454562:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc900 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016132.454567:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116487 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016132.454574:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116487 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016132.454595:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016132.454598:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016132.454603:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116487 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016132.454609:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116487 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:2.0:1734016132.454690:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333835008 00000100:00100000:2.0:1734016132.454701:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333835008 00002000:00010000:2.0:1734016132.454755:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (6164132->18446744073709551615) 00002000:00100000:2.0:1734016132.454759:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd29880 with x1818247333835008 ext(6164132->18446744073709551615) 00002000:00010000:2.0:1734016132.454778:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007bd29880. 00000100:00100000:2.0:1734016132.454797:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333835136 00000100:00100000:2.0:1734016132.454828:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333835136 00002000:00010000:2.0:1734016132.454839:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:2.0:1734016132.454842:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749aea00 with x1818247333835136 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1734016132.454851:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749aea00. 00000100:00100000:2.0:1734016132.454867:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8815 00000100:00100000:2.0:1734016132.454875:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333835008:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016132.455182:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5244325 -> 6164132 00002000:00010000:2.0:1734016132.455187:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016133 -> 1734016133 00002000:00010000:2.0:1734016132.455189:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016132 -> 1734016132 00002000:00010000:2.0:1734016132.455190:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016133 -> 1734016133 00002000:00010000:2.0:1734016132.455192:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 6800 -> 6800 00000100:00100000:2.0:1734016132.455252:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333835008:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 376us (1223us total) trans 4294968013 rc 0/0 00000100:00100000:2.0:1734016132.455261:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8815 00002000:00010000:2.0:1734016132.455264:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (6164132->18446744073709551615) 00002000:00100000:2.0:1734016132.455267:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd29880 with x1818247333835008 ext(6164132->18446744073709551615) 00002000:00010000:2.0:1734016132.455270:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007bd29880. 00000100:00100000:2.0:1734016132.455285:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8816 00000100:00100000:2.0:1734016132.455289:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333835136:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016132.455365:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1734016132.455367:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016133 -> 1734016133 00002000:00010000:2.0:1734016132.455369:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016132 -> 1734016132 00002000:00010000:2.0:1734016132.455371:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016133 -> 1734016133 00002000:00010000:2.0:1734016132.455373:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1734016132.455389:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333835136:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 99us (1261us total) trans 4294969487 rc 0/0 00000100:00100000:2.0:1734016132.455394:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8816 00002000:00010000:2.0:1734016132.455397:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:2.0:1734016132.455399:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749aea00 with x1818247333835136 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1734016132.455402:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749aea00. 00000100:00100000:0.0:1734016132.458248:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016132.458330:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333835264 00000100:00100000:1.0:1734016132.458339:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333835264 00000100:00100000:1.0:1734016132.458398:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2298 00000100:00100000:1.0:1734016132.458405:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+27:10406:x1818247333835264:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016132.458442:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016132.458464:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc2711648e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e62d6 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016132.458565:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27116495 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016132.458582:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27116495 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016132.458593:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27116495 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:1.0:1734016132.458621:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 10358436 00000004:00200000:1.0:1734016132.458626:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016132.458647:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27116495 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016132.458669:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc2711648e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62d6 expref: 29 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016132.458701:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27116495 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62d6 expref: 28 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016132.458710:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016132.458714:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016132.458718:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016132.458767:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+28:10406:x1818247333835264:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 363us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016132.458775:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2298 00000100:00100000:0.0:1734016132.461942:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.462051:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333835392 00000100:00100000:3.0:1734016132.462065:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333835392 00000100:00100000:3.0:1734016132.462128:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2299 00000100:00100000:3.0:1734016132.462136:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:10406:x1818247333835392:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.462169:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.462201:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711649c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e62dd expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.462341:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271164a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.462361:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271164a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.462375:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271164a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016132.462402:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 10358436 00000004:00200000:3.0:1734016132.462407:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016132.462427:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271164a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.462453:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711649c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62dd expref: 22 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.462497:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271164a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62dd expref: 21 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.462505:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016132.462508:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016132.462512:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016132.462596:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:10406:x1818247333835392:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 460us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.462605:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2299 00000100:00100000:0.0:1734016132.471774:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.472083:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333835648 00000100:00100000:3.0:1734016132.472107:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333835648 00000100:00100000:1.0:1734016132.472437:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.473152:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333835520 00000100:00100000:3.0:1734016132.473159:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333835520 00000100:00100000:3.0:1734016132.473225:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11202 00000100:00100000:3.0:1734016132.473237:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333835648:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.473272:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.473306:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271164aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e62eb expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016132.473401:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335339904:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016132.473495:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781a80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016132.473585:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11203 00000100:00100000:0.0:1734016132.473594:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333835520:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016132.473606:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016132.473623:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7581440/0x5e3a3adc271164b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e62e4 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016132.473665:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335340032:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016132.473714:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016132.480504:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335340032:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016132.480585:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581440/0x5e3a3adc271164b1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62e4 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016132.480611:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581440/0x5e3a3adc271164b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62e4 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016132.480645:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:1.0:1734016132.480770:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333835520:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7172us (8331us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016132.480786:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11203 00000100:00100000:3.0:1734016132.481456:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335339904:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016132.481500:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271164aa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62eb expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.481518:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271164aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62eb expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.481561:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016132.481600:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333835648:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8367us (9852us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016132.481609:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11202 00000100:00100000:0.0:1734016132.485277:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.485351:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.485486:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333835904 00000100:00100000:3.0:1734016132.485500:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333835904 00000100:00100000:3.0:1734016132.485588:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333835776 00000100:00100000:3.0:1734016132.485591:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333835776 00000100:00100000:3.0:1734016132.485618:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11204 00000100:00100000:3.0:1734016132.485631:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333835904:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.485666:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.485708:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271164b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e62f9 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016132.485847:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335340160:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016132.486038:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.486125:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11205 00000100:00100000:2.0:1734016132.486132:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333835776:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.486143:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.486161:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc271164bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e62f2 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.486202:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335340288:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.486232:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016132.490601:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335340160:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016132.490661:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271164b8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62f9 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.490686:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271164b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62f9 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1734016132.490818:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335340288:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.490843:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc271164bf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62f2 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.490858:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc271164bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62f2 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.491028:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016132.491135:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333835776:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4999us (5779us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.491146:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11205 00010000:00010000:3.0:1734016132.491982:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016132.492015:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333835904:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6387us (6760us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016132.492021:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11204 00000100:00100000:1.0:1734016132.499900:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016132.499970:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.500089:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333836160 00000100:00100000:2.0:1734016132.500106:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333836160 00000100:00100000:2.0:1734016132.500159:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333836032 00000100:00100000:2.0:1734016132.500161:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333836032 00000100:00100000:2.0:1734016132.500182:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11206 00000100:00100000:2.0:1734016132.500191:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333836160:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.500221:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.500246:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271164c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6307 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.500345:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335340416:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.500442:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016132.501640:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11207 00000100:00100000:1.0:1734016132.501649:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333836032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016132.501669:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016132.501701:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc271164cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6300 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016132.501758:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e607b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335340544:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016132.501857:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.503691:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335340416:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.503734:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271164c6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6307 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.503749:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271164c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6307 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.503770:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016132.505144:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333836160:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4940us (5250us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.505162:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11206 00000100:00100000:2.0:1734016132.505872:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e607b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335340544:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.505916:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc271164cd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6300 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.505935:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc271164cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6300 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.505950:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:2.0:1734016132.506000:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333836032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4351us (6028us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.506008:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11207 00000100:00100000:0.0:1734016132.508934:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.509115:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333836288 00000100:00100000:3.0:1734016132.509128:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333836288 00000100:00100000:3.0:1734016132.509214:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11208 00000100:00100000:3.0:1734016132.509223:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:10406:x1818247333836288:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.509258:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.509293:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271164d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e630e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.509342:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271163fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6266 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.509353:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016132.509357:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016132.509361:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271164d4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [1773568->1777663] (req 1773568->1777663) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e630e expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.509408:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271163fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6266 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.509425:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271163fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6266 expref: 11 pid: 7682 timeout: 499 lvb_type: 0 00000100:00100000:3.0:1734016132.509450:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335340672:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016132.509549:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781a80 going to sleep for 11 seconds 00000100:00100000:3.0:1734016132.514733:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335340672:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016132.514783:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271164d4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [1773568->1777663] (req 1773568->1777663) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e630e expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.515333:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016132.515423:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:10406:x1818247333836288:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6195us (6502us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.515440:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11208 00000100:00100000:0.0:1734016132.515899:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.516181:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333836416 00000100:00100000:2.0:1734016132.516193:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333836416 00002000:00100000:2.0:1734016132.516249:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (1998848->2007039) req@ffff8800749ad500 x1818247333836416/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 8680/0 e 0 to 0 dl 1734016143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.516259:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad500 with x1818247333836416 ext(1998848->2007039) 00010000:00010000:2.0:1734016132.516269:0:7689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271163fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6266 expref: 12 pid: 7682 timeout: 499 lvb_type: 0 00010000:00010000:2.0:1734016132.516283:0:7689:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271163fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6266 expref: 12 pid: 7682 timeout: 499 lvb_type: 0 00002000:00010000:2.0:1734016132.516291:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800749ad500 00000100:00100000:2.0:1734016132.516320:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 285 00000100:00100000:2.0:1734016132.516328:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333836416:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016132.520385:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247333836416:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4032us (4463us total) trans 4294969488 rc 0/0 00000100:00100000:2.0:1734016132.520407:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 285 00002000:00100000:2.0:1734016132.520428:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (1998848->2007039) req@ffff8800749ad500 x1818247333836416/t4294969488(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 8680/448 e 0 to 0 dl 1734016143 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.520439:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad500 with x1818247333836416 ext(1998848->2007039) 00010000:00010000:2.0:1734016132.520454:0:7689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271163fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6266 expref: 14 pid: 7682 timeout: 499 lvb_type: 0 00010000:00010000:2.0:1734016132.520482:0:7689:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271163fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6266 expref: 14 pid: 7682 timeout: 499 lvb_type: 0 00002000:00010000:2.0:1734016132.520489:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800749ad500 00000100:00100000:0.0:1734016132.526949:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.527585:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333836544 00000100:00100000:3.0:1734016132.527600:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333836544 00010000:00010000:3.0:1734016132.527657:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271163fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6266 expref: 14 pid: 7682 timeout: 499 lvb_type: 0 00000100:00100000:3.0:1734016132.528032:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3118 00000100:00100000:3.0:1734016132.528043:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+14:1984:x1818247333836544:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016132.528070:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1734016132.528095:0:7698:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 8 -> 24 00010000:00010000:3.0:1734016132.528101:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271163fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6266 expref: 14 pid: 7682 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1734016132.528114:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271163fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6266 expref: 14 pid: 7682 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1734016132.528146:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271163fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6266 expref: 14 pid: 7682 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1734016132.528424:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016132.528427:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016132.528437:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271164d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1777663) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e630e expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.528449:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271164d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1777663) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e630e expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.528496:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271164d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1777663) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e630e expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016132.528510:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335340800:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016132.528604:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781a80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016132.533608:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.533690:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333836672 00000100:00100000:0.0:1734016132.533708:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333836672 00000100:00100000:3.0:1734016132.534083:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335340800:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016132.534121:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016132.534183:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247333836544:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6139us (7403us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.534196:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3118 00000100:00100000:0.0:1734016132.535915:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11209 00000100:00100000:0.0:1734016132.535929:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333836672:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016132.536249:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1734016132.536252:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016133 -> 1734016133 00002000:00010000:0.0:1734016132.536254:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016132 -> 1734016132 00002000:00010000:0.0:1734016132.536256:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016133 -> 1734016132 00002000:00010000:0.0:1734016132.536258:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 24 -> 32 00000100:00100000:0.0:1734016132.536333:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247333836672:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 406us (2747us total) trans 4294969489 rc 0/0 00000100:00100000:0.0:1734016132.536342:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11209 00000100:00100000:0.0:1734016132.541651:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.541790:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333836800 00000100:00100000:2.0:1734016132.541849:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333836800 00000100:00100000:2.0:1734016132.541913:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11210 00000100:00100000:2.0:1734016132.541922:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333836800:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.541951:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.541984:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271164db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6315 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.542079:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335340928:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.542763:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00002000:00010000:2.0:1734016132.545476:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016132 -> 1734016133 00000100:00100000:2.0:1734016132.545517:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335340928:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.545567:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271164db lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6315 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.545582:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271164db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6315 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.545601:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016132.545946:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333836800:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4024us (4309us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.545957:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11210 00000100:00100000:0.0:1734016132.549601:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.549841:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333836928 00000100:00100000:2.0:1734016132.549855:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333836928 00000100:00100000:2.0:1734016132.549906:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11211 00000100:00100000:2.0:1734016132.549916:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333836928:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.549942:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.549967:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271164e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e631c expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.550032:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335341056:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.550118:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.553487:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335341056:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.553563:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271164e2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e631c expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.553586:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271164e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e631c expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.553610:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016132.554387:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333836928:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4467us (4794us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.554402:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11211 00000100:00100000:0.0:1734016132.557989:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.558169:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333837056 00000100:00100000:2.0:1734016132.558179:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333837056 00000100:00100000:2.0:1734016132.558230:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11212 00000100:00100000:2.0:1734016132.558239:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333837056:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.558267:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.558292:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271164e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6323 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.558369:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335341184:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.558616:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.560951:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335341184:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.561017:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271164e9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6323 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.561036:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271164e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6323 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.561059:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016132.561149:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333837056:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2908us (3174us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.561160:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11212 00000100:00100000:2.0:1734016132.565388:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.565471:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333837184 00000100:00100000:0.0:1734016132.565488:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333837184 00000100:00100000:0.0:1734016132.565563:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11213 00000100:00100000:0.0:1734016132.565573:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333837184:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016132.566041:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 6164132 -> 6164132 00002000:00010000:0.0:1734016132.566046:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016133 -> 1734016133 00002000:00010000:0.0:1734016132.566049:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016132 -> 1734016132 00002000:00010000:0.0:1734016132.566051:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016133 -> 1734016132 00002000:00010000:0.0:1734016132.566053:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 6800 -> 6808 00000100:00100000:0.0:1734016132.566148:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333837184:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 574us (777us total) trans 4294968014 rc 0/0 00000100:00100000:0.0:1734016132.566161:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11213 00000100:00100000:1.0:1734016132.569284:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.569753:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333837312 00000100:00100000:2.0:1734016132.569763:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333837312 00000100:00100000:2.0:1734016132.569865:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11214 00000100:00100000:2.0:1734016132.569873:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333837312:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.569895:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.569917:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc271164f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e632a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.569979:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335341312:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.570056:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00002000:00010000:2.0:1734016132.574163:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016132 -> 1734016133 00000100:00100000:2.0:1734016132.574217:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335341312:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.574287:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc271164f0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e632a expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.574310:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc271164f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e632a expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.574331:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016132.574412:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333837312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4536us (5143us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.574426:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11214 00000100:00100000:0.0:1734016132.577867:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.578103:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333837440 00000100:00100000:2.0:1734016132.578118:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333837440 00000100:00100000:2.0:1734016132.578178:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11215 00000100:00100000:2.0:1734016132.578189:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333837440:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.578225:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.578254:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271164f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6331 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.578341:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335341440:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.578428:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.581785:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335341440:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.581917:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271164f7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6331 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.581937:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271164f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6331 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.582313:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:3.0:1734016132.582530:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333837440:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4339us (4735us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016132.582543:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11215 00000100:00100000:0.0:1734016132.584986:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.585352:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333837568 00000100:00100000:3.0:1734016132.585363:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333837568 00000100:00100000:3.0:1734016132.585487:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11216 00000100:00100000:3.0:1734016132.585498:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333837568:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.585524:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.585548:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc271164fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6338 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016132.585622:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335341568:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016132.586504:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781a80 going to sleep for 11 seconds 00000100:00100000:3.0:1734016132.590245:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335341568:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016132.590317:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc271164fe lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6338 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.590342:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc271164fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6338 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.590527:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016132.590599:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333837568:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5101us (5625us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016132.590611:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11216 00000100:00100000:0.0:1734016132.593570:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.593716:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333837696 00000100:00100000:3.0:1734016132.593728:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333837696 00000100:00100000:3.0:1734016132.594039:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11217 00000100:00100000:3.0:1734016132.594047:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333837696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.594073:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.594097:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116505 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e633f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016132.594168:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335341696:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016132.594243:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781a80 going to sleep for 11 seconds 00000100:00100000:3.0:1734016132.596400:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335341696:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016132.596466:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116505 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e633f expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.596489:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116505 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e633f expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.596511:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016132.597144:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333837696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3093us (3585us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016132.597155:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11217 00010000:00010000:2.0:1734016132.599883:0:6469:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1734016132.600736:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016132.601203:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333837952 00000100:00100000:1.0:1734016132.601218:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333837952 00000100:00100000:1.0:1734016132.601335:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2300 00000100:00100000:1.0:1734016132.601346:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:10406:x1818247333837952:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016132.601420:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016132.601461:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271164a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62dd expref: 21 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016132.602218:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016132.602226:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016132.602463:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc2711650c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016132.602484:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27116495 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62d6 expref: 27 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016132.602494:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc2711650c lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016132.602717:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27116495 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62d6 expref: 27 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016132.602741:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27116495 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62d6 expref: 27 pid: 6479 timeout: 499 lvb_type: 0 00000100:00100000:1.0:1734016132.602757:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e605180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335341824:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016132.602929:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016132.607685:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e605180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335341824:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016132.607728:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc2711650c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016132.607789:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.608063:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333838080 00000100:00100000:3.0:1734016132.608074:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333838080 00010000:00010000:3.0:1734016132.608115:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27116495 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62d6 expref: 28 pid: 6479 timeout: 499 lvb_type: 0 00000100:00100000:3.0:1734016132.608150:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3119 00000100:00100000:3.0:1734016132.608158:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+28:1982:x1818247333838080:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016132.608179:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016132.608184:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27116495 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62d6 expref: 28 pid: 6479 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1734016132.608195:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27116495 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62d6 expref: 28 pid: 6479 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1734016132.608219:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc27116495 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e62d6 expref: 28 pid: 6479 timeout: 499 lvb_type: 0 00010000:00010000:3.0:1734016132.608258:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016132.608263:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc2711650c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016132.608273:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc2711650c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016132.608282:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc2711650c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016132.608303:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016132.608357:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+27:1982:x1818247333838080:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 199us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.608364:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3119 00010000:00010000:1.0:1734016132.608913:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc2711650c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016132.608921:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc2711650c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:1.0:1734016132.609046:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968797 00000004:00010000:1.0:1734016132.609100:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007487d880 reply state ffff8801309f7000 transno 4294968798 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc2711650c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:1.0:1734016132.609111:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016132.609202:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:10406:x1818247333837952:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 7858us (8479us total) trans 4294968798 rc 0/0 00000100:00100000:1.0:1734016132.609209:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2300 00000020:00080000:1.0:1734016132.609213:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016132.611583:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.611775:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333838208 00000100:00100000:3.0:1734016132.611788:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333838208 00000100:00100000:3.0:1734016132.611902:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11218 00000100:00100000:3.0:1734016132.611911:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:10406:x1818247333838208:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.611939:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.611968:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116513 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6346 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.612009:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271163df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2367487) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6251 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.612023:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016132.612026:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016132.612029:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116513 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6346 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.612071:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271163df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2367487) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6251 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.612087:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271163df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2367487) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6251 expref: 8 pid: 7682 timeout: 499 lvb_type: 0 00000100:00100000:3.0:1734016132.612099:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335341952:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016132.612176:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781a80 going to sleep for 11 seconds 00010000:00010000:2.0:1734016132.612443:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc2711650c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016132.612452:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc2711650c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016132.612460:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc2711650c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016132.612467:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499f3c0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016132.612471:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc2711650c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016132.612480:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc2711650c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016132.612503:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016132.612506:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016132.612511:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc2711650c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016132.612516:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc2711650c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:3.0:1734016132.616555:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335341952:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016132.616613:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116513 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6346 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.616635:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016132.616739:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333838208:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4826us (5167us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.616751:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11218 00000100:00100000:0.0:1734016132.618073:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.618867:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333838336 00000100:00100000:2.0:1734016132.618878:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333838336 00010000:00010000:2.0:1734016132.618919:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271163df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2367487) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6251 expref: 9 pid: 7682 timeout: 499 lvb_type: 0 00000100:00100000:2.0:1734016132.618969:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3120 00000100:00100000:2.0:1734016132.618978:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5227450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333838336:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016132.618998:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016132.619029:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271163df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2359296->2367487) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6251 expref: 9 pid: 7682 timeout: 499 lvb_type: 0 00010000:00010000:2.0:1734016132.619042:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271163df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2359296->2367487) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6251 expref: 9 pid: 7682 timeout: 499 lvb_type: 0 00010000:00010000:2.0:1734016132.619073:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271163df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2359296->2367487) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6251 expref: 9 pid: 7682 timeout: 499 lvb_type: 0 00010000:00010000:2.0:1734016132.619093:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016132.619097:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016132.619104:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116513 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6346 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.619113:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116513 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6346 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.619164:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116513 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6346 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.619178:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335342080:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016132.619260:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016132.623958:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.624115:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333838464 00000100:00100000:2.0:1734016132.624125:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333838464 00002000:00010000:2.0:1734016132.624172:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (25008->18446744073709551615) 00002000:00100000:2.0:1734016132.624176:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605180 with x1818247333838464 ext(25008->18446744073709551615) 00002000:00010000:2.0:1734016132.624190:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e605180. 00000100:00100000:3.0:1734016132.624368:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335342080:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016132.624396:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016132.624450:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5227450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333838336:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5471us (6382us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.624465:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3120 00000100:00100000:2.0:1734016132.624760:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8817 00000100:00100000:2.0:1734016132.624767:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333838464:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016132.628284:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 6164132 -> 25008 00002000:00010000:2.0:1734016132.628294:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016133 -> 1734016133 00002000:00010000:2.0:1734016132.628299:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016132 -> 1734016132 00002000:00010000:2.0:1734016132.628301:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016133 -> 1734016133 00002000:00010000:2.0:1734016132.628304:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 6808 -> 64 00000100:00100000:2.0:1734016132.628395:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333838464:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 3619us (4438us total) trans 4294968015 rc 0/0 00000100:00100000:2.0:1734016132.628409:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8817 00002000:00010000:2.0:1734016132.628419:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (25008->18446744073709551615) 00002000:00100000:2.0:1734016132.628423:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605180 with x1818247333838464 ext(25008->18446744073709551615) 00002000:00010000:2.0:1734016132.628431:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e605180. 00000100:00100000:1.0:1734016132.629112:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.629331:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333838592 00000100:00100000:0.0:1734016132.629348:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333838592 00002000:00010000:0.0:1734016132.629399:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:0.0:1734016132.629403:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604a80 with x1818247333838592 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016132.629413:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e604a80. 00000100:00100000:0.0:1734016132.629432:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8818 00000100:00100000:0.0:1734016132.629438:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333838592:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016132.635604:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 4194304 -> 0 00002000:00010000:0.0:1734016132.635622:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016133 -> 1734016133 00002000:00010000:0.0:1734016132.635626:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016132 -> 1734016132 00002000:00010000:0.0:1734016132.635629:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016133 -> 1734016133 00002000:00010000:0.0:1734016132.635631:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 32 -> 0 00000100:00100000:0.0:1734016132.640468:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1982:x1818247333838592:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 11008us (11338us total) trans 4294969490 rc 0/0 00000100:00100000:0.0:1734016132.640487:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8818 00002000:00010000:0.0:1734016132.640498:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:0.0:1734016132.640504:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604a80 with x1818247333838592 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016132.640521:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e604a80. 00000100:00100000:1.0:1734016132.641140:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.641255:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333838720 00000100:00100000:2.0:1734016132.641265:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333838720 00000100:00100000:3.0:1734016132.642384:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2301 00000100:00100000:3.0:1734016132.642401:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+27:10406:x1818247333838720:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.642442:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.642479:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc2711651a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e634d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.642624:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116521 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.642643:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.642660:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016132.642695:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 25008 00000004:00200000:3.0:1734016132.642699:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016132.642719:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.642745:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc2711651a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e634d expref: 29 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.642783:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116521 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e634d expref: 28 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.642791:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016132.642794:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016132.642845:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016132.642919:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+28:10406:x1818247333838720:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 521us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.642927:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2301 00000100:00100000:0.0:1734016132.645245:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.646321:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016132.646401:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333838976 00000100:00100000:1.0:1734016132.646420:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333838976 00000100:00100000:1.0:1734016132.646654:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333838848 00000100:00100000:1.0:1734016132.646658:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333838848 00000100:00100000:3.0:1734016132.646706:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11219 00000100:00100000:3.0:1734016132.646715:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247333838976:12345-192.168.201.16@tcp:101:fsx.0 00000100:00100000:3.0:1734016132.646739:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11220 00000100:00100000:3.0:1734016132.646742:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333838848:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.646758:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.646786:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116528 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6354 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016132.646880:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335342208:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016132.646965:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781480 going to sleep for 11 seconds 00010000:00010000:3.0:1734016132.646979:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.646993:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc2711652f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e635b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016132.647019:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335342336:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016132.647037:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737813c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016132.649406:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335342208:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016132.649461:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116528 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6354 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.649478:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116528 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6354 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.649493:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016132.649559:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333838848:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2813us (3241us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016132.649572:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11220 00000100:00100000:2.0:1734016132.649701:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335342336:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.649729:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc2711652f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e635b expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.649740:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc2711652f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e635b expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.649755:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:2.0:1734016132.649788:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247333838976:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3074us (4556us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.649795:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11219 00000100:00100000:0.0:1734016132.653617:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.653703:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.653856:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333839232 00000100:00100000:3.0:1734016132.654128:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333839104 00000100:00100000:3.0:1734016132.654138:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333839104 00000100:00100000:2.0:1734016132.654275:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333839232 00000100:00100000:3.0:1734016132.654912:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11221 00000100:00100000:3.0:1734016132.654924:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333839104:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.654961:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.655006:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116536 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6362 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016132.655105:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335342464:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016132.657111:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.658176:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11222 00000100:00100000:2.0:1734016132.658192:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247333839232:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.658225:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.658248:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711653d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6369 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.658327:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335342592:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.658415:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706d80 going to sleep for 11 seconds 00000100:00100000:3.0:1734016132.660786:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335342464:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016132.660921:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116536 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6362 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.660947:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116536 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6362 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.660965:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016132.665899:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333839104:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10944us (12161us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016132.665926:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11221 00000100:00100000:2.0:1734016132.667320:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335342592:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.667375:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711653d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6369 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.667397:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711653d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6369 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.667431:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016132.667495:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247333839232:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9305us (13896us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.667508:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11222 00000100:00100000:0.0:1734016132.671243:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.671347:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333839360 00000100:00100000:2.0:1734016132.671364:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333839360 00000100:00100000:2.0:1734016132.671448:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2302 00000100:00100000:2.0:1734016132.671461:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:10406:x1818247333839360:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.671497:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.671527:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116544 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6370 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.671670:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711654b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016132.671699:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711654b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016132.671713:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711654b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:2.0:1734016132.671743:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 25008 00000004:00200000:2.0:1734016132.671747:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016132.671766:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711654b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016132.671792:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116544 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6370 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.671845:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711654b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6370 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.671855:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016132.671857:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016132.671862:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016132.671925:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:10406:x1818247333839360:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 468us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016132.671932:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2302 00000100:00100000:0.0:1734016132.679622:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.679778:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333839616 00000100:00100000:2.0:1734016132.679793:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333839616 00002000:00100000:3.0:1734016132.680709:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->28671) req@ffff880073b9f480 x1818247333839616/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:93/0 lens 488/0 e 0 to 0 dl 1734016143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016132.680722:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9f480 with x1818247333839616 ext(0->28671) 00002000:00010000:3.0:1734016132.680729:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b9f480 00000100:00100000:3.0:1734016132.681219:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8819 00000100:00100000:3.0:1734016132.681231:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333839616:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016132.684515:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333839616:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 3258us (4890us total) trans 0 rc 28672/28672 00000100:00100000:3.0:1734016132.684537:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8819 00002000:00100000:3.0:1734016132.684559:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->28671) req@ffff880073b9f480 x1818247333839616/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:93/0 lens 488/440 e 0 to 0 dl 1734016143 ref 1 fl Complete:/200/0 rc 28672/28672 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016132.684570:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9f480 with x1818247333839616 ext(0->28671) 00002000:00010000:3.0:1734016132.684578:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b9f480 00000100:00100000:0.0:1734016132.687048:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.687212:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.687287:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333839744 00000100:00100000:2.0:1734016132.687299:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333839744 00000100:00100000:2.0:1734016132.688610:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333839872 00000100:00100000:2.0:1734016132.688622:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333839872 00000100:00100000:1.0:1734016132.688712:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11223 00000100:00100000:1.0:1734016132.688723:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333839744:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016132.688750:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016132.688776:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116552 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6377 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016132.688865:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e605880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335342720:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016132.688961:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.689023:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11224 00000100:00100000:2.0:1734016132.689029:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333839872:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.689038:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.689054:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116559 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e637e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.689081:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335342848:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.689106:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00002000:00010000:1.0:1734016132.692534:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016132 -> 1734016133 00000100:00100000:1.0:1734016132.692588:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e605880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335342720:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016132.692649:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116552 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6377 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016132.692683:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116552 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6377 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016132.692711:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016132.692813:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333839744:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4073us (5760us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016132.692825:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11223 00002000:00010000:2.0:1734016132.692950:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016132 -> 1734016133 00000100:00100000:2.0:1734016132.692972:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335342848:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.693003:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116559 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e637e expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.693013:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116559 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e637e expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.693083:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016132.693111:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333839872:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4081us (5900us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.693117:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11224 00000100:00100000:0.0:1734016132.698713:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.698851:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.698980:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333840000 00000100:00100000:2.0:1734016132.698999:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333840000 00000100:00100000:1.0:1734016132.699032:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333840128 00000100:00100000:1.0:1734016132.699035:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333840128 00000100:00100000:2.0:1734016132.699085:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11225 00000100:00100000:2.0:1734016132.699100:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333840000:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.699137:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.699178:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116560 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6385 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.699281:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335342976:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.699388:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016132.699558:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11226 00000100:00100000:1.0:1734016132.699565:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333840128:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016132.699577:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016132.699594:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27116567 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e638c expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016132.699633:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e605880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335343104:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016132.699665:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016132.702401:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e605880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335343104:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.702401:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335342976:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016132.702468:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27116567 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e638c expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.702468:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116560 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6385 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016132.702486:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27116567 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e638c expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.702486:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116560 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6385 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016132.702513:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00010000:00010000:2.0:1734016132.702536:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:1.0:1734016132.702603:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333840128:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3030us (3743us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016132.702623:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11226 00000100:00100000:2.0:1734016132.703422:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333840000:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4319us (4729us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.703436:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11225 00000100:00100000:0.0:1734016132.709039:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.709315:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333840256 00000100:00100000:2.0:1734016132.709331:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333840256 00000100:00100000:0.0:1734016132.709351:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.710066:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333840384 00000100:00100000:2.0:1734016132.710073:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333840384 00000100:00100000:0.0:1734016132.710076:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11227 00000100:00100000:0.0:1734016132.710090:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333840256:12345-192.168.201.16@tcp:101:fsx.0 00000100:00100000:2.0:1734016132.710119:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11228 00000100:00100000:2.0:1734016132.710125:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333840384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016132.710138:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.710139:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016132.710175:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7581440/0x5e3a3adc2711656e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6393 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.710175:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116575 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e639a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016132.710271:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335343232:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.710271:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335343360:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.711067:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016132.712363:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.715054:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335343360:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.715132:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116575 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e639a expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.715160:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116575 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e639a expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.715203:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016132.716196:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333840384:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6060us (6836us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.716210:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11228 00000100:00100000:2.0:1734016132.717924:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335343232:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.717983:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581440/0x5e3a3adc2711656e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6393 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.718003:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581440/0x5e3a3adc2711656e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6393 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.718017:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:2.0:1734016132.718083:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333840256:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7994us (9070us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.718094:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11227 00000100:00100000:0.0:1734016132.727226:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.727309:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.727746:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333840512 00000100:00100000:2.0:1734016132.727760:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333840512 00000100:00100000:2.0:1734016132.727846:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333840640 00000100:00100000:2.0:1734016132.727849:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333840640 00000100:00100000:2.0:1734016132.727874:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11229 00000100:00100000:2.0:1734016132.727883:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333840512:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.727911:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.727941:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711657c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e63a1 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.728019:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335343488:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.728102:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016132.728109:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11230 00000100:00100000:3.0:1734016132.728115:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333840640:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.728124:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.728136:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116583 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e63a8 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016132.728170:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335343616:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016132.728192:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.730306:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335343488:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.730364:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711657c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63a1 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.730383:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711657c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63a1 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.730399:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016132.730465:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333840512:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2581us (3260us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.730477:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11229 00000100:00100000:3.0:1734016132.730780:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335343616:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016132.730866:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116583 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63a8 expref: 14 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.730881:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116583 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63a8 expref: 14 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.730907:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016132.733654:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333840640:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5511us (6317us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016132.733679:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11230 00000100:00100000:0.0:1734016132.736481:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.736553:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.737377:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333840768 00000100:00100000:2.0:1734016132.737391:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333840768 00000100:00100000:2.0:1734016132.737446:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333840896 00000100:00100000:2.0:1734016132.737447:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333840896 00000100:00100000:2.0:1734016132.737473:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11231 00000100:00100000:2.0:1734016132.737483:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333840768:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.737511:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.737538:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711658a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e63af expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.737610:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335343744:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.737691:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.737714:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11232 00000100:00100000:2.0:1734016132.737718:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247333840896:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.737725:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.737736:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116591 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e63b6 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.737761:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335343872:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.737777:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706d80 going to sleep for 11 seconds 00000100:00100000:3.0:1734016132.740951:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335343872:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016132.741057:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116591 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63b6 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.741084:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116591 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63b6 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.741112:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016132.741396:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335343744:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.741423:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711658a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63af expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.741432:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711658a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63af expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.741442:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016132.741537:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333840768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4053us (5072us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.741554:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11231 00000100:00100000:3.0:1734016132.741993:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247333840896:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4272us (5437us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016132.741999:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11232 00000100:00100000:0.0:1734016132.747049:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.747124:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.747233:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333841024 00000100:00100000:3.0:1734016132.747248:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333841024 00000100:00100000:3.0:1734016132.747595:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333841152 00000100:00100000:3.0:1734016132.747598:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333841152 00000100:00100000:2.0:1734016132.747647:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11233 00000100:00100000:2.0:1734016132.747660:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333841024:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.747707:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.747742:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116598 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e63bd expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.747888:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335344000:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.747998:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016132.748077:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11234 00000100:00100000:3.0:1734016132.748086:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333841152:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.748095:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.748108:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711659f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e63c4 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016132.748144:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335344128:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016132.748166:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.751253:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335344000:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.751300:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116598 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63bd expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.751316:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116598 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63bd expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.751336:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016132.751407:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333841024:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3748us (4376us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.751418:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11233 00000100:00100000:3.0:1734016132.751532:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335344128:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016132.751560:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711659f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63c4 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.751640:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711659f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63c4 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.751655:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016132.751685:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333841152:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3599us (4560us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016132.751692:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11234 00000100:00100000:0.0:1734016132.757680:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.757835:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333841408 00000100:00100000:3.0:1734016132.757848:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333841408 00000100:00100000:3.0:1734016132.758333:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2303 00000100:00100000:3.0:1734016132.758343:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+28:10406:x1818247333841408:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016132.758436:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016132.758483:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116521 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e634d expref: 28 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.758705:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016132.758710:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016132.759011:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.759028:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711654b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6370 expref: 22 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.759035:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165a6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.759080:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711654b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6370 expref: 22 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.759097:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711654b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6370 expref: 22 pid: 6479 timeout: 499 lvb_type: 0 00000100:00100000:3.0:1734016132.759110:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335344256:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016132.761552:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781b40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016132.764456:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.764646:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333841536 00000100:00100000:2.0:1734016132.764660:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333841536 00010000:00010000:2.0:1734016132.764716:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711654b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6370 expref: 23 pid: 6479 timeout: 499 lvb_type: 0 00000100:00100000:2.0:1734016132.764754:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3121 00000100:00100000:2.0:1734016132.764764:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:1982:x1818247333841536:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016132.764783:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016132.764791:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711654b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6370 expref: 23 pid: 6479 timeout: 499 lvb_type: 0 00010000:00010000:2.0:1734016132.764837:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711654b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6370 expref: 23 pid: 6479 timeout: 499 lvb_type: 0 00010000:00010000:2.0:1734016132.764870:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016132.764877:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.764887:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.764894:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.764919:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016132.764998:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:1982:x1818247333841536:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 234us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016132.765005:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3121 00010000:00010000:3.0:1734016132.765695:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711654b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6370 expref: 22 pid: 6479 timeout: 499 lvb_type: 0 00000100:00100000:3.0:1734016132.765723:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335344256:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016132.765750:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.765760:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.765770:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:3.0:1734016132.765912:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968799 00000004:00010000:3.0:1734016132.765973:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800849b5880 reply state ffff880075f77000 transno 4294968800 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016132.765982:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016132.766088:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+30:10406:x1818247333841408:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 7746us (8435us total) trans 4294968800 rc 0/0 00000100:00100000:3.0:1734016132.766095:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2303 00000020:00080000:3.0:1734016132.766099:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016132.770307:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1734016132.770456:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.770466:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.770473:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.770479:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df5b00 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016132.770483:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.770492:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.770513:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016132.770516:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016132.770522:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016132.770527:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016132.771152:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333841664 00000100:00100000:3.0:1734016132.771172:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333841664 00000100:00100000:3.0:1734016132.771919:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11235 00000100:00100000:3.0:1734016132.771932:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090248c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333841664:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.771961:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.771995:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271165ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e63cb expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.772055:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116513 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6346 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.772063:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016132.772065:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016132.772070:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271165ad lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63cb expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.772125:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116513 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6346 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.772142:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116513 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6346 expref: 6 pid: 8216 timeout: 499 lvb_type: 0 00000100:00100000:3.0:1734016132.772158:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335344384:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016132.772874:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016132.776853:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335344384:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016132.776905:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271165ad lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63cb expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.776927:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016132.776994:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090248c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247333841664:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5062us (6702us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.777008:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11235 00000100:00100000:0.0:1734016132.777992:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.778031:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333841792 00000100:00100000:0.0:1734016132.778041:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333841792 00010000:00010000:0.0:1734016132.778083:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116513 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6346 expref: 7 pid: 8216 timeout: 499 lvb_type: 0 00000100:00100000:0.0:1734016132.778129:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3122 00000100:00100000:0.0:1734016132.778137:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333841792:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016132.778162:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016132.778199:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116513 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6346 expref: 7 pid: 8216 timeout: 499 lvb_type: 0 00010000:00010000:0.0:1734016132.778215:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116513 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6346 expref: 7 pid: 8216 timeout: 499 lvb_type: 0 00010000:00010000:0.0:1734016132.778253:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116513 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6346 expref: 7 pid: 8216 timeout: 499 lvb_type: 0 00010000:00010000:0.0:1734016132.778286:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016132.778290:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016132.778298:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271165ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63cb expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016132.778309:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271165ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63cb expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016132.778350:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271165ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63cb expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016132.778368:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335344512:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016132.778430:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016132.782953:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.783178:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335344512:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016132.783218:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016132.783291:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333841792:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5151us (5300us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016132.783312:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3122 00000100:00100000:3.0:1734016132.783431:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333841920 00000100:00100000:3.0:1734016132.783443:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333841920 00000100:00100000:3.0:1734016132.783495:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11236 00000100:00100000:3.0:1734016132.783502:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:10406:x1818247333841920:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.783526:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.783549:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271165b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e63d2 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.783591:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271164d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1777663) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e630e expref: 12 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.783606:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016132.783609:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016132.783613:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271165b4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d2 expref: 14 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.783649:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271164d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1777663) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e630e expref: 12 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.783665:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271164d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1777663) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e630e expref: 12 pid: 8216 timeout: 499 lvb_type: 0 00000100:00100000:3.0:1734016132.783687:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335344640:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016132.783726:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016132.787832:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.787949:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335344640:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016132.787989:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271165b4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d2 expref: 14 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.788011:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016132.788065:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+14:10406:x1818247333841920:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4563us (5133us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.788074:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11236 00000100:00100000:2.0:1734016132.788168:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333842048 00000100:00100000:2.0:1734016132.788176:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333842048 00010000:00010000:2.0:1734016132.788204:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271164d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1777663) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e630e expref: 13 pid: 8216 timeout: 499 lvb_type: 0 00000100:00100000:2.0:1734016132.788236:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3123 00000100:00100000:2.0:1734016132.788242:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1982:x1818247333842048:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016132.788260:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016132.788284:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271164d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->1777663) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e630e expref: 13 pid: 8216 timeout: 499 lvb_type: 0 00010000:00010000:2.0:1734016132.788297:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271164d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->1777663) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e630e expref: 13 pid: 8216 timeout: 499 lvb_type: 0 00010000:00010000:2.0:1734016132.788323:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271164d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->1777663) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e630e expref: 13 pid: 8216 timeout: 499 lvb_type: 0 00010000:00010000:2.0:1734016132.789100:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016132.789104:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016132.789111:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271165b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d2 expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.789120:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271165b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d2 expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016132.789168:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271165b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d2 expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.789182:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335344768:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016132.789247:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.794600:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335344768:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016132.794647:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016132.794749:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333842048:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6504us (6949us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016132.794766:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3123 00000100:00100000:0.0:1734016132.795932:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.796045:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.796750:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333842304 00000100:00100000:3.0:1734016132.796760:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333842304 00002000:00010000:3.0:1734016132.796838:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (3643390->18446744073709551615) 00002000:00100000:3.0:1734016132.796843:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b7b80 with x1818247333842304 ext(3643390->18446744073709551615) 00002000:00010000:3.0:1734016132.796860:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b7b80. 00000100:00100000:3.0:1734016132.796881:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333842176 00000100:00100000:3.0:1734016132.796884:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333842176 00002000:00010000:3.0:1734016132.796899:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:3.0:1734016132.796901:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b7800 with x1818247333842176 ext(4194304->18446744073709551615) 00002000:00010000:3.0:1734016132.796909:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800849b7800. 00000100:00100000:3.0:1734016132.796924:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8820 00000100:00100000:3.0:1734016132.796931:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247333842304:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016132.797212:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 3643390 00002000:00010000:3.0:1734016132.797216:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016133 -> 1734016133 00002000:00010000:3.0:1734016132.797219:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016133 -> 1734016132 00002000:00010000:3.0:1734016132.797221:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016133 -> 1734016133 00002000:00010000:3.0:1734016132.797223:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1734016132.797302:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+15:1981:x1818247333842304:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 369us (1372us total) trans 4294969491 rc 0/0 00000100:00100000:3.0:1734016132.797310:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8820 00002000:00010000:3.0:1734016132.797316:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (3643390->18446744073709551615) 00002000:00100000:3.0:1734016132.797319:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b7b80 with x1818247333842304 ext(3643390->18446744073709551615) 00002000:00010000:3.0:1734016132.797323:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b7b80. 00000100:00100000:3.0:1734016132.797342:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8821 00000100:00100000:3.0:1734016132.797347:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333842176:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016132.797452:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 25008 -> 4194304 00002000:00010000:3.0:1734016132.797455:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016133 -> 1734016133 00002000:00010000:3.0:1734016132.797457:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016133 -> 1734016132 00002000:00010000:3.0:1734016132.797459:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016133 -> 1734016133 00002000:00010000:3.0:1734016132.797462:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 64 -> 64 00000100:00100000:3.0:1734016132.797481:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333842176:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 133us (1435us total) trans 4294968016 rc 0/0 00000100:00100000:3.0:1734016132.797487:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8821 00002000:00010000:3.0:1734016132.797490:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:3.0:1734016132.797492:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b7800 with x1818247333842176 ext(4194304->18446744073709551615) 00002000:00010000:3.0:1734016132.797495:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800849b7800. 00000100:00100000:0.0:1734016132.808610:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.810383:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333842560 00000100:00100000:2.0:1734016132.810409:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333842560 00002000:00100000:2.0:1734016132.810507:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (3637248->3641343) req@ffff8800849b5500 x1818247333842560/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 488/0 e 0 to 0 dl 1734016143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.810528:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b5500 with x1818247333842560 ext(3637248->3641343) 00002000:00010000:2.0:1734016132.810535:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b5500 00000100:00100000:2.0:1734016132.810585:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8822 00000100:00100000:2.0:1734016132.810595:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+15:1982:x1818247333842560:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016132.811021:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+15:1982:x1818247333842560:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 424us (2423us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016132.811029:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8822 00002000:00100000:2.0:1734016132.811037:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (3637248->3641343) req@ffff8800849b5500 x1818247333842560/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 488/4536 e 0 to 0 dl 1734016143 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.811043:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b5500 with x1818247333842560 ext(3637248->3641343) 00002000:00010000:2.0:1734016132.811046:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b5500 00000100:00100000:1.0:1734016132.812139:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.812346:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333842816 00000100:00100000:0.0:1734016132.812357:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333842816 00002000:00100000:0.0:1734016132.812413:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff88012e605880 x1818247333842816/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 488/0 e 0 to 0 dl 1734016143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016132.812424:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605880 with x1818247333842816 ext(0->4194303) 00002000:00010000:0.0:1734016132.812429:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e605880 00000100:00100000:0.0:1734016132.812449:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8823 00000100:00100000:0.0:1734016132.812459:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333842816:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016132.831104:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.831246:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333843072 00000100:00100000:3.0:1734016132.831266:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333843072 00002000:00100000:3.0:1734016132.831335:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (0->3645439) req@ffff88007487c380 x1818247333843072/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 504/0 e 0 to 0 dl 1734016143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016132.831346:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487c380 with x1818247333843072 ext(0->3645439) 00002000:00010000:3.0:1734016132.831354:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487c380 00000100:00100000:3.0:1734016132.831400:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8824 00000100:00100000:3.0:1734016132.831408:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+15:1984:x1818247333843072:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016132.885275:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333842816:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 72784us (73112us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016132.885305:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8823 00002000:00100000:1.0:1734016132.885333:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff88012e605880 x1818247333842816/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 488/440 e 0 to 0 dl 1734016143 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016132.885345:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605880 with x1818247333842816 ext(0->4194303) 00002000:00010000:1.0:1734016132.885354:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e605880 00000100:00100000:2.0:1734016132.922956:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+15:1984:x1818247333843072:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 91521us (91842us total) trans 0 rc 3641344/3641344 00000100:00100000:2.0:1734016132.922980:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8824 00002000:00100000:2.0:1734016132.923010:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (0->3645439) req@ffff88007487c380 x1818247333843072/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 504/440 e 0 to 0 dl 1734016143 ref 1 fl Complete:/200/0 rc 3641344/3641344 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.923023:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487c380 with x1818247333843072 ext(0->3645439) 00002000:00010000:2.0:1734016132.923035:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487c380 00000100:00100000:0.0:1734016132.930185:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.930447:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333843200 00000100:00100000:2.0:1734016132.930463:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333843200 00002000:00100000:2.0:1734016132.930535:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (3637248->3643389) req@ffff8800849b4700 x1818247333843200/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 6632/0 e 0 to 0 dl 1734016143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.930549:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b4700 with x1818247333843200 ext(3637248->3643389) 00002000:00010000:2.0:1734016132.930558:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b4700 00000100:00100000:2.0:1734016132.930619:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8825 00000100:00100000:2.0:1734016132.930627:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+15:1982:x1818247333843200:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016132.932573:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+17:1982:x1818247333843200:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1932us (2400us total) trans 4294969492 rc 0/0 00000100:00100000:2.0:1734016132.932586:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8825 00002000:00100000:2.0:1734016132.932597:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (3637248->3643389) req@ffff8800849b4700 x1818247333843200/t4294969492(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:93/0 lens 6632/448 e 0 to 0 dl 1734016143 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016132.932606:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b4700 with x1818247333843200 ext(3637248->3643389) 00002000:00010000:2.0:1734016132.932610:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b4700 00000100:00100000:0.0:1734016132.934906:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.935113:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333843328 00000100:00100000:3.0:1734016132.935135:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333843328 00000100:00100000:3.0:1734016132.935355:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2304 00000100:00100000:3.0:1734016132.935366:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+29:10406:x1818247333843328:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:3.0:1734016132.935593:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+29:10406:x1818247333843328:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 229us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.935603:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2304 00000100:00100000:0.0:1734016132.938554:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.938659:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333843456 00000100:00100000:3.0:1734016132.938678:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333843456 00000100:00100000:3.0:1734016132.938741:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11237 00000100:00100000:3.0:1734016132.938750:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+17:1981:x1818247333843456:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016132.940243:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969492 is committed 00000001:00080000:2.0:1734016132.940282:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969490 is committed 00000100:00100000:3.0:1734016132.940648:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333843456:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 1892us (2101us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.940659:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11237 00000100:00100000:0.0:1734016132.942644:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.942791:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333843584 00000100:00100000:3.0:1734016132.942891:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333843584 00000100:00100000:3.0:1734016132.943243:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2305 00000100:00100000:3.0:1734016132.943251:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+29:10406:x1818247333843584:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.943275:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.943299:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271165bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e63d9 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.943419:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271165c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.943432:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271165c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.943445:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271165c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016132.943466:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 7837694 00000004:00200000:3.0:1734016132.943469:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016132.943487:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271165c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.943509:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271165bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d9 expref: 31 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.943525:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271165c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d9 expref: 30 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.943537:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016132.943540:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016132.943543:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016132.943779:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+30:10406:x1818247333843584:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 525us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.943785:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2305 00000100:00100000:0.0:1734016132.947551:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.948118:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333843712 00000100:00100000:3.0:1734016132.948135:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333843712 00000100:00100000:3.0:1734016132.948193:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11238 00000100:00100000:3.0:1734016132.948206:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333843712:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016132.948575:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 3643390 -> 3643390 00002000:00010000:3.0:1734016132.948579:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016133 -> 1734016133 00002000:00010000:3.0:1734016132.948582:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016132 -> 1734016133 00002000:00010000:3.0:1734016132.948586:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016133 -> 1734016132 00002000:00010000:3.0:1734016132.948588:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 40 00000100:00100000:3.0:1734016132.948663:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333843712:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 458us (1127us total) trans 4294969493 rc 0/0 00000100:00100000:3.0:1734016132.948680:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11238 00000100:00100000:0.0:1734016132.951463:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.951587:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333843840 00000100:00100000:3.0:1734016132.951600:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333843840 00000100:00100000:3.0:1734016132.951733:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2306 00000100:00100000:3.0:1734016132.951745:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:10406:x1818247333843840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.951780:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.951931:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271165c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e63e0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.952088:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.952111:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.952127:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016132.952171:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 7837694 00000004:00200000:3.0:1734016132.952179:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016132.952203:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016132.952232:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271165c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63e0 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.952310:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63e0 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.952322:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016132.952325:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016132.952328:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016132.953053:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:10406:x1818247333843840:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1308us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.953062:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2306 00000100:00100000:0.0:1734016132.955280:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.955406:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016132.955510:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333843968 00000100:00100000:2.0:1734016132.955524:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333843968 00000100:00100000:2.0:1734016132.955592:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333844096 00000100:00100000:2.0:1734016132.955595:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333844096 00000100:00100000:2.0:1734016132.955638:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11239 00000100:00100000:2.0:1734016132.955649:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333843968:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.955689:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.955721:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271165d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e63e7 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.955887:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335344896:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.955979:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016132.956110:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11240 00000100:00100000:3.0:1734016132.956118:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333844096:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.956129:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.956148:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271165de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e63ee expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016132.956192:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335345024:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016132.956226:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781480 going to sleep for 11 seconds 00002000:00010000:2.0:1734016132.958380:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016132 -> 1734016133 00000100:00100000:2.0:1734016132.958427:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335344896:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.958485:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271165d7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63e7 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.958502:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271165d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63e7 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.959015:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00002000:00010000:3.0:1734016132.959131:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016132 -> 1734016133 00000100:00100000:3.0:1734016132.959145:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335345024:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016132.959170:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271165de lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63ee expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.959179:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271165de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63ee expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.959193:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:2.0:1734016132.959283:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333843968:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3632us (4022us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.959293:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11239 00000100:00100000:3.0:1734016132.959769:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333844096:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3648us (4360us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016132.959777:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11240 00000100:00100000:0.0:1734016132.962563:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.962776:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.962908:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333844352 00000100:00100000:3.0:1734016132.962922:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333844352 00000100:00100000:3.0:1734016132.963364:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333844224 00000100:00100000:3.0:1734016132.963370:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333844224 00000100:00100000:2.0:1734016132.963420:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11241 00000100:00100000:2.0:1734016132.963435:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333844352:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016132.963467:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016132.963496:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271165e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e63fc expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016132.963582:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335345152:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016132.963697:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016132.964280:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11242 00000100:00100000:3.0:1734016132.964289:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333844224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.964304:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.964321:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc271165ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e63f5 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016132.964368:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335345280:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016132.964401:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.967118:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335345152:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.967181:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271165e5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63fc expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.967204:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271165e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63fc expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.967224:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016132.967292:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333844352:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3859us (4741us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.967304:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11241 00000100:00100000:3.0:1734016132.970697:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335345280:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016132.970763:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc271165ec lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63f5 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.970782:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc271165ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63f5 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.970839:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016132.971529:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333844224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7236us (8747us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016132.971544:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11242 00000100:00100000:0.0:1734016132.974723:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016132.974795:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.975250:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333844480 00000100:00100000:3.0:1734016132.975267:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333844480 00000100:00100000:3.0:1734016132.975333:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333844608 00000100:00100000:3.0:1734016132.975336:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333844608 00000100:00100000:3.0:1734016132.975359:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11243 00000100:00100000:3.0:1734016132.975369:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333844480:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.975400:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.975432:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc271165f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6403 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016132.975522:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335345408:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016132.975601:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016132.975618:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11244 00000100:00100000:3.0:1734016132.975622:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333844608:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.975630:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.975643:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271165fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e640a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016132.975686:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335345536:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016132.975706:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016132.981121:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335345536:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016132.981187:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271165fa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e640a expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.981207:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271165fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e640a expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016132.981226:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:2.0:1734016132.981296:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333844608:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5670us (6498us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016132.981308:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11244 00000100:00100000:3.0:1734016132.981449:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335345408:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016132.981477:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc271165f3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6403 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.981488:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc271165f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6403 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016132.981503:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016132.981525:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333844480:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6158us (6820us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016132.981532:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11243 00000100:00100000:0.0:1734016132.984517:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.984704:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333844736 00000100:00100000:3.0:1734016132.984716:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333844736 00000100:00100000:3.0:1734016132.984787:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11245 00000100:00100000:3.0:1734016132.984794:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333844736:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016132.984862:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016132.984893:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116601 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6411 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.984937:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271165b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d2 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.984944:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016132.984946:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016132.984950:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116601 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [208896->221183] (req 208896->221183) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6411 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.984986:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271165b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d2 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.984998:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271165b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d2 expref: 8 pid: 8216 timeout: 500 lvb_type: 0 00000100:00100000:3.0:1734016132.985012:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335345664:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016132.985082:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016132.987234:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335345664:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016132.987287:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116601 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [208896->221183] (req 208896->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6411 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.987312:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016132.987386:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333844736:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2590us (2890us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.987400:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11245 00000100:00100000:0.0:1734016132.992781:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.993004:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333844864 00000100:00100000:3.0:1734016132.993017:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333844864 00010000:00010000:3.0:1734016132.993074:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271165b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d2 expref: 9 pid: 8216 timeout: 500 lvb_type: 0 00000100:00100000:3.0:1734016132.993121:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3124 00000100:00100000:3.0:1734016132.993128:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333844864:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016132.993150:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016132.993180:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271165b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d2 expref: 9 pid: 8216 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016132.993196:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271165b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d2 expref: 9 pid: 8216 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016132.993232:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271165b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d2 expref: 9 pid: 8216 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016132.993261:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016132.993264:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016132.993273:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116601 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6411 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.993284:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116601 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->221183) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6411 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016132.993335:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116601 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6411 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016132.993356:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335345792:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016132.993425:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016132.996635:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335345792:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016132.996698:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016132.996871:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333844864:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3739us (4104us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016132.996889:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3124 00000100:00100000:0.0:1734016132.997877:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016132.998674:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333844992 00000100:00100000:3.0:1734016132.998687:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333844992 00000100:00100000:3.0:1734016132.998774:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11246 00000100:00100000:3.0:1734016132.998784:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333844992:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016132.999172:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 3643390 -> 3643390 00002000:00010000:3.0:1734016132.999176:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016133 -> 1734016133 00002000:00010000:3.0:1734016132.999179:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016133 -> 1734016133 00002000:00010000:3.0:1734016132.999182:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016133 -> 1734016132 00002000:00010000:3.0:1734016132.999184:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 40 -> 64 00000100:00100000:3.0:1734016132.999412:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333844992:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 625us (1540us total) trans 4294969494 rc 0/0 00000100:00100000:3.0:1734016132.999421:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11246 00000100:00100000:0.0:1734016133.002303:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.002434:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333845120 00000100:00100000:2.0:1734016133.002451:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333845120 00000100:00100000:2.0:1734016133.002524:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11247 00000100:00100000:2.0:1734016133.002532:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333845120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016133.002564:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016133.002594:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27116608 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6418 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016133.002682:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335345920:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016133.002752:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00002000:00010000:2.0:1734016133.004641:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016132 -> 1734016133 00000100:00100000:2.0:1734016133.004691:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335345920:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016133.004745:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27116608 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6418 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.004763:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27116608 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6418 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.005949:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016133.006298:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333845120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3761us (4006us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016133.006309:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11247 00000100:00100000:0.0:1734016133.008463:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.008583:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333845248 00000100:00100000:2.0:1734016133.008592:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333845248 00000100:00100000:2.0:1734016133.008642:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11248 00000100:00100000:2.0:1734016133.008648:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333845248:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016133.008677:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016133.008706:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711660f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e641f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016133.008777:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335346048:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016133.008889:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016133.011584:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335346048:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016133.011637:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711660f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e641f expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.011656:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc2711660f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e641f expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.012179:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016133.012275:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333845248:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3623us (3818us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016133.012290:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11248 00000100:00100000:0.0:1734016133.014992:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.015162:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333845376 00000100:00100000:2.0:1734016133.015183:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333845376 00000100:00100000:2.0:1734016133.015295:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11249 00000100:00100000:2.0:1734016133.015308:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333845376:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016133.015349:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016133.015389:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116616 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6426 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.015452:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271165ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63cb expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.015465:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016133.015470:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016133.015475:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116616 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1843200->1851391] (req 1843200->1851391) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6426 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.015550:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271165ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63cb expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.015578:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271165ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63cb expref: 9 pid: 8216 timeout: 500 lvb_type: 0 00000100:00100000:2.0:1734016133.015601:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335346176:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016133.017133:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.019403:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335346176:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016133.019463:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116616 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1843200->1851391] (req 1843200->1851391) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6426 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.019499:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:3.0:1734016133.019570:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333845376:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4262us (4601us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016133.019580:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11249 00000100:00100000:0.0:1734016133.030052:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.030301:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333845504 00000100:00100000:3.0:1734016133.030318:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333845504 00010000:00010000:3.0:1734016133.030368:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271165ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63cb expref: 10 pid: 8216 timeout: 500 lvb_type: 0 00000100:00100000:3.0:1734016133.030419:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3125 00000100:00100000:3.0:1734016133.030428:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333845504:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016133.030451:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016133.030477:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271165ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63cb expref: 10 pid: 8216 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.030490:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271165ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63cb expref: 10 pid: 8216 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.030519:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271165ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63cb expref: 10 pid: 8216 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.030552:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016133.030554:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016133.030563:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116616 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->1851391) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6426 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.030578:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116616 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->1851391) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6426 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.030618:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116616 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->1851391) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6426 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.030633:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335346304:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016133.030717:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016133.036015:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.036123:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335346304:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016133.036163:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016133.036227:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333845504:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5799us (6197us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016133.036245:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3125 00000100:00100000:2.0:1734016133.036361:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333845632 00000100:00100000:2.0:1734016133.036372:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333845632 00000100:00100000:2.0:1734016133.036740:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11250 00000100:00100000:2.0:1734016133.036748:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333845632:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016133.037070:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1734016133.037074:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016133 -> 1734016133 00002000:00010000:2.0:1734016133.037076:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016133 -> 1734016132 00002000:00010000:2.0:1734016133.037078:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016133 -> 1734016133 00002000:00010000:2.0:1734016133.037080:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 64 -> 64 00000100:00100000:2.0:1734016133.037177:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333845632:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 429us (1177us total) trans 4294968017 rc 0/0 00000100:00100000:2.0:1734016133.037183:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11250 00000100:00100000:0.0:1734016133.042772:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.043625:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.044119:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333845888 00000100:00100000:3.0:1734016133.044132:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333845888 00000100:00100000:3.0:1734016133.044202:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333845760 00000100:00100000:3.0:1734016133.044205:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333845760 00000100:00100000:3.0:1734016133.044238:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11251 00000100:00100000:3.0:1734016133.044246:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333845888:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.044279:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.044312:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711661d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6434 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.044409:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335346432:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.044516:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016133.044600:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11252 00000100:00100000:2.0:1734016133.044607:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333845760:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016133.044617:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016133.044634:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116624 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e642d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016133.044681:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335346560:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016133.044707:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.047355:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335346432:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016133.047427:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711661d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6434 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.047445:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711661d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6434 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.047489:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016133.047572:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333845888:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3323us (4822us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.047585:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11251 00002000:00010000:2.0:1734016133.047707:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016132 -> 1734016133 00000100:00100000:2.0:1734016133.047728:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335346560:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016133.047755:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116624 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e642d expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.047765:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116624 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e642d expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.047780:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016133.047839:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333845760:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3192us (4176us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016133.047846:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11252 00000100:00100000:0.0:1734016133.051852:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.051988:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.052040:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333846016 00000100:00100000:0.0:1734016133.052055:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333846016 00000100:00100000:0.0:1734016133.054230:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333846144 00000100:00100000:0.0:1734016133.054252:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333846144 00000100:00100000:0.0:1734016133.054339:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11253 00000100:00100000:0.0:1734016133.054353:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333846016:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016133.054384:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016133.054420:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7581f80/0x5e3a3adc2711662b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e643b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016133.054524:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335346688:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016133.054627:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016133.054649:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11254 00000100:00100000:0.0:1734016133.054653:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333846144:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016133.054663:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016133.054681:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27116632 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6442 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016133.054719:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335346816:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016133.054739:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016133.057763:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335346816:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016133.057866:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27116632 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6442 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016133.057887:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27116632 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6442 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016133.057911:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582d00, rc 0) 00000100:00100000:1.0:1734016133.057971:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333846144:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3314us (5979us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016133.057983:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11254 00000100:00100000:2.0:1734016133.058323:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335346688:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016133.058347:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581f80/0x5e3a3adc2711662b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e643b expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.058358:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581f80/0x5e3a3adc2711662b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e643b expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.058368:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00000100:00100000:2.0:1734016133.058405:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333846016:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4056us (6571us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016133.058413:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11253 00000100:00100000:0.0:1734016133.061720:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.061858:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333846272 00000100:00100000:2.0:1734016133.061877:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333846272 00000100:00100000:2.0:1734016133.062241:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11255 00000100:00100000:2.0:1734016133.062254:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247333846272:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016133.062278:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016133.062303:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116639 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6449 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.062354:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116616 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->1851391) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6426 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.062362:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016133.062363:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016133.062366:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116639 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1810432->1818623] (req 1810432->1818623) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6449 expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.062404:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116616 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->1851391) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6426 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.062418:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116616 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->1851391) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6426 expref: 7 pid: 8216 timeout: 500 lvb_type: 0 00000100:00100000:2.0:1734016133.062432:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335346944:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016133.062519:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00000100:00100000:2.0:1734016133.065861:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335346944:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016133.065913:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116639 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1810432->1818623] (req 1810432->1818623) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6449 expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.065937:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016133.065998:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:10406:x1818247333846272:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3745us (4292us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016133.066010:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11255 00000100:00100000:0.0:1734016133.066242:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.066594:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333846400 00000100:00100000:3.0:1734016133.066602:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333846400 00010000:00010000:3.0:1734016133.066638:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116616 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6426 expref: 8 pid: 8216 timeout: 500 lvb_type: 0 00000100:00100000:3.0:1734016133.066663:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3126 00000100:00100000:3.0:1734016133.066677:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333846400:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016133.066696:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016133.066721:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116616 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6426 expref: 8 pid: 8216 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.066738:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116616 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->1851391) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6426 expref: 8 pid: 8216 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.066763:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116616 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->1851391) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6426 expref: 8 pid: 8216 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.066797:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016133.066828:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016133.066838:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116639 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->1818623) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6449 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.066849:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116639 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->1818623) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6449 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.066890:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116639 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->1818623) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6449 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.066906:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335347072:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016133.066959:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781480 going to sleep for 11 seconds 00000100:00100000:1.0:1734016133.070862:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.071002:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335347072:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016133.071048:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016133.071205:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333846656 00000100:00100000:2.0:1734016133.071222:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333846656 00002000:00100000:2.0:1734016133.071299:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (1810432->1814527) req@ffff88012e607800 x1818247333846656/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 488/0 e 0 to 0 dl 1734016144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016133.071313:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e607800 with x1818247333846656 ext(1810432->1814527) 00002000:00010000:2.0:1734016133.071321:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e607800 00000100:00100000:2.0:1734016133.071357:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8826 00000100:00100000:2.0:1734016133.071367:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333846656:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016133.071747:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333846400:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5067us (5505us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016133.071763:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3126 00000100:00100000:2.0:1734016133.073390:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333846656:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 2008us (2528us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016133.073408:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8826 00002000:00100000:2.0:1734016133.073433:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (1810432->1814527) req@ffff88012e607800 x1818247333846656/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 488/4536 e 0 to 0 dl 1734016144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016133.073444:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e607800 with x1818247333846656 ext(1810432->1814527) 00002000:00010000:2.0:1734016133.073451:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e607800 00000100:00100000:0.0:1734016133.075982:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.076079:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333846912 00000100:00100000:2.0:1734016133.076093:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333846912 00002000:00100000:2.0:1734016133.076150:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (1814528->1818623) req@ffff8801369f2a00 x1818247333846912/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 488/0 e 0 to 0 dl 1734016144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016133.076163:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f2a00 with x1818247333846912 ext(1814528->1818623) 00002000:00010000:2.0:1734016133.076170:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801369f2a00 00000100:00100000:2.0:1734016133.076247:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8827 00000100:00100000:2.0:1734016133.076257:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333846912:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016133.077007:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333846912:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 747us (1040us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016133.077017:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8827 00002000:00100000:2.0:1734016133.077025:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (1814528->1818623) req@ffff8801369f2a00 x1818247333846912/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 488/4536 e 0 to 0 dl 1734016144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016133.077033:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f2a00 with x1818247333846912 ext(1814528->1818623) 00002000:00010000:2.0:1734016133.077036:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801369f2a00 00000100:00100000:0.0:1734016133.079695:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.079911:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333847040 00000100:00100000:2.0:1734016133.079926:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333847040 00000100:00100000:2.0:1734016133.080338:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11256 00000100:00100000:2.0:1734016133.080348:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333847040:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016133.080370:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016133.080399:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116640 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6450 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016133.080476:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335347200:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016133.080780:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016133.083783:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335347200:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016133.083897:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116640 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6450 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.083919:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116640 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6450 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.083982:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016133.084579:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333847040:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4228us (4908us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016133.084590:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11256 00000100:00100000:0.0:1734016133.087710:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.087871:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333847168 00000100:00100000:2.0:1734016133.087894:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333847168 00000100:00100000:2.0:1734016133.087985:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11257 00000100:00100000:2.0:1734016133.087999:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333847168:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016133.088032:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016133.088064:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116647 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6457 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016133.088158:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335347328:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016133.088246:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016133.090645:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335347328:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016133.090742:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116647 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6457 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.090767:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116647 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6457 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.090838:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016133.091692:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333847168:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3687us (4029us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016133.091709:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11257 00000100:00100000:0.0:1734016133.095726:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.096504:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333847296 00000100:00100000:2.0:1734016133.096521:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333847296 00000100:00100000:2.0:1734016133.096681:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11258 00000100:00100000:2.0:1734016133.096691:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333847296:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016133.096723:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016133.096758:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711664e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e645e expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016133.096868:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335347456:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016133.097192:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016133.099336:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335347456:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016133.099413:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711664e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e645e expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.099437:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711664e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e645e expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.099480:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016133.100051:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333847296:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3356us (4352us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016133.100077:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11258 00000100:00100000:0.0:1734016133.103221:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.103706:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333847424 00000100:00100000:2.0:1734016133.103723:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333847424 00000100:00100000:2.0:1734016133.103908:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11259 00000100:00100000:2.0:1734016133.103919:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333847424:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016133.103956:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016133.103995:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116655 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6465 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016133.104092:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335347584:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016133.104209:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016133.106935:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335347584:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016133.106992:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116655 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6465 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.107010:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116655 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6465 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.107040:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016133.107111:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333847424:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3191us (3907us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016133.107122:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11259 00000100:00100000:0.0:1734016133.109569:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.109757:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333847552 00000100:00100000:2.0:1734016133.109766:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333847552 00000100:00100000:2.0:1734016133.109978:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11260 00000100:00100000:2.0:1734016133.109987:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333847552:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016133.110010:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016133.110031:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711665c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e646c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016133.110093:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335347712:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016133.110163:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016133.113094:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335347712:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016133.113142:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711665c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e646c expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.113160:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711665c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e646c expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.113332:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016133.114220:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333847552:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4226us (4655us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016133.114237:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11260 00000100:00100000:0.0:1734016133.116770:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.117542:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333847680 00000100:00100000:2.0:1734016133.117556:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333847680 00000100:00100000:2.0:1734016133.118142:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11261 00000100:00100000:2.0:1734016133.118155:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333847680:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016133.118179:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016133.118208:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116663 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6473 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.118258:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116639 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->1818623) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6449 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.118266:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016133.118268:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016133.118272:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116663 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1753088->1757183] (req 1753088->1757183) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6473 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.118307:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116639 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->1818623) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6449 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.118322:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->1818623) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6449 expref: 9 pid: 7684 timeout: 500 lvb_type: 0 00000100:00100000:2.0:1734016133.118336:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335347840:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016133.118416:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016133.121379:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335347840:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016133.121450:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116663 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1753088->1757183] (req 1753088->1757183) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6473 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.121496:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016133.121581:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247333847680:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3427us (4831us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016133.121596:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11261 00000100:00100000:0.0:1734016133.121969:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.122132:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333847808 00000100:00100000:3.0:1734016133.122149:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333847808 00002000:00100000:3.0:1734016133.122221:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (1810432->1818623) req@ffff880075609500 x1818247333847808/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 8680/0 e 0 to 0 dl 1734016144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016133.122234:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609500 with x1818247333847808 ext(1810432->1818623) 00010000:00010000:3.0:1734016133.122245:0:7688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6449 expref: 10 pid: 7684 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.122268:0:7688:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6449 expref: 10 pid: 7684 timeout: 500 lvb_type: 0 00002000:00010000:3.0:1734016133.122277:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880075609500 00000100:00100000:3.0:1734016133.122323:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 286 00000100:00100000:3.0:1734016133.122331:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333847808:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016133.125408:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333847808:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 3053us (3418us total) trans 4294968018 rc 0/0 00000100:00100000:3.0:1734016133.125428:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 286 00002000:00100000:3.0:1734016133.125449:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (1810432->1818623) req@ffff880075609500 x1818247333847808/t4294968018(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 8680/448 e 0 to 0 dl 1734016144 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016133.125460:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609500 with x1818247333847808 ext(1810432->1818623) 00010000:00010000:3.0:1734016133.125474:0:7688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6449 expref: 12 pid: 7684 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.125499:0:7688:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6449 expref: 12 pid: 7684 timeout: 500 lvb_type: 0 00002000:00010000:3.0:1734016133.125507:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880075609500 00000100:00100000:0.0:1734016133.129036:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.129192:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333847936 00000100:00100000:3.0:1734016133.129207:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333847936 00010000:00010000:3.0:1734016133.129279:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6449 expref: 12 pid: 7684 timeout: 500 lvb_type: 0 00000100:00100000:3.0:1734016133.129342:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3127 00000100:00100000:3.0:1734016133.129355:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333847936:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016133.129382:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1734016133.129411:0:7698:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 64 -> 72 00010000:00010000:3.0:1734016133.129418:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6449 expref: 12 pid: 7684 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.129432:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116639 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->1818623) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6449 expref: 12 pid: 7684 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.129473:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116639 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->1818623) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6449 expref: 12 pid: 7684 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.129739:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016133.129743:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016133.129755:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116663 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1753088->1757183) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6473 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.129766:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116663 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1753088->1757183) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6473 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.129847:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116663 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1753088->1757183) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6473 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.129865:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335347968:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016133.130371:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016133.139401:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.139537:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333848192 00000100:00100000:2.0:1734016133.139551:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333848192 00002000:00100000:2.0:1734016133.139612:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (28672->4194303) req@ffff88007560bb80 x1818247333848192/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:94/0 lens 488/0 e 0 to 0 dl 1734016144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016133.139626:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560bb80 with x1818247333848192 ext(28672->4194303) 00002000:00010000:2.0:1734016133.139633:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007560bb80 00000100:00100000:3.0:1734016133.139759:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335347968:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016133.139793:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016133.139906:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333847936:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 10549us (10891us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016133.139922:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3127 00000100:00100000:2.0:1734016133.140395:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8828 00000100:00100000:2.0:1734016133.140404:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333848192:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016133.197877:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333848192:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 57444us (58464us total) trans 0 rc 4165632/4165632 00000100:00100000:3.0:1734016133.197904:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8828 00002000:00100000:3.0:1734016133.197930:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (28672->4194303) req@ffff88007560bb80 x1818247333848192/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:94/0 lens 488/440 e 0 to 0 dl 1734016144 ref 1 fl Complete:/200/0 rc 4165632/4165632 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016133.197944:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560bb80 with x1818247333848192 ext(28672->4194303) 00002000:00010000:3.0:1734016133.197956:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007560bb80 00000100:00100000:0.0:1734016133.206686:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.209689:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333848320 00000100:00100000:2.0:1734016133.209714:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333848320 00000100:00100000:2.0:1734016133.209903:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11262 00000100:00100000:2.0:1734016133.209915:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333848320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016133.209954:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016133.209995:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711666a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e647a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.210052:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116601 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->221183) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6411 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.210064:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016133.210069:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016133.210074:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711666a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [2953216->2961407] (req 2953216->2961407) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e647a expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.210133:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116601 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->221183) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6411 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.210152:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116601 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->221183) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6411 expref: 7 pid: 7682 timeout: 500 lvb_type: 0 00000100:00100000:2.0:1734016133.210170:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335348096:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016133.210320:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016133.216785:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.217355:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335348096:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016133.217428:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711666a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [2953216->2961407] (req 2953216->2961407) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e647a expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.217465:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:3.0:1734016133.218128:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333848448 00000100:00100000:3.0:1734016133.218140:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333848448 00010000:00010000:3.0:1734016133.218191:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116601 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6411 expref: 8 pid: 7682 timeout: 500 lvb_type: 0 00000100:00100000:3.0:1734016133.218256:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3128 00000100:00100000:3.0:1734016133.218266:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333848448:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016133.218291:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016133.218329:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116601 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 208896->221183) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6411 expref: 8 pid: 7682 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.218347:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116601 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 208896->221183) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6411 expref: 8 pid: 7682 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.218388:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116601 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 208896->221183) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6411 expref: 8 pid: 7682 timeout: 500 lvb_type: 0 00000100:00100000:2.0:1734016133.219283:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247333848320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9358us (12608us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016133.219299:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11262 00010000:00010000:3.0:1734016133.220534:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016133.220541:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016133.220557:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711666a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->2961407) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e647a expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.220572:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711666a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->2961407) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e647a expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.220645:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711666a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->2961407) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e647a expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.220677:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335348224:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016133.220781:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016133.225344:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.225398:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333848704 00000100:00100000:0.0:1734016133.225409:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333848704 00002000:00100000:0.0:1734016133.225470:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (2953216->3645439) req@ffff88007560b800 x1818247333848704/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 504/0 e 0 to 0 dl 1734016144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016133.225484:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560b800 with x1818247333848704 ext(2953216->3645439) 00002000:00010000:0.0:1734016133.225492:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560b800 00000100:00100000:3.0:1734016133.225993:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335348224:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016133.226030:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016133.226108:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333848448:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7841us (9355us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016133.226120:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3128 00000100:00100000:1.0:1734016133.226904:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8829 00000100:00100000:1.0:1734016133.226918:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333848704:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016133.233523:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333848704:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 6584us (8168us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1734016133.233545:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8829 00002000:00100000:1.0:1734016133.233566:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2953216->3645439) req@ffff88007560b800 x1818247333848704/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 504/440 e 0 to 0 dl 1734016144 ref 1 fl Complete:/200/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016133.233575:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560b800 with x1818247333848704 ext(2953216->3645439) 00002000:00010000:1.0:1734016133.233584:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560b800 00000100:00100000:0.0:1734016133.235604:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016133.235707:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333848960 00000100:00100000:1.0:1734016133.235721:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333848960 00002000:00100000:1.0:1734016133.235785:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2957312->2961407) req@ffff88007560a680 x1818247333848960/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 488/0 e 0 to 0 dl 1734016144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016133.235794:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560a680 with x1818247333848960 ext(2957312->2961407) 00002000:00010000:1.0:1734016133.235844:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560a680 00000100:00100000:1.0:1734016133.235878:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8830 00000100:00100000:1.0:1734016133.235887:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333848960:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016133.236132:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333848960:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 244us (540us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016133.236141:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8830 00002000:00100000:1.0:1734016133.236147:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2957312->2961407) req@ffff88007560a680 x1818247333848960/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 488/4536 e 0 to 0 dl 1734016144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016133.236153:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560a680 with x1818247333848960 ext(2957312->2961407) 00002000:00010000:1.0:1734016133.236155:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007560a680 00000100:00100000:2.0:1734016133.242897:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.243161:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333849088 00000100:00100000:0.0:1734016133.243184:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333849088 00000100:00100000:0.0:1734016133.243280:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11263 00000100:00100000:0.0:1734016133.243290:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333849088:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016133.243336:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016133.243375:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27116671 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6481 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016133.243478:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335348352:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016133.243584:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016133.245886:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335348352:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016133.245951:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27116671 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6481 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.245977:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27116671 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6481 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.249707:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582f40, rc 0) 00000100:00100000:2.0:1734016133.249906:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333849088:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6599us (7018us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016133.249924:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11263 00000100:00100000:2.0:1734016133.253541:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.253744:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333849216 00000100:00100000:0.0:1734016133.253760:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333849216 00000100:00100000:0.0:1734016133.257371:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11264 00000100:00100000:0.0:1734016133.257394:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333849216:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016133.257436:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016133.257479:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27116678 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6488 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016133.257586:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335348480:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016133.257710:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016133.266522:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335348480:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016133.266591:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27116678 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6488 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016133.266614:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27116678 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6488 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016133.271405:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75818c0, rc 0) 00000100:00100000:3.0:1734016133.271793:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333849216:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 14388us (18254us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.271830:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11264 00000100:00100000:0.0:1734016133.276125:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.276263:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333849344 00000100:00100000:3.0:1734016133.276280:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333849344 00000100:00100000:3.0:1734016133.276555:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11265 00000100:00100000:3.0:1734016133.276566:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333849344:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.276598:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.276632:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711667f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e648f expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.276727:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335348608:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.276909:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.285338:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335348608:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016133.285408:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711667f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e648f expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.285429:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711667f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e648f expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.285478:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016133.285595:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333849344:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9027us (9494us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.285611:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11265 00000100:00100000:2.0:1734016133.295710:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.296721:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333849472 00000100:00100000:3.0:1734016133.296740:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333849472 00000100:00100000:3.0:1734016133.296849:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11266 00000100:00100000:3.0:1734016133.296860:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333849472:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.296897:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.296936:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27116686 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6496 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.297016:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335348736:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.297116:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.303282:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335348736:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016133.303346:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27116686 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6496 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.303367:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27116686 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6496 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.303397:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016133.303962:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333849472:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7100us (8281us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.303973:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11266 00000100:00100000:0.0:1734016133.308797:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.311226:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333849728 00000100:00100000:3.0:1734016133.311245:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333849728 00000100:00100000:3.0:1734016133.311493:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2307 00000100:00100000:3.0:1734016133.311505:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:10406:x1818247333849728:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016133.311607:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016133.311676:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271165d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63e0 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.315115:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016133.315145:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016133.315625:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711668d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016133.315671:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271165c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d9 expref: 29 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.315679:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711668d lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016133.315750:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271165c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d9 expref: 29 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.315780:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271165c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d9 expref: 29 pid: 6478 timeout: 500 lvb_type: 0 00000100:00100000:3.0:1734016133.315821:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335348864:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016133.315966:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.322059:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335348864:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016133.322125:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711668d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016133.322741:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.322872:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333849856 00000100:00100000:3.0:1734016133.322885:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333849856 00010000:00010000:3.0:1734016133.322958:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271165c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d9 expref: 30 pid: 6478 timeout: 500 lvb_type: 0 00000100:00100000:3.0:1734016133.323028:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3129 00000100:00100000:3.0:1734016133.323043:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075dea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+30:1981:x1818247333849856:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016133.323074:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016133.323085:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271165c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d9 expref: 30 pid: 6478 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.323107:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271165c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d9 expref: 30 pid: 6478 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.323153:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271165c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e63d9 expref: 30 pid: 6478 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.323206:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016133.323214:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711668d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016133.323231:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711668d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016133.323247:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711668d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016133.323285:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016133.323365:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075dea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+29:1981:x1818247333849856:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 326us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016133.323374:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3129 00010000:00010000:3.0:1734016133.323405:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711668d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016133.323411:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711668d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:3.0:1734016133.323658:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968801 00000004:00010000:3.0:1734016133.323763:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075deb800 reply state ffff88012d4fb000 transno 4294968802 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711668d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016133.323772:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016133.323925:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+25:10406:x1818247333849728:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 12423us (15155us total) trans 4294968802 rc 0/0 00000100:00100000:3.0:1734016133.323935:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2307 00000020:00080000:3.0:1734016133.323940:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1734016133.327631:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711668d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016133.327653:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711668d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016133.327671:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711668d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016133.327681:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df7cc0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016133.327689:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711668d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016133.327701:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711668d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016133.327725:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:0.0:1734016133.327727:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016133.327732:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711668d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016133.327737:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711668d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016133.330385:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.330517:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333849984 00000100:00100000:2.0:1734016133.330534:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333849984 00000100:00100000:1.0:1734016133.331206:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11267 00000100:00100000:1.0:1734016133.331220:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247333849984:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016133.331251:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016133.331285:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116694 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e649d expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016133.331337:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116663 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1753088->1757183) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6473 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016133.331348:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016133.331351:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016133.331356:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116694 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e649d expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016133.331423:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116663 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1753088->1757183) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6473 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016133.331441:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116663 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1753088->1757183) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6473 expref: 9 pid: 7684 timeout: 500 lvb_type: 0 00000100:00100000:1.0:1734016133.331459:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e604700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335348992:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016133.335091:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016133.346486:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e604700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335348992:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016133.346561:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116694 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e649d expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016133.346601:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016133.346762:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:10406:x1818247333849984:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 15541us (16399us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016133.346776:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11267 00000100:00100000:0.0:1734016133.358569:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.360226:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333850112 00000100:00100000:2.0:1734016133.360257:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333850112 00010000:00010000:2.0:1734016133.360345:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116663 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1753088->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6473 expref: 9 pid: 7684 timeout: 500 lvb_type: 0 00000100:00100000:2.0:1734016133.360428:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3130 00000100:00100000:2.0:1734016133.360440:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333850112:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016133.360474:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016133.360515:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116663 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1753088->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6473 expref: 9 pid: 7684 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1734016133.360533:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116663 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1753088->1757183) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6473 expref: 9 pid: 7684 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1734016133.360569:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116663 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1753088->1757183) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6473 expref: 9 pid: 7684 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1734016133.360610:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016133.360614:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016133.360623:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116694 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e649d expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.360634:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116694 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e649d expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.360698:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116694 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e649d expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016133.360716:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335349120:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016133.360864:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.367730:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.367920:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335349120:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016133.367970:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016133.368071:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333850112:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7631us (9539us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016133.368091:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3130 00000100:00100000:1.0:1734016133.369534:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333850240 00000100:00100000:1.0:1734016133.369554:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333850240 00000100:00100000:1.0:1734016133.369623:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11268 00000100:00100000:1.0:1734016133.369633:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333850240:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016133.369679:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016133.369714:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc2711669b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e64a4 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016133.369768:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711666a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->2961407) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e647a expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016133.369779:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016133.369781:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016133.369787:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc2711669b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64a4 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016133.369859:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711666a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->2961407) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e647a expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016133.369876:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711666a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->2961407) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e647a expref: 8 pid: 7684 timeout: 500 lvb_type: 0 00000100:00100000:1.0:1734016133.369893:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e604700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335349248:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016133.370005:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016133.374387:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e604700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335349248:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016133.374478:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc2711669b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64a4 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016133.374530:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016133.375028:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247333850240:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5393us (7326us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016133.375045:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11268 00000100:00100000:0.0:1734016133.375942:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.377406:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333850368 00000100:00100000:2.0:1734016133.377425:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333850368 00002000:00100000:2.0:1734016133.377517:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (2953216->2961407) req@ffff880075de8000 x1818247333850368/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 8680/0 e 0 to 0 dl 1734016144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016133.377531:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075de8000 with x1818247333850368 ext(2953216->2961407) 00010000:00010000:2.0:1734016133.377549:0:7688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711666a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e647a expref: 9 pid: 7684 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1734016133.377570:0:7688:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711666a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e647a expref: 9 pid: 7684 timeout: 500 lvb_type: 0 00002000:00010000:2.0:1734016133.377580:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880075de8000 00000100:00100000:2.0:1734016133.377637:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 287 00000100:00100000:2.0:1734016133.377647:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333850368:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016133.379339:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333850368:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1677us (3388us total) trans 4294969495 rc 0/0 00000100:00100000:0.0:1734016133.379354:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 287 00002000:00100000:0.0:1734016133.379368:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (2953216->2961407) req@ffff880075de8000 x1818247333850368/t4294969495(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 8680/448 e 0 to 0 dl 1734016144 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016133.379378:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075de8000 with x1818247333850368 ext(2953216->2961407) 00010000:00010000:0.0:1734016133.379388:0:7688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711666a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e647a expref: 11 pid: 7684 timeout: 500 lvb_type: 0 00010000:00010000:0.0:1734016133.379406:0:7688:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711666a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e647a expref: 11 pid: 7684 timeout: 500 lvb_type: 0 00002000:00010000:0.0:1734016133.379414:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880075de8000 00000100:00100000:0.0:1734016133.382571:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.383267:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333850496 00000100:00100000:2.0:1734016133.383284:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333850496 00010000:00010000:2.0:1734016133.383345:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711666a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e647a expref: 11 pid: 7684 timeout: 500 lvb_type: 0 00000100:00100000:2.0:1734016133.383475:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3131 00000100:00100000:2.0:1734016133.383488:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333850496:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016133.383519:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1734016133.383556:0:6465:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 64 -> 80 00010000:00010000:2.0:1734016133.383562:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711666a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2953216->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e647a expref: 11 pid: 7684 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1734016133.383578:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711666a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2953216->2961407) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e647a expref: 11 pid: 7684 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1734016133.383614:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711666a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2953216->2961407) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e647a expref: 11 pid: 7684 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1734016133.383874:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016133.383877:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016133.383886:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc2711669b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64a4 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.383896:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc2711669b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64a4 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.383947:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc2711669b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64a4 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016133.383963:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335349376:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016133.384725:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016133.392108:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.392194:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.392281:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333850752 00000100:00100000:0.0:1734016133.392298:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333850752 00002000:00010000:0.0:1734016133.392375:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:0.0:1734016133.392384:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075dead80 with x1818247333850752 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016133.392408:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075dead80. 00000100:00100000:0.0:1734016133.392441:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333850624 00000100:00100000:0.0:1734016133.392444:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333850624 00002000:00010000:0.0:1734016133.392460:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4022426->18446744073709551615) 00002000:00100000:0.0:1734016133.392463:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075de9c00 with x1818247333850624 ext(4022426->18446744073709551615) 00002000:00010000:0.0:1734016133.392476:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075de9c00. 00000100:00100000:0.0:1734016133.392515:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8831 00000100:00100000:0.0:1734016133.392526:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333850752:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:1.0:1734016133.394503:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8832 00000100:00100000:1.0:1734016133.394517:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333850624:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:2.0:1734016133.394829:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335349376:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016133.394865:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016133.394972:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333850496:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 11485us (12431us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016133.394985:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3131 00002000:00010000:1.0:1734016133.395016:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 4022426 00002000:00010000:1.0:1734016133.395021:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016133 -> 1734016133 00002000:00010000:1.0:1734016133.395024:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016133 -> 1734016133 00002000:00010000:1.0:1734016133.395026:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016133 -> 1734016133 00002000:00010000:1.0:1734016133.395028:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 72 -> 72 00000100:00100000:1.0:1734016133.395060:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333850624:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 546us (2867us total) trans 4294968019 rc 0/0 00000100:00100000:1.0:1734016133.395066:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8832 00002000:00010000:1.0:1734016133.395071:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4022426->18446744073709551615) 00002000:00100000:1.0:1734016133.395075:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075de9c00 with x1818247333850624 ext(4022426->18446744073709551615) 00002000:00010000:1.0:1734016133.395082:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075de9c00. 00002000:00010000:0.0:1734016133.396689:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 3643390 -> 0 00002000:00010000:0.0:1734016133.396695:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016133 -> 1734016133 00002000:00010000:0.0:1734016133.396697:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016133 -> 1734016133 00002000:00010000:0.0:1734016133.396700:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016133 -> 1734016133 00002000:00010000:0.0:1734016133.396701:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 80 -> 0 00000100:00100000:0.0:1734016133.396734:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333850752:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 4210us (4664us total) trans 4294969496 rc 0/0 00000100:00100000:0.0:1734016133.396740:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8831 00002000:00010000:0.0:1734016133.396743:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:0.0:1734016133.396745:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075dead80 with x1818247333850752 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016133.396751:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075dead80. 00000100:00100000:0.0:1734016133.401515:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.403101:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333850880 00000100:00100000:3.0:1734016133.403116:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333850880 00000100:00100000:3.0:1734016133.403721:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2308 00000100:00100000:3.0:1734016133.403734:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+29:10406:x1818247333850880:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.403769:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.403826:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc271166a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e64ab expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.404001:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271166a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016133.404018:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271166a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016133.404034:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271166a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016133.404070:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 4022426 00000004:00200000:3.0:1734016133.404075:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016133.404099:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271166a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016133.404127:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc271166a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ab expref: 31 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.404172:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271166a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ab expref: 30 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.404187:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016133.404190:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016133.404194:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016133.405404:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+30:10406:x1818247333850880:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1658us (3902us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016133.405416:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2308 00000100:00100000:0.0:1734016133.408738:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.408915:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.409066:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333851008 00000100:00100000:2.0:1734016133.409080:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333851008 00000100:00100000:2.0:1734016133.409140:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333851136 00000100:00100000:2.0:1734016133.409143:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333851136 00000100:00100000:2.0:1734016133.409172:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11269 00000100:00100000:2.0:1734016133.409182:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333851008:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016133.409213:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016133.409241:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271166b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e64b2 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016133.409334:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335349504:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016133.409414:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016133.409449:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11270 00000100:00100000:2.0:1734016133.409453:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333851136:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016133.409462:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016133.409475:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271166b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e64b9 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016133.409503:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335349632:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016133.409519:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00000100:00100000:2.0:1734016133.411677:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335349504:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016133.411721:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271166b0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64b2 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.411735:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271166b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64b2 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1734016133.412229:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335349632:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016133.412251:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271166b7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64b9 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.412260:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc271166b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64b9 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.412269:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:3.0:1734016133.412320:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333851136:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2863us (3402us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.412329:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11270 00010000:00010000:2.0:1734016133.413054:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016133.413093:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333851008:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3912us (4384us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016133.413099:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11269 00000100:00100000:2.0:1734016133.416996:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.417060:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.417151:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333851392 00000100:00100000:0.0:1734016133.417168:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333851392 00000100:00100000:0.0:1734016133.417249:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333851264 00000100:00100000:0.0:1734016133.417252:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333851264 00000100:00100000:0.0:1734016133.417297:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11271 00000100:00100000:0.0:1734016133.417308:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333851392:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016133.417344:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016133.417381:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc271166be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e64c7 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016133.417490:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075deb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335349760:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016133.417587:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016133.417733:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11272 00000100:00100000:0.0:1734016133.417738:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333851264:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016133.417749:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016133.417764:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7581680/0x5e3a3adc271166c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e64c0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016133.417796:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075deb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335349888:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016133.417849:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016133.422148:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075deb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335349760:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016133.422210:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc271166be lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64c7 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.422227:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc271166be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64c7 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.422255:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581200, rc 0) 00000100:00100000:2.0:1734016133.422327:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333851392:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5018us (5351us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016133.422337:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11271 00000100:00100000:2.0:1734016133.423251:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075deb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335349888:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016133.423275:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581680/0x5e3a3adc271166c5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64c0 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.423286:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581680/0x5e3a3adc271166c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64c0 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.423297:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581680, rc 0) 00000100:00100000:2.0:1734016133.424249:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333851264:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6506us (7185us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016133.424256:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11272 00000100:00100000:0.0:1734016133.428204:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.428902:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.429003:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333851520 00000100:00100000:3.0:1734016133.429017:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333851520 00000100:00100000:3.0:1734016133.429124:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333851648 00000100:00100000:3.0:1734016133.429128:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333851648 00000100:00100000:3.0:1734016133.429165:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11273 00000100:00100000:3.0:1734016133.429177:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333851520:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.429210:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.429245:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271166cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e64ce expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.429348:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335350016:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016133.429471:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11274 00000100:00100000:1.0:1734016133.429478:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333851648:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016133.429488:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016133.429499:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc271166d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e64d5 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016133.429539:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e604700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335350144:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.430789:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016133.430962:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.434441:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335350016:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016133.434525:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271166cc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ce expref: 12 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.434549:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271166cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ce expref: 12 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.434573:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016133.434647:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333851520:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5472us (6455us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.434668:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11273 00000100:00100000:1.0:1734016133.435477:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e604700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335350144:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016133.435507:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc271166d3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64d5 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016133.435517:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc271166d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64d5 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016133.435543:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016133.435574:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333851648:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6095us (6673us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016133.435582:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11274 00000100:00100000:0.0:1734016133.438520:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.439328:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.439445:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333851904 00000100:00100000:3.0:1734016133.439461:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333851904 00000100:00100000:3.0:1734016133.439509:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333851776 00000100:00100000:3.0:1734016133.439513:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333851776 00000100:00100000:3.0:1734016133.439768:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11275 00000100:00100000:3.0:1734016133.439778:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333851904:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.439828:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.439858:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271166da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e64e3 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.439936:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335350272:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016133.440345:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11276 00000100:00100000:0.0:1734016133.440353:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333851776:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016133.440366:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016133.440383:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7580480/0x5e3a3adc271166e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e64dc expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016133.440423:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075653800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335350400:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.440871:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016133.441040:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016133.443830:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335350272:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016133.443891:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271166da lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64e3 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.443910:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271166da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64e3 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.443948:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:2.0:1734016133.444029:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333851904:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4252us (5525us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016133.444041:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11275 00000100:00100000:1.0:1734016133.444842:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075653800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335350400:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016133.444888:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7580480/0x5e3a3adc271166e1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64dc expref: 12 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016133.444900:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7580480/0x5e3a3adc271166e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64dc expref: 12 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016133.444930:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:1.0:1734016133.444967:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333851776:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4615us (5640us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016133.444981:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11276 00000100:00100000:0.0:1734016133.452306:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.452992:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333852160 00000100:00100000:3.0:1734016133.453007:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333852160 00000100:00100000:3.0:1734016133.453349:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2309 00000100:00100000:3.0:1734016133.453359:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+30:10406:x1818247333852160:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016133.453452:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016133.453494:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271166a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ab expref: 30 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.453867:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016133.454168:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016133.454404:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271166e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016133.454421:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271166e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016133.454431:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271166e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:3.0:1734016133.454465:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968803 00000004:00010000:3.0:1734016133.454485:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075650700 reply state ffff880073913000 transno 4294968804 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271166e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016133.454493:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016133.454594:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+32:10406:x1818247333852160:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 1234us (2301us total) trans 4294968804 rc 0/0 00000100:00100000:3.0:1734016133.454602:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2309 00000020:00080000:3.0:1734016133.454608:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016133.458397:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016133.458536:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333852288 00000100:00100000:1.0:1734016133.458555:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333852288 00000100:00100000:1.0:1734016133.458638:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11277 00000100:00100000:1.0:1734016133.458648:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:10406:x1818247333852288:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016133.458691:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016133.458724:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271166ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e64ea expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016133.458782:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116694 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e649d expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016133.458793:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016133.458796:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016133.458831:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271166ef lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ea expref: 12 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016133.458892:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116694 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e649d expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016133.458916:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116694 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e649d expref: 8 pid: 7682 timeout: 500 lvb_type: 0 00000100:00100000:1.0:1734016133.458932:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e604700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335350528:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016133.459029:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00010000:00010000:2.0:1734016133.459643:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271166e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016133.459666:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271166e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016133.459673:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271166e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016133.459680:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4240 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016133.459686:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271166e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016133.459693:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271166e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016133.459716:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016133.459719:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016133.459724:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271166e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016133.459728:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271166e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016133.462368:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016133.462518:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e604700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335350528:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016133.462572:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271166ef lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ea expref: 12 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016133.462596:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016133.462676:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:10406:x1818247333852288:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4029us (4305us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016133.462688:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11277 00000100:00100000:2.0:1734016133.464708:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333852416 00000100:00100000:2.0:1734016133.464735:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333852416 00010000:00010000:2.0:1734016133.464830:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116694 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e649d expref: 9 pid: 7682 timeout: 500 lvb_type: 0 00000100:00100000:2.0:1734016133.464901:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3132 00000100:00100000:2.0:1734016133.464914:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075652300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333852416:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016133.464944:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016133.464990:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116694 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e649d expref: 9 pid: 7682 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1734016133.465006:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116694 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e649d expref: 9 pid: 7682 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1734016133.465043:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116694 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e649d expref: 9 pid: 7682 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1734016133.465064:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016133.465066:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016133.465074:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271166ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ea expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.465085:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271166ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ea expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.465144:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271166ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ea expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016133.465158:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335350656:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016133.465243:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016133.470881:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335350656:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016133.470921:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016133.470996:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075652300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333852416:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6084us (8648us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016133.471011:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3132 00000100:00100000:0.0:1734016133.471185:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.471229:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333852544 00000100:00100000:0.0:1734016133.471237:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333852544 00000100:00100000:0.0:1734016133.471282:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11278 00000100:00100000:0.0:1734016133.471291:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:10406:x1818247333852544:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016133.471319:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016133.471351:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271166f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e64f1 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016133.471392:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc2711669b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64a4 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016133.471402:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016133.471405:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016133.471409:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271166f6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64f1 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016133.471449:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc2711669b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64a4 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016133.471463:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc2711669b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64a4 expref: 8 pid: 7682 timeout: 500 lvb_type: 0 00000100:00100000:0.0:1734016133.471479:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075651180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335350784:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016133.471530:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016133.477641:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.478003:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075651180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335350784:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016133.478049:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271166f6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64f1 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016133.478071:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:2.0:1734016133.478133:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:10406:x1818247333852544:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6844us (6949us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016133.478143:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11278 00000100:00100000:3.0:1734016133.478639:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333852672 00000100:00100000:3.0:1734016133.478653:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333852672 00010000:00010000:3.0:1734016133.478697:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc2711669b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64a4 expref: 9 pid: 7682 timeout: 500 lvb_type: 0 00000100:00100000:3.0:1734016133.478741:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3133 00000100:00100000:3.0:1734016133.478749:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075650e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333852672:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016133.478771:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016133.478843:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc2711669b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64a4 expref: 9 pid: 7682 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.478858:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc2711669b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64a4 expref: 9 pid: 7682 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.478897:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc2711669b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64a4 expref: 9 pid: 7682 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.478928:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016133.478931:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016133.478940:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271166f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64f1 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.478951:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271166f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64f1 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.478999:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271166f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64f1 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.479014:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335350912:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016133.479088:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016133.482667:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.482838:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016133.482981:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333852928 00000100:00100000:1.0:1734016133.482995:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333852928 00002000:00010000:1.0:1734016133.483057:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (2983201->18446744073709551615) 00002000:00100000:1.0:1734016133.483062:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075652680 with x1818247333852928 ext(2983201->18446744073709551615) 00002000:00010000:1.0:1734016133.483077:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075652680. 00000100:00100000:1.0:1734016133.483100:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333852800 00000100:00100000:1.0:1734016133.483103:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333852800 00002000:00010000:1.0:1734016133.483114:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:1.0:1734016133.483116:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075653480 with x1818247333852800 ext(4194304->18446744073709551615) 00002000:00010000:1.0:1734016133.483128:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075653480. 00000100:00100000:1.0:1734016133.483145:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8833 00000100:00100000:1.0:1734016133.483157:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333852928:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016133.483461:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 2983201 00002000:00010000:1.0:1734016133.483464:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016133 -> 1734016134 00002000:00010000:1.0:1734016133.483467:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016133 -> 1734016133 00002000:00010000:1.0:1734016133.483469:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016133 -> 1734016134 00002000:00010000:1.0:1734016133.483470:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1734016133.483541:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333852928:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 386us (903us total) trans 4294969497 rc 0/0 00000100:00100000:1.0:1734016133.483555:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8833 00002000:00010000:1.0:1734016133.483560:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (2983201->18446744073709551615) 00002000:00100000:1.0:1734016133.483562:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075652680 with x1818247333852928 ext(2983201->18446744073709551615) 00002000:00010000:1.0:1734016133.483565:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075652680. 00000100:00100000:1.0:1734016133.483590:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8834 00000100:00100000:1.0:1734016133.483594:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333852800:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016133.483713:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4022426 -> 4194304 00002000:00010000:1.0:1734016133.483716:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016133 -> 1734016134 00002000:00010000:1.0:1734016133.483718:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016133 -> 1734016133 00002000:00010000:1.0:1734016133.483720:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016133 -> 1734016134 00002000:00010000:1.0:1734016133.483722:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 72 -> 72 00000100:00100000:1.0:1734016133.483739:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333852800:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 144us (940us total) trans 4294968020 rc 0/0 00000100:00100000:1.0:1734016133.483743:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8834 00002000:00010000:1.0:1734016133.483745:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:1.0:1734016133.483748:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075653480 with x1818247333852800 ext(4194304->18446744073709551615) 00002000:00010000:1.0:1734016133.483751:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075653480. 00000100:00100000:3.0:1734016133.484288:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335350912:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016133.484328:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016133.484376:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075650e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333852672:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5628us (6747us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016133.484387:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3133 00000100:00100000:0.0:1734016133.489545:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.490712:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333853056 00000100:00100000:3.0:1734016133.490743:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333853056 00000100:00100000:3.0:1734016133.493342:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2310 00000100:00100000:3.0:1734016133.493380:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+31:10406:x1818247333853056:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.493463:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.493516:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271166fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e64f8 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.493739:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116704 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016133.493768:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016133.493788:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016133.493865:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 7177505 00000004:00200000:3.0:1734016133.493872:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016133.493902:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016133.493933:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271166fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64f8 expref: 33 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.493988:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116704 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64f8 expref: 32 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.494000:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016133.494006:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016133.494013:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016133.494164:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+32:10406:x1818247333853056:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 796us (4647us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016133.494177:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2310 00000100:00100000:0.0:1734016133.514790:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.514980:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016133.515071:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333853440 00000100:00100000:1.0:1734016133.515094:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333853440 00002000:00100000:1.0:1734016133.515172:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (0->2985983) req@ffff880075651180 x1818247333853440/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 488/0 e 0 to 0 dl 1734016144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016133.515188:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075651180 with x1818247333853440 ext(0->2985983) 00002000:00010000:1.0:1734016133.515196:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075651180 00000100:00100000:1.0:1734016133.515233:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333853568 00000100:00100000:1.0:1734016133.515237:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333853568 00002000:00100000:1.0:1734016133.515254:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff880075653800 x1818247333853568/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 488/0 e 0 to 0 dl 1734016144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016133.515260:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075653800 with x1818247333853568 ext(0->4194303) 00002000:00010000:1.0:1734016133.515264:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075653800 00000100:00100000:1.0:1734016133.515289:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8835 00000100:00100000:1.0:1734016133.515300:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333853440:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016133.523788:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8836 00000100:00100000:0.0:1734016133.523837:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333853568:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:3.0:1734016133.607127:0:8957:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1734016133.621160:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333853440:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 105844us (106381us total) trans 0 rc 2985984/2985984 00000100:00100000:1.0:1734016133.621177:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8835 00002000:00100000:1.0:1734016133.621193:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (0->2985983) req@ffff880075651180 x1818247333853440/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 488/440 e 0 to 0 dl 1734016144 ref 1 fl Complete:/200/0 rc 2985984/2985984 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016133.621204:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075651180 with x1818247333853440 ext(0->2985983) 00002000:00010000:1.0:1734016133.621211:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075651180 00000100:00100000:0.0:1734016133.660134:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.660342:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333853696 00000100:00100000:3.0:1734016133.660361:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333853696 00000100:00100000:3.0:1734016133.660470:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2311 00000100:00100000:3.0:1734016133.660486:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:10406:x1818247333853696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.660579:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.660615:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711670b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e64ff expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.660779:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116712 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016133.660828:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016133.660847:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016133.660885:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 7177505 00000004:00200000:3.0:1734016133.660893:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016133.660922:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016133.660956:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711670b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ff expref: 26 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.660992:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116712 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ff expref: 25 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.661003:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016133.661007:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016133.661010:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016133.661101:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+25:10406:x1818247333853696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 619us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016133.661110:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2311 00000100:00100000:1.0:1734016133.668050:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333853568:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 144189us (153039us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016133.668074:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8836 00002000:00100000:1.0:1734016133.668098:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff880075653800 x1818247333853568/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 488/440 e 0 to 0 dl 1734016144 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016133.668109:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075653800 with x1818247333853568 ext(0->4194303) 00002000:00010000:1.0:1734016133.668118:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075653800 00000100:00100000:0.0:1734016133.671240:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.673733:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.674356:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333853952 00000100:00100000:2.0:1734016133.674377:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333853952 00000100:00100000:2.0:1734016133.674471:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333853824 00000100:00100000:2.0:1734016133.674473:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333853824 00000100:00100000:2.0:1734016133.674505:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11279 00000100:00100000:2.0:1734016133.674517:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333853952:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016133.674560:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016133.674600:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116719 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e650d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016133.674718:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335351040:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016133.674832:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016133.675040:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11280 00000100:00100000:2.0:1734016133.675045:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333853824:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016133.675055:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016133.675071:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116720 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6506 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016133.675107:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335351168:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016133.675131:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00002000:00010000:2.0:1734016133.679211:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016133 -> 1734016134 00002000:00010000:3.0:1734016133.679216:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016133 -> 1734016134 00000100:00100000:2.0:1734016133.679251:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335351040:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.679251:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335351168:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016133.679300:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116719 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e650d expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.679300:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116720 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6506 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.679319:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116719 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e650d expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.679319:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116720 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6506 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.679351:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00010000:00010000:3.0:1734016133.679353:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:3.0:1734016133.679421:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333853824:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4371us (5710us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.679433:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11280 00000100:00100000:2.0:1734016133.679841:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333853952:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5325us (10052us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016133.679847:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11279 00000100:00100000:0.0:1734016133.690684:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.690789:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.690917:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333854208 00000100:00100000:2.0:1734016133.690998:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333854080 00000100:00100000:2.0:1734016133.691012:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333854080 00000100:00100000:3.0:1734016133.691030:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333854208 00000100:00100000:2.0:1734016133.691118:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11281 00000100:00100000:2.0:1734016133.691127:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333854080:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016133.691157:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016133.691190:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116727 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6514 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016133.691277:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335351296:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.691299:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11282 00000100:00100000:3.0:1734016133.691305:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333854208:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.691315:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.691331:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711672e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e651b expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016133.691366:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.691375:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335351424:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.691404:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016133.695111:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335351296:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016133.695186:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116727 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6514 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.695208:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116727 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6514 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.695239:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016133.695684:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333854080:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4552us (4889us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016133.695698:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11281 00000100:00100000:3.0:1734016133.697349:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335351424:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016133.697400:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711672e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e651b expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.697415:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711672e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e651b expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.699392:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016133.699527:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333854208:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8210us (8860us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.699543:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11282 00000100:00100000:0.0:1734016133.725740:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.730018:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333854336 00000100:00100000:3.0:1734016133.730058:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333854336 00000100:00100000:3.0:1734016133.730207:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11283 00000100:00100000:3.0:1734016133.730217:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247333854336:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.730250:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.730279:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116735 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6522 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.730333:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271166ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ea expref: 12 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.730342:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016133.730344:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016133.730348:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116735 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [5832704->5840895] (req 5832704->5840895) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6522 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.730401:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271166ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ea expref: 12 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.730416:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271166ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ea expref: 12 pid: 8216 timeout: 500 lvb_type: 0 00000100:00100000:3.0:1734016133.730429:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335351552:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016133.730765:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781b40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.735622:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335351552:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016133.735707:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116735 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [5832704->5840895] (req 5832704->5840895) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6522 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.735741:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016133.738160:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:10406:x1818247333854336:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7924us (12420us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016133.738177:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11283 00000100:00100000:0.0:1734016133.747512:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.747672:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333854464 00000100:00100000:3.0:1734016133.747691:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333854464 00010000:00010000:3.0:1734016133.747761:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271166ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ea expref: 13 pid: 8216 timeout: 500 lvb_type: 0 00000100:00100000:3.0:1734016133.747877:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3134 00000100:00100000:3.0:1734016133.747888:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333854464:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016133.747920:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016133.747954:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271166ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ea expref: 13 pid: 8216 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.747970:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271166ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ea expref: 13 pid: 8216 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.748016:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271166ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ea expref: 13 pid: 8216 timeout: 500 lvb_type: 0 00010000:00010000:3.0:1734016133.748062:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016133.748065:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016133.748075:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116735 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5832704->5840895) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6522 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.748085:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116735 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5832704->5840895) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6522 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.748142:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116735 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5832704->5840895) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6522 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.748162:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335351680:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016133.748311:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781b40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.754118:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335351680:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016133.754163:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016133.754189:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.754256:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333854464:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6369us (6762us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016133.754275:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3134 00000100:00100000:0.0:1734016133.754361:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333854592 00000100:00100000:0.0:1734016133.754375:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333854592 00000100:00100000:3.0:1734016133.756062:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11284 00000100:00100000:3.0:1734016133.756071:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333854592:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.756097:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.756143:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711673c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6529 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.756229:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335351808:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.756332:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.760265:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335351808:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016133.760335:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711673c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6529 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.760358:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711673c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6529 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.760389:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016133.763232:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333854592:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7133us (9032us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.763252:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11284 00000100:00100000:1.0:1734016133.767650:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.767761:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333854720 00000100:00100000:3.0:1734016133.767769:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333854720 00000100:00100000:3.0:1734016133.770022:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11285 00000100:00100000:3.0:1734016133.770040:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333854720:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.770066:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.770091:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116743 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6530 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.770159:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335351936:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.772153:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.775566:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335351936:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016133.775633:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116743 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6530 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.775651:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116743 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6530 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.780177:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016133.780287:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333854720:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10245us (12641us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.780299:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11285 00000100:00100000:0.0:1734016133.783569:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.784528:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333854848 00000100:00100000:3.0:1734016133.784542:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333854848 00000100:00100000:3.0:1734016133.784665:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11286 00000100:00100000:3.0:1734016133.784673:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333854848:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.784693:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.784711:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc2711674a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6537 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.784782:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335352064:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.785170:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.788551:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335352064:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016133.788608:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc2711674a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6537 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.788623:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc2711674a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6537 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.789366:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016133.789689:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333854848:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5011us (6126us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.789700:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11286 00000100:00100000:0.0:1734016133.797643:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.799229:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333854976 00000100:00100000:3.0:1734016133.799244:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333854976 00000100:00100000:3.0:1734016133.799312:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11287 00000100:00100000:3.0:1734016133.799321:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333854976:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.799346:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.799370:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116751 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e653e expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.799440:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335352192:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.799534:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.801353:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335352192:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016133.801406:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116751 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e653e expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.801421:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116751 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e653e expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.801461:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016133.801516:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333854976:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2195us (3891us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.801527:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11287 00000100:00100000:0.0:1734016133.805459:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.805512:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333855232 00000100:00100000:0.0:1734016133.805526:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333855232 00002000:00100000:0.0:1734016133.805587:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (3375104->3379199) req@ffff880073790e00 x1818247333855232/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:94/0 lens 488/0 e 0 to 0 dl 1734016144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016133.805600:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790e00 with x1818247333855232 ext(3375104->3379199) 00002000:00010000:0.0:1734016133.805608:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073790e00 00000100:00100000:0.0:1734016133.805635:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8837 00000100:00100000:0.0:1734016133.805642:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333855232:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016133.805928:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333855232:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 284us (484us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016133.805938:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8837 00002000:00100000:0.0:1734016133.805945:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (3375104->3379199) req@ffff880073790e00 x1818247333855232/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:94/0 lens 488/4536 e 0 to 0 dl 1734016144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016133.805953:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790e00 with x1818247333855232 ext(3375104->3379199) 00002000:00010000:0.0:1734016133.805956:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073790e00 00000100:00100000:0.0:1734016133.811036:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.811193:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333855488 00000100:00100000:2.0:1734016133.811208:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333855488 00002000:00100000:2.0:1734016133.811286:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (3379200->3383295) req@ffff880073791500 x1818247333855488/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:94/0 lens 488/0 e 0 to 0 dl 1734016144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016133.811298:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073791500 with x1818247333855488 ext(3379200->3383295) 00002000:00010000:2.0:1734016133.811306:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073791500 00000100:00100000:2.0:1734016133.811352:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8838 00000100:00100000:2.0:1734016133.811360:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333855488:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016133.812206:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333855488:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 842us (1187us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016133.812214:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8838 00002000:00100000:2.0:1734016133.812221:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (3379200->3383295) req@ffff880073791500 x1818247333855488/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:94/0 lens 488/4536 e 0 to 0 dl 1734016144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016133.812228:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073791500 with x1818247333855488 ext(3379200->3383295) 00002000:00010000:2.0:1734016133.812232:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073791500 00000100:00100000:0.0:1734016133.815147:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.815583:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333855616 00000100:00100000:3.0:1734016133.815605:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333855616 00000100:00100000:3.0:1734016133.815692:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11288 00000100:00100000:3.0:1734016133.815705:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333855616:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.815748:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.815784:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116758 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6545 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.815950:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335352320:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.816078:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781900 going to sleep for 11 seconds 00002000:00010000:3.0:1734016133.818778:0:7682:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size: 4194304 -> 5838947 00000100:00100000:3.0:1734016133.818952:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335352320:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016133.819007:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116758 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6545 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.819025:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116758 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6545 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.819557:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016133.820208:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333855616:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4501us (5079us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.820223:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11288 00000100:00100000:0.0:1734016133.825261:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.825427:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333855744 00000100:00100000:3.0:1734016133.825449:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333855744 00000100:00100000:3.0:1734016133.825571:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11289 00000100:00100000:3.0:1734016133.825583:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333855744:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.825621:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.825669:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc2711675f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e654c expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.825777:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335352448:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.826343:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.829250:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335352448:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016133.829339:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc2711675f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e654c expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.829365:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc2711675f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e654c expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.829785:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016133.829948:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333855744:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4364us (4702us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.829961:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11289 00000100:00100000:0.0:1734016133.833318:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.833477:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333855872 00000100:00100000:3.0:1734016133.833492:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333855872 00000100:00100000:3.0:1734016133.833855:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11290 00000100:00100000:3.0:1734016133.833866:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333855872:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.833897:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.833927:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116766 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6553 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.834007:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335352576:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.834094:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.836286:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335352576:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016133.836335:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116766 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6553 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.836350:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116766 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6553 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.836362:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016133.836449:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333855872:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2583us (3150us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.836462:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11290 00000100:00100000:1.0:1734016133.841743:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.841890:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333856000 00000100:00100000:3.0:1734016133.841907:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333856000 00000100:00100000:3.0:1734016133.841989:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11291 00000100:00100000:3.0:1734016133.842001:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333856000:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.842036:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.842063:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc2711676d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e655a expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.842140:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335352704:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.842235:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.844632:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335352704:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016133.844724:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc2711676d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e655a expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.844744:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc2711676d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e655a expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.844953:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016133.845054:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333856000:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3051us (3335us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.845068:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11291 00000100:00100000:1.0:1734016133.848699:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.848844:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333856256 00000100:00100000:2.0:1734016133.848859:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333856256 00002000:00100000:2.0:1734016133.848924:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (3936256->3940351) req@ffff88012e604e00 x1818247333856256/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 488/0 e 0 to 0 dl 1734016144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016133.848936:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604e00 with x1818247333856256 ext(3936256->3940351) 00002000:00010000:2.0:1734016133.848943:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e604e00 00000100:00100000:2.0:1734016133.848987:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8839 00000100:00100000:2.0:1734016133.848997:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333856256:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016133.849245:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333856256:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 249us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016133.849254:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8839 00002000:00100000:2.0:1734016133.849260:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (3936256->3940351) req@ffff88012e604e00 x1818247333856256/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 488/440 e 0 to 0 dl 1734016144 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016133.849267:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604e00 with x1818247333856256 ext(3936256->3940351) 00002000:00010000:2.0:1734016133.849270:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e604e00 00000100:00100000:0.0:1734016133.852540:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.852861:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333856384 00000100:00100000:3.0:1734016133.852880:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333856384 00000100:00100000:3.0:1734016133.852952:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11292 00000100:00100000:3.0:1734016133.852965:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333856384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.852998:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.853034:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116774 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6561 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.853128:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335352832:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.854429:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.856390:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335352832:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016133.856462:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116774 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6561 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.856486:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116774 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6561 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.856513:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016133.857096:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333856384:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4130us (4573us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.857110:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11292 00000100:00100000:0.0:1734016133.859385:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.859514:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333856640 00000100:00100000:2.0:1734016133.859531:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333856640 00002000:00100000:2.0:1734016133.859610:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (3940352->3944447) req@ffff880073790700 x1818247333856640/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 488/0 e 0 to 0 dl 1734016144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016133.859624:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790700 with x1818247333856640 ext(3940352->3944447) 00002000:00010000:2.0:1734016133.859631:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073790700 00000100:00100000:2.0:1734016133.859673:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8840 00000100:00100000:2.0:1734016133.859684:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333856640:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016133.860028:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333856640:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 344us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016133.860039:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8840 00002000:00100000:2.0:1734016133.860047:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (3940352->3944447) req@ffff880073790700 x1818247333856640/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 488/440 e 0 to 0 dl 1734016144 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016133.860055:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790700 with x1818247333856640 ext(3940352->3944447) 00002000:00010000:2.0:1734016133.860059:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073790700 00000100:00100000:0.0:1734016133.863567:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.863702:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333856768 00000100:00100000:3.0:1734016133.863714:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333856768 00000100:00100000:3.0:1734016133.863778:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11293 00000100:00100000:3.0:1734016133.863787:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333856768:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.863853:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.863881:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc2711677b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6568 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.863976:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335352960:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.864087:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.866097:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335352960:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016133.866143:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc2711677b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6568 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.866158:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc2711677b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6568 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.866212:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016133.866457:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333856768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2667us (2902us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.866468:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11293 00000100:00100000:0.0:1734016133.868996:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.869178:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333857024 00000100:00100000:2.0:1734016133.869193:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333857024 00002000:00100000:2.0:1734016133.869260:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (3944448->3948543) req@ffff880073bbd500 x1818247333857024/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 488/0 e 0 to 0 dl 1734016144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016133.869272:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbd500 with x1818247333857024 ext(3944448->3948543) 00002000:00010000:2.0:1734016133.869278:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbd500 00000100:00100000:2.0:1734016133.869320:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8841 00000100:00100000:2.0:1734016133.869328:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333857024:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016133.869544:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333857024:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 216us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016133.869552:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8841 00002000:00100000:2.0:1734016133.869559:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (3944448->3948543) req@ffff880073bbd500 x1818247333857024/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:94/0 lens 488/440 e 0 to 0 dl 1734016144 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016133.869566:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbd500 with x1818247333857024 ext(3944448->3948543) 00002000:00010000:2.0:1734016133.869569:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbd500 00000100:00100000:0.0:1734016133.873777:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.874204:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333857152 00000100:00100000:3.0:1734016133.874220:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333857152 00000100:00100000:3.0:1734016133.874292:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11294 00000100:00100000:3.0:1734016133.874302:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333857152:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.874333:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.874364:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27116782 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e656f expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.874459:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335353088:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.874545:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.876280:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335353088:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016133.876337:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27116782 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e656f expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.876351:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27116782 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e656f expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.876496:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016133.876564:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333857152:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2260us (2810us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.876577:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11294 00000100:00100000:0.0:1734016133.882160:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.882348:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333857280 00000100:00100000:3.0:1734016133.882361:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333857280 00000100:00100000:3.0:1734016133.882422:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11295 00000100:00100000:3.0:1734016133.882430:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333857280:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.882451:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.882470:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116789 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6576 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.882536:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335353216:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.882607:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.887631:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335353216:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016133.887784:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116789 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6576 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.887907:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116789 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6576 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.887938:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016133.887999:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333857280:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5568us (5852us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.888009:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11295 00000100:00100000:0.0:1734016133.894528:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.895991:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333857408 00000100:00100000:3.0:1734016133.896017:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333857408 00000100:00100000:3.0:1734016133.896116:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11296 00000100:00100000:3.0:1734016133.896126:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:10406:x1818247333857408:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.896160:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.896188:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116790 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e657d expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.896229:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116735 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5832704->5840895) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6522 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.896239:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016133.896242:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016133.896246:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116790 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3198976->3207167] (req 3198976->3207167) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e657d expref: 13 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.896289:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116735 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5832704->5840895) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6522 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.896303:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116735 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5832704->5840895) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6522 expref: 8 pid: 7682 timeout: 501 lvb_type: 0 00000100:00100000:3.0:1734016133.896322:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335353344:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016133.896438:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016133.921252:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.921343:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335353344:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016133.921397:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116790 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3198976->3207167] (req 3198976->3207167) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e657d expref: 13 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.921426:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:2.0:1734016133.921448:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333857536 00000100:00100000:2.0:1734016133.921457:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333857536 00000100:00100000:3.0:1734016133.921499:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:10406:x1818247333857408:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 25374us (26990us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016133.921509:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11296 00002000:00100000:2.0:1734016133.921513:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (3375104->5838946) req@ffff880073bbe680 x1818247333857536/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:94/0 lens 504/0 e 0 to 0 dl 1734016144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016133.921521:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbe680 with x1818247333857536 ext(3375104->5838946) 00010000:00010000:2.0:1734016133.921527:0:7687:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116735 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5832704->5840895) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6522 expref: 9 pid: 7682 timeout: 501 lvb_type: 0 00010000:00010000:2.0:1734016133.921539:0:7687:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116735 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5832704->5840895) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6522 expref: 9 pid: 7682 timeout: 501 lvb_type: 0 00002000:00010000:2.0:1734016133.921545:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880073bbe680 00000100:00100000:2.0:1734016133.921579:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 288 00000100:00100000:2.0:1734016133.921586:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333857536:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016133.936391:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333857536:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 14785us (15145us total) trans 4294968021 rc 0/0 00000100:00100000:2.0:1734016133.936409:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 288 00002000:00100000:2.0:1734016133.936425:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (3375104->5838946) req@ffff880073bbe680 x1818247333857536/t4294968021(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:94/0 lens 504/448 e 0 to 0 dl 1734016144 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016133.936436:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbe680 with x1818247333857536 ext(3375104->5838946) 00010000:00010000:2.0:1734016133.936449:0:7687:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116735 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5832704->5840895) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6522 expref: 11 pid: 7682 timeout: 501 lvb_type: 0 00010000:00010000:2.0:1734016133.936465:0:7687:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116735 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5832704->5840895) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6522 expref: 11 pid: 7682 timeout: 501 lvb_type: 0 00002000:00010000:2.0:1734016133.936472:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880073bbe680 00000100:00100000:0.0:1734016133.941213:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.941869:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333857664 00000100:00100000:3.0:1734016133.941893:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333857664 00010000:00010000:3.0:1734016133.941975:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116735 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5832704->5840895) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6522 expref: 11 pid: 7682 timeout: 501 lvb_type: 0 00000100:00100000:3.0:1734016133.942036:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3135 00000100:00100000:3.0:1734016133.942049:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333857664:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016133.942083:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1734016133.942119:0:6465:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 72 -> 104 00010000:00010000:3.0:1734016133.942127:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116735 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5832704->5840895) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6522 expref: 11 pid: 7682 timeout: 501 lvb_type: 0 00010000:00010000:3.0:1734016133.942144:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116735 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5832704->5840895) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6522 expref: 11 pid: 7682 timeout: 501 lvb_type: 0 00010000:00010000:3.0:1734016133.942198:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116735 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5832704->5840895) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6522 expref: 11 pid: 7682 timeout: 501 lvb_type: 0 00010000:00010000:3.0:1734016133.942253:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016133.942257:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016133.942270:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116790 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3207167) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e657d expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.942284:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3207167) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e657d expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016133.942348:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3207167) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e657d expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.942370:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335353472:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016133.942504:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016133.951530:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.955386:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333857792 00000100:00100000:3.0:1734016133.955426:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333857792 00000100:00100000:3.0:1734016133.955562:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11297 00000100:00100000:3.0:1734016133.955577:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333857792:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016133.955981:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5838947 -> 5838947 00002000:00010000:3.0:1734016133.955986:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016134 -> 1734016134 00002000:00010000:3.0:1734016133.955988:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016134 -> 1734016134 00002000:00010000:3.0:1734016133.955990:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016134 -> 1734016134 00002000:00010000:3.0:1734016133.955992:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 104 -> 104 00000100:00100000:3.0:1734016133.957043:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333857792:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1463us (5535us total) trans 4294968022 rc 0/0 00000100:00100000:3.0:1734016133.957054:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11297 00000100:00100000:3.0:1734016133.957746:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335353472:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016133.957787:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016133.958019:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333857664:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 15973us (16848us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016133.958032:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3135 00000100:00100000:0.0:1734016133.963632:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.963718:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016133.963879:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333857920 00000100:00100000:3.0:1734016133.963897:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333857920 00000100:00100000:3.0:1734016133.963969:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333858048 00000100:00100000:3.0:1734016133.963971:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333858048 00000100:00100000:3.0:1734016133.964000:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11298 00000100:00100000:3.0:1734016133.964011:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333857920:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.964049:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.964085:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116797 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6584 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.964182:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335353600:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.964278:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.964332:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11299 00000100:00100000:3.0:1734016133.964337:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333858048:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.964349:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.964363:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc2711679e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e658b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.964406:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335353728:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.964431:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.973663:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335353600:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016133.973745:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116797 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6584 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.973771:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116797 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6584 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016133.973829:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016133.973950:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333857920:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9939us (10333us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016133.973965:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11298 00000100:00100000:2.0:1734016133.974362:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335353728:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016133.974392:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc2711679e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e658b expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.974402:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc2711679e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e658b expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.974422:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:2.0:1734016133.974449:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333858048:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10111us (10730us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016133.974456:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11299 00000100:00100000:0.0:1734016133.987106:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016133.987173:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016133.989368:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333858304 00000100:00100000:2.0:1734016133.989391:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333858304 00000100:00100000:2.0:1734016133.989468:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11300 00000100:00100000:2.0:1734016133.989481:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333858304:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016133.989516:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016133.989547:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271167a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6599 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016133.989644:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335353856:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016133.989760:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706d80 going to sleep for 11 seconds 00000100:00100000:3.0:1734016133.990350:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333858176 00000100:00100000:3.0:1734016133.990358:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333858176 00000100:00100000:3.0:1734016133.990402:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11301 00000100:00100000:3.0:1734016133.990408:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333858176:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016133.990421:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016133.990438:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271167ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6592 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016133.990478:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335353984:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016133.990508:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016133.994945:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e71ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335353984:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016133.994996:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271167ac lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6592 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016133.995015:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271167ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6592 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016133.995048:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:0.0:1734016133.995116:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333858176:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4705us (7939us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016133.995127:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11301 00000100:00100000:2.0:1734016133.999230:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335353856:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016133.999308:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271167a5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6599 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.999337:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271167a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6599 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016133.999352:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016133.999458:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333858304:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9977us (12364us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016133.999468:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11300 00000100:00100000:3.0:1734016134.006830:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.007025:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333858560 00000100:00100000:2.0:1734016134.007037:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333858560 00002000:00100000:2.0:1734016134.007607:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1384448->1388543) req@ffff88012e71ad80 x1818247333858560/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016134.007618:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71ad80 with x1818247333858560 ext(1384448->1388543) 00002000:00010000:2.0:1734016134.007624:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e71ad80 00000100:00100000:2.0:1734016134.007940:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8842 00000100:00100000:2.0:1734016134.007948:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1983:x1818247333858560:12345-192.168.201.16@tcp:3:fsx.0 00000100:00080000:0.0:1734016134.008202:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016104 00000100:00100000:2.0:1734016134.008635:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1983:x1818247333858560:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 685us (1851us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016134.008642:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8842 00002000:00100000:2.0:1734016134.008657:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1384448->1388543) req@ffff88012e71ad80 x1818247333858560/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/4536 e 0 to 0 dl 1734016145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016134.008666:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e71ad80 with x1818247333858560 ext(1384448->1388543) 00002000:00010000:2.0:1734016134.008669:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e71ad80 00000100:00100000:1.0:1734016134.019184:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.019395:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333858816 00000100:00100000:2.0:1734016134.019417:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333858816 00002000:00100000:2.0:1734016134.019524:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1388544->1392639) req@ffff88012e604380 x1818247333858816/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016134.019540:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604380 with x1818247333858816 ext(1388544->1392639) 00002000:00010000:2.0:1734016134.019553:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e604380 00000100:00100000:2.0:1734016134.019601:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8843 00000100:00100000:2.0:1734016134.019612:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1984:x1818247333858816:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016134.020000:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1984:x1818247333858816:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 389us (851us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016134.020012:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8843 00002000:00100000:2.0:1734016134.020021:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1388544->1392639) req@ffff88012e604380 x1818247333858816/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/4536 e 0 to 0 dl 1734016145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016134.020028:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604380 with x1818247333858816 ext(1388544->1392639) 00002000:00010000:2.0:1734016134.020031:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e604380 00000100:00100000:0.0:1734016134.032347:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.034065:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333859072 00000100:00100000:3.0:1734016134.034101:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333859072 00002000:00100000:3.0:1734016134.034212:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (1392640->1396735) req@ffff8800755b7100 x1818247333859072/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016134.034231:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b7100 with x1818247333859072 ext(1392640->1396735) 00002000:00010000:3.0:1734016134.034243:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800755b7100 00000100:00100000:3.0:1734016134.034331:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8844 00000100:00100000:3.0:1734016134.034346:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247333859072:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016134.034688:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247333859072:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 344us (2365us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016134.034697:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8844 00002000:00100000:3.0:1734016134.034705:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (1392640->1396735) req@ffff8800755b7100 x1818247333859072/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/4536 e 0 to 0 dl 1734016145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016134.034713:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b7100 with x1818247333859072 ext(1392640->1396735) 00002000:00010000:3.0:1734016134.034716:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800755b7100 00000100:00100000:0.0:1734016134.042001:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016134.042087:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.042228:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333859328 00000100:00100000:1.0:1734016134.042244:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333859328 00000100:00100000:1.0:1734016134.042323:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333859200 00000100:00100000:1.0:1734016134.042325:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333859200 00000100:00100000:1.0:1734016134.042360:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11302 00000100:00100000:1.0:1734016134.042368:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333859328:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016134.042404:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016134.042438:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271167b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e65a7 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016134.042531:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335354112:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016134.042626:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016134.042664:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11303 00000100:00100000:1.0:1734016134.042669:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333859200:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016134.042677:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016134.042691:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc271167ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e65a0 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016134.042731:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335354240:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016134.042755:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7c00 going to sleep for 11 seconds 00000100:00080000:0.0:1734016134.042828:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016104 00000100:00080000:0.0:1734016134.042833:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016104 00000100:00100000:2.0:1734016134.046478:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335354240:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016134.046533:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc271167ba lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65a0 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.046551:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc271167ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65a0 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.046569:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:2.0:1734016134.046636:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333859200:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3963us (4546us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016134.046660:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11303 00000100:00100000:1.0:1734016134.050558:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335354112:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016134.050614:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271167b3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65a7 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.050631:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc271167b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65a7 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.052678:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016134.054506:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333859328:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11559us (11954us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016134.054521:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11302 00000100:00100000:0.0:1734016134.060076:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016134.060143:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.060280:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333859456 00000100:00100000:1.0:1734016134.060296:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333859456 00000100:00100000:1.0:1734016134.060361:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333859584 00000100:00100000:1.0:1734016134.060364:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333859584 00000100:00100000:1.0:1734016134.060387:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11304 00000100:00100000:1.0:1734016134.060395:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333859456:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016134.060420:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016134.060446:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc271167c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e65ae expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016134.060541:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335354368:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016134.060615:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016134.061043:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11305 00000100:00100000:3.0:1734016134.061051:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333859584:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.061061:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.061077:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271167c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e65b5 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016134.061115:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335354496:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016134.061141:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016134.064034:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335354368:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016134.064096:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc271167c1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65ae expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.064115:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc271167c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65ae expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.064161:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016134.064240:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333859456:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3841us (4179us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016134.064253:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11304 00000100:00100000:3.0:1734016134.066082:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335354496:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016134.066140:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271167c8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65b5 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.066159:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271167c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65b5 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.066188:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016134.066251:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333859584:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5199us (6107us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016134.066261:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11305 00000100:00100000:0.0:1734016134.070013:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.070216:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333859712 00000100:00100000:3.0:1734016134.070232:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333859712 00000100:00100000:3.0:1734016134.070310:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11306 00000100:00100000:3.0:1734016134.070319:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247333859712:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.070346:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.070373:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271167cf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e65bc expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.070417:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271166f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64f1 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.070426:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016134.070428:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016134.070433:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271167cf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [3780608->3788799] (req 3780608->3788799) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65bc expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.070476:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271166f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64f1 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.070491:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271166f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64f1 expref: 11 pid: 8216 timeout: 501 lvb_type: 0 00000100:00100000:3.0:1734016134.070504:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335354624:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016134.071431:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016134.078038:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.078508:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333859840 00000100:00100000:2.0:1734016134.078523:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333859840 00000100:00100000:3.0:1734016134.078676:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335354624:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016134.078724:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271167cf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [3780608->3788799] (req 3780608->3788799) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65bc expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.078757:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016134.078852:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:10406:x1818247333859712:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8532us (8858us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016134.078866:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11306 00010000:00010000:2.0:1734016134.079236:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271166f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64f1 expref: 12 pid: 8216 timeout: 501 lvb_type: 0 00000100:00080000:0.0:1734016134.080315:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016104 00000100:00100000:2.0:1734016134.080478:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3136 00000100:00100000:2.0:1734016134.080491:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333859840:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016134.080521:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016134.080560:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271166f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64f1 expref: 12 pid: 8216 timeout: 501 lvb_type: 0 00010000:00010000:2.0:1734016134.080579:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271166f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64f1 expref: 12 pid: 8216 timeout: 501 lvb_type: 0 00010000:00010000:2.0:1734016134.080615:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271166f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64f1 expref: 12 pid: 8216 timeout: 501 lvb_type: 0 00010000:00010000:2.0:1734016134.080660:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016134.080663:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016134.080672:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271167cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3780608->3788799) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65bc expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.080683:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271167cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3780608->3788799) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65bc expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.080733:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271167cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3780608->3788799) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65bc expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016134.080747:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335354752:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016134.080832:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706900 going to sleep for 11 seconds 00000100:00100000:2.0:1734016134.086412:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016134.086528:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333859968 00000100:00100000:0.0:1734016134.086548:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333859968 00000100:00100000:0.0:1734016134.086643:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11307 00000100:00100000:0.0:1734016134.086665:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333859968:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016134.087026:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 2983201 -> 2983201 00002000:00010000:0.0:1734016134.087029:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016134 -> 1734016134 00002000:00010000:0.0:1734016134.087032:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016134 -> 1734016133 00002000:00010000:0.0:1734016134.087035:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016134 -> 1734016134 00002000:00010000:0.0:1734016134.087037:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1734016134.087140:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333859968:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 477us (757us total) trans 4294969498 rc 0/0 00000100:00100000:0.0:1734016134.087148:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11307 00000100:00100000:3.0:1734016134.089139:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335354752:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016134.089176:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016134.089241:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333859840:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 8749us (11225us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016134.089255:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3136 00000100:00100000:0.0:1734016134.093426:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.094716:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333860096 00000100:00100000:1.0:1734016134.094731:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333860096 00000100:00100000:1.0:1734016134.094793:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11308 00000100:00100000:1.0:1734016134.094813:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333860096:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016134.094839:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016134.094863:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271167d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e65c3 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016134.094931:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335354880:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016134.095672:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00002000:00010000:1.0:1734016134.098032:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016133 -> 1734016134 00000100:00100000:1.0:1734016134.098080:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335354880:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016134.098142:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271167d6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65c3 expref: 12 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.098164:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271167d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65c3 expref: 12 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.098202:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016134.098282:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333860096:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3477us (4876us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016134.098294:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11308 00000100:00100000:0.0:1734016134.101502:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.101667:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333860224 00000100:00100000:1.0:1734016134.101682:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333860224 00000100:00100000:1.0:1734016134.101747:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11309 00000100:00100000:1.0:1734016134.101757:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333860224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016134.101794:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016134.101861:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc271167dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e65ca expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016134.101984:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335355008:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016134.102117:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016134.109915:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335355008:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016134.109988:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc271167dd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65ca expref: 12 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.110012:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc271167dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65ca expref: 12 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.110048:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016134.110138:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333860224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8379us (8660us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016134.110154:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11309 00000100:00100000:0.0:1734016134.113400:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.113691:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333860480 00000100:00100000:2.0:1734016134.113705:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333860480 00002000:00100000:2.0:1734016134.113780:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (3268608->3272703) req@ffff880073b48e00 x1818247333860480/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016134.113796:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48e00 with x1818247333860480 ext(3268608->3272703) 00002000:00010000:2.0:1734016134.113827:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b48e00 00000100:00100000:2.0:1734016134.113933:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8845 00000100:00100000:2.0:1734016134.113943:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1983:x1818247333860480:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016134.115480:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1983:x1818247333860480:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1531us (2085us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016134.115489:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8845 00002000:00100000:2.0:1734016134.115499:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (3268608->3272703) req@ffff880073b48e00 x1818247333860480/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/4536 e 0 to 0 dl 1734016145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016134.115507:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48e00 with x1818247333860480 ext(3268608->3272703) 00002000:00010000:2.0:1734016134.115512:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b48e00 00000100:00100000:0.0:1734016134.118404:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.118669:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333860736 00000100:00100000:2.0:1734016134.118686:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333860736 00002000:00100000:2.0:1734016134.118758:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (3276800->3280895) req@ffff880073b49c00 x1818247333860736/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016134.118769:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b49c00 with x1818247333860736 ext(3276800->3280895) 00002000:00010000:2.0:1734016134.118775:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b49c00 00000100:00100000:2.0:1734016134.118839:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8846 00000100:00100000:2.0:1734016134.118848:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1984:x1818247333860736:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016134.119108:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1984:x1818247333860736:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 259us (730us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016134.119119:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8846 00002000:00100000:2.0:1734016134.119125:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (3276800->3280895) req@ffff880073b49c00 x1818247333860736/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/4536 e 0 to 0 dl 1734016145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016134.119133:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b49c00 with x1818247333860736 ext(3276800->3280895) 00002000:00010000:2.0:1734016134.119136:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b49c00 00000100:00100000:0.0:1734016134.122412:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.122658:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333860864 00000100:00100000:1.0:1734016134.122672:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333860864 00000100:00100000:1.0:1734016134.122741:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11310 00000100:00100000:1.0:1734016134.122751:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333860864:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016134.122788:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016134.122847:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271167e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e65d1 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016134.122930:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335355136:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016134.123047:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016134.125101:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335355136:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016134.125151:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271167e4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65d1 expref: 12 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.125168:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc271167e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65d1 expref: 12 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.125202:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016134.125278:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333860864:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2525us (2883us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016134.125290:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11310 00000100:00100000:2.0:1734016134.129074:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.129180:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333860992 00000100:00100000:1.0:1734016134.129199:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333860992 00000100:00100000:1.0:1734016134.129316:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11311 00000100:00100000:1.0:1734016134.129327:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333860992:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016134.129364:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016134.129403:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271167eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e65d8 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016134.129518:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335355264:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016134.129629:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016134.132517:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335355264:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016134.132591:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271167eb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65d8 expref: 12 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.132614:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271167eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65d8 expref: 12 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.132638:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016134.132742:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333860992:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3414us (3686us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016134.132752:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11311 00000100:00100000:0.0:1734016134.135436:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.135605:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333861120 00000100:00100000:1.0:1734016134.135626:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333861120 00000100:00100000:1.0:1734016134.135708:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11312 00000100:00100000:1.0:1734016134.135720:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333861120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016134.135757:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016134.135794:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271167f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e65df expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016134.135946:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335355392:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016134.136075:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016134.139450:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335355392:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016134.139512:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271167f2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65df expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.139532:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271167f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65df expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.139562:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016134.139639:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333861120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3921us (4229us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016134.139656:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11312 00000100:00100000:0.0:1734016134.142635:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.142782:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333861248 00000100:00100000:1.0:1734016134.142796:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333861248 00000100:00100000:1.0:1734016134.143166:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11313 00000100:00100000:1.0:1734016134.143175:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333861248:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016134.143202:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016134.143234:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc271167f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e65e6 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016134.143321:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335355520:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016134.143424:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016134.146015:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335355520:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016134.146057:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc271167f9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65e6 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.146074:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc271167f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65e6 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.146087:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016134.146149:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333861248:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2974us (3525us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016134.146164:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11313 00000100:00100000:0.0:1734016134.150294:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.150423:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333861376 00000100:00100000:1.0:1734016134.150441:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333861376 00000100:00100000:1.0:1734016134.150530:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11314 00000100:00100000:1.0:1734016134.150541:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333861376:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016134.150574:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016134.150603:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499e880/0x5e3a3adc27116800 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e65ed expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016134.150704:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335355648:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016134.150835:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016134.153522:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335355648:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016134.153590:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499e880/0x5e3a3adc27116800 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65ed expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.153608:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499e880/0x5e3a3adc27116800 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65ed expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.153976:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016134.154060:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333861376:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3518us (3787us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016134.154072:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11314 00000100:00100000:0.0:1734016134.156962:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.157153:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333861504 00000100:00100000:1.0:1734016134.157166:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333861504 00000100:00100000:1.0:1734016134.157239:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11315 00000100:00100000:1.0:1734016134.157251:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:10406:x1818247333861504:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016134.157282:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016134.157312:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27116807 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e65f4 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016134.157358:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116790 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3207167) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e657d expref: 13 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016134.157367:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016134.157370:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016134.157375:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27116807 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1888256->1896447] (req 1888256->1896447) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65f4 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016134.157419:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3207167) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e657d expref: 13 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016134.157434:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3207167) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e657d expref: 13 pid: 7682 timeout: 501 lvb_type: 0 00000100:00100000:1.0:1734016134.157449:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335355776:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016134.157540:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016134.161774:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335355776:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016134.161882:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27116807 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1888256->1896447] (req 1888256->1896447) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65f4 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016134.161911:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016134.161997:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:10406:x1818247333861504:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4746us (5050us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016134.162014:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11315 00000100:00100000:0.0:1734016134.162756:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.163303:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333861632 00000100:00100000:2.0:1734016134.163317:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333861632 00002000:00100000:2.0:1734016134.163386:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (3268608->3280895) req@ffff880073b48700 x1818247333861632/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 12776/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016134.163401:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48700 with x1818247333861632 ext(3268608->3280895) 00010000:00010000:2.0:1734016134.163413:0:7688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3207167) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e657d expref: 14 pid: 7682 timeout: 501 lvb_type: 0 00010000:00010000:2.0:1734016134.163433:0:7688:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3207167) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e657d expref: 14 pid: 7682 timeout: 501 lvb_type: 0 00002000:00010000:2.0:1734016134.163450:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880073b48700 00000100:00100000:2.0:1734016134.163485:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 289 00000100:00100000:2.0:1734016134.163495:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333861632:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016134.167027:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+16:1982:x1818247333861632:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 3515us (4255us total) trans 4294968023 rc 0/0 00000100:00100000:2.0:1734016134.167047:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 289 00002000:00100000:2.0:1734016134.167064:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (3268608->3280895) req@ffff880073b48700 x1818247333861632/t4294968023(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 12776/448 e 0 to 0 dl 1734016145 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016134.167074:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48700 with x1818247333861632 ext(3268608->3280895) 00010000:00010000:2.0:1734016134.167091:0:7688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3207167) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e657d expref: 16 pid: 7682 timeout: 501 lvb_type: 0 00010000:00010000:2.0:1734016134.167112:0:7688:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3207167) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e657d expref: 16 pid: 7682 timeout: 501 lvb_type: 0 00002000:00010000:2.0:1734016134.167120:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880073b48700 00000100:00100000:0.0:1734016134.170189:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.170467:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333861760 00000100:00100000:3.0:1734016134.170485:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333861760 00010000:00010000:3.0:1734016134.170550:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3207167) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e657d expref: 16 pid: 7682 timeout: 501 lvb_type: 0 00000100:00100000:3.0:1734016134.170608:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3137 00000100:00100000:3.0:1734016134.170619:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+16:1981:x1818247333861760:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016134.170641:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1734016134.170674:0:6465:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 104 -> 136 00010000:00010000:3.0:1734016134.170680:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3198976->3207167) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e657d expref: 16 pid: 7682 timeout: 501 lvb_type: 0 00010000:00010000:3.0:1734016134.170692:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3198976->3207167) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e657d expref: 16 pid: 7682 timeout: 501 lvb_type: 0 00010000:00010000:3.0:1734016134.170724:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116790 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3198976->3207167) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e657d expref: 16 pid: 7682 timeout: 501 lvb_type: 0 00010000:00010000:3.0:1734016134.171457:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016134.171461:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016134.171471:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27116807 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->1896447) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65f4 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.171481:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27116807 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->1896447) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65f4 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.171538:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27116807 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->1896447) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65f4 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016134.171555:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335355904:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016134.171679:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016134.177310:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.177479:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335355904:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016134.177534:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016134.177620:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+15:1981:x1818247333861760:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6999us (7446us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016134.177639:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3137 00000100:00100000:1.0:1734016134.178069:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333861888 00000100:00100000:1.0:1734016134.178081:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333861888 00000100:00100000:1.0:1734016134.178156:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11316 00000100:00100000:1.0:1734016134.178163:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333861888:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016134.178526:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5838947 -> 5838947 00002000:00010000:1.0:1734016134.178530:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016134 -> 1734016134 00002000:00010000:1.0:1734016134.178533:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016134 -> 1734016134 00002000:00010000:1.0:1734016134.178535:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016134 -> 1734016134 00002000:00010000:1.0:1734016134.178538:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 136 -> 152 00000100:00100000:1.0:1734016134.178566:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247333861888:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 404us (1286us total) trans 4294968024 rc 0/0 00000100:00100000:1.0:1734016134.178571:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11316 00000100:00100000:0.0:1734016134.187499:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.187634:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333862144 00000100:00100000:2.0:1734016134.187655:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333862144 00002000:00100000:2.0:1734016134.187721:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (2015232->2019327) req@ffff880073b4ad80 x1818247333862144/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:95/0 lens 488/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016134.187734:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b4ad80 with x1818247333862144 ext(2015232->2019327) 00002000:00010000:2.0:1734016134.187740:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b4ad80 00000100:00100000:2.0:1734016134.187771:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8847 00000100:00100000:2.0:1734016134.187780:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1983:x1818247333862144:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016134.192442:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1983:x1818247333862144:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 4626us (4930us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016134.192464:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8847 00002000:00100000:2.0:1734016134.192490:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (2015232->2019327) req@ffff880073b4ad80 x1818247333862144/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:95/0 lens 488/4536 e 0 to 0 dl 1734016145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016134.192504:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b4ad80 with x1818247333862144 ext(2015232->2019327) 00002000:00010000:2.0:1734016134.192515:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b4ad80 00000100:00100000:1.0:1734016134.193051:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016134.193177:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333862400 00000100:00100000:0.0:1734016134.193189:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333862400 00002000:00100000:0.0:1734016134.193237:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (0->2985983) req@ffff88012e607100 x1818247333862400/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:95/0 lens 488/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016134.193246:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e607100 with x1818247333862400 ext(0->2985983) 00002000:00010000:0.0:1734016134.193250:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e607100 00000100:00100000:0.0:1734016134.193279:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8848 00000100:00100000:0.0:1734016134.193284:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333862400:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016134.204849:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.207914:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333862656 00000100:00100000:3.0:1734016134.207946:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333862656 00002000:00100000:3.0:1734016134.208046:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (2019328->2023423) req@ffff88007487d500 x1818247333862656/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:95/0 lens 488/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016134.208066:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487d500 with x1818247333862656 ext(2019328->2023423) 00002000:00010000:3.0:1734016134.208076:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007487d500 00000100:00100000:3.0:1734016134.208125:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8849 00000100:00100000:3.0:1734016134.208135:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1983:x1818247333862656:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016134.208437:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1983:x1818247333862656:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 302us (3601us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016134.208448:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8849 00002000:00100000:3.0:1734016134.208454:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (2019328->2023423) req@ffff88007487d500 x1818247333862656/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:95/0 lens 488/4536 e 0 to 0 dl 1734016145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016134.208461:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487d500 with x1818247333862656 ext(2019328->2023423) 00002000:00010000:3.0:1734016134.208463:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007487d500 00000100:00100000:2.0:1734016134.236894:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333862400:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 43579us (43814us total) trans 0 rc 2985984/2985984 00000100:00100000:2.0:1734016134.236915:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8848 00002000:00100000:2.0:1734016134.236940:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (0->2985983) req@ffff88012e607100 x1818247333862400/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:95/0 lens 488/440 e 0 to 0 dl 1734016145 ref 1 fl Complete:/200/0 rc 2985984/2985984 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016134.236953:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e607100 with x1818247333862400 ext(0->2985983) 00002000:00010000:2.0:1734016134.236961:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e607100 00000100:00100000:0.0:1734016134.237568:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016134.237747:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.239194:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333862912 00000100:00100000:3.0:1734016134.239208:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333862912 00000100:00100000:3.0:1734016134.239266:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333862784 00000100:00100000:3.0:1734016134.239269:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333862784 00000100:00100000:3.0:1734016134.239310:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11317 00000100:00100000:3.0:1734016134.239326:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333862912:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.239366:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.239419:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711680e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6602 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016134.239538:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335356032:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016134.239675:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016134.239717:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11318 00000100:00100000:3.0:1734016134.239723:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+15:1981:x1818247333862784:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.239736:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.239757:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116815 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e65fb expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016134.239832:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335356160:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016134.239863:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737813c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016134.247905:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e719c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335356032:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016134.247982:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711680e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6602 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.248006:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711680e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6602 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1734016134.248277:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335356160:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016134.248310:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116815 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65fb expref: 16 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.248320:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116815 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65fb expref: 16 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.248339:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:2.0:1734016134.248445:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+15:1981:x1818247333862784:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8718us (10695us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016134.248457:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11318 00010000:00010000:3.0:1734016134.250154:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016134.250243:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333862912:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10919us (12672us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016134.250256:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11317 00000100:00100000:2.0:1734016134.256699:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.256835:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333863040 00000100:00100000:3.0:1734016134.256849:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333863040 00000100:00100000:3.0:1734016134.256909:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11319 00000100:00100000:3.0:1734016134.256917:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+15:10406:x1818247333863040:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.256941:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.256963:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711681c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6609 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.257005:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27116807 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->1896447) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65f4 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.257015:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016134.257017:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016134.257022:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711681c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2826240->2830335] (req 2826240->2830335) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6609 expref: 16 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.257061:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27116807 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->1896447) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65f4 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.257079:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27116807 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->1896447) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65f4 expref: 11 pid: 8216 timeout: 501 lvb_type: 0 00000100:00100000:3.0:1734016134.257097:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335356288:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016134.257195:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016134.261030:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335356288:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016134.261092:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711681c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2826240->2830335] (req 2826240->2830335) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6609 expref: 16 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.261123:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016134.261572:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+16:10406:x1818247333863040:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4650us (4885us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016134.261587:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11319 00000100:00100000:0.0:1734016134.262903:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.263134:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333863168 00000100:00100000:3.0:1734016134.263147:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333863168 00010000:00010000:3.0:1734016134.263207:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27116807 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65f4 expref: 12 pid: 8216 timeout: 501 lvb_type: 0 00000100:00100000:3.0:1734016134.263258:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3138 00000100:00100000:3.0:1734016134.263268:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247333863168:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016134.263294:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016134.263328:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27116807 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65f4 expref: 12 pid: 8216 timeout: 501 lvb_type: 0 00010000:00010000:3.0:1734016134.263343:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27116807 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->1896447) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65f4 expref: 12 pid: 8216 timeout: 501 lvb_type: 0 00010000:00010000:3.0:1734016134.263383:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27116807 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->1896447) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65f4 expref: 12 pid: 8216 timeout: 501 lvb_type: 0 00010000:00010000:3.0:1734016134.263418:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016134.263421:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016134.263435:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711681c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2826240->2830335) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6609 expref: 15 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.263446:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711681c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2826240->2830335) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6609 expref: 15 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.263504:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711681c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2826240->2830335) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6609 expref: 15 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016134.263521:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335356416:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016134.263594:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016134.269388:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.269847:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335356416:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016134.270057:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333863296 00000100:00100000:0.0:1734016134.270075:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333863296 00000100:00100000:0.0:1734016134.270165:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11320 00000100:00100000:0.0:1734016134.270174:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+16:1982:x1818247333863296:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016134.270590:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5838947 -> 5838947 00002000:00010000:0.0:1734016134.270594:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016134 -> 1734016134 00002000:00010000:0.0:1734016134.270596:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016134 -> 1734016134 00002000:00010000:0.0:1734016134.270598:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016134 -> 1734016134 00002000:00010000:0.0:1734016134.270601:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 152 -> 160 00000100:00100000:0.0:1734016134.270694:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+17:1982:x1818247333863296:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 519us (1325us total) trans 4294968025 rc 0/0 00000100:00100000:0.0:1734016134.270702:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11320 00010000:00010000:3.0:1734016134.271280:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016134.271321:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333863168:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 8054us (8426us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016134.271330:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3138 00000100:00100000:2.0:1734016134.275344:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016134.275475:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333863424 00000100:00100000:0.0:1734016134.275493:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333863424 00000100:00100000:0.0:1734016134.275582:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11321 00000100:00100000:0.0:1734016134.275595:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1983:x1818247333863424:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016134.275643:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016134.275688:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27116823 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6610 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016134.275793:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335356544:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016134.275957:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:2.0:1734016134.286171:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335356544:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016134.286235:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27116823 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6610 expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.286254:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27116823 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6610 expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.286302:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581b00, rc 0) 00000100:00100000:2.0:1734016134.286404:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1983:x1818247333863424:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10811us (11082us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016134.286416:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11321 00000100:00100000:0.0:1734016134.289080:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.290850:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333863552 00000100:00100000:2.0:1734016134.290866:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333863552 00000100:00100000:2.0:1734016134.290968:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11322 00000100:00100000:2.0:1734016134.290978:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333863552:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016134.291013:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016134.291057:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711682a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6617 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016134.291187:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335356672:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016134.291350:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00000100:00100000:2.0:1734016134.297279:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335356672:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016134.297345:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711682a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6617 expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.297365:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711682a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6617 expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.297432:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016134.297525:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333863552:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6546us (8461us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016134.297540:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11322 00000100:00100000:0.0:1734016134.303310:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.304043:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333863680 00000100:00100000:2.0:1734016134.304063:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333863680 00000100:00100000:2.0:1734016134.304157:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11323 00000100:00100000:2.0:1734016134.304172:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1983:x1818247333863680:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016134.304213:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016134.304249:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116831 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e661e expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016134.304337:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335356800:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016134.304440:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00000100:00100000:2.0:1734016134.308556:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335356800:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016134.308627:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116831 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e661e expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.308717:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116831 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e661e expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.308753:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016134.308975:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1983:x1818247333863680:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4805us (5692us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016134.308987:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11323 00000100:00100000:3.0:1734016134.311256:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.311378:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333863808 00000100:00100000:2.0:1734016134.311391:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333863808 00000100:00100000:2.0:1734016134.311461:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11324 00000100:00100000:2.0:1734016134.311472:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1983:x1818247333863808:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016134.311502:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016134.311700:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116838 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6625 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016134.311788:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335356928:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016134.311939:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00000100:00100000:2.0:1734016134.313922:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335356928:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016134.313989:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116838 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6625 expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.314014:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116838 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6625 expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.314034:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016134.314391:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1983:x1818247333863808:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2918us (3148us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016134.314412:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11324 00000100:00100000:1.0:1734016134.317292:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.317458:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333863936 00000100:00100000:2.0:1734016134.317476:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333863936 00000100:00100000:2.0:1734016134.317679:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11325 00000100:00100000:2.0:1734016134.317692:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333863936:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016134.318099:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 2983201 -> 2983201 00002000:00010000:2.0:1734016134.318103:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016134 -> 1734016134 00002000:00010000:2.0:1734016134.318106:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016134 -> 1734016133 00002000:00010000:2.0:1734016134.318108:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016134 -> 1734016134 00002000:00010000:2.0:1734016134.318110:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1734016134.318241:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333863936:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 551us (971us total) trans 4294969499 rc 0/0 00000100:00100000:2.0:1734016134.318250:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11325 00000100:00100000:3.0:1734016134.325498:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016134.326351:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333864064 00000100:00100000:0.0:1734016134.326367:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333864064 00000100:00100000:0.0:1734016134.326904:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11326 00000100:00100000:0.0:1734016134.326916:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1983:x1818247333864064:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016134.326957:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016134.326993:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7581b00/0x5e3a3adc2711683f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e662c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016134.327078:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335357056:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016134.327389:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016134.329310:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335357056:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016134.329346:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581b00/0x5e3a3adc2711683f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e662c expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016134.329362:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581b00/0x5e3a3adc2711683f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e662c expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016134.329401:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581b00, rc 0) 00000100:00100000:0.0:1734016134.329469:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1983:x1818247333864064:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2554us (3991us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016134.329480:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11326 00000100:00100000:1.0:1734016134.334118:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016134.334259:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333864192 00000100:00100000:0.0:1734016134.334280:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333864192 00000100:00100000:0.0:1734016134.334380:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11327 00000100:00100000:0.0:1734016134.334393:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090248450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333864192:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016134.334432:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016134.334470:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7582640/0x5e3a3adc27116846 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6633 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016134.334584:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335357184:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016134.334717:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016134.340402:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335357184:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016134.340476:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7582640/0x5e3a3adc27116846 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6633 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016134.340502:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7582640/0x5e3a3adc27116846 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6633 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016134.340542:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:0.0:1734016134.340630:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090248450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333864192:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6236us (7465us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016134.340660:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11327 00000100:00100000:1.0:1734016134.344739:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016134.345168:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333864320 00000100:00100000:0.0:1734016134.345187:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333864320 00000100:00100000:0.0:1734016134.346423:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11328 00000100:00100000:0.0:1734016134.346442:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333864320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016134.346480:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016134.346523:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc2711684d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e663a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016134.346657:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335357312:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016134.346788:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00002000:00010000:0.0:1734016134.349655:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016133 -> 1734016134 00000100:00100000:0.0:1734016134.349698:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335357312:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016134.349743:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc2711684d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e663a expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016134.349759:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc2711684d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e663a expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016134.349775:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:0.0:1734016134.349870:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333864320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3432us (5151us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016134.349882:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11328 00000100:00100000:0.0:1734016134.354613:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.354786:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333864448 00000100:00100000:2.0:1734016134.354828:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333864448 00000100:00100000:2.0:1734016134.354894:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11329 00000100:00100000:2.0:1734016134.354906:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333864448:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016134.354938:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016134.354973:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116854 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6641 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016134.355089:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335357440:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016134.355213:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00000100:00100000:2.0:1734016134.358640:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335357440:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016134.358729:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116854 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6641 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.358755:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116854 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6641 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.358969:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016134.359074:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333864448:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4165us (4476us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016134.359090:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11329 00000100:00100000:1.0:1734016134.366365:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.367152:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333864576 00000100:00100000:2.0:1734016134.367172:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333864576 00000100:00100000:2.0:1734016134.367255:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11330 00000100:00100000:2.0:1734016134.367267:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:10406:x1818247333864576:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016134.367301:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016134.367345:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711685b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6648 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.367400:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711681c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2826240->2830335) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6609 expref: 16 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.367409:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016134.367412:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016134.367416:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711685b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1282048->1294335] (req 1282048->1294335) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6648 expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.367471:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711681c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2826240->2830335) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6609 expref: 16 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.367493:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711681c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2826240->2830335) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6609 expref: 16 pid: 7684 timeout: 501 lvb_type: 0 00000100:00100000:2.0:1734016134.367509:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335357568:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016134.367622:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00000100:00100000:1.0:1734016134.375182:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.376195:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333864704 00000100:00100000:3.0:1734016134.376223:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333864704 00010000:00010000:3.0:1734016134.376315:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711681c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2826240->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6609 expref: 17 pid: 7684 timeout: 501 lvb_type: 0 00000100:00100000:3.0:1734016134.376421:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3139 00000100:00100000:3.0:1734016134.376434:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+17:1981:x1818247333864704:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016134.376481:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016134.376532:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711681c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2826240->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6609 expref: 17 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:3.0:1734016134.376553:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711681c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2826240->2830335) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6609 expref: 17 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:3.0:1734016134.376618:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016134.376623:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016134.376640:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711685b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1294335) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6648 expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.376666:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711685b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1294335) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6648 expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.376737:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711685b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1294335) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6648 expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016134.376756:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335357696:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016134.376967:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1734016134.377949:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711681c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2826240->2830335) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6609 expref: 17 pid: 7684 timeout: 501 lvb_type: 0 00000100:00100000:2.0:1734016134.377996:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335357568:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016134.378053:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711685b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1294335) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6648 expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.378067:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016134.378129:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:10406:x1818247333864576:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10861us (11796us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016134.378145:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11330 00000100:00100000:3.0:1734016134.390599:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335357696:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016134.390670:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016134.390796:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+16:1981:x1818247333864704:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 14361us (15644us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016134.390876:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3139 00000100:00100000:0.0:1734016134.391295:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.391860:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333864960 00000100:00100000:2.0:1734016134.391877:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333864960 00002000:00100000:2.0:1734016134.391967:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff880075fc5880 x1818247333864960/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:95/0 lens 488/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016134.391980:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc5880 with x1818247333864960 ext(0->4194303) 00002000:00010000:2.0:1734016134.391992:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075fc5880 00000100:00100000:2.0:1734016134.392027:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8850 00000100:00100000:2.0:1734016134.392035:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333864960:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016134.496313:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333864960:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 104245us (104986us total) trans 0 rc 4194304/4194304 00000100:00100000:3.0:1734016134.496340:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8850 00002000:00100000:3.0:1734016134.496371:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff880075fc5880 x1818247333864960/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:95/0 lens 488/440 e 0 to 0 dl 1734016145 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016134.496386:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc5880 with x1818247333864960 ext(0->4194303) 00002000:00010000:3.0:1734016134.496398:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075fc5880 00000100:00100000:0.0:1734016134.504111:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.504941:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333865088 00000100:00100000:2.0:1734016134.504965:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333865088 00000100:00100000:2.0:1734016134.508536:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11331 00000100:00100000:2.0:1734016134.508569:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+16:1981:x1818247333865088:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016134.508622:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016134.508685:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116862 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e664f expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.508749:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016134.508753:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016134.508771:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116862 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e664f expref: 17 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.508829:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116862 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e664f expref: 17 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.508852:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016134.517447:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+17:1981:x1818247333865088:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8849us (13328us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016134.517471:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11331 00000100:00100000:0.0:1734016134.521268:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.521432:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333865216 00000100:00100000:2.0:1734016134.521449:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333865216 00000100:00100000:2.0:1734016134.521554:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11332 00000100:00100000:2.0:1734016134.521567:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333865216:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016134.521613:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016134.521661:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116869 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6656 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016134.521758:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335357824:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016134.522502:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00002000:00010000:2.0:1734016134.526410:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016134 -> 1734016135 00000100:00100000:2.0:1734016134.526464:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335357824:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016134.526536:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116869 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6656 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.526558:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116869 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6656 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.527219:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016134.527337:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333865216:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5770us (6091us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016134.527350:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11332 00000100:00100000:0.0:1734016134.529998:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.530379:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333865344 00000100:00100000:3.0:1734016134.530393:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333865344 00000100:00100000:3.0:1734016134.530466:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11333 00000100:00100000:3.0:1734016134.530475:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333865344:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.530501:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.530526:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116870 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e665d expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016134.530598:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335357952:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016134.530747:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016134.533474:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335357952:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016134.533547:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116870 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e665d expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.533568:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116870 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e665d expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.533610:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016134.533689:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333865344:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3212us (3699us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016134.533702:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11333 00000100:00100000:0.0:1734016134.538919:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.539503:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333865600 00000100:00100000:3.0:1734016134.539513:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333865600 00000100:00100000:3.0:1734016134.539607:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2312 00000100:00100000:3.0:1734016134.539616:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+32:10406:x1818247333865600:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016134.539710:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016134.539752:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116704 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64f8 expref: 32 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.539795:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016134.539834:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016134.540052:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116877 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016134.540071:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116712 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ff expref: 24 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.540080:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116877 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016134.540124:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116712 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ff expref: 24 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.540140:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116712 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ff expref: 24 pid: 6478 timeout: 501 lvb_type: 0 00000100:00100000:3.0:1734016134.540155:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335358080:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016134.540257:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781900 going to sleep for 11 seconds 00000100:00080000:0.0:1734016134.541229:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016104 00000100:00100000:3.0:1734016134.545321:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335358080:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016134.545408:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116877 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016134.546085:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.546345:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333865728 00000100:00100000:3.0:1734016134.546359:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333865728 00010000:00010000:3.0:1734016134.546440:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116712 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ff expref: 25 pid: 6478 timeout: 501 lvb_type: 0 00000100:00080000:0.0:1734016134.546780:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016104 00000100:00100000:3.0:1734016134.547133:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3140 00000100:00100000:3.0:1734016134.547148:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+25:1982:x1818247333865728:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016134.547182:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016134.547192:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116712 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ff expref: 25 pid: 6478 timeout: 501 lvb_type: 0 00010000:00010000:3.0:1734016134.547210:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116712 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ff expref: 25 pid: 6478 timeout: 501 lvb_type: 0 00010000:00010000:3.0:1734016134.547247:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116712 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e64ff expref: 25 pid: 6478 timeout: 501 lvb_type: 0 00010000:00010000:3.0:1734016134.547276:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016134.547283:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116877 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016134.547296:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116877 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016134.547307:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116877 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016134.548317:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016134.548424:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:1982:x1818247333865728:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1272us (2337us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016134.548436:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3140 00010000:00010000:2.0:1734016134.549452:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116877 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016134.549462:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116877 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:2.0:1734016134.549579:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968805 00000004:00010000:2.0:1734016134.549651:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075fc5f80 reply state ffff880073911000 transno 4294968806 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116877 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016134.549659:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016134.549779:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+34:10406:x1818247333865600:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 10164us (10872us total) trans 4294968806 rc 0/0 00000100:00100000:2.0:1734016134.549788:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2312 00000020:00080000:2.0:1734016134.549793:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016134.554300:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1734016134.554450:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116877 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016134.554469:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116877 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016134.554479:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116877 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016134.554489:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df7180 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016134.554495:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116877 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016134.554503:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116877 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016134.554536:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016134.554539:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016134.554544:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116877 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016134.554548:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116877 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016134.554944:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333865856 00000100:00100000:3.0:1734016134.554966:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333865856 00000100:00100000:3.0:1734016134.555031:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11334 00000100:00100000:3.0:1734016134.555041:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+17:10406:x1818247333865856:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.555079:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.555116:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711687e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6664 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.555168:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711685b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1294335) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6648 expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.555178:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116862 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e664f expref: 18 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.555184:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016134.555185:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016134.555189:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711687e lrc: 5/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6664 expref: 18 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.555232:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116862 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e664f expref: 18 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.555246:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116862 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e664f expref: 18 pid: 7684 timeout: 501 lvb_type: 1 00000100:00100000:3.0:1734016134.555261:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335358208:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016134.556002:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711685b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1294335) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6648 expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.556016:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711685b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1294335) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6648 expref: 11 pid: 7684 timeout: 501 lvb_type: 0 00000100:00100000:3.0:1734016134.556025:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335358336:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016134.556053:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016134.560734:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335358208:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016134.560752:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335358336:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016134.560866:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711687e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6664 expref: 18 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.560895:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016134.560987:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+18:10406:x1818247333865856:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5943us (6719us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016134.561004:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11334 00000100:00100000:0.0:1734016134.566676:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016134.567569:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.567776:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333865984 00000100:00100000:1.0:1734016134.567795:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333865984 00010000:00010000:1.0:1734016134.567913:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116862 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e664f expref: 18 pid: 7684 timeout: 501 lvb_type: 1 00000100:00100000:1.0:1734016134.568372:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333866112 00000100:00100000:1.0:1734016134.568376:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333866112 00010000:00010000:1.0:1734016134.568397:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711685b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6648 expref: 12 pid: 7684 timeout: 501 lvb_type: 0 00000100:00100000:3.0:1734016134.568441:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3141 00000100:00100000:3.0:1734016134.568454:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78eac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247333865984:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016134.568489:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016134.568535:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116862 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e664f expref: 18 pid: 7684 timeout: 501 lvb_type: 1 00010000:00010000:3.0:1734016134.568552:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116862 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e664f expref: 18 pid: 7684 timeout: 501 lvb_type: 1 00010000:00010000:3.0:1734016134.568607:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116862 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e664f expref: 18 pid: 7684 timeout: 501 lvb_type: 1 00010000:00010000:3.0:1734016134.572061:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016134.572408:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3142 00000100:00100000:1.0:1734016134.572429:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333866112:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016134.572459:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016134.572491:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711685b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6648 expref: 12 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:1.0:1734016134.572508:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711685b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1294335) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6648 expref: 12 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:1.0:1734016134.572542:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711685b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1294335) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6648 expref: 12 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:1.0:1734016134.572567:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016134.572570:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016134.572579:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711687e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6664 expref: 17 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016134.572590:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711687e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6664 expref: 17 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016134.572658:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711687e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6664 expref: 17 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016134.572673:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e604700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335358464:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016134.573176:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78eac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+17:1982:x1818247333865984:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4722us (6514us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016134.573188:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3141 00000100:00100000:1.0:1734016134.573355:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016134.578226:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.578378:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e604700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335358464:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016134.578410:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016134.578477:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333866112:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6052us (10905us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016134.578495:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3142 00000100:00100000:3.0:1734016134.578607:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333866240 00000100:00100000:3.0:1734016134.578617:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333866240 00000100:00100000:3.0:1734016134.578946:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11335 00000100:00100000:3.0:1734016134.578955:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:10406:x1818247333866240:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.578983:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.579013:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116885 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e666b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.579054:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271167cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3780608->3788799) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65bc expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.579063:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016134.579066:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016134.579072:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116885 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e666b expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.579115:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271167cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3780608->3788799) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65bc expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.579135:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271167cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3780608->3788799) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65bc expref: 10 pid: 7684 timeout: 501 lvb_type: 0 00000100:00100000:3.0:1734016134.579150:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335358592:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016134.579202:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781780 going to sleep for 11 seconds 00000100:00100000:0.0:1734016134.587549:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.587899:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335358592:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016134.587962:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116885 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e666b expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.587991:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016134.588059:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:10406:x1818247333866240:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9104us (9855us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016134.588073:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11335 00000100:00100000:1.0:1734016134.588178:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333866368 00000100:00100000:1.0:1734016134.588189:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333866368 00010000:00010000:1.0:1734016134.588233:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271167cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3780608->3788799) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65bc expref: 11 pid: 7684 timeout: 501 lvb_type: 0 00000100:00100000:1.0:1734016134.588271:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3143 00000100:00100000:1.0:1734016134.588279:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333866368:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016134.588302:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016134.588332:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271167cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3780608->3788799) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65bc expref: 11 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:1.0:1734016134.588346:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271167cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3780608->3788799) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65bc expref: 11 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:1.0:1734016134.588385:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271167cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3780608->3788799) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e65bc expref: 11 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:1.0:1734016134.588409:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016134.588411:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016134.588418:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116885 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e666b expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016134.588436:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116885 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e666b expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016134.588478:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116885 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e666b expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016134.588495:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e604700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335358720:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016134.588549:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016134.595403:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e604700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335358720:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016134.595449:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016134.595530:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333866368:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7249us (7996us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016134.595548:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3143 00000100:00100000:0.0:1734016134.596952:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.597329:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333866624 00000100:00100000:3.0:1734016134.597343:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333866624 00002000:00010000:3.0:1734016134.597402:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (3496067->18446744073709551615) 00002000:00100000:3.0:1734016134.597407:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc5500 with x1818247333866624 ext(3496067->18446744073709551615) 00002000:00010000:3.0:1734016134.597427:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc5500. 00000100:00100000:3.0:1734016134.597456:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8851 00000100:00100000:3.0:1734016134.597463:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333866624:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016134.597850:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 2983201 -> 3496067 00002000:00010000:3.0:1734016134.597854:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016134 -> 1734016135 00002000:00010000:3.0:1734016134.597857:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016135 -> 1734016133 00002000:00010000:3.0:1734016134.597859:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016134 -> 1734016135 00002000:00010000:3.0:1734016134.597861:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1734016134.597940:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333866624:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 475us (993us total) trans 4294969500 rc 0/0 00000100:00100000:3.0:1734016134.597950:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8851 00002000:00010000:3.0:1734016134.597953:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (3496067->18446744073709551615) 00002000:00100000:3.0:1734016134.597956:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc5500 with x1818247333866624 ext(3496067->18446744073709551615) 00002000:00010000:3.0:1734016134.597960:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc5500. 00000100:00100000:1.0:1734016134.598200:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.599152:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333866496 00000100:00100000:3.0:1734016134.599160:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333866496 00002000:00010000:3.0:1734016134.599188:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:3.0:1734016134.599191:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604700 with x1818247333866496 ext(4194304->18446744073709551615) 00002000:00010000:3.0:1734016134.599203:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e604700. 00000100:00100000:3.0:1734016134.599905:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8852 00000100:00100000:3.0:1734016134.599916:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+17:1982:x1818247333866496:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016134.600231:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5838947 -> 4194304 00002000:00010000:3.0:1734016134.600235:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016134 -> 1734016135 00002000:00010000:3.0:1734016134.600237:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016134 -> 1734016134 00002000:00010000:3.0:1734016134.600239:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016134 -> 1734016135 00002000:00010000:3.0:1734016134.600241:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 160 -> 144 00000100:00100000:3.0:1734016134.602164:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247333866496:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 2220us (3935us total) trans 4294968026 rc 0/0 00000100:00100000:3.0:1734016134.602190:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8852 00002000:00010000:3.0:1734016134.602206:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:3.0:1734016134.602213:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604700 with x1818247333866496 ext(4194304->18446744073709551615) 00002000:00010000:3.0:1734016134.602235:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e604700. 00000100:00100000:0.0:1734016134.604341:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.604516:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333866752 00000100:00100000:2.0:1734016134.604533:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333866752 00000100:00100000:2.0:1734016134.604604:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2313 00000100:00100000:2.0:1734016134.604613:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+33:10406:x1818247333866752:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016134.604680:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016134.604710:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711688c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6672 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.604923:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116893 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016134.604948:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016134.604965:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016134.605007:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 7690371 00000004:00200000:2.0:1734016134.605015:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016134.605038:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016134.605067:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711688c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6672 expref: 35 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.605112:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6672 expref: 34 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.605121:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016134.605124:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016134.605128:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016134.605204:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+34:10406:x1818247333866752:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 591us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016134.605212:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2313 00010000:00010000:2.0:1734016134.606456:0:6468:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1734016134.610066:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016134.610137:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.610628:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333867136 00000100:00100000:3.0:1734016134.610648:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333867136 00002000:00100000:3.0:1734016134.610709:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2985984->3497983) req@ffff880073792300 x1818247333867136/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016134.610720:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073792300 with x1818247333867136 ext(2985984->3497983) 00002000:00010000:3.0:1734016134.610727:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073792300 00000100:00100000:3.0:1734016134.610761:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333867264 00000100:00100000:3.0:1734016134.610764:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333867264 00002000:00100000:3.0:1734016134.610777:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (376832->380927) req@ffff880073791c00 x1818247333867264/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016134.610785:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073791c00 with x1818247333867264 ext(376832->380927) 00002000:00010000:3.0:1734016134.610789:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073791c00 00000100:00100000:3.0:1734016134.610836:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8853 00000100:00100000:3.0:1734016134.610844:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333867136:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016134.611944:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8854 00000100:00100000:3.0:1734016134.611956:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247333867264:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016134.612062:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247333867264:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 106us (1923us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016134.612069:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8854 00002000:00100000:3.0:1734016134.612078:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (376832->380927) req@ffff880073791c00 x1818247333867264/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/4536 e 0 to 0 dl 1734016145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016134.612086:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073791c00 with x1818247333867264 ext(376832->380927) 00002000:00010000:3.0:1734016134.612092:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073791c00 00000100:00100000:3.0:1734016134.619183:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333867136:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 8324us (9122us total) trans 0 rc 512000/512000 00000100:00100000:3.0:1734016134.619201:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8853 00002000:00100000:3.0:1734016134.619217:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2985984->3497983) req@ffff880073792300 x1818247333867136/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/440 e 0 to 0 dl 1734016145 ref 1 fl Complete:/200/0 rc 512000/512000 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016134.619228:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073792300 with x1818247333867136 ext(2985984->3497983) 00002000:00010000:3.0:1734016134.619237:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073792300 00000100:00100000:0.0:1734016134.620426:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.621170:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333867520 00000100:00100000:3.0:1734016134.621179:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333867520 00002000:00100000:3.0:1734016134.621225:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (380928->385023) req@ffff880073792d80 x1818247333867520/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016134.621234:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073792d80 with x1818247333867520 ext(380928->385023) 00002000:00010000:3.0:1734016134.621238:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073792d80 00000100:00100000:1.0:1734016134.622468:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8855 00000100:00100000:1.0:1734016134.622485:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247333867520:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016134.623232:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247333867520:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 743us (2804us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016134.623239:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8855 00002000:00100000:1.0:1734016134.623249:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (380928->385023) req@ffff880073792d80 x1818247333867520/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/4536 e 0 to 0 dl 1734016145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016134.623258:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073792d80 with x1818247333867520 ext(380928->385023) 00002000:00010000:1.0:1734016134.623266:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073792d80 00000100:00100000:0.0:1734016134.626965:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.627349:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333867776 00000100:00100000:1.0:1734016134.627374:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333867776 00002000:00100000:1.0:1734016134.627461:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (385024->389119) req@ffff880073790000 x1818247333867776/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016134.627477:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790000 with x1818247333867776 ext(385024->389119) 00002000:00010000:1.0:1734016134.627485:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073790000 00000100:00100000:1.0:1734016134.628111:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8856 00000100:00100000:1.0:1734016134.628122:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247333867776:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016134.628422:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247333867776:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 298us (1493us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016134.628431:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8856 00002000:00100000:1.0:1734016134.628437:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (385024->389119) req@ffff880073790000 x1818247333867776/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/4536 e 0 to 0 dl 1734016145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016134.628445:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790000 with x1818247333867776 ext(385024->389119) 00002000:00010000:1.0:1734016134.628450:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073790000 00000100:00100000:0.0:1734016134.632649:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.632875:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333867904 00000100:00100000:3.0:1734016134.632893:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333867904 00000100:00100000:3.0:1734016134.633322:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11336 00000100:00100000:3.0:1734016134.633338:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:10406:x1818247333867904:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.633385:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.633429:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711689a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6679 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.633484:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116885 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e666b expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.633496:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016134.633498:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016134.633505:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711689a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [2195456->2203647] (req 2195456->2203647) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6679 expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.633564:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116885 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e666b expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.633582:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e666b expref: 12 pid: 7684 timeout: 501 lvb_type: 0 00000100:00100000:3.0:1734016134.633602:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335358848:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016134.633714:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016134.638578:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016134.638692:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333868032 00000100:00100000:0.0:1734016134.638708:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333868032 00010000:00010000:0.0:1734016134.638762:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116885 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e666b expref: 13 pid: 7684 timeout: 501 lvb_type: 0 00000100:00100000:0.0:1734016134.638839:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3144 00000100:00100000:0.0:1734016134.638852:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333868032:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016134.638879:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016134.638911:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116885 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e666b expref: 13 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:0.0:1734016134.638930:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e666b expref: 13 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:0.0:1734016134.638976:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016134.638979:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016134.638991:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711689a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2203647) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6679 expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016134.639004:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711689a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2203647) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6679 expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016134.639072:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711689a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2203647) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6679 expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016134.639092:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335358976:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016134.639220:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00010000:00010000:3.0:1734016134.639349:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116885 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e666b expref: 13 pid: 7684 timeout: 501 lvb_type: 0 00000100:00100000:3.0:1734016134.639394:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335358848:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016134.639436:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711689a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2203647) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6679 expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.639448:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016134.639487:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:10406:x1818247333867904:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6152us (6869us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016134.639500:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11336 00000100:00100000:0.0:1734016134.644030:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.644227:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335358976:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016134.644270:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016134.644442:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333868288 00000100:00100000:3.0:1734016134.644456:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333868288 00002000:00100000:3.0:1734016134.644530:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2195456->2199551) req@ffff880073792680 x1818247333868288/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:95/0 lens 488/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016134.644548:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073792680 with x1818247333868288 ext(2195456->2199551) 00002000:00010000:3.0:1734016134.644553:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073792680 00000100:00100000:3.0:1734016134.644603:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8857 00000100:00100000:3.0:1734016134.644613:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333868288:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016134.644880:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333868032:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6029us (6319us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016134.644891:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3144 00000100:00100000:3.0:1734016134.646928:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333868288:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 2302us (2907us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016134.646942:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8857 00002000:00100000:3.0:1734016134.646958:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2195456->2199551) req@ffff880073792680 x1818247333868288/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:95/0 lens 488/4536 e 0 to 0 dl 1734016145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016134.646968:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073792680 with x1818247333868288 ext(2195456->2199551) 00002000:00010000:3.0:1734016134.646976:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073792680 00000100:00100000:0.0:1734016134.650632:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.651402:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333868544 00000100:00100000:3.0:1734016134.651422:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333868544 00002000:00100000:3.0:1734016134.651525:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2199552->2203647) req@ffff880073793100 x1818247333868544/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:95/0 lens 488/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016134.651906:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073793100 with x1818247333868544 ext(2199552->2203647) 00002000:00010000:3.0:1734016134.651914:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073793100 00000100:00100000:3.0:1734016134.651956:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8858 00000100:00100000:3.0:1734016134.651966:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333868544:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016134.653663:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333868544:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1685us (3034us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016134.653681:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8858 00002000:00100000:2.0:1734016134.653694:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2199552->2203647) req@ffff880073793100 x1818247333868544/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:95/0 lens 488/4536 e 0 to 0 dl 1734016145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016134.653704:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073793100 with x1818247333868544 ext(2199552->2203647) 00002000:00010000:2.0:1734016134.653709:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073793100 00000100:00100000:0.0:1734016134.657200:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.657605:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333868672 00000100:00100000:3.0:1734016134.657621:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333868672 00000100:00100000:3.0:1734016134.657726:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11337 00000100:00100000:3.0:1734016134.657736:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333868672:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.657774:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.657854:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271168a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6680 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.657896:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016134.657900:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016134.657912:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271168a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6680 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.657944:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271168a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6680 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.657965:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016134.658049:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333868672:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 313us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016134.658057:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11337 00000100:00100000:0.0:1734016134.662625:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.662874:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333868800 00000100:00100000:2.0:1734016134.662891:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333868800 00000100:00100000:2.0:1734016134.662975:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2314 00000100:00100000:2.0:1734016134.662987:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:10406:x1818247333868800:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016134.663030:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016134.663064:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271168a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6687 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.663252:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271168af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016134.663272:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271168af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016134.663289:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271168af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:2.0:1734016134.663334:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 7690371 00000004:00200000:2.0:1734016134.663340:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016134.663363:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271168af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016134.663396:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271168a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6687 expref: 26 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.664065:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271168af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6687 expref: 25 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.664074:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016134.664077:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016134.664080:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016134.664664:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+25:10406:x1818247333868800:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1677us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016134.664673:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2314 00000100:00100000:0.0:1734016134.667238:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.667596:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333868928 00000100:00100000:1.0:1734016134.667617:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333868928 00000100:00100000:1.0:1734016134.667738:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11338 00000100:00100000:1.0:1734016134.667752:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333868928:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016134.667896:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016134.667941:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc271168b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e668e expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016134.668079:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335359104:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016134.668205:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7c00 going to sleep for 11 seconds 00002000:00010000:1.0:1734016134.671470:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016134 -> 1734016135 00000100:00100000:1.0:1734016134.671524:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335359104:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016134.671586:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc271168b6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e668e expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.671608:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc271168b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e668e expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.672304:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016134.672372:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333868928:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4622us (5164us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016134.672381:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11338 00000100:00100000:0.0:1734016134.675198:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.675335:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333869056 00000100:00100000:1.0:1734016134.675353:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333869056 00000100:00100000:1.0:1734016134.675422:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11339 00000100:00100000:1.0:1734016134.675431:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:10406:x1818247333869056:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016134.675459:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016134.675491:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271168bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6695 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016134.675543:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711687e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6664 expref: 17 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016134.675551:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016134.675554:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016134.675558:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271168bd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2256896->2260991] (req 2256896->2260991) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6695 expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016134.675608:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711687e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6664 expref: 17 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016134.675622:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711687e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6664 expref: 17 pid: 7684 timeout: 501 lvb_type: 0 00000100:00100000:1.0:1734016134.675636:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335359232:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016134.675736:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016134.678377:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335359232:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016134.678423:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271168bd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2256896->2260991] (req 2256896->2260991) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6695 expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016134.678449:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016134.678505:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:10406:x1818247333869056:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3075us (3319us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016134.678517:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11339 00000100:00100000:0.0:1734016134.679963:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.680145:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333869184 00000100:00100000:3.0:1734016134.680157:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333869184 00010000:00010000:3.0:1734016134.680195:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711687e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6664 expref: 18 pid: 7684 timeout: 501 lvb_type: 0 00000100:00100000:3.0:1734016134.680611:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3145 00000100:00100000:3.0:1734016134.680624:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247333869184:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016134.680657:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016134.680688:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711687e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6664 expref: 18 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:3.0:1734016134.680710:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711687e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6664 expref: 18 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:3.0:1734016134.680742:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711687e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6664 expref: 18 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:3.0:1734016134.680777:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016134.680779:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016134.680790:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271168bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->2260991) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6695 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.681736:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271168bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->2260991) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6695 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.681791:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271168bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->2260991) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6695 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016134.682178:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335359360:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016134.682509:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016134.684697:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335359360:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016134.684729:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016134.685664:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+17:1982:x1818247333869184:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5039us (5714us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016134.685677:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3145 00000100:00100000:0.0:1734016134.685978:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.686130:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333869312 00000100:00100000:1.0:1734016134.686137:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333869312 00000100:00100000:1.0:1734016134.686176:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11340 00000100:00100000:1.0:1734016134.686182:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333869312:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016134.686446:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1734016134.686450:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016135 -> 1734016135 00002000:00010000:1.0:1734016134.686452:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016135 -> 1734016134 00002000:00010000:1.0:1734016134.686454:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016135 -> 1734016134 00002000:00010000:1.0:1734016134.686456:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 144 -> 152 00000100:00100000:1.0:1734016134.686488:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1982:x1818247333869312:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 307us (513us total) trans 4294968027 rc 0/0 00000100:00100000:1.0:1734016134.686494:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11340 00000100:00100000:0.0:1734016134.689962:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.692773:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333869440 00000100:00100000:3.0:1734016134.692817:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333869440 00000100:00100000:3.0:1734016134.692898:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11341 00000100:00100000:3.0:1734016134.692908:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+17:1981:x1818247333869440:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.692938:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.692969:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271168c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e669c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016134.693062:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335359488:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016134.693171:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00002000:00010000:3.0:1734016134.695690:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016134 -> 1734016135 00002000:00010000:3.0:1734016134.695706:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016134 -> 1734016135 00000100:00100000:3.0:1734016134.695738:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335359488:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016134.695794:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271168c4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e669c expref: 18 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.695853:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271168c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e669c expref: 18 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.696009:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016134.696541:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+17:1981:x1818247333869440:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3630us (6589us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016134.696554:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11341 00000100:00100000:0.0:1734016134.700879:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.701096:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333869568 00000100:00100000:3.0:1734016134.701113:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333869568 00000100:00100000:3.0:1734016134.701238:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11342 00000100:00100000:3.0:1734016134.701252:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+17:1984:x1818247333869568:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.701286:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.701324:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc271168cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e66a3 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016134.701419:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335359616:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016134.701831:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016134.704317:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335359616:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016134.704390:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc271168cb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66a3 expref: 18 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.704409:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc271168cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66a3 expref: 18 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.705068:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016134.705145:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+17:1984:x1818247333869568:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3893us (4284us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016134.705159:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11342 00000100:00100000:0.0:1734016134.709042:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.709156:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333869824 00000100:00100000:2.0:1734016134.709168:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333869824 00002000:00100000:2.0:1734016134.709238:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (3411968->3416063) req@ffff8800755b5180 x1818247333869824/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016134.709248:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5180 with x1818247333869824 ext(3411968->3416063) 00002000:00010000:2.0:1734016134.709255:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b5180 00000100:00100000:2.0:1734016134.709283:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8859 00000100:00100000:2.0:1734016134.709292:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247333869824:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016134.709514:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247333869824:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 222us (486us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016134.709524:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8859 00002000:00100000:2.0:1734016134.709531:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (3411968->3416063) req@ffff8800755b5180 x1818247333869824/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/4536 e 0 to 0 dl 1734016145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016134.709538:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5180 with x1818247333869824 ext(3411968->3416063) 00002000:00010000:2.0:1734016134.709540:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b5180 00000100:00100000:2.0:1734016134.711752:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.712707:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333870080 00000100:00100000:1.0:1734016134.712722:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333870080 00002000:00100000:1.0:1734016134.712787:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (3416064->3420159) req@ffff88007487ca80 x1818247333870080/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016134.712821:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487ca80 with x1818247333870080 ext(3416064->3420159) 00002000:00010000:1.0:1734016134.712829:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487ca80 00000100:00100000:1.0:1734016134.712862:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8860 00000100:00100000:1.0:1734016134.712870:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247333870080:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016134.713196:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247333870080:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 324us (1449us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016134.713208:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8860 00002000:00100000:1.0:1734016134.713215:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (3416064->3420159) req@ffff88007487ca80 x1818247333870080/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/4536 e 0 to 0 dl 1734016145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016134.713223:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487ca80 with x1818247333870080 ext(3416064->3420159) 00002000:00010000:1.0:1734016134.713227:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487ca80 00000100:00100000:0.0:1734016134.715523:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.716344:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333870336 00000100:00100000:2.0:1734016134.716361:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333870336 00002000:00100000:2.0:1734016134.716445:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (3420160->3424255) req@ffff8800755b7b80 x1818247333870336/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016134.716459:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b7b80 with x1818247333870336 ext(3420160->3424255) 00002000:00010000:2.0:1734016134.716470:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b7b80 00000100:00100000:2.0:1734016134.716504:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8861 00000100:00100000:2.0:1734016134.716515:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247333870336:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016134.716892:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247333870336:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 376us (1390us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016134.716903:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8861 00002000:00100000:2.0:1734016134.716911:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (3420160->3424255) req@ffff8800755b7b80 x1818247333870336/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 488/4536 e 0 to 0 dl 1734016145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016134.716920:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b7b80 with x1818247333870336 ext(3420160->3424255) 00002000:00010000:2.0:1734016134.716924:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b7b80 00000100:00100000:0.0:1734016134.719660:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.719933:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333870464 00000100:00100000:3.0:1734016134.719949:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333870464 00000100:00100000:3.0:1734016134.720732:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11343 00000100:00100000:3.0:1734016134.720741:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+17:1983:x1818247333870464:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.720771:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.720796:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc271168d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e66aa expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016134.720918:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335359744:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016134.721005:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016134.723651:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335359744:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016134.723722:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc271168d2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66aa expref: 18 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.723745:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc271168d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66aa expref: 18 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.724257:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016134.724326:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+17:1983:x1818247333870464:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3584us (4696us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016134.724340:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11343 00000100:00100000:0.0:1734016134.731090:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.731287:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333870592 00000100:00100000:3.0:1734016134.731304:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333870592 00000100:00100000:3.0:1734016134.731469:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11344 00000100:00100000:3.0:1734016134.731479:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+17:1984:x1818247333870592:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.731509:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.731542:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271168d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e66b1 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016134.731635:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335359872:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016134.731998:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016134.734135:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335359872:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016134.734205:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271168d9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66b1 expref: 18 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.734232:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271168d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66b1 expref: 18 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.734269:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016134.734376:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+17:1984:x1818247333870592:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2895us (3304us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016134.734390:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11344 00000100:00100000:0.0:1734016134.738095:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.738365:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333870720 00000100:00100000:3.0:1734016134.738380:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333870720 00000100:00100000:3.0:1734016134.738630:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11345 00000100:00100000:3.0:1734016134.738653:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+17:10406:x1818247333870720:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.738681:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.738712:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271168e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e66b8 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.738766:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271168bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->2260991) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6695 expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.738775:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016134.738777:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016134.738782:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271168e0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [5685248->5697535] (req 5685248->5697535) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66b8 expref: 18 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.739668:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271168bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->2260991) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6695 expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.739692:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271168bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->2260991) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6695 expref: 12 pid: 7682 timeout: 501 lvb_type: 0 00000100:00100000:3.0:1734016134.739705:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335360000:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016134.739859:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016134.743267:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.743599:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333870848 00000100:00100000:2.0:1734016134.743613:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333870848 00010000:00010000:2.0:1734016134.743667:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271168bd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->2260991) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6695 expref: 13 pid: 7682 timeout: 501 lvb_type: 0 00000100:00100000:3.0:1734016134.743950:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335360000:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016134.743996:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271168e0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [5685248->5697535] (req 5685248->5697535) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66b8 expref: 18 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.744019:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:2.0:1734016134.744301:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3146 00000100:00100000:2.0:1734016134.744315:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1982:x1818247333870848:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016134.744339:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016134.744366:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271168bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->2260991) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6695 expref: 13 pid: 7682 timeout: 501 lvb_type: 0 00010000:00010000:2.0:1734016134.744380:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271168bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->2260991) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6695 expref: 13 pid: 7682 timeout: 501 lvb_type: 0 00010000:00010000:2.0:1734016134.744414:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271168bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->2260991) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6695 expref: 13 pid: 7682 timeout: 501 lvb_type: 0 00000100:00100000:3.0:1734016134.744725:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+18:10406:x1818247333870720:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6084us (6647us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016134.744735:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11345 00010000:00010000:2.0:1734016134.745435:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016134.745439:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016134.745453:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271168e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5685248->5697535) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66b8 expref: 17 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.745470:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271168e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5685248->5697535) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66b8 expref: 17 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.745522:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271168e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5685248->5697535) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66b8 expref: 17 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016134.745539:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335360128:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016134.746092:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737063c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016134.749553:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335360128:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016134.749598:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016134.749696:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333870848:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5381us (6439us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016134.749714:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3146 00000100:00100000:0.0:1734016134.750461:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.750919:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333870976 00000100:00100000:3.0:1734016134.750933:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333870976 00000100:00100000:3.0:1734016134.751002:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11346 00000100:00100000:3.0:1734016134.751014:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247333870976:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.751069:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.751109:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271168e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e66bf expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016134.751226:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335360256:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016134.751317:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00002000:00010000:3.0:1734016134.754715:0:7684:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size: 4194304 -> 5695795 00000100:00100000:3.0:1734016134.754774:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335360256:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016134.754970:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271168e7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66bf expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.754990:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271168e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66bf expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.755032:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016134.755284:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247333870976:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4270us (4822us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016134.755294:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11346 00000100:00100000:0.0:1734016134.761188:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.761340:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333871104 00000100:00100000:3.0:1734016134.761357:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333871104 00000100:00100000:3.0:1734016134.761441:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11347 00000100:00100000:3.0:1734016134.761450:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1984:x1818247333871104:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.761477:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.761511:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc271168ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e66c6 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016134.761588:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335360384:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016134.761693:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016134.764220:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335360384:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016134.764289:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc271168ee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66c6 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.764307:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc271168ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66c6 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.764348:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016134.764566:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1984:x1818247333871104:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3115us (3398us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016134.764577:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11347 00000100:00100000:0.0:1734016134.770056:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.770307:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333871232 00000100:00100000:3.0:1734016134.770328:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333871232 00000100:00100000:3.0:1734016134.770851:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11348 00000100:00100000:3.0:1734016134.770862:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247333871232:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.770892:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.770923:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc271168f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e66cd expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016134.771019:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335360512:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016134.771101:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016134.773248:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335360512:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016134.773295:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc271168f5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66cd expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.773310:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc271168f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66cd expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.773384:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016134.773447:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247333871232:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2583us (3415us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016134.773463:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11348 00000100:00100000:0.0:1734016134.777720:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.778238:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333871360 00000100:00100000:3.0:1734016134.778260:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333871360 00000100:00100000:3.0:1734016134.778385:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11349 00000100:00100000:3.0:1734016134.778400:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333871360:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.778446:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.778495:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc271168fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e66d4 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016134.778626:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335360640:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016134.778747:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016134.781390:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335360640:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016134.781476:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc271168fc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66d4 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.781499:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc271168fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66d4 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.782014:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016134.782456:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333871360:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4050us (4758us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016134.782473:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11349 00000100:00100000:0.0:1734016134.785725:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.786014:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333871616 00000100:00100000:2.0:1734016134.786027:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333871616 00000100:00100000:2.0:1734016134.786095:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2315 00000100:00100000:2.0:1734016134.786104:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+25:10406:x1818247333871616:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016134.786196:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016134.786381:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271168af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6687 expref: 25 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.786432:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016134.786437:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016134.786628:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116903 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016134.786652:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116893 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6672 expref: 33 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.786657:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116903 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016134.786708:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6672 expref: 33 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.786727:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116893 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6672 expref: 33 pid: 6478 timeout: 501 lvb_type: 0 00000100:00100000:2.0:1734016134.786747:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335360768:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016134.786924:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00000100:00100000:0.0:1734016134.789998:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.790248:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333871744 00000100:00100000:3.0:1734016134.790265:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333871744 00010000:00010000:3.0:1734016134.790333:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116893 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6672 expref: 34 pid: 6478 timeout: 501 lvb_type: 0 00000100:00100000:3.0:1734016134.790395:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3147 00000100:00100000:3.0:1734016134.790411:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+34:1982:x1818247333871744:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016134.790439:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016134.790449:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116893 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6672 expref: 34 pid: 6478 timeout: 501 lvb_type: 0 00010000:00010000:3.0:1734016134.790470:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116893 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6672 expref: 34 pid: 6478 timeout: 501 lvb_type: 0 00010000:00010000:3.0:1734016134.790516:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016134.790525:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116903 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016134.790537:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116903 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016134.790548:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116903 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016134.790584:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016134.790658:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+34:1982:x1818247333871744:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 248us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016134.790667:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3147 00010000:00010000:2.0:1734016134.791234:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116893 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6672 expref: 33 pid: 6478 timeout: 501 lvb_type: 0 00000100:00100000:2.0:1734016134.791317:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335360768:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016134.791361:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116903 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016134.791373:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116903 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016134.791379:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116903 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:2.0:1734016134.791532:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968807 00000004:00010000:2.0:1734016134.791605:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800755b4000 reply state ffff880075603000 transno 4294968808 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116903 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:2.0:1734016134.791614:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016134.791862:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:10406:x1818247333871616:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 5694us (6088us total) trans 4294968808 rc 0/0 00000100:00100000:2.0:1734016134.791875:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2315 00000020:00080000:2.0:1734016134.791885:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1734016134.797104:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116903 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016134.797130:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116903 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016134.797146:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116903 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016134.797155:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcb40 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016134.797164:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116903 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016134.797176:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116903 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016134.797206:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016134.797210:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016134.797215:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116903 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016134.797221:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116903 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016134.797502:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016134.798151:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333871872 00000100:00100000:0.0:1734016134.798169:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333871872 00000100:00100000:0.0:1734016134.798262:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11350 00000100:00100000:0.0:1734016134.798275:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:10406:x1818247333871872:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016134.798314:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016134.798347:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7580000/0x5e3a3adc2711690a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e66db expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016134.798384:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271168e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5685248->5697535) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66b8 expref: 17 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016134.798394:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016134.798397:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016134.798402:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7580000/0x5e3a3adc2711690a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66db expref: 13 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016134.798462:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271168e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5685248->5697535) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66b8 expref: 17 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016134.798478:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271168e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5685248->5697535) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66b8 expref: 17 pid: 7684 timeout: 501 lvb_type: 0 00000100:00100000:0.0:1734016134.798493:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335360896:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016134.798591:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016134.803200:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b4a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335360896:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016134.803264:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7580000/0x5e3a3adc2711690a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66db expref: 13 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.803303:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:2.0:1734016134.803385:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:10406:x1818247333871872:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5111us (5892us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016134.803400:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11350 00000100:00100000:0.0:1734016134.803906:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.805114:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333872000 00000100:00100000:1.0:1734016134.805126:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333872000 00002000:00100000:1.0:1734016134.805206:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (5685248->5695794) req@ffff880073b48a80 x1818247333872000/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 11040/0 e 0 to 0 dl 1734016145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016134.805217:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48a80 with x1818247333872000 ext(5685248->5695794) 00010000:00010000:1.0:1734016134.805229:0:7687:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271168e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5685248->5697535) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66b8 expref: 18 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:1.0:1734016134.805245:0:7687:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271168e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5685248->5697535) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66b8 expref: 18 pid: 7684 timeout: 501 lvb_type: 0 00002000:00010000:1.0:1734016134.805253:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880073b48a80 00000100:00100000:1.0:1734016134.805726:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 290 00000100:00100000:1.0:1734016134.805735:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:1981:x1818247333872000:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016134.807684:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+20:1981:x1818247333872000:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1937us (3768us total) trans 4294968028 rc 0/0 00000100:00100000:1.0:1734016134.807695:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 290 00002000:00100000:1.0:1734016134.807707:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (5685248->5695794) req@ffff880073b48a80 x1818247333872000/t4294968028(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:95/0 lens 11040/448 e 0 to 0 dl 1734016145 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016134.807717:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48a80 with x1818247333872000 ext(5685248->5695794) 00010000:00010000:1.0:1734016134.807732:0:7687:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271168e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5685248->5697535) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66b8 expref: 20 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:1.0:1734016134.807751:0:7687:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271168e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5685248->5697535) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66b8 expref: 20 pid: 7684 timeout: 501 lvb_type: 0 00002000:00010000:1.0:1734016134.807760:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880073b48a80 00000100:00100000:0.0:1734016134.810967:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.811139:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333872128 00000100:00100000:2.0:1734016134.811156:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333872128 00010000:00010000:2.0:1734016134.811226:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271168e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5685248->5697535) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66b8 expref: 20 pid: 7684 timeout: 501 lvb_type: 0 00000100:00100000:2.0:1734016134.811659:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3148 00000100:00100000:2.0:1734016134.811669:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+20:1983:x1818247333872128:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016134.811697:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1734016134.811732:0:6465:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 152 -> 176 00010000:00010000:2.0:1734016134.811739:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271168e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5685248->5697535) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66b8 expref: 20 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:2.0:1734016134.811758:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271168e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5685248->5697535) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66b8 expref: 20 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:2.0:1734016134.811856:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271168e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5685248->5697535) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66b8 expref: 20 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:2.0:1734016134.811890:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016134.811893:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016134.811905:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7580000/0x5e3a3adc2711690a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66db expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.811918:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7580000/0x5e3a3adc2711690a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66db expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.811984:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7580000/0x5e3a3adc2711690a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66db expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016134.812002:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335361024:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016134.812124:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737063c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016134.814745:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.814958:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333872256 00000100:00100000:3.0:1734016134.814969:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333872256 00000100:00100000:3.0:1734016134.815042:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11351 00000100:00100000:3.0:1734016134.815053:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:10406:x1818247333872256:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.815081:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.815105:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116911 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e66e2 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.815138:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711689a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2203647) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6679 expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.815146:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271168a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6680 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.815154:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016134.815156:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016134.815161:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116911 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e2 expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.815199:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271168a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6680 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.815212:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271168a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6680 expref: 12 pid: 7684 timeout: 501 lvb_type: 1 00000100:00100000:3.0:1734016134.815223:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335361152:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016134.815291:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711689a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2203647) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6679 expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.815298:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711689a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2203647) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6679 expref: 12 pid: 7684 timeout: 501 lvb_type: 0 00000100:00100000:3.0:1734016134.815304:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335361280:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016134.815320:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016134.815418:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335361024:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016134.815442:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016134.815466:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+19:1983:x1818247333872128:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3799us (4520us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016134.815476:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3148 00000100:00100000:3.0:1734016134.819180:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335361152:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016134.819203:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335361280:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016134.819263:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116911 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e2 expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016134.819296:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016134.819377:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:10406:x1818247333872256:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4323us (4644us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016134.819391:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11351 00000100:00100000:0.0:1734016134.819876:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016134.819956:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016134.819994:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333872384 00000100:00100000:0.0:1734016134.820003:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333872384 00010000:00010000:0.0:1734016134.820039:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271168a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6680 expref: 13 pid: 7684 timeout: 501 lvb_type: 1 00000100:00100000:0.0:1734016134.820069:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333872512 00000100:00100000:0.0:1734016134.820071:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333872512 00010000:00010000:0.0:1734016134.820080:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711689a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6679 expref: 12 pid: 7684 timeout: 501 lvb_type: 0 00000100:00100000:0.0:1734016134.820097:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3149 00000100:00100000:0.0:1734016134.820103:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333872384:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016134.820127:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016134.820158:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271168a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6680 expref: 13 pid: 7684 timeout: 501 lvb_type: 1 00010000:00010000:0.0:1734016134.820169:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271168a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6680 expref: 13 pid: 7684 timeout: 501 lvb_type: 1 00010000:00010000:0.0:1734016134.820203:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271168a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6680 expref: 13 pid: 7684 timeout: 501 lvb_type: 1 00010000:00010000:0.0:1734016134.820223:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016134.820246:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333872384:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 143us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016134.820252:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3149 00000100:00100000:0.0:1734016134.820268:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3150 00000100:00100000:0.0:1734016134.820271:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247333872512:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016134.820278:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016134.820283:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711689a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6679 expref: 12 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:0.0:1734016134.820292:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711689a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2203647) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6679 expref: 12 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:0.0:1734016134.820304:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711689a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2203647) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6679 expref: 12 pid: 7684 timeout: 501 lvb_type: 0 00010000:00010000:0.0:1734016134.820318:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016134.820321:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016134.820328:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116911 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e2 expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016134.820339:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116911 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e2 expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016134.820374:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116911 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e2 expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016134.820385:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335361408:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016134.820421:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016134.824010:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016134.824599:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b4bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335361408:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016134.824627:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016134.824690:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333872512:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4416us (4732us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016134.824703:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3150 00000100:00100000:2.0:1734016134.825632:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.826194:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333872768 00000100:00100000:1.0:1734016134.826203:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333872768 00002000:00010000:1.0:1734016134.826242:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:1.0:1734016134.826247:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487d180 with x1818247333872768 ext(0->18446744073709551615) 00002000:00010000:1.0:1734016134.826262:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487d180. 00000100:00100000:1.0:1734016134.826286:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333872640 00000100:00100000:1.0:1734016134.826288:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333872640 00002000:00010000:1.0:1734016134.826298:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (344534->18446744073709551615) 00002000:00100000:1.0:1734016134.826300:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487fb80 with x1818247333872640 ext(344534->18446744073709551615) 00002000:00010000:1.0:1734016134.826308:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007487fb80. 00000100:00100000:1.0:1734016134.826322:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8862 00000100:00100000:1.0:1734016134.826328:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333872768:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016134.829059:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 3496067 -> 0 00002000:00010000:1.0:1734016134.829073:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016135 -> 1734016135 00002000:00010000:1.0:1734016134.829077:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016133 -> 1734016133 00002000:00010000:1.0:1734016134.829079:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016135 -> 1734016135 00002000:00010000:1.0:1734016134.829082:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1734016134.829182:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333872768:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 2846us (5185us total) trans 4294969501 rc 0/0 00000100:00100000:1.0:1734016134.829195:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8862 00002000:00010000:1.0:1734016134.829200:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:1.0:1734016134.829203:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487d180 with x1818247333872768 ext(0->18446744073709551615) 00002000:00010000:1.0:1734016134.829209:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487d180. 00000100:00100000:1.0:1734016134.829238:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8863 00000100:00100000:1.0:1734016134.829246:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1982:x1818247333872640:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016134.832863:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5695795 -> 344534 00002000:00010000:1.0:1734016134.832879:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016135 -> 1734016135 00002000:00010000:1.0:1734016134.832882:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016135 -> 1734016135 00002000:00010000:1.0:1734016134.832884:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016135 -> 1734016135 00002000:00010000:1.0:1734016134.832888:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 176 -> 64 00000100:00100000:1.0:1734016134.833005:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1982:x1818247333872640:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 3749us (7363us total) trans 4294968029 rc 0/0 00000100:00100000:1.0:1734016134.833019:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8863 00002000:00010000:1.0:1734016134.833032:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (344534->18446744073709551615) 00002000:00100000:1.0:1734016134.833036:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487fb80 with x1818247333872640 ext(344534->18446744073709551615) 00002000:00010000:1.0:1734016134.833046:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007487fb80. 00000100:00100000:0.0:1734016134.843995:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.844152:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333872896 00000100:00100000:2.0:1734016134.844171:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333872896 00000100:00100000:2.0:1734016134.844254:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2316 00000100:00100000:2.0:1734016134.844265:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+33:10406:x1818247333872896:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016134.844301:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016134.844335:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116918 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e66e9 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.844493:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711691f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016134.844514:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711691f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016134.844530:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711691f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:2.0:1734016134.844571:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 344534 00000004:00200000:2.0:1734016134.844576:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016134.844610:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711691f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016134.844649:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116918 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e9 expref: 35 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.844688:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711691f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e9 expref: 34 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.844702:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016134.844705:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016134.844711:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016134.845076:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+34:10406:x1818247333872896:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 810us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016134.845086:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2316 00000100:00100000:0.0:1734016134.853758:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.855719:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333873024 00000100:00100000:3.0:1734016134.855745:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333873024 00000100:00100000:3.0:1734016134.855859:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11352 00000100:00100000:3.0:1734016134.855869:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+19:1981:x1818247333873024:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.855903:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.855938:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116926 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e66f0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016134.856046:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335361536:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016134.856171:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016134.856536:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.856606:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333873152 00000100:00100000:1.0:1734016134.856610:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333873152 00000100:00100000:1.0:1734016134.856655:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11353 00000100:00100000:1.0:1734016134.856660:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333873152:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016134.856669:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016134.856688:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711692d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e66f7 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016134.856730:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335361664:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016134.856781:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016134.863303:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335361536:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016134.863371:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116926 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66f0 expref: 20 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.863390:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116926 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66f0 expref: 20 pid: 7684 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1734016134.863535:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016133 -> 1734016135 00000100:00100000:1.0:1734016134.863557:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335361664:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016134.863587:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711692d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66f7 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.863598:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc2711692d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66f7 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.863759:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016134.864035:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+19:1981:x1818247333873024:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8164us (10294us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016134.864053:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11352 00010000:00010000:1.0:1734016134.867067:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016134.867195:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333873152:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10526us (10652us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016134.867207:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11353 00000100:00100000:0.0:1734016134.870619:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016134.870682:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.870875:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333873408 00000100:00100000:3.0:1734016134.870888:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333873408 00000100:00100000:3.0:1734016134.870935:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333873280 00000100:00100000:3.0:1734016134.870937:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333873280 00000100:00100000:3.0:1734016134.870954:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11354 00000100:00100000:3.0:1734016134.870962:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247333873408:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.870983:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.871007:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116934 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6705 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016134.871083:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335361792:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016134.871150:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016134.871205:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11355 00000100:00100000:2.0:1734016134.871211:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+19:1984:x1818247333873280:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016134.871219:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016134.871229:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711693b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e66fe expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016134.871261:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335361920:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016134.871281:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016134.874650:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335361920:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016134.874732:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711693b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66fe expref: 20 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.874751:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711693b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66fe expref: 20 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.878810:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016134.878967:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+19:1984:x1818247333873280:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7741us (8269us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016134.878984:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11355 00000100:00100000:3.0:1734016134.879281:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335361792:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016134.879344:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116934 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6705 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.879362:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116934 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6705 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016134.879392:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016134.879415:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247333873408:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8455us (8814us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016134.879421:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11354 00000100:00100000:0.0:1734016134.884678:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016134.884974:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016134.885070:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333873536 00000100:00100000:3.0:1734016134.885093:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333873536 00000100:00100000:3.0:1734016134.885153:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333873664 00000100:00100000:3.0:1734016134.885155:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333873664 00000100:00100000:3.0:1734016134.885190:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11356 00000100:00100000:3.0:1734016134.885199:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+19:1984:x1818247333873536:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016134.885229:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016134.885265:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116942 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e670c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016134.885365:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335362048:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016134.885458:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016134.885521:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11357 00000100:00100000:1.0:1734016134.885530:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247333873664:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016134.885542:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016134.885559:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27116949 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6713 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016134.885597:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335362176:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016134.885630:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7900 going to sleep for 11 seconds 00002000:00010000:1.0:1734016134.894185:0:7682:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size: 0 -> 2680125 00002000:00010000:1.0:1734016134.894199:0:7682:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:1.0:1734016134.894228:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335362176:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016134.894289:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27116949 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6713 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.894306:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27116949 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6713 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.894324:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016134.894387:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247333873664:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8856us (9412us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016134.894401:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11357 00000100:00100000:2.0:1734016134.894504:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335362048:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016134.894529:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116942 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e670c expref: 20 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.894537:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116942 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e670c expref: 20 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.894558:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:2.0:1734016134.894577:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+19:1984:x1818247333873536:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9380us (9927us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016134.894586:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11356 00000100:00100000:0.0:1734016134.896950:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016134.897030:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.897130:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333873792 00000100:00100000:1.0:1734016134.897142:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333873792 00000100:00100000:1.0:1734016134.897193:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333873920 00000100:00100000:1.0:1734016134.897195:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333873920 00000100:00100000:1.0:1734016134.897230:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11358 00000100:00100000:1.0:1734016134.897241:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+19:1983:x1818247333873792:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016134.897270:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016134.897298:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499e880/0x5e3a3adc27116950 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e671a expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016134.897386:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335362304:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016134.897470:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7900 going to sleep for 11 seconds 00000100:00100000:2.0:1734016134.897554:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11359 00000100:00100000:2.0:1734016134.897560:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333873920:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016134.897570:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016134.897586:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116957 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6721 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016134.897621:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335362432:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016134.897655:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:1.0:1734016134.901256:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335362304:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016134.901323:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499e880/0x5e3a3adc27116950 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e671a expref: 20 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.901341:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499e880/0x5e3a3adc27116950 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e671a expref: 20 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.901360:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016134.901419:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+19:1983:x1818247333873792:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4179us (4485us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016134.901431:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11358 00000100:00100000:2.0:1734016134.902229:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335362432:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016134.902259:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116957 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6721 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.902269:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116957 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6721 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.902283:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016134.903481:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333873920:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5917us (6447us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016134.903490:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11359 00000100:00100000:0.0:1734016134.910284:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.910463:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333874048 00000100:00100000:2.0:1734016134.910483:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333874048 00000100:00100000:2.0:1734016134.911491:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11360 00000100:00100000:2.0:1734016134.911500:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+19:10406:x1818247333874048:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016134.911527:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016134.911555:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711695e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6728 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.911593:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7580000/0x5e3a3adc2711690a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66db expref: 13 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.911600:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016134.911602:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016134.911605:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711695e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3526656->3534847] (req 3526656->3534847) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6728 expref: 20 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.911649:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7580000/0x5e3a3adc2711690a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66db expref: 13 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.911661:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a7580000/0x5e3a3adc2711690a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66db expref: 13 pid: 7684 timeout: 502 lvb_type: 0 00000100:00100000:2.0:1734016134.911674:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335362560:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016134.911760:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016134.913454:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335362560:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016134.913493:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711695e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3526656->3534847] (req 3526656->3534847) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6728 expref: 20 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.913512:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016134.913556:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+20:10406:x1818247333874048:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2055us (3297us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016134.913565:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11360 00000100:00100000:0.0:1734016134.921766:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.922199:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333874176 00000100:00100000:1.0:1734016134.922223:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333874176 00010000:00010000:1.0:1734016134.922295:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7580000/0x5e3a3adc2711690a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66db expref: 14 pid: 7684 timeout: 502 lvb_type: 0 00000100:00100000:1.0:1734016134.922346:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3151 00000100:00100000:1.0:1734016134.922356:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1981:x1818247333874176:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016134.922384:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016134.922414:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a7580000/0x5e3a3adc2711690a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66db expref: 14 pid: 7684 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1734016134.922430:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a7580000/0x5e3a3adc2711690a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66db expref: 14 pid: 7684 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1734016134.922468:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7580000/0x5e3a3adc2711690a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66db expref: 14 pid: 7684 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1734016134.922497:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016134.922500:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016134.922510:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711695e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3526656->3534847) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6728 expref: 19 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016134.922519:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711695e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3526656->3534847) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6728 expref: 19 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016134.922575:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711695e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3526656->3534847) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6728 expref: 19 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016134.922592:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335362688:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016134.922697:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016134.925665:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.926072:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335362688:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016134.926100:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016134.926160:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1981:x1818247333874176:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3805us (8393us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016134.926176:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3151 00000100:00100000:2.0:1734016134.928128:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333874304 00000100:00100000:2.0:1734016134.928151:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333874304 00000100:00100000:2.0:1734016134.928236:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11361 00000100:00100000:2.0:1734016134.928247:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+20:1981:x1818247333874304:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016134.928527:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 344534 -> 344534 00002000:00010000:2.0:1734016134.928531:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016135 -> 1734016135 00002000:00010000:2.0:1734016134.928533:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016135 -> 1734016135 00002000:00010000:2.0:1734016134.928536:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016135 -> 1734016135 00002000:00010000:2.0:1734016134.928538:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 64 -> 64 00000100:00100000:2.0:1734016134.928658:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+21:1981:x1818247333874304:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 412us (3010us total) trans 4294968030 rc 0/0 00000100:00100000:2.0:1734016134.928666:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11361 00000100:00100000:0.0:1734016134.937630:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.937764:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333874432 00000100:00100000:2.0:1734016134.937783:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333874432 00000100:00100000:2.0:1734016134.937911:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2317 00000100:00100000:2.0:1734016134.937923:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+26:10406:x1818247333874432:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016134.937967:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016134.938000:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116965 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e672f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.938145:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711696c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016134.938162:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711696c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016134.938180:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711696c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:2.0:1734016134.938212:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 344534 00000004:00200000:2.0:1734016134.938217:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016134.938236:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711696c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016134.938261:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116965 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e672f expref: 28 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.938300:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711696c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e672f expref: 27 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016134.938311:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016134.938314:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016134.938319:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016134.938385:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:10406:x1818247333874432:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 462us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016134.938392:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2317 00000100:00100000:0.0:1734016134.941088:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.941214:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333874560 00000100:00100000:1.0:1734016134.941229:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333874560 00000100:00100000:1.0:1734016134.941310:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11362 00000100:00100000:1.0:1734016134.941318:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1982:x1818247333874560:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016134.941354:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016134.941392:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27116973 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6736 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016134.941490:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335362816:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016134.942543:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016134.953551:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335362816:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016134.953624:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27116973 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6736 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.953658:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27116973 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6736 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.958528:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016134.958692:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1982:x1818247333874560:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 17364us (17615us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016134.958706:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11362 00000100:00100000:0.0:1734016134.962228:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.962394:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333874688 00000100:00100000:1.0:1734016134.962411:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333874688 00000100:00100000:1.0:1734016134.962493:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11363 00000100:00100000:1.0:1734016134.962503:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1983:x1818247333874688:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016134.962542:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016134.962584:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711697a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e673d expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016134.962692:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335362944:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016134.962860:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016134.965412:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335362944:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016134.965493:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711697a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e673d expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.965523:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711697a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e673d expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016134.965545:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016134.965657:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1983:x1818247333874688:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3151us (3452us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016134.965673:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11363 00000100:00100000:0.0:1734016134.968783:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.969486:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333874816 00000100:00100000:1.0:1734016134.969507:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333874816 00000100:00100000:1.0:1734016134.970781:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11364 00000100:00100000:1.0:1734016134.970817:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247333874816:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016134.971176:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 2680125 -> 0 00002000:00010000:1.0:1734016134.971181:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016135 -> 1734016135 00002000:00010000:1.0:1734016134.971183:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016135 -> 1734016133 00002000:00010000:1.0:1734016134.971187:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016135 -> 1734016135 00002000:00010000:1.0:1734016134.971189:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 1 -> 0 00000100:00100000:1.0:1734016134.971331:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1981:x1818247333874816:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 534us (2566us total) trans 4294969502 rc 0/0 00000100:00100000:1.0:1734016134.971341:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11364 00000100:00100000:0.0:1734016134.979002:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016134.982304:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333874944 00000100:00100000:1.0:1734016134.982324:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333874944 00000100:00100000:0.0:1734016134.982466:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11365 00000100:00100000:0.0:1734016134.982479:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1983:x1818247333874944:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016134.982510:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016134.982541:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7580000/0x5e3a3adc27116981 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6744 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016134.982630:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335363072:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016134.982748:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016134.984706:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335363072:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016134.984750:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7580000/0x5e3a3adc27116981 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6744 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.984767:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7580000/0x5e3a3adc27116981 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6744 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.984846:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:2.0:1734016134.984898:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1983:x1818247333874944:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2420us (5909us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016134.984910:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11365 00000100:00100000:0.0:1734016134.991977:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.992109:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333875072 00000100:00100000:2.0:1734016134.992123:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333875072 00000100:00100000:2.0:1734016134.992335:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11366 00000100:00100000:2.0:1734016134.992346:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1982:x1818247333875072:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016134.992383:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016134.992416:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116988 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e674b expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016134.992508:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335363200:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016134.992605:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016134.995033:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335363200:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016134.995084:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116988 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e674b expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.995101:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116988 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e674b expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016134.995136:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016134.995191:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1982:x1818247333875072:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2845us (3230us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016134.995202:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11366 00000100:00100000:0.0:1734016134.997221:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016134.998378:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333875200 00000100:00100000:2.0:1734016134.998395:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333875200 00000100:00100000:2.0:1734016134.998453:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11367 00000100:00100000:2.0:1734016134.998461:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1984:x1818247333875200:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016134.998492:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016134.998523:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711698f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6752 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016134.998586:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335363328:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016134.998676:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016135.004949:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335363328:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016135.005027:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711698f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6752 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.005050:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc2711698f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6752 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.005080:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016135.005172:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1984:x1818247333875200:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6708us (7959us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016135.005184:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11367 00000100:00100000:0.0:1734016135.008029:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.012909:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333875328 00000100:00100000:2.0:1734016135.012936:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333875328 00000100:00100000:2.0:1734016135.013023:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11368 00000100:00100000:2.0:1734016135.013036:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1981:x1818247333875328:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016135.013076:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016135.013107:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116996 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6759 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016135.013217:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335363456:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016135.013329:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016135.015261:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335363456:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016135.015323:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116996 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6759 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.015341:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116996 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6759 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.015359:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016135.015429:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1981:x1818247333875328:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2394us (7424us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016135.015444:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11368 00000100:00100000:0.0:1734016135.019880:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.019983:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333875584 00000100:00100000:2.0:1734016135.019994:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333875584 00000100:00100000:2.0:1734016135.020042:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2318 00000100:00100000:2.0:1734016135.020050:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:10406:x1818247333875584:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016135.020116:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016135.020154:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711696c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e672f expref: 27 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.020188:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016135.020194:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016135.020417:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711699d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016135.020436:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711691f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e9 expref: 33 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.020444:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711699d lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016135.020482:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711691f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e9 expref: 33 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.020496:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711691f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e9 expref: 33 pid: 6479 timeout: 502 lvb_type: 0 00000100:00100000:2.0:1734016135.020510:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335363584:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016135.020589:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016135.023245:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335363584:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016135.023289:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711699d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016135.026616:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016135.027832:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333875712 00000100:00100000:1.0:1734016135.027851:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333875712 00010000:00010000:1.0:1734016135.027911:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711691f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e9 expref: 34 pid: 6479 timeout: 502 lvb_type: 0 00000100:00100000:1.0:1734016135.027971:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3152 00000100:00100000:1.0:1734016135.027981:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+34:1981:x1818247333875712:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016135.028009:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016135.028019:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711691f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e9 expref: 34 pid: 6479 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1734016135.028037:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711691f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e9 expref: 34 pid: 6479 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1734016135.028078:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711691f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e9 expref: 34 pid: 6479 timeout: 502 lvb_type: 0 00010000:00010000:1.0:1734016135.028129:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016135.028138:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711699d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016135.028152:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711699d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016135.028163:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711699d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016135.033871:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016135.034043:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+33:1981:x1818247333875712:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6044us (7426us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016135.034070:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3152 00010000:00010000:3.0:1734016135.034828:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711699d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016135.034841:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711699d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:3.0:1734016135.035010:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968809 00000004:00010000:3.0:1734016135.035090:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800849b4a80 reply state ffff88007bf5f000 transno 4294968810 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711699d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016135.035101:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016135.035238:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+29:10406:x1818247333875584:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 15187us (15377us total) trans 4294968810 rc 0/0 00000100:00100000:3.0:1734016135.035248:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2318 00000020:00080000:3.0:1734016135.035252:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016135.037641:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711699d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016135.037661:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711699d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016135.037672:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711699d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016135.037680:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbdf80 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016135.037688:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711699d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016135.037703:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711699d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016135.037736:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016135.037739:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016135.037745:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711699d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016135.037750:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711699d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016135.038749:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.038858:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333875840 00000100:00100000:2.0:1734016135.038879:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333875840 00000100:00100000:2.0:1734016135.038964:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11369 00000100:00100000:2.0:1734016135.038979:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:10406:x1818247333875840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016135.039022:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016135.039054:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271169a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6760 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.039106:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711695e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3526656->3534847) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6728 expref: 20 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.039117:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016135.039121:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016135.039126:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271169a4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6760 expref: 14 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.039185:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711695e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3526656->3534847) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6728 expref: 20 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.039212:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711695e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3526656->3534847) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6728 expref: 20 pid: 7684 timeout: 502 lvb_type: 0 00000100:00100000:2.0:1734016135.039230:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335363712:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016135.039341:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016135.048505:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335363712:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016135.048561:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271169a4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6760 expref: 14 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.048590:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016135.048698:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:10406:x1818247333875840:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9719us (9961us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016135.048714:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11369 00000100:00100000:0.0:1734016135.049220:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.049631:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333875968 00000100:00100000:2.0:1734016135.049653:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333875968 00010000:00010000:2.0:1734016135.049702:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711695e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3526656->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6728 expref: 21 pid: 7684 timeout: 502 lvb_type: 0 00000100:00100000:2.0:1734016135.049737:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3153 00000100:00100000:2.0:1734016135.049745:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+21:1981:x1818247333875968:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016135.049769:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016135.049829:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711695e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3526656->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6728 expref: 21 pid: 7684 timeout: 502 lvb_type: 0 00010000:00010000:2.0:1734016135.049850:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711695e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3526656->3534847) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6728 expref: 21 pid: 7684 timeout: 502 lvb_type: 0 00010000:00010000:2.0:1734016135.049892:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711695e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3526656->3534847) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6728 expref: 21 pid: 7684 timeout: 502 lvb_type: 0 00010000:00010000:2.0:1734016135.051872:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016135.051883:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016135.051899:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271169a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6760 expref: 13 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.051913:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271169a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6760 expref: 13 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.052000:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271169a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6760 expref: 13 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016135.052016:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335363840:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016135.052125:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016135.060091:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.062475:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335363840:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016135.062534:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016135.063378:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+20:1981:x1818247333875968:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 13626us (14154us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016135.063400:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3153 00000100:00100000:0.0:1734016135.065037:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016135.065069:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333876096 00000100:00100000:3.0:1734016135.065084:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333876096 00002000:00010000:3.0:1734016135.065141:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4337090->18446744073709551615) 00002000:00100000:3.0:1734016135.065147:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c2300 with x1818247333876096 ext(4337090->18446744073709551615) 00002000:00010000:3.0:1734016135.065167:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c2300. 00000100:00100000:3.0:1734016135.065218:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8864 00000100:00100000:3.0:1734016135.065227:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1981:x1818247333876096:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016135.065568:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 344534 -> 4337090 00002000:00010000:3.0:1734016135.065572:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016135 -> 1734016135 00002000:00010000:3.0:1734016135.065574:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016135 -> 1734016135 00002000:00010000:3.0:1734016135.065576:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016135 -> 1734016135 00002000:00010000:3.0:1734016135.065579:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 64 -> 64 00000100:00100000:3.0:1734016135.065662:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1981:x1818247333876096:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 435us (5587us total) trans 4294968031 rc 0/0 00000100:00100000:3.0:1734016135.065670:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8864 00002000:00010000:3.0:1734016135.065672:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4337090->18446744073709551615) 00002000:00100000:3.0:1734016135.065675:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c2300 with x1818247333876096 ext(4337090->18446744073709551615) 00002000:00010000:3.0:1734016135.065680:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c2300. 00000100:00100000:2.0:1734016135.066773:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333876224 00000100:00100000:2.0:1734016135.066785:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333876224 00002000:00010000:2.0:1734016135.066845:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:2.0:1734016135.066851:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c1f80 with x1818247333876224 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1734016135.066865:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c1f80. 00000100:00100000:2.0:1734016135.066897:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8865 00000100:00100000:2.0:1734016135.066904:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1982:x1818247333876224:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016135.067117:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1734016135.067120:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016135 -> 1734016135 00002000:00010000:2.0:1734016135.067123:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016133 -> 1734016133 00002000:00010000:2.0:1734016135.067125:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016135 -> 1734016135 00002000:00010000:2.0:1734016135.067127:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1734016135.067184:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1982:x1818247333876224:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 280us (2161us total) trans 4294969503 rc 0/0 00000100:00100000:2.0:1734016135.067193:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8865 00002000:00010000:2.0:1734016135.067196:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:2.0:1734016135.067199:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c1f80 with x1818247333876224 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1734016135.067204:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c1f80. 00000100:00100000:0.0:1734016135.083885:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016135.083964:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016135.084274:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333876480 00000100:00100000:3.0:1734016135.084294:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333876480 00002000:00100000:3.0:1734016135.084392:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4333567) req@ffff8800750c1880 x1818247333876480/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 504/0 e 0 to 0 dl 1734016146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016135.084407:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c1880 with x1818247333876480 ext(0->4333567) 00002000:00010000:3.0:1734016135.084417:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c1880 00000100:00100000:3.0:1734016135.084439:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333876608 00000100:00100000:3.0:1734016135.084441:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333876608 00002000:00100000:3.0:1734016135.084454:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (4190208->4194303) req@ffff8800750c0a80 x1818247333876608/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 488/0 e 0 to 0 dl 1734016146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016135.084461:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0a80 with x1818247333876608 ext(4190208->4194303) 00002000:00010000:3.0:1734016135.084466:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c0a80 00000100:00100000:3.0:1734016135.084600:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8866 00000100:00100000:3.0:1734016135.084609:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333876480:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016135.088066:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8867 00000100:00100000:0.0:1734016135.088097:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333876608:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016135.088490:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333876608:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 405us (4525us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016135.088499:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8867 00002000:00100000:0.0:1734016135.088509:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (4190208->4194303) req@ffff8800750c0a80 x1818247333876608/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 488/4536 e 0 to 0 dl 1734016146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016135.088519:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0a80 with x1818247333876608 ext(4190208->4194303) 00002000:00010000:0.0:1734016135.088527:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c0a80 00000100:00100000:3.0:1734016135.175862:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247333876480:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 91229us (91979us total) trans 0 rc 4194304/4194304 00000100:00100000:3.0:1734016135.175886:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8866 00002000:00100000:3.0:1734016135.175906:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4333567) req@ffff8800750c1880 x1818247333876480/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 504/440 e 0 to 0 dl 1734016146 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016135.175919:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c1880 with x1818247333876480 ext(0->4333567) 00002000:00010000:3.0:1734016135.175928:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c1880 00000100:00100000:0.0:1734016135.189683:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016135.189740:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016135.193206:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333877120 00000100:00100000:1.0:1734016135.193235:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333877120 00002000:00100000:1.0:1734016135.193320:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (0->4194303) req@ffff8801369f1500 x1818247333877120/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 504/0 e 0 to 0 dl 1734016146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016135.193333:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1500 with x1818247333877120 ext(0->4194303) 00002000:00010000:1.0:1734016135.193340:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f1500 00000100:00100000:1.0:1734016135.193397:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333877248 00000100:00100000:1.0:1734016135.193399:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333877248 00002000:00100000:1.0:1734016135.193412:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (4333568->4337663) req@ffff8801369f3b80 x1818247333877248/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 488/0 e 0 to 0 dl 1734016146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016135.193418:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f3b80 with x1818247333877248 ext(4333568->4337663) 00002000:00010000:1.0:1734016135.193422:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801369f3b80 00000100:00100000:1.0:1734016135.193437:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8868 00000100:00100000:1.0:1734016135.193445:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1983:x1818247333877120:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016135.196745:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8869 00000100:00100000:0.0:1734016135.196762:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1983:x1818247333877248:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016135.197042:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1983:x1818247333877248:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 282us (7299us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016135.197048:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8869 00002000:00100000:0.0:1734016135.197059:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (4333568->4337663) req@ffff8801369f3b80 x1818247333877248/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 488/4536 e 0 to 0 dl 1734016146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016135.197070:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f3b80 with x1818247333877248 ext(4333568->4337663) 00002000:00010000:0.0:1734016135.197078:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801369f3b80 00000100:00100000:0.0:1734016135.208264:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016135.208479:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333877376 00000100:00100000:3.0:1734016135.208499:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333877376 00002000:00100000:3.0:1734016135.208583:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (4329472->4337089) req@ffff8801369f3480 x1818247333877376/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 8112/0 e 0 to 0 dl 1734016146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016135.208600:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f3480 with x1818247333877376 ext(4329472->4337089) 00002000:00010000:3.0:1734016135.208609:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801369f3480 00000100:00100000:3.0:1734016135.208673:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8870 00000100:00100000:3.0:1734016135.208685:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247333877376:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016135.214367:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1982:x1818247333877376:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4290us (4731us total) trans 4294968032 rc 0/0 00000100:00100000:3.0:1734016135.214403:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8870 00002000:00100000:3.0:1734016135.214435:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (4329472->4337089) req@ffff8801369f3480 x1818247333877376/t4294968032(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 8112/448 e 0 to 0 dl 1734016146 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016135.214450:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f3480 with x1818247333877376 ext(4329472->4337089) 00002000:00010000:3.0:1734016135.214464:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801369f3480 00000100:00100000:3.0:1734016135.214817:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.219061:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333877504 00000100:00100000:2.0:1734016135.219090:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333877504 00000100:00100000:2.0:1734016135.219973:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2319 00000100:00100000:2.0:1734016135.219984:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+28:10406:x1818247333877504:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:2.0:1734016135.221934:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+28:10406:x1818247333877504:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 1933us (7119us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016135.221951:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2319 00000100:00100000:0.0:1734016135.229024:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016135.229169:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333877632 00000100:00100000:3.0:1734016135.229184:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333877632 00000100:00100000:3.0:1734016135.229235:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11370 00000100:00100000:3.0:1734016135.229244:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1983:x1818247333877632:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016135.238620:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968032 is committed 00000001:00080000:0.0:1734016135.238675:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968030 is committed 00000100:00100000:0.0:1734016135.250723:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333877632:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 21452us (21688us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016135.250741:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11370 00000100:00100000:0.0:1734016135.264663:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.264986:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1983:x1818247333877120:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 71534us (75312us total) trans 0 rc 4182016/4182016 00000100:00100000:2.0:1734016135.265005:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8868 00002000:00100000:2.0:1734016135.265022:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (0->4194303) req@ffff8801369f1500 x1818247333877120/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 504/440 e 0 to 0 dl 1734016146 ref 1 fl Complete:/200/0 rc 4182016/4182016 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016135.265033:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1500 with x1818247333877120 ext(0->4194303) 00002000:00010000:2.0:1734016135.265043:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f1500 00000100:00100000:3.0:1734016135.265189:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333877760 00000100:00100000:3.0:1734016135.265206:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333877760 00000100:00100000:3.0:1734016135.265289:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2320 00000100:00100000:3.0:1734016135.265298:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+33:10406:x1818247333877760:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016135.265342:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016135.265372:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271169ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6767 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016135.265558:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271169b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016135.265580:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271169b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016135.265598:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271169b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016135.265641:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 8531394 00000004:00200000:3.0:1734016135.265645:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016135.265667:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271169b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016135.265692:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271169ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6767 expref: 35 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016135.265722:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271169b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6767 expref: 34 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016135.265731:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016135.265734:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016135.265738:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016135.269393:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+34:10406:x1818247333877760:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4060us (4712us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016135.269424:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2320 00000100:00100000:0.0:1734016135.275131:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.275748:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333877888 00000100:00100000:2.0:1734016135.275769:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333877888 00000100:00100000:2.0:1734016135.276165:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11371 00000100:00100000:2.0:1734016135.276177:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333877888:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016135.276225:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016135.276263:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc271169b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e676e expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016135.276391:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335363968:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016135.276829:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016135.277059:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.277873:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333878016 00000100:00100000:2.0:1734016135.277882:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333878016 00000100:00100000:2.0:1734016135.277936:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11372 00000100:00100000:2.0:1734016135.277943:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333878016:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016135.277960:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016135.277979:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271169c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6775 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016135.278025:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335364096:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016135.278090:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00002000:00010000:2.0:1734016135.278986:0:7682:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks: 64 -> 72 00000100:00100000:2.0:1734016135.279019:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335363968:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016135.279064:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc271169b9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e676e expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.279078:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc271169b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e676e expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.279108:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016135.279160:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333877888:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2982us (4044us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016135.279169:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11371 00002000:00010000:2.0:1734016135.280170:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016133 -> 1734016135 00002000:00010000:2.0:1734016135.280178:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:2.0:1734016135.280203:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335364096:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016135.280239:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271169c0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6775 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.280254:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271169c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6775 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.280266:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016135.280305:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333878016:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2361us (3245us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016135.280314:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11372 00000100:00100000:0.0:1734016135.282972:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016135.283044:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.283144:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333878144 00000100:00100000:2.0:1734016135.283158:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333878144 00000100:00100000:2.0:1734016135.283229:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333878272 00000100:00100000:2.0:1734016135.283233:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333878272 00000100:00100000:2.0:1734016135.283260:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11373 00000100:00100000:2.0:1734016135.283270:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090248050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333878144:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016135.283301:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016135.283333:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271169c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e677c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016135.283442:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335364224:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016135.283562:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016135.283608:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11374 00000100:00100000:2.0:1734016135.283612:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333878272:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016135.283622:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016135.283648:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271169ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6783 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016135.283682:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335364352:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016135.283707:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00000100:00100000:2.0:1734016135.287933:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335364224:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016135.287940:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335364352:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016135.288027:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271169ce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6783 expref: 13 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.288047:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271169c7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e677c expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016135.288054:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271169ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6783 expref: 13 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.288059:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271169c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e677c expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016135.288097:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:3.0:1734016135.288186:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333878272:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4570us (5139us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016135.288201:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11374 00010000:00010000:2.0:1734016135.288335:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016135.288365:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090248050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333878144:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5095us (5409us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016135.288372:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11373 00000100:00100000:1.0:1734016135.291304:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016135.291368:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.291465:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333878528 00000100:00100000:2.0:1734016135.291478:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333878528 00000100:00100000:2.0:1734016135.291539:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333878400 00000100:00100000:2.0:1734016135.291542:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333878400 00000100:00100000:2.0:1734016135.291564:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11375 00000100:00100000:2.0:1734016135.291572:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333878528:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016135.291601:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016135.291644:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271169d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6791 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016135.291740:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335364480:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016135.291865:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016135.291897:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11376 00000100:00100000:2.0:1734016135.291901:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333878400:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016135.291913:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016135.291934:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271169dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e678a expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016135.291967:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335364608:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016135.291990:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016135.295224:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335364608:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016135.295285:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271169dc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e678a expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016135.295311:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271169dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e678a expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016135.295346:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:3.0:1734016135.295409:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333878400:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3505us (4039us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016135.295417:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11376 00000100:00100000:2.0:1734016135.295938:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335364480:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016135.295966:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271169d5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6791 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.295975:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271169d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6791 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.295983:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016135.296004:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333878528:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4434us (4719us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016135.296011:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11375 00000100:00100000:0.0:1734016135.299050:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.299208:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333878656 00000100:00100000:2.0:1734016135.299223:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333878656 00000100:00100000:2.0:1734016135.299298:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11377 00000100:00100000:2.0:1734016135.299310:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:10406:x1818247333878656:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016135.299339:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016135.299372:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271169e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6798 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.299421:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271169a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6760 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.299430:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016135.299432:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016135.299436:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271169e3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [5558272->5570559] (req 5558272->5570559) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6798 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.299477:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271169a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6760 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.299493:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271169a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6760 expref: 5 pid: 7682 timeout: 502 lvb_type: 0 00000100:00100000:2.0:1734016135.299506:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335364736:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016135.299590:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016135.302317:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335364736:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016135.302373:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271169e3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [5558272->5570559] (req 5558272->5570559) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6798 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.302395:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016135.302457:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333878656:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3148us (3424us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016135.302468:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11377 00000100:00100000:0.0:1734016135.315193:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.316918:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333878784 00000100:00100000:2.0:1734016135.316934:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333878784 00010000:00010000:2.0:1734016135.316989:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271169a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6760 expref: 6 pid: 7682 timeout: 502 lvb_type: 0 00000100:00100000:2.0:1734016135.318097:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3154 00000100:00100000:2.0:1734016135.318108:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333878784:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016135.318130:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016135.318158:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271169a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6760 expref: 6 pid: 7682 timeout: 502 lvb_type: 0 00010000:00010000:2.0:1734016135.318171:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271169a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6760 expref: 6 pid: 7682 timeout: 502 lvb_type: 0 00010000:00010000:2.0:1734016135.318197:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271169a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6760 expref: 6 pid: 7682 timeout: 502 lvb_type: 0 00010000:00010000:2.0:1734016135.318237:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016135.318240:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016135.318250:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271169e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5558272->5570559) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6798 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.318259:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271169e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5558272->5570559) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6798 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.318300:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271169e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5558272->5570559) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6798 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016135.318312:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335364864:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016135.318410:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016135.324601:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335364864:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016135.324662:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016135.324747:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333878784:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6638us (9569us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016135.324768:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3154 00000100:00100000:0.0:1734016135.332375:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.332536:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333878912 00000100:00100000:2.0:1734016135.332551:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333878912 00000100:00100000:2.0:1734016135.332645:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11378 00000100:00100000:2.0:1734016135.332653:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333878912:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016135.333277:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4337090 -> 5569016 00002000:00010000:2.0:1734016135.333282:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016135 -> 1734016135 00002000:00010000:2.0:1734016135.333284:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016135 -> 1734016135 00002000:00010000:2.0:1734016135.333286:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016135 -> 1734016135 00002000:00010000:2.0:1734016135.333288:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 72 -> 96 00000100:00100000:2.0:1734016135.334451:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333878912:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1791us (2095us total) trans 4294968033 rc 0/0 00000100:00100000:2.0:1734016135.334465:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11378 00000100:00100000:0.0:1734016135.336728:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.337163:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333879040 00000100:00100000:2.0:1734016135.337173:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333879040 00000100:00100000:2.0:1734016135.337646:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11379 00000100:00100000:2.0:1734016135.337656:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247333879040:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016135.337689:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016135.337724:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271169ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e679f expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016135.337829:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335364992:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016135.337933:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016135.339923:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335364992:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016135.339985:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271169ea lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e679f expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.340007:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271169ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e679f expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.340254:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016135.340611:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247333879040:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2956us (3899us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016135.340622:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11379 00000100:00100000:0.0:1734016135.346186:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.346361:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333879168 00000100:00100000:2.0:1734016135.346380:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333879168 00000100:00100000:2.0:1734016135.347166:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11380 00000100:00100000:2.0:1734016135.347179:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333879168:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016135.347218:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016135.347254:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271169f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e67a6 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016135.347380:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335365120:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016135.347480:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016135.350670:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335365120:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016135.350732:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271169f1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67a6 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.350751:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc271169f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67a6 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.350792:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016135.350902:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333879168:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3725us (4745us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016135.350916:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11380 00000100:00100000:0.0:1734016135.359570:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.359863:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333879296 00000100:00100000:2.0:1734016135.359880:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333879296 00000100:00100000:2.0:1734016135.359963:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11381 00000100:00100000:2.0:1734016135.359975:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333879296:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016135.360006:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016135.360038:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc271169f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e67ad expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016135.360143:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335365248:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016135.360254:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016135.369488:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335365248:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016135.369566:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc271169f8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67ad expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.369588:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc271169f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67ad expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.371078:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016135.371990:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333879296:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12005us (12423us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016135.372009:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11381 00000100:00100000:0.0:1734016135.378942:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.379395:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333879424 00000100:00100000:2.0:1734016135.379418:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333879424 00000100:00100000:2.0:1734016135.379542:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11382 00000100:00100000:2.0:1734016135.379555:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:10406:x1818247333879424:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016135.379595:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016135.379650:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271169ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e67b4 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.379722:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271169e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5558272->5570559) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6798 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.379732:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016135.379734:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016135.379739:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271169ff lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2093056->2097151] (req 2093056->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67b4 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.379792:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271169e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5558272->5570559) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6798 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.379840:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271169e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5558272->5570559) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6798 expref: 7 pid: 7684 timeout: 502 lvb_type: 0 00000100:00100000:2.0:1734016135.379861:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335365376:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016135.379965:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016135.386095:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.386445:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335365376:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016135.386519:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271169ff lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2093056->2097151] (req 2093056->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67b4 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.386555:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016135.386669:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333879424:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7116us (7750us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016135.386683:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11382 00000100:00100000:3.0:1734016135.388938:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333879552 00000100:00100000:3.0:1734016135.388964:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333879552 00010000:00010000:3.0:1734016135.389050:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271169e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5558272->5570559) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6798 expref: 8 pid: 7684 timeout: 502 lvb_type: 0 00000100:00100000:3.0:1734016135.389136:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3155 00000100:00100000:3.0:1734016135.389146:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333879552:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016135.389177:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016135.389216:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271169e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5558272->5570559) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6798 expref: 8 pid: 7684 timeout: 502 lvb_type: 0 00010000:00010000:3.0:1734016135.389233:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271169e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5558272->5570559) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6798 expref: 8 pid: 7684 timeout: 502 lvb_type: 0 00010000:00010000:3.0:1734016135.389279:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271169e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5558272->5570559) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6798 expref: 8 pid: 7684 timeout: 502 lvb_type: 0 00010000:00010000:3.0:1734016135.389410:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016135.389421:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016135.389435:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271169ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67b4 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016135.389447:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271169ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67b4 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016135.389520:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271169ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67b4 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016135.389535:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335365504:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016135.389665:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800737813c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016135.396133:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335365504:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016135.396185:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016135.396302:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333879552:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7154us (10221us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016135.396315:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3155 00000100:00100000:0.0:1734016135.400042:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016135.400999:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333879808 00000100:00100000:3.0:1734016135.401013:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333879808 00002000:00100000:3.0:1734016135.401085:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (2093056->5570559) req@ffff8801369f0a80 x1818247333879808/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 504/0 e 0 to 0 dl 1734016146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016135.401096:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f0a80 with x1818247333879808 ext(2093056->5570559) 00002000:00010000:3.0:1734016135.401102:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801369f0a80 00000100:00100000:3.0:1734016135.401153:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8871 00000100:00100000:3.0:1734016135.401162:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333879808:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016135.423688:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333879808:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 22510us (23645us total) trans 0 rc 1380352/1380352 00000100:00100000:3.0:1734016135.423705:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8871 00002000:00100000:3.0:1734016135.423720:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (2093056->5570559) req@ffff8801369f0a80 x1818247333879808/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 504/440 e 0 to 0 dl 1734016146 ref 1 fl Complete:/200/0 rc 1380352/1380352 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016135.423732:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f0a80 with x1818247333879808 ext(2093056->5570559) 00002000:00010000:3.0:1734016135.423739:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801369f0a80 00000100:00100000:0.0:1734016135.431652:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016135.432736:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333879936 00000100:00100000:3.0:1734016135.432751:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333879936 00002000:00100000:3.0:1734016135.432856:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (2093056->2097151) req@ffff8800a78cce00 x1818247333879936/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 4584/0 e 0 to 0 dl 1734016146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016135.432867:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cce00 with x1818247333879936 ext(2093056->2097151) 00002000:00010000:3.0:1734016135.432873:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a78cce00 00000100:00100000:3.0:1734016135.432904:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8872 00000100:00100000:3.0:1734016135.432913:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333879936:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016135.449344:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333879936:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 16409us (17696us total) trans 4294968034 rc 0/0 00000100:00100000:3.0:1734016135.449369:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8872 00002000:00100000:3.0:1734016135.449391:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (2093056->2097151) req@ffff8800a78cce00 x1818247333879936/t4294968034(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 4584/448 e 0 to 0 dl 1734016146 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016135.449404:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cce00 with x1818247333879936 ext(2093056->2097151) 00002000:00010000:3.0:1734016135.449411:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a78cce00 00000100:00100000:0.0:1734016135.451977:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.452282:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333880064 00000100:00100000:2.0:1734016135.452299:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333880064 00000100:00100000:3.0:1734016135.453619:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11383 00000100:00100000:3.0:1734016135.453641:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333880064:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:1.0:1734016135.455318:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968034 is committed 00000001:00080000:1.0:1734016135.455348:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968033 is committed 00000100:00100000:3.0:1734016135.455609:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333880064:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 1965us (3656us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016135.455624:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11383 00000100:00100000:0.0:1734016135.458790:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016135.458882:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016135.460193:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333880192 00000100:00100000:3.0:1734016135.460211:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333880192 00000100:00100000:3.0:1734016135.460270:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333880320 00000100:00100000:3.0:1734016135.460274:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333880320 00000100:00100000:3.0:1734016135.460315:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11384 00000100:00100000:3.0:1734016135.460326:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333880192:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016135.460366:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016135.460405:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116a06 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e67bb expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016135.460504:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335365632:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016135.460619:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016135.460645:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11385 00000100:00100000:3.0:1734016135.460650:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247333880320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016135.460659:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016135.460671:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116a0d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e67c2 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016135.460698:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335365760:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016135.460718:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00002000:00010000:0.0:1734016135.468389:0:7682:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016135 -> 1734016136 00002000:00010000:0.0:1734016135.468411:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016135 -> 1734016136 00000100:00100000:0.0:1734016135.468454:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335365760:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016135.468539:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116a0d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67c2 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016135.468578:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116a0d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67c2 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016135.468619:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:0.0:1734016135.468731:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247333880320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8076us (9847us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016135.468744:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11385 00002000:00010000:3.0:1734016135.469087:0:8216:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime: 1734016135 -> 1734016136 00002000:00010000:3.0:1734016135.469092:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016135 -> 1734016136 00002000:00010000:3.0:1734016135.469094:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks: 96 -> 104 00000100:00100000:3.0:1734016135.469111:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335365632:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016135.469137:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116a06 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67bb expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016135.469147:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116a06 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67bb expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016135.469170:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016135.469193:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333880192:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8871us (10423us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016135.469198:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11384 00000100:00100000:0.0:1734016135.475164:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016135.475780:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016135.475968:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333880576 00000100:00100000:1.0:1734016135.475984:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333880576 00000100:00100000:1.0:1734016135.476047:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333880448 00000100:00100000:1.0:1734016135.476049:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333880448 00000100:00100000:1.0:1734016135.476496:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11386 00000100:00100000:1.0:1734016135.476507:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333880576:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016135.476542:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016135.476574:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27116a14 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e67d0 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016135.476679:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11387 00000100:00100000:3.0:1734016135.476688:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333880448:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016135.476698:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016135.476716:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116a1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e67c9 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016135.476780:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335365888:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016135.477061:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335366016:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016135.477221:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016135.477271:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016135.481025:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335365888:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016135.481091:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335366016:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016135.481106:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116a1b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67c9 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016135.481126:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27116a14 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67d0 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016135.481130:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116a1b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67c9 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016135.481135:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27116a14 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67d0 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016135.481156:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00010000:00010000:1.0:1734016135.481158:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:3.0:1734016135.481396:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333880448:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4706us (5613us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016135.481408:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11387 00000100:00100000:1.0:1734016135.481419:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333880576:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4915us (6270us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016135.481424:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11386 00000100:00100000:0.0:1734016135.487022:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016135.487114:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016135.487390:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333880832 00000100:00100000:3.0:1734016135.487409:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333880832 00000100:00100000:3.0:1734016135.487478:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333880704 00000100:00100000:3.0:1734016135.487480:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333880704 00000100:00100000:3.0:1734016135.487531:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11388 00000100:00100000:3.0:1734016135.487544:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333880832:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016135.487580:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016135.487615:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116a22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e67de expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016135.487740:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335366144:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016135.487911:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016135.488041:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11389 00000100:00100000:0.0:1734016135.488050:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333880704:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016135.488063:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016135.488080:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7582640/0x5e3a3adc27116a29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e67d7 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016135.488124:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335366272:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016135.488153:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016135.493011:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335366144:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016135.493090:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116a22 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67de expref: 13 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016135.493116:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116a22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67de expref: 13 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016135.493149:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016135.494116:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333880832:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6570us (7116us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016135.494132:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11388 00000100:00100000:2.0:1734016135.497260:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335366272:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016135.497325:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7582640/0x5e3a3adc27116a29 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67d7 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.497347:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7582640/0x5e3a3adc27116a29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67d7 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.497389:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:2.0:1734016135.497486:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333880704:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9431us (10367us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016135.497500:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11389 00000100:00100000:0.0:1734016135.507936:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.508009:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333880960 00000100:00100000:2.0:1734016135.508025:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333880960 00000100:00100000:2.0:1734016135.508101:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11390 00000100:00100000:2.0:1734016135.508111:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333880960:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016135.508142:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016135.508170:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116a30 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e67e5 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016135.508252:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335366400:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016135.508332:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016135.509121:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016135.509598:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333881088 00000100:00100000:3.0:1734016135.509611:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333881088 00000100:00100000:3.0:1734016135.509671:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11391 00000100:00100000:3.0:1734016135.509677:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333881088:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016135.509696:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016135.509715:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116a37 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e67ec expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016135.509771:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335366528:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016135.509861:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016135.510929:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335366400:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016135.510966:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116a30 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67e5 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.510978:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116a30 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67e5 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.511002:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016135.511034:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333880960:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2925us (3114us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016135.511042:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11390 00000100:00100000:3.0:1734016135.512879:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335366528:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016135.512923:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116a37 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67ec expref: 13 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016135.512940:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116a37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67ec expref: 13 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016135.512970:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016135.513019:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333881088:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3340us (3900us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016135.513029:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11391 00000100:00100000:0.0:1734016135.523075:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016135.523188:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333881344 00000100:00100000:3.0:1734016135.523203:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333881344 00000100:00100000:3.0:1734016135.523277:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2321 00000100:00100000:3.0:1734016135.523286:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+28:10406:x1818247333881344:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016135.523550:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116a3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016135.523568:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271169b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6767 expref: 33 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016135.523574:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116a3e lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016135.523607:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271169b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6767 expref: 33 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016135.523620:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271169b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6767 expref: 33 pid: 6478 timeout: 502 lvb_type: 0 00000100:00100000:3.0:1734016135.523660:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335366656:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016135.523735:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016135.527264:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335366656:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016135.527310:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116a3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016135.528049:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016135.528128:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333881472 00000100:00100000:3.0:1734016135.528138:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333881472 00010000:00010000:3.0:1734016135.528183:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271169b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6767 expref: 34 pid: 6478 timeout: 502 lvb_type: 0 00000100:00100000:3.0:1734016135.528229:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3156 00000100:00100000:3.0:1734016135.528237:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+34:1981:x1818247333881472:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016135.528256:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016135.528263:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271169b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6767 expref: 34 pid: 6478 timeout: 502 lvb_type: 0 00010000:00010000:3.0:1734016135.528279:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271169b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6767 expref: 34 pid: 6478 timeout: 502 lvb_type: 0 00010000:00010000:3.0:1734016135.528314:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271169b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6767 expref: 34 pid: 6478 timeout: 502 lvb_type: 0 00010000:00010000:3.0:1734016135.528336:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016135.528344:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116a3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016135.528359:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116a3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016135.528368:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116a3e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016135.528400:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016135.528427:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116a3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016135.528436:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116a3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:0.0:1734016135.528563:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968811 00000004:00010000:0.0:1734016135.528620:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880073b9e300 reply state ffff880073917000 transno 4294968812 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116a3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016135.528636:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016135.529183:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+31:10406:x1818247333881344:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 5897us (6126us total) trans 4294968812 rc 0/0 00000100:00100000:3.0:1734016135.529183:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+33:1981:x1818247333881472:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 945us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016135.529192:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2321 00000100:00100000:3.0:1734016135.529192:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3156 00000020:00080000:0.0:1734016135.529198:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016135.535406:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1734016135.536045:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116a3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016135.536065:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116a3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016135.536075:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116a3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016135.536085:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df73c0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016135.536090:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116a3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016135.536099:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116a3e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016135.536131:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016135.536135:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016135.536140:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116a3e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016135.536146:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116a3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016135.538217:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.538244:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333881728 00000100:00100000:2.0:1734016135.538263:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333881728 00002000:00010000:3.0:1734016135.538411:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:3.0:1734016135.538419:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d3100 with x1818247333881728 ext(4194304->18446744073709551615) 00002000:00010000:3.0:1734016135.538436:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d3100. 00000100:00100000:3.0:1734016135.539507:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333881600 00000100:00100000:3.0:1734016135.539516:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333881600 00000100:00100000:2.0:1734016135.539554:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8873 00000100:00100000:2.0:1734016135.539563:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1983:x1818247333881728:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016135.539702:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (5810068->18446744073709551615) 00002000:00100000:3.0:1734016135.539706:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d2d80 with x1818247333881600 ext(5810068->18446744073709551615) 00002000:00010000:3.0:1734016135.539720:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750d2d80. 00000100:00100000:3.0:1734016135.539731:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8874 00000100:00100000:3.0:1734016135.539736:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333881600:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016135.540291:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1734016135.540296:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016136 -> 1734016136 00002000:00010000:2.0:1734016135.540299:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016135 -> 1734016133 00002000:00010000:2.0:1734016135.540302:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016136 -> 1734016136 00002000:00010000:2.0:1734016135.540305:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 1 -> 0 00000100:00100000:2.0:1734016135.547389:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1983:x1818247333881728:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 7784us (11971us total) trans 4294969504 rc 0/0 00000100:00100000:2.0:1734016135.547423:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8873 00002000:00010000:2.0:1734016135.547440:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:2.0:1734016135.547448:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d3100 with x1818247333881728 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1734016135.547473:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750d3100. 00002000:00010000:3.0:1734016135.548144:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5569016 -> 5810068 00002000:00010000:3.0:1734016135.548148:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016136 -> 1734016136 00002000:00010000:3.0:1734016135.548151:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016135 -> 1734016135 00002000:00010000:3.0:1734016135.548155:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016136 -> 1734016136 00002000:00010000:3.0:1734016135.548158:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 104 -> 104 00000100:00100000:3.0:1734016135.548263:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333881600:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 8522us (10067us total) trans 4294968035 rc 0/0 00000100:00100000:3.0:1734016135.548273:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8874 00002000:00010000:3.0:1734016135.548277:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (5810068->18446744073709551615) 00002000:00100000:3.0:1734016135.548281:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d2d80 with x1818247333881600 ext(5810068->18446744073709551615) 00002000:00010000:3.0:1734016135.548288:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750d2d80. 00000100:00100000:0.0:1734016135.563638:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016135.563738:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333881984 00000100:00100000:1.0:1734016135.563750:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333881984 00002000:00100000:1.0:1734016135.563832:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (5570560->5812223) req@ffff88007bd3c000 x1818247333881984/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 488/0 e 0 to 0 dl 1734016146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016135.563852:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3c000 with x1818247333881984 ext(5570560->5812223) 00002000:00010000:1.0:1734016135.563858:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007bd3c000 00000100:00100000:1.0:1734016135.563893:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8875 00000100:00100000:1.0:1734016135.563901:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333881984:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016135.576073:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333881984:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 12148us (12433us total) trans 0 rc 241664/241664 00000100:00100000:1.0:1734016135.576095:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8875 00002000:00100000:1.0:1734016135.576117:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (5570560->5812223) req@ffff88007bd3c000 x1818247333881984/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 488/440 e 0 to 0 dl 1734016146 ref 1 fl Complete:/200/0 rc 241664/241664 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016135.576127:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3c000 with x1818247333881984 ext(5570560->5812223) 00002000:00010000:1.0:1734016135.576135:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007bd3c000 00000100:00100000:0.0:1734016135.587578:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016135.588975:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333882112 00000100:00100000:1.0:1734016135.588999:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333882112 00002000:00100000:1.0:1734016135.589074:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (5804032->5810067) req@ffff88007bd3c700 x1818247333882112/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 6528/0 e 0 to 0 dl 1734016146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016135.589089:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3c700 with x1818247333882112 ext(5804032->5810067) 00002000:00010000:1.0:1734016135.589096:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007bd3c700 00000100:00100000:1.0:1734016135.589298:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8876 00000100:00100000:1.0:1734016135.589308:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333882112:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016135.594506:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333882112:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 5178us (6927us total) trans 4294968036 rc 0/0 00000100:00100000:1.0:1734016135.594526:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8876 00002000:00100000:1.0:1734016135.594546:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (5804032->5810067) req@ffff88007bd3c700 x1818247333882112/t4294968036(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 6528/448 e 0 to 0 dl 1734016146 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016135.594556:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3c700 with x1818247333882112 ext(5804032->5810067) 00002000:00010000:1.0:1734016135.594562:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007bd3c700 00000100:00100000:0.0:1734016135.600408:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.600558:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333882240 00000100:00100000:2.0:1734016135.600574:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333882240 00000100:00100000:2.0:1734016135.600655:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2322 00000100:00100000:2.0:1734016135.600664:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+30:10406:x1818247333882240:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:2.0:1734016135.601030:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+30:10406:x1818247333882240:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 366us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016135.601038:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2322 00000100:00100000:0.0:1734016135.603015:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016135.603222:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333882368 00000100:00100000:3.0:1734016135.603242:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333882368 00000100:00100000:3.0:1734016135.603326:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11392 00000100:00100000:3.0:1734016135.603339:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333882368:12345-192.168.201.16@tcp:16:fsx.0 00010000:00010000:2.0:1734016135.608500:0:8958:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1734016135.609140:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968036 is committed 00000100:00100000:3.0:1734016135.612127:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333882368:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 8765us (9112us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016135.612153:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11392 00000100:00100000:0.0:1734016135.615303:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.619254:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333882496 00000100:00100000:2.0:1734016135.619274:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333882496 00000100:00100000:2.0:1734016135.619351:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2323 00000100:00100000:2.0:1734016135.619359:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+30:10406:x1818247333882496:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016135.619383:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016135.619410:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116a45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e67f3 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.619529:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116a4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016135.619549:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116a4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016135.619566:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116a4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016135.619595:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 10004372 00000004:00200000:2.0:1734016135.619600:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016135.619622:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116a4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016135.619661:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116a45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67f3 expref: 32 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.619685:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116a4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67f3 expref: 31 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016135.619694:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016135.619697:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016135.619700:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016135.619776:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+31:10406:x1818247333882496:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 417us (4492us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016135.619784:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2323 00000100:00100000:0.0:1734016135.626572:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016135.626864:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333882624 00000100:00100000:1.0:1734016135.626880:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333882624 00002000:00100000:1.0:1734016135.626967:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2670592->2977791) req@ffff880074939500 x1818247333882624/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 504/0 e 0 to 0 dl 1734016146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016135.626981:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074939500 with x1818247333882624 ext(2670592->2977791) 00002000:00010000:1.0:1734016135.626988:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074939500 00000100:00100000:1.0:1734016135.627046:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8877 00000100:00100000:1.0:1734016135.627057:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247333882624:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016135.633858:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1982:x1818247333882624:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 6768us (7280us total) trans 4294969505 rc 0/0 00000100:00100000:1.0:1734016135.633883:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8877 00002000:00100000:1.0:1734016135.633912:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2670592->2977791) req@ffff880074939500 x1818247333882624/t4294969505(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 504/448 e 0 to 0 dl 1734016146 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016135.633926:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074939500 with x1818247333882624 ext(2670592->2977791) 00002000:00010000:1.0:1734016135.633934:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074939500 00000100:00100000:0.0:1734016135.638188:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016135.638314:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333882752 00000100:00100000:3.0:1734016135.638328:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333882752 00000100:00100000:3.0:1734016135.639043:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11393 00000100:00100000:3.0:1734016135.639055:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1984:x1818247333882752:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016135.641335:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969505 is committed 00000001:00080000:0.0:1734016135.641383:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969500 is committed 00000100:00100000:3.0:1734016135.642459:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333882752:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 3396us (4277us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016135.642480:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11393 00000100:00100000:0.0:1734016135.650902:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016135.651135:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333882880 00000100:00100000:1.0:1734016135.651151:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333882880 00000100:00100000:1.0:1734016135.653021:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2324 00000100:00100000:1.0:1734016135.653048:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+33:10406:x1818247333882880:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016135.653101:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016135.653151:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27116a53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e67fa expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016135.653349:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27116a5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016135.653374:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27116a5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016135.653396:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27116a5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:1.0:1734016135.653441:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 10004372 00000004:00200000:1.0:1734016135.653447:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016135.653474:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27116a5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016135.653509:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27116a53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67fa expref: 35 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016135.655036:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27116a5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67fa expref: 34 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016135.655055:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016135.655058:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016135.655064:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016135.656813:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+34:10406:x1818247333882880:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3753us (5991us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016135.656827:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2324 00000100:00100000:0.0:1734016135.664022:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016135.664089:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016135.664939:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333883136 00000100:00100000:3.0:1734016135.664957:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333883136 00000100:00100000:3.0:1734016135.665044:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333883008 00000100:00100000:3.0:1734016135.665047:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333883008 00000100:00100000:3.0:1734016135.665101:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11394 00000100:00100000:3.0:1734016135.665111:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333883136:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016135.665150:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016135.665193:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116a61 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6808 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016135.665305:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335366784:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016135.665409:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016135.666101:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11395 00000100:00100000:2.0:1734016135.666113:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333883008:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016135.666129:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016135.666151:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116a68 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6801 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016135.666208:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335366912:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016135.666285:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00002000:00010000:3.0:1734016135.670492:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016133 -> 1734016136 00002000:00010000:3.0:1734016135.670509:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 0 -> 48 00000100:00100000:3.0:1734016135.670563:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335366784:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016135.670952:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116a61 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6808 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016135.670973:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116a61 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6808 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016135.671003:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016135.671119:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333883136:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6008us (7109us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016135.671133:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11394 00002000:00010000:0.0:1734016135.672098:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016135 -> 1734016136 00002000:00010000:0.0:1734016135.672107:0:7683:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks: 104 -> 128 00000100:00100000:0.0:1734016135.672134:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335366912:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016135.672188:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116a68 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6801 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016135.672203:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116a68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6801 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016135.672225:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:0.0:1734016135.672279:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333883008:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6169us (8189us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016135.672288:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11395 00000100:00100000:2.0:1734016135.689087:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016135.689190:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333883264 00000100:00100000:0.0:1734016135.689207:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333883264 00000100:00100000:0.0:1734016135.689635:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11396 00000100:00100000:0.0:1734016135.689646:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333883264:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016135.689680:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016135.689706:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116a6f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e680f expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016135.689983:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd29f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335367040:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016135.690075:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016135.694757:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016135.696292:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd29f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335367040:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016135.696355:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116a6f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e680f expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016135.696380:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116a6f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e680f expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016135.696406:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:1.0:1734016135.696516:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333883264:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6872us (7451us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016135.696530:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11396 00000100:00100000:1.0:1734016135.696583:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333883392 00000100:00100000:1.0:1734016135.696595:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333883392 00000100:00100000:1.0:1734016135.696651:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11397 00000100:00100000:1.0:1734016135.696663:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333883392:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016135.696698:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016135.696724:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27116a76 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6816 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016135.700769:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335367168:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016135.700885:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016135.707421:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335367168:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016135.707488:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27116a76 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6816 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016135.707506:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27116a76 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6816 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016135.707556:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016135.709749:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333883392:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 13071us (14993us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016135.709763:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11397 00000100:00100000:0.0:1734016135.722519:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016135.723912:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333883648 00000100:00100000:1.0:1734016135.723933:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333883648 00002000:00100000:1.0:1734016135.724017:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (2842624->2846719) req@ffff88007bd29180 x1818247333883648/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 488/0 e 0 to 0 dl 1734016146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016135.724031:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd29180 with x1818247333883648 ext(2842624->2846719) 00002000:00010000:1.0:1734016135.724037:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007bd29180 00000100:00100000:1.0:1734016135.724666:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8878 00000100:00100000:1.0:1734016135.724675:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333883648:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016135.724943:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333883648:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 268us (2442us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016135.724951:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8878 00002000:00100000:1.0:1734016135.724958:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (2842624->2846719) req@ffff88007bd29180 x1818247333883648/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 488/4536 e 0 to 0 dl 1734016146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016135.724964:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd29180 with x1818247333883648 ext(2842624->2846719) 00002000:00010000:1.0:1734016135.724967:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007bd29180 00000100:00100000:0.0:1734016135.734131:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016135.734235:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333883904 00000100:00100000:3.0:1734016135.734253:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333883904 00002000:00100000:3.0:1734016135.734324:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (2846720->2850815) req@ffff88007bd2b800 x1818247333883904/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 488/0 e 0 to 0 dl 1734016146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016135.734337:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd2b800 with x1818247333883904 ext(2846720->2850815) 00002000:00010000:3.0:1734016135.734346:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007bd2b800 00000100:00100000:3.0:1734016135.734402:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8879 00000100:00100000:3.0:1734016135.734415:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333883904:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016135.734735:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333883904:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 321us (626us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016135.734744:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8879 00002000:00100000:3.0:1734016135.734751:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (2846720->2850815) req@ffff88007bd2b800 x1818247333883904/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:96/0 lens 488/4536 e 0 to 0 dl 1734016146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016135.734759:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd2b800 with x1818247333883904 ext(2846720->2850815) 00002000:00010000:3.0:1734016135.734764:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007bd2b800 00000100:00100000:0.0:1734016135.740344:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016135.740409:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016135.740452:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333884160 00000100:00100000:1.0:1734016135.740467:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333884160 00000100:00100000:1.0:1734016135.740522:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333884032 00000100:00100000:1.0:1734016135.740523:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333884032 00000100:00100000:1.0:1734016135.740552:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11398 00000100:00100000:1.0:1734016135.740562:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333884160:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016135.740586:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016135.740606:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27116a7d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6824 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016135.740694:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335367296:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016135.740783:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016135.740840:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11399 00000100:00100000:1.0:1734016135.740845:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333884032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016135.740854:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016135.740865:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27116a84 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e681d expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016135.740896:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335367424:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016135.740917:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016135.751149:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335367424:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016135.751217:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27116a84 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e681d expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016135.751244:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27116a84 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e681d expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016135.751264:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:0.0:1734016135.751337:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333884032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10488us (10925us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016135.751349:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11399 00000100:00100000:1.0:1734016135.753589:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335367296:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016135.753648:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27116a7d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6824 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016135.753662:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27116a7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6824 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016135.753696:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016135.753776:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333884160:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 13213us (13450us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016135.753792:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11398 00000100:00100000:0.0:1734016135.759760:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016135.760081:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016135.761794:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333884288 00000100:00100000:1.0:1734016135.761834:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333884288 00000100:00100000:1.0:1734016135.761892:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333884416 00000100:00100000:1.0:1734016135.761894:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333884416 00000100:00100000:1.0:1734016135.762610:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11400 00000100:00100000:1.0:1734016135.762627:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333884288:12345-192.168.201.16@tcp:101:fsx.0 00000100:00100000:2.0:1734016135.762683:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11401 00000100:00100000:2.0:1734016135.762690:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333884416:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016135.762706:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016135.762773:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27116a8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6832 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016135.762778:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016135.762813:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116a92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e682b expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016135.762897:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335367680:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016135.762897:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335367552:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016135.763080:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016135.763134:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016135.767583:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335367680:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016135.767652:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116a92 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e682b expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016135.767677:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116a92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e682b expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016135.767719:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:2.0:1734016135.767884:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335367552:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016135.767911:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27116a8b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6832 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.767921:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27116a8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6832 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016135.767944:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016135.767963:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333884416:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5273us (7882us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016135.767972:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11401 00000100:00100000:1.0:1734016135.768179:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333884288:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5176us (8061us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016135.768187:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11400 00000100:00100000:0.0:1734016135.770767:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016135.770964:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333884544 00000100:00100000:1.0:1734016135.770978:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333884544 00000100:00100000:1.0:1734016135.771055:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11402 00000100:00100000:1.0:1734016135.771065:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:10406:x1818247333884544:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016135.771094:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016135.771122:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27116a99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6839 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016135.771172:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271169ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67b4 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016135.771181:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016135.771183:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016135.771187:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27116a99 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [4583424->4587519] (req 4583424->4587519) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6839 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016135.771229:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271169ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67b4 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016135.771243:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271169ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67b4 expref: 5 pid: 7684 timeout: 502 lvb_type: 0 00000100:00100000:1.0:1734016135.771259:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335367808:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016135.771331:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016135.777981:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335367808:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016135.778035:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27116a99 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [4583424->4587519] (req 4583424->4587519) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6839 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016135.778072:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016135.778140:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333884544:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7075us (7391us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016135.778153:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11402 00000100:00100000:0.0:1734016135.794131:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016135.794239:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333884672 00000100:00100000:3.0:1734016135.794254:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333884672 00010000:00010000:3.0:1734016135.794296:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271169ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67b4 expref: 6 pid: 7684 timeout: 502 lvb_type: 0 00000100:00100000:3.0:1734016135.794335:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3157 00000100:00100000:3.0:1734016135.794343:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333884672:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016135.794364:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016135.794395:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271169ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67b4 expref: 6 pid: 7684 timeout: 502 lvb_type: 0 00010000:00010000:3.0:1734016135.794409:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271169ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67b4 expref: 6 pid: 7684 timeout: 502 lvb_type: 0 00010000:00010000:3.0:1734016135.794436:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271169ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67b4 expref: 6 pid: 7684 timeout: 502 lvb_type: 0 00010000:00010000:3.0:1734016135.794480:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016135.794484:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016135.794492:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27116a99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4583424->4587519) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6839 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016135.794502:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27116a99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4583424->4587519) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6839 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016135.794541:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27116a99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4583424->4587519) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6839 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016135.794559:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335367936:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016135.794671:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016135.806846:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335367936:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016135.806899:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016135.806976:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333884672:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 12628us (12856us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016135.806990:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3157 00000100:00100000:0.0:1734016135.814287:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016135.814412:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016135.819890:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333884928 00000100:00100000:3.0:1734016135.819913:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333884928 00002000:00100000:3.0:1734016135.819985:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4587519) req@ffff8800749ac700 x1818247333884928/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:96/0 lens 504/0 e 0 to 0 dl 1734016146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016135.819997:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ac700 with x1818247333884928 ext(0->4587519) 00002000:00010000:3.0:1734016135.820007:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800749ac700 00000100:00100000:3.0:1734016135.820053:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333885056 00000100:00100000:3.0:1734016135.820058:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333885056 00002000:00100000:3.0:1734016135.820071:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (4190208->4194303) req@ffff8800749ad180 x1818247333885056/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:96/0 lens 488/0 e 0 to 0 dl 1734016146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016135.820079:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad180 with x1818247333885056 ext(4190208->4194303) 00002000:00010000:3.0:1734016135.820083:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800749ad180 00000100:00100000:3.0:1734016135.820098:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8880 00000100:00100000:3.0:1734016135.820109:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333884928:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016135.825571:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8881 00000100:00100000:2.0:1734016135.825594:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333885056:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016135.825941:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333885056:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 353us (11528us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016135.825949:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8881 00002000:00100000:2.0:1734016135.825963:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (4190208->4194303) req@ffff8800749ad180 x1818247333885056/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:96/0 lens 488/4536 e 0 to 0 dl 1734016146 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016135.825980:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad180 with x1818247333885056 ext(4190208->4194303) 00002000:00010000:2.0:1734016135.825987:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800749ad180 00000100:00100000:2.0:1734016135.877759:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333884928:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 57628us (63466us total) trans 0 rc 4194304/4194304 00000100:00100000:2.0:1734016135.877780:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8880 00002000:00100000:2.0:1734016135.877796:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4587519) req@ffff8800749ac700 x1818247333884928/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:96/0 lens 504/440 e 0 to 0 dl 1734016146 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016135.877830:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ac700 with x1818247333884928 ext(0->4587519) 00002000:00010000:2.0:1734016135.877839:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800749ac700 00000100:00100000:0.0:1734016135.886711:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016135.888650:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333885312 00000100:00100000:1.0:1734016135.888680:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333885312 00000100:00100000:1.0:1734016135.888819:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11403 00000100:00100000:1.0:1734016135.888830:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333885312:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016135.888869:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016135.888908:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116aa0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6840 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016135.889005:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335368064:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016135.889103:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016135.893321:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335368064:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016135.893396:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116aa0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6840 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016135.893421:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116aa0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6840 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016135.893450:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016135.893560:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333885312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4729us (6866us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016135.893575:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11403 00000100:00100000:0.0:1734016135.905520:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016135.905796:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333885440 00000100:00100000:1.0:1734016135.905829:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333885440 00000100:00100000:1.0:1734016135.905900:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11404 00000100:00100000:1.0:1734016135.905910:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333885440:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016135.905936:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016135.905964:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27116aa7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6847 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016135.906057:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335368192:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016135.906145:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016135.909259:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335368192:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016135.909314:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27116aa7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6847 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016135.909335:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27116aa7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6847 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016135.909358:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016135.911444:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333885440:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5510us (5917us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016135.911464:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11404 00000100:00100000:0.0:1734016135.914926:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016135.915027:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333885568 00000100:00100000:1.0:1734016135.915043:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333885568 00000100:00100000:1.0:1734016135.915181:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11405 00000100:00100000:1.0:1734016135.915190:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333885568:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016135.915214:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016135.915238:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116aae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e684e expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016135.915308:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335368320:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016135.915384:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016135.919067:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335368320:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016135.919148:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116aae lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e684e expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016135.919168:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116aae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e684e expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016135.919193:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016135.919288:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333885568:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4094us (4372us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016135.919302:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11405 00000100:00100000:0.0:1734016135.927791:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016135.927957:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333885696 00000100:00100000:1.0:1734016135.927970:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333885696 00000100:00100000:1.0:1734016135.928568:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11406 00000100:00100000:1.0:1734016135.928579:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333885696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016135.928607:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016135.928638:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116ab5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6855 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016135.928715:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335368448:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016135.929362:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016135.936580:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335368448:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016135.936638:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116ab5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6855 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016135.936658:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116ab5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6855 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016135.937224:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016135.937307:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333885696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8726us (9531us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016135.937317:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11406 00000100:00100000:0.0:1734016135.939983:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016135.940934:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333885952 00000100:00100000:1.0:1734016135.940948:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333885952 00000100:00100000:1.0:1734016135.941039:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2325 00000100:00100000:1.0:1734016135.941049:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+31:10406:x1818247333885952:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016135.941138:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016135.941186:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116a4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67f3 expref: 31 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016135.941218:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016135.941223:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016135.941513:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27116abc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016135.941531:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27116a5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67fa expref: 33 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016135.941538:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27116abc lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016135.941581:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27116a5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67fa expref: 33 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016135.941596:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27116a5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67fa expref: 33 pid: 6479 timeout: 503 lvb_type: 0 00000100:00100000:1.0:1734016135.941610:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335368576:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016135.941720:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016135.947302:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335368576:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016135.947356:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27116abc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016135.948582:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016135.949058:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333886080 00000100:00100000:3.0:1734016135.949074:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333886080 00010000:00010000:3.0:1734016135.949145:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27116a5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67fa expref: 34 pid: 6479 timeout: 503 lvb_type: 0 00000100:00100000:3.0:1734016135.949193:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3158 00000100:00100000:3.0:1734016135.949205:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+34:1982:x1818247333886080:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016135.949235:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016135.949246:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27116a5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67fa expref: 34 pid: 6479 timeout: 503 lvb_type: 0 00010000:00010000:3.0:1734016135.949265:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27116a5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67fa expref: 34 pid: 6479 timeout: 503 lvb_type: 0 00010000:00010000:3.0:1734016135.949304:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27116a5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e67fa expref: 34 pid: 6479 timeout: 503 lvb_type: 0 00010000:00010000:3.0:1734016135.949356:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016135.949363:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27116abc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016135.949381:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27116abc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016135.949391:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27116abc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016135.949440:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016135.949512:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+33:1982:x1818247333886080:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 307us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016135.949519:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3158 00010000:00010000:1.0:1734016135.950131:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27116abc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016135.950144:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27116abc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:1.0:1734016135.950395:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968813 00000004:00010000:1.0:1734016135.950507:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800749aed80 reply state ffff8800a7abf000 transno 4294968814 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27116abc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:1.0:1734016135.950518:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1734016135.950693:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+33:10406:x1818247333885952:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 9641us (10731us total) trans 4294968814 rc 0/0 00000100:00100000:1.0:1734016135.950703:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2325 00000020:00080000:1.0:1734016135.950709:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1734016135.955099:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016135.955192:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27116abc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016135.955207:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27116abc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016135.955216:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27116abc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016135.955223:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499db00 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:0.0:1734016135.955228:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27116abc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016135.955237:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27116abc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016135.955260:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:0.0:1734016135.955263:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1734016135.955268:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27116abc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016135.955273:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27116abc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:1.0:1734016135.955654:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333886208 00000100:00100000:1.0:1734016135.955676:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333886208 00000100:00100000:1.0:1734016135.955764:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11407 00000100:00100000:1.0:1734016135.955775:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:10406:x1818247333886208:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016135.955855:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016135.955885:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116ac3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e685c expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016135.955936:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27116a99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4583424->4587519) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6839 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016135.955945:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016135.955948:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016135.955952:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116ac3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e685c expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016135.956007:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27116a99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4583424->4587519) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6839 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016135.956022:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27116a99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4583424->4587519) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6839 expref: 6 pid: 7682 timeout: 503 lvb_type: 0 00000100:00100000:1.0:1734016135.956036:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335368704:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016135.956152:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016135.961469:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e606d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335368704:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016135.961524:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116ac3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e685c expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016135.961551:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016135.961634:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333886208:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5860us (6552us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016135.961647:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11407 00000100:00100000:0.0:1734016135.963320:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.964603:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333886336 00000100:00100000:2.0:1734016135.964671:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333886336 00002000:00100000:2.0:1734016135.964768:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (4583424->4587519) req@ffff88012b15dc00 x1818247333886336/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:96/0 lens 4584/0 e 0 to 0 dl 1734016146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016135.964784:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15dc00 with x1818247333886336 ext(4583424->4587519) 00010000:00010000:2.0:1734016135.964815:0:7687:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27116a99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4583424->4587519) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6839 expref: 7 pid: 7682 timeout: 503 lvb_type: 0 00010000:00010000:2.0:1734016135.964839:0:7687:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27116a99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4583424->4587519) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6839 expref: 7 pid: 7682 timeout: 503 lvb_type: 0 00002000:00010000:2.0:1734016135.964849:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b15dc00 00000100:00100000:2.0:1734016135.964894:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 291 00000100:00100000:2.0:1734016135.964903:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333886336:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016135.966135:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333886336:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1220us (2819us total) trans 4294968037 rc 0/0 00000100:00100000:2.0:1734016135.966147:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 291 00002000:00100000:2.0:1734016135.966162:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (4583424->4587519) req@ffff88012b15dc00 x1818247333886336/t4294968037(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:96/0 lens 4584/448 e 0 to 0 dl 1734016146 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016135.966173:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15dc00 with x1818247333886336 ext(4583424->4587519) 00010000:00010000:2.0:1734016135.966183:0:7687:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27116a99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4583424->4587519) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6839 expref: 9 pid: 7682 timeout: 503 lvb_type: 0 00010000:00010000:2.0:1734016135.966195:0:7687:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27116a99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4583424->4587519) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6839 expref: 9 pid: 7682 timeout: 503 lvb_type: 0 00002000:00010000:2.0:1734016135.966203:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b15dc00 00000100:00100000:2.0:1734016135.982886:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016135.983399:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333886464 00000100:00100000:0.0:1734016135.983414:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333886464 00010000:00010000:0.0:1734016135.983472:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27116a99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4583424->4587519) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6839 expref: 9 pid: 7682 timeout: 503 lvb_type: 0 00000100:00100000:0.0:1734016135.983530:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3159 00000100:00100000:0.0:1734016135.983544:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333886464:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016135.983570:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1734016135.983598:0:6466:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 128 -> 136 00010000:00010000:0.0:1734016135.983605:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27116a99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4583424->4587519) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6839 expref: 9 pid: 7682 timeout: 503 lvb_type: 0 00010000:00010000:0.0:1734016135.983635:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27116a99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4583424->4587519) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6839 expref: 9 pid: 7682 timeout: 503 lvb_type: 0 00010000:00010000:0.0:1734016135.983669:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27116a99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4583424->4587519) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6839 expref: 9 pid: 7682 timeout: 503 lvb_type: 0 00010000:00010000:0.0:1734016135.983696:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016135.983699:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016135.983709:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116ac3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e685c expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016135.983721:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116ac3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e685c expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016135.983765:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116ac3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e685c expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016135.983783:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335368832:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016135.983904:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016135.986588:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b15d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335368832:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016135.986612:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016135.986680:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333886464:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3138us (3816us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016135.986693:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3159 00000100:00100000:0.0:1734016135.988675:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016135.990313:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016135.990336:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333886720 00000100:00100000:2.0:1734016135.990356:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333886720 00002000:00010000:2.0:1734016135.990418:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:2.0:1734016135.991424:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15f800 with x1818247333886720 ext(0->18446744073709551615) 00002000:00010000:2.0:1734016135.991446:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15f800. 00000100:00100000:2.0:1734016135.991486:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333886592 00000100:00100000:2.0:1734016135.991490:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333886592 00002000:00010000:2.0:1734016135.991509:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (689382->18446744073709551615) 00002000:00100000:2.0:1734016135.991511:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15ce00 with x1818247333886592 ext(689382->18446744073709551615) 00002000:00010000:2.0:1734016135.991525:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b15ce00. 00000100:00100000:2.0:1734016135.991559:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8882 00000100:00100000:2.0:1734016135.991570:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333886720:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016135.995401:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 4194304 -> 0 00002000:00010000:2.0:1734016135.995414:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016136 -> 1734016136 00002000:00010000:2.0:1734016135.995417:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016136 -> 1734016133 00002000:00010000:2.0:1734016135.995419:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016136 -> 1734016136 00002000:00010000:2.0:1734016135.995421:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 48 -> 0 00000100:00100000:2.0:1734016135.995519:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333886720:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 3943us (6854us total) trans 4294969506 rc 0/0 00000100:00100000:2.0:1734016135.995534:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8882 00002000:00010000:2.0:1734016135.995543:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:2.0:1734016135.995547:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15f800 with x1818247333886720 ext(0->18446744073709551615) 00002000:00010000:2.0:1734016135.995554:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15f800. 00000100:00100000:2.0:1734016135.995588:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8883 00000100:00100000:2.0:1734016135.995597:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333886592:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016136.002571:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5810068 -> 689382 00002000:00010000:2.0:1734016136.002587:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016136 -> 1734016136 00002000:00010000:2.0:1734016136.002590:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016136 -> 1734016136 00002000:00010000:2.0:1734016136.002593:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016136 -> 1734016136 00002000:00010000:2.0:1734016136.002595:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 136 -> 64 00000100:00100000:0.0:1734016136.012138:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016136.015444:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333886848 00000100:00100000:1.0:1734016136.015468:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333886848 00000100:00100000:1.0:1734016136.015607:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2326 00000100:00100000:1.0:1734016136.015629:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+32:10406:x1818247333886848:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016136.015679:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016136.015713:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27116aca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6863 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016136.015913:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27116ad1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016136.015934:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27116ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016136.015951:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27116ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:1.0:1734016136.015987:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 689382 00000004:00200000:1.0:1734016136.015993:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016136.016020:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27116ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016136.016049:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27116aca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6863 expref: 34 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016136.016085:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27116ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6863 expref: 33 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016136.016095:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016136.016098:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016136.016101:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016136.016188:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+33:10406:x1818247333886848:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 571us (4075us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016136.016195:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2326 00000100:00080000:0.0:1734016136.017358:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016106 00000100:00100000:2.0:1734016136.017764:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333886592:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 22156us (27447us total) trans 4294968038 rc 0/0 00000100:00100000:2.0:1734016136.017783:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8883 00002000:00010000:2.0:1734016136.017796:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (689382->18446744073709551615) 00002000:00100000:2.0:1734016136.017813:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15ce00 with x1818247333886592 ext(689382->18446744073709551615) 00002000:00010000:2.0:1734016136.017829:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b15ce00. 00000100:00100000:0.0:1734016136.022466:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016136.022645:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333886976 00000100:00100000:1.0:1734016136.022665:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333886976 00000100:00080000:0.0:1734016136.022843:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016106 00000100:00100000:3.0:1734016136.024116:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11408 00000100:00100000:3.0:1734016136.024139:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333886976:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016136.024547:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 689382 -> 689382 00002000:00010000:3.0:1734016136.024552:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016136 -> 1734016136 00002000:00010000:3.0:1734016136.024554:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016136 -> 1734016136 00002000:00010000:3.0:1734016136.024556:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016136 -> 1734016136 00002000:00010000:3.0:1734016136.024559:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 64 -> 64 00000100:00100000:3.0:1734016136.029882:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333886976:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 5713us (7399us total) trans 4294968039 rc 0/0 00000100:00100000:3.0:1734016136.029909:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11408 00000100:00100000:1.0:1734016136.034861:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.036691:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333887104 00000100:00100000:3.0:1734016136.036710:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333887104 00000100:00100000:3.0:1734016136.037178:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2327 00000100:00100000:3.0:1734016136.037194:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+33:10406:x1818247333887104:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.037240:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.037278:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116ad8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e686a expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.037506:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116adf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016136.037528:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016136.037546:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016136.037583:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 689382 00000004:00200000:3.0:1734016136.037588:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016136.037611:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016136.037662:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116ad8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e686a expref: 35 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.037688:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e686a expref: 34 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.037702:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016136.037706:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016136.037711:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016136.037836:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+34:10406:x1818247333887104:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 646us (3005us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016136.037843:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2327 00000100:00080000:0.0:1734016136.037921:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016106 00000100:00100000:1.0:1734016136.050442:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016136.050512:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016136.050583:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333887360 00000100:00100000:0.0:1734016136.050596:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333887360 00000100:00100000:0.0:1734016136.050669:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333887232 00000100:00100000:0.0:1734016136.050672:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333887232 00000100:00100000:0.0:1734016136.050707:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11409 00000100:00100000:0.0:1734016136.050717:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333887360:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016136.050751:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016136.050780:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27116ae6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6878 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016136.050903:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335368960:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016136.051004:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016136.051024:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11410 00000100:00100000:0.0:1734016136.051028:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333887232:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016136.051041:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016136.051059:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7582640/0x5e3a3adc27116aed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6871 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016136.051096:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335369088:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016136.051123:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00080000:1.0:1734016136.051252:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016106 00000100:00080000:1.0:1734016136.051258:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016106 00002000:00010000:2.0:1734016136.054116:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016133 -> 1734016136 00000100:00100000:2.0:1734016136.054151:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335368960:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016136.054201:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27116ae6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6878 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.054218:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75821c0/0x5e3a3adc27116ae6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6878 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.054245:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:2.0:1734016136.054331:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333887360:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3612us (3902us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016136.054349:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11409 00000100:00100000:2.0:1734016136.056500:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335369088:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016136.056559:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7582640/0x5e3a3adc27116aed lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6871 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.056576:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7582640/0x5e3a3adc27116aed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6871 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.056591:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:2.0:1734016136.056668:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333887232:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5637us (6155us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016136.056680:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11410 00000100:00100000:0.0:1734016136.059656:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016136.059726:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.059864:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333887616 00000100:00100000:3.0:1734016136.059882:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333887616 00000100:00100000:3.0:1734016136.059960:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333887488 00000100:00100000:3.0:1734016136.059963:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333887488 00000100:00100000:3.0:1734016136.059992:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11411 00000100:00100000:3.0:1734016136.060005:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333887616:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.060042:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.060078:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116af4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6886 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016136.060185:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335369216:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016136.060305:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016136.060358:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11412 00000100:00100000:3.0:1734016136.060363:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333887488:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.060375:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.060395:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116afb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e687f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016136.060431:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075447100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335369344:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016136.060457:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016136.063187:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075447100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335369344:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016136.063260:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116afb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e687f expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.063281:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116afb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e687f expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.063298:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:2.0:1734016136.063376:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333887488:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3008us (3646us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016136.063390:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11412 00000100:00100000:3.0:1734016136.063521:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335369216:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016136.063547:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116af4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6886 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.063557:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116af4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6886 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.063846:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016136.063875:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333887616:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3873us (4240us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016136.063882:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11411 00000100:00100000:1.0:1734016136.076788:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.076972:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333887872 00000100:00100000:2.0:1734016136.076984:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333887872 00000100:00100000:2.0:1734016136.077049:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2328 00000100:00100000:2.0:1734016136.077060:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+33:10406:x1818247333887872:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016136.077135:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016136.077170:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27116ad1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6863 expref: 33 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016136.077194:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016136.077198:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016136.082008:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116b02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016136.082075:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116adf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e686a expref: 33 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016136.082086:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116b02 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016136.082172:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e686a expref: 33 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016136.082200:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116adf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e686a expref: 33 pid: 6478 timeout: 503 lvb_type: 0 00000100:00100000:2.0:1734016136.082216:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335369472:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016136.082391:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016136.087362:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335369472:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016136.087415:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116b02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016136.087836:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.088027:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333888000 00000100:00100000:2.0:1734016136.088036:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333888000 00010000:00010000:2.0:1734016136.088085:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116adf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e686a expref: 34 pid: 6478 timeout: 503 lvb_type: 0 00000100:00100000:2.0:1734016136.088423:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3160 00000100:00100000:2.0:1734016136.088434:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+34:1981:x1818247333888000:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016136.088460:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016136.088468:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116adf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e686a expref: 34 pid: 6478 timeout: 503 lvb_type: 0 00010000:00010000:2.0:1734016136.088484:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e686a expref: 34 pid: 6478 timeout: 503 lvb_type: 0 00010000:00010000:2.0:1734016136.088515:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116adf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e686a expref: 34 pid: 6478 timeout: 503 lvb_type: 0 00000001:00080000:1.0:1734016136.088638:0:6461:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968815 is committed 00000001:00080000:1.0:1734016136.088682:0:6461:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968806 is committed 00010000:00010000:2.0:1734016136.088880:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016136.088888:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116b02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016136.088903:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016136.088914:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116b02 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016136.089753:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016136.091444:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+17:1981:x1818247333888000:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 2996us (3595us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016136.091467:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3160 00010000:00010000:3.0:1734016136.091898:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016136.091910:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:3.0:1734016136.092103:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968815 00000004:00010000:3.0:1734016136.092197:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075884000 reply state ffff88007bf58000 transno 4294968816 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:3.0:1734016136.092212:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016136.092397:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333887872:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 15338us (15624us total) trans 4294968816 rc 0/0 00000100:00100000:3.0:1734016136.092406:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2328 00000020:00080000:3.0:1734016136.092413:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016136.102001:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1734016136.102134:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016136.102150:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116b02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016136.102158:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116b02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016136.102165:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbe1c0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016136.102172:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116b02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016136.102181:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116b02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016136.102203:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016136.102207:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016136.102213:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116b02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016136.102218:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116b02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016136.103781:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.104606:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333888128 00000100:00100000:2.0:1734016136.104632:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333888128 00002000:00010000:2.0:1734016136.104700:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:2.0:1734016136.104706:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ed880 with x1818247333888128 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1734016136.104725:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756ed880. 00000100:00100000:2.0:1734016136.104750:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333888256 00000100:00100000:2.0:1734016136.104753:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333888256 00002000:00010000:2.0:1734016136.104773:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (3402383->18446744073709551615) 00002000:00100000:2.0:1734016136.104776:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a7100 with x1818247333888256 ext(3402383->18446744073709551615) 00002000:00010000:2.0:1734016136.104785:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a7100. 00000100:00100000:2.0:1734016136.104823:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8884 00000100:00100000:2.0:1734016136.104832:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333888128:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016136.105092:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 689382 -> 4194304 00002000:00010000:2.0:1734016136.105096:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016136 -> 1734016136 00002000:00010000:2.0:1734016136.105099:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016136 -> 1734016136 00002000:00010000:2.0:1734016136.105102:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016136 -> 1734016136 00002000:00010000:2.0:1734016136.105104:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 64 -> 64 00000100:00100000:2.0:1734016136.105171:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333888128:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 339us (3193us total) trans 4294968040 rc 0/0 00000100:00100000:2.0:1734016136.105179:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8884 00002000:00010000:2.0:1734016136.105184:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:2.0:1734016136.105186:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ed880 with x1818247333888128 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1734016136.105191:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756ed880. 00000100:00100000:2.0:1734016136.105210:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8885 00000100:00100000:2.0:1734016136.105214:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333888256:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016136.105382:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 3402383 00002000:00010000:2.0:1734016136.105385:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016136 -> 1734016136 00002000:00010000:2.0:1734016136.105387:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016136 -> 1734016133 00002000:00010000:2.0:1734016136.105389:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016136 -> 1734016136 00002000:00010000:2.0:1734016136.105391:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1734016136.105410:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333888256:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 194us (1645us total) trans 4294969507 rc 0/0 00000100:00100000:2.0:1734016136.105416:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8885 00002000:00010000:2.0:1734016136.105419:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (3402383->18446744073709551615) 00002000:00100000:2.0:1734016136.105422:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a7100 with x1818247333888256 ext(3402383->18446744073709551615) 00002000:00010000:2.0:1734016136.105426:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a7100. 00000100:00080000:1.0:1734016136.105671:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016106 00000100:00100000:1.0:1734016136.113125:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016136.113223:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.113353:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333888384 00000100:00100000:3.0:1734016136.113368:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333888384 00000100:00100000:3.0:1734016136.113471:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2329 00000100:00100000:3.0:1734016136.113484:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+17:10406:x1818247333888384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.113531:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.113577:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116b09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e688d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.113784:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116b10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016136.113832:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016136.113852:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016136.113895:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 7596687 00000004:00200000:3.0:1734016136.113904:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016136.113934:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016136.113968:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116b09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e688d expref: 19 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.114017:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116b10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e688d expref: 18 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.114032:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016136.114037:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016136.114043:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016136.114137:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:10406:x1818247333888384:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 655us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016136.114147:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2329 00000100:00100000:2.0:1734016136.114547:0:6475:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333888512 00000100:00100000:2.0:1734016136.114556:0:6475:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333888512 00000100:00100000:2.0:1734016136.114605:0:6475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 332 00000100:00100000:2.0:1734016136.114613:0:6475:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7610450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99867e87-1bc2-4e49-bd45-a757ae2fdd76+12:1982:x1818247333888512:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:2.0:1734016136.114666:0:6475:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7610450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99867e87-1bc2-4e49-bd45-a757ae2fdd76+12:1982:x1818247333888512:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 54us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016136.114673:0:6475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 332 00000100:00080000:1.0:1734016136.115016:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016106 00000100:00100000:0.0:1734016136.122163:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.122459:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333888640 00000100:00100000:3.0:1734016136.122481:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333888640 00000100:00100000:3.0:1734016136.122575:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11413 00000100:00100000:3.0:1734016136.122588:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333888640:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.122642:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.122679:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116b17 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6894 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016136.122827:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335369600:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016136.122946:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016136.125195:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016136.125446:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333888768 00000100:00100000:1.0:1734016136.125463:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333888768 00000100:00100000:1.0:1734016136.125534:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11414 00000100:00100000:1.0:1734016136.125547:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333888768:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016136.125588:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016136.125632:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27116b1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e689b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016136.125726:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075887800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335369728:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016136.125852:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016136.130882:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335369600:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016136.130945:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116b17 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6894 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.130964:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116b17 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6894 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.130982:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016136.131063:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333888640:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8477us (8932us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016136.131076:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11413 00002000:00010000:1.0:1734016136.133908:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016133 -> 1734016136 00000100:00100000:1.0:1734016136.133965:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075887800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335369728:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016136.134027:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27116b1e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e689b expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016136.134048:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27116b1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e689b expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016136.134090:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016136.134175:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333888768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8627us (8990us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016136.134192:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11414 00000100:00100000:0.0:1734016136.137258:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016136.137345:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.137477:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333888896 00000100:00100000:3.0:1734016136.137496:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333888896 00000100:00100000:3.0:1734016136.137581:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333889024 00000100:00100000:3.0:1734016136.137584:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333889024 00000100:00100000:3.0:1734016136.137645:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11415 00000100:00100000:3.0:1734016136.137661:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333888896:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.137702:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.137745:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116b25 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e68a2 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016136.137915:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335369856:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016136.138027:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016136.138110:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11416 00000100:00100000:0.0:1734016136.138117:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333889024:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016136.138130:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016136.138148:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27116b2c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e68a9 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016136.138201:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335369984:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016136.138232:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:3.0:1734016136.144287:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335369856:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016136.144361:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116b25 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68a2 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.144384:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116b25 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68a2 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.144423:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016136.144518:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333888896:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6861us (7290us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016136.144531:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11415 00000100:00100000:1.0:1734016136.145574:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335369984:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016136.145604:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27116b2c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68a9 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016136.145629:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27116b2c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68a9 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016136.145656:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:1.0:1734016136.145700:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333889024:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7583us (8355us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016136.145708:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11416 00000100:00100000:0.0:1734016136.148348:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.148498:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333889152 00000100:00100000:3.0:1734016136.148514:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333889152 00000100:00100000:3.0:1734016136.148613:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2330 00000100:00100000:3.0:1734016136.148632:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10406:x1818247333889152:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.148685:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.148720:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116b33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e68b0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.149286:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116b3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016136.149311:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016136.149330:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:3.0:1734016136.149366:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 7596687 00000004:00200000:3.0:1734016136.149373:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016136.149398:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016136.149428:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116b33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68b0 expref: 17 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.149451:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116b3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68b0 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.149465:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016136.149468:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016136.149471:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016136.149584:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333889152:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 953us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016136.149591:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2330 00000100:00100000:2.0:1734016136.153866:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016136.154323:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333889280 00000100:00100000:1.0:1734016136.154344:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333889280 00000100:00100000:1.0:1734016136.154524:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11417 00000100:00100000:1.0:1734016136.154539:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333889280:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016136.155056:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 3402383 -> 3402383 00002000:00010000:1.0:1734016136.155061:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016136 -> 1734016136 00002000:00010000:1.0:1734016136.155064:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016136 -> 1734016133 00002000:00010000:1.0:1734016136.155065:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016136 -> 1734016136 00002000:00010000:1.0:1734016136.155067:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 16 00000100:00100000:1.0:1734016136.155187:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333889280:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 647us (1393us total) trans 4294969508 rc 0/0 00000100:00100000:1.0:1734016136.155200:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11417 00000100:00100000:0.0:1734016136.159363:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.160792:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333889408 00000100:00100000:3.0:1734016136.160825:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333889408 00000100:00100000:3.0:1734016136.161403:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11418 00000100:00100000:3.0:1734016136.161414:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333889408:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016136.161977:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 3402383 -> 3402383 00002000:00010000:3.0:1734016136.161981:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016136 -> 1734016136 00002000:00010000:3.0:1734016136.161983:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016133 -> 1734016133 00002000:00010000:3.0:1734016136.161986:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016136 -> 1734016136 00002000:00010000:3.0:1734016136.161988:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 16 -> 40 00000100:00100000:3.0:1734016136.162210:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333889408:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 796us (2871us total) trans 4294969509 rc 0/0 00000100:00100000:3.0:1734016136.162220:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11418 00000100:00100000:0.0:1734016136.166500:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016136.166602:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016136.166791:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333889664 00000100:00100000:1.0:1734016136.166865:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333889664 00000100:00100000:1.0:1734016136.166957:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333889536 00000100:00100000:1.0:1734016136.166960:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333889536 00000100:00100000:1.0:1734016136.166998:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11419 00000100:00100000:1.0:1734016136.167010:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333889664:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016136.167054:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016136.167092:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27116b41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e68be expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016136.167209:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075887800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335370112:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016136.167313:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016136.167695:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11420 00000100:00100000:3.0:1734016136.167703:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333889536:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.167714:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.167730:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116b48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e68b7 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016136.167772:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335370240:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016136.167831:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00002000:00010000:1.0:1734016136.171483:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016133 -> 1734016136 00000100:00100000:1.0:1734016136.171537:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075887800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335370112:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016136.171599:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27116b41 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68be expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016136.171634:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27116b41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68be expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016136.171668:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016136.171758:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333889664:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4748us (5295us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016136.171772:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11419 00000100:00100000:2.0:1734016136.173151:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335370240:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016136.173193:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116b48 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68b7 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.173215:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116b48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68b7 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.173232:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:2.0:1734016136.173268:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333889536:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5565us (6665us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016136.173277:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11420 00000100:00100000:0.0:1734016136.177740:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016136.178133:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.178160:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333889920 00000100:00100000:2.0:1734016136.178176:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333889920 00000100:00100000:2.0:1734016136.178264:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11421 00000100:00100000:2.0:1734016136.178275:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333889920:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016136.178315:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016136.178343:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27116b4f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e68cc expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016136.178443:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335370368:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016136.178531:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016136.179191:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333889792 00000100:00100000:0.0:1734016136.179198:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333889792 00000100:00100000:0.0:1734016136.179230:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11422 00000100:00100000:0.0:1734016136.179235:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333889792:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016136.179248:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016136.179268:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7582640/0x5e3a3adc27116b56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e68c5 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016136.179316:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335370496:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016136.181078:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016136.182262:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335370368:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016136.182320:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27116b4f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68cc expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.182340:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27116b4f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68cc expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.182364:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016136.182438:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333889920:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4165us (4722us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016136.182451:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11421 00000100:00100000:2.0:1734016136.184276:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b4a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335370496:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016136.184343:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7582640/0x5e3a3adc27116b56 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68c5 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.184364:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7582640/0x5e3a3adc27116b56 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68c5 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.184383:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:2.0:1734016136.184441:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333889792:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5202us (6306us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016136.184452:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11422 00000100:00100000:1.0:1734016136.188419:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.188669:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333890176 00000100:00100000:2.0:1734016136.188685:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333890176 00002000:00100000:2.0:1734016136.188746:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (2727936->2732031) req@ffff880075884a80 x1818247333890176/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:97/0 lens 488/0 e 0 to 0 dl 1734016147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016136.188758:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075884a80 with x1818247333890176 ext(2727936->2732031) 00002000:00010000:2.0:1734016136.188765:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075884a80 00000100:00100000:2.0:1734016136.188797:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8886 00000100:00100000:2.0:1734016136.188832:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333890176:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016136.189111:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333890176:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 280us (713us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016136.189119:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8886 00002000:00100000:2.0:1734016136.189126:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (2727936->2732031) req@ffff880075884a80 x1818247333890176/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:97/0 lens 488/4536 e 0 to 0 dl 1734016147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016136.189134:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075884a80 with x1818247333890176 ext(2727936->2732031) 00002000:00010000:2.0:1734016136.189137:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075884a80 00000100:00100000:0.0:1734016136.193001:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.193417:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333890432 00000100:00100000:2.0:1734016136.193439:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333890432 00002000:00100000:2.0:1734016136.193542:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2732032->2736127) req@ffff880073b4a300 x1818247333890432/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:97/0 lens 488/0 e 0 to 0 dl 1734016147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016136.193559:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b4a300 with x1818247333890432 ext(2732032->2736127) 00002000:00010000:2.0:1734016136.193568:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b4a300 00000100:00100000:2.0:1734016136.193611:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8887 00000100:00100000:2.0:1734016136.193635:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1983:x1818247333890432:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016136.194059:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1983:x1818247333890432:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 423us (1085us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016136.194073:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8887 00002000:00100000:2.0:1734016136.194082:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2732032->2736127) req@ffff880073b4a300 x1818247333890432/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:97/0 lens 488/4536 e 0 to 0 dl 1734016147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016136.194090:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b4a300 with x1818247333890432 ext(2732032->2736127) 00002000:00010000:2.0:1734016136.194094:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b4a300 00000100:00100000:0.0:1734016136.198635:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.198937:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333890560 00000100:00100000:2.0:1734016136.198954:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333890560 00002000:00100000:2.0:1734016136.199035:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (2727936->2736127) req@ffff880073b49880 x1818247333890560/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:97/0 lens 8680/0 e 0 to 0 dl 1734016147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016136.199052:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b49880 with x1818247333890560 ext(2727936->2736127) 00002000:00010000:2.0:1734016136.199062:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b49880 00000100:00100000:2.0:1734016136.199097:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8888 00000100:00100000:2.0:1734016136.199108:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333890560:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016136.201973:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1984:x1818247333890560:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 2838us (3341us total) trans 4294969510 rc 0/0 00000100:00100000:2.0:1734016136.202001:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8888 00002000:00100000:2.0:1734016136.202029:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (2727936->2736127) req@ffff880073b49880 x1818247333890560/t4294969510(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:97/0 lens 8680/448 e 0 to 0 dl 1734016147 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016136.202042:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b49880 with x1818247333890560 ext(2727936->2736127) 00002000:00010000:2.0:1734016136.202050:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b49880 00000100:00100000:0.0:1734016136.204257:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.204375:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333890688 00000100:00100000:3.0:1734016136.204387:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333890688 00000100:00100000:3.0:1734016136.204455:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2331 00000100:00100000:3.0:1734016136.204466:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333890688:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:3.0:1734016136.204676:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333890688:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 211us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016136.204683:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2331 00000100:00100000:0.0:1734016136.206769:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.206977:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333890816 00000100:00100000:2.0:1734016136.206990:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333890816 00000100:00100000:2.0:1734016136.207056:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11423 00000100:00100000:2.0:1734016136.207066:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1981:x1818247333890816:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:1.0:1734016136.208991:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969510 is committed 00000100:00100000:2.0:1734016136.209922:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333890816:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2842us (3153us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016136.209940:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11423 00000100:00100000:0.0:1734016136.216003:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016136.216094:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016136.216360:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333890944 00000100:00100000:1.0:1734016136.216379:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333890944 00000100:00100000:1.0:1734016136.216457:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333891072 00000100:00100000:1.0:1734016136.216460:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333891072 00000100:00100000:1.0:1734016136.216485:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11424 00000100:00100000:1.0:1734016136.216496:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333890944:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016136.216535:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016136.216562:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499ef40/0x5e3a3adc27116b5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e68d3 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016136.216658:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335370624:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016136.216752:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016136.216845:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11425 00000100:00100000:2.0:1734016136.216851:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333891072:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016136.216862:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016136.216882:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116b64 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e68da expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016136.216931:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335370752:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016136.216964:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706d80 going to sleep for 11 seconds 00000100:00100000:1.0:1734016136.220433:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335370624:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016136.220493:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499ef40/0x5e3a3adc27116b5d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68d3 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016136.220511:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499ef40/0x5e3a3adc27116b5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68d3 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016136.220533:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016136.220601:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333890944:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4106us (4625us total) trans 0 rc 301/301 00002000:00010000:2.0:1734016136.220706:0:7682:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 40 -> 56 00000100:00100000:2.0:1734016136.220728:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335370752:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016136.220758:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116b64 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68da expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.220769:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116b64 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68da expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.220980:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016136.221003:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333891072:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4152us (4909us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016136.221559:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11424 00000100:00100000:2.0:1734016136.221820:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11425 00000100:00100000:0.0:1734016136.226376:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016136.226467:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.226646:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333891200 00000100:00100000:2.0:1734016136.226664:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333891200 00000100:00100000:2.0:1734016136.226746:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333891328 00000100:00100000:2.0:1734016136.226749:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333891328 00000100:00100000:2.0:1734016136.226781:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11426 00000100:00100000:2.0:1734016136.226792:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333891200:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016136.226881:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016136.226916:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116b6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e68e1 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016136.227013:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335370880:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016136.227122:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706d80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016136.227146:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11427 00000100:00100000:2.0:1734016136.227152:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333891328:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016136.227166:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016136.227184:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116b72 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e68e8 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016136.227216:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335371008:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016136.227237:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016136.230981:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335370880:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016136.231041:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116b6b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68e1 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.231070:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116b6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68e1 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1734016136.231765:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335371008:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016136.231794:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116b72 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68e8 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.231823:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116b72 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68e8 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.231844:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:3.0:1734016136.231929:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333891328:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4773us (5458us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016136.231944:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11427 00010000:00010000:2.0:1734016136.232263:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016136.232301:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333891200:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5511us (5954us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016136.232311:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11426 00000100:00100000:0.0:1734016136.236129:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.236280:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333891456 00000100:00100000:2.0:1734016136.236298:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333891456 00000100:00100000:2.0:1734016136.236377:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11428 00000100:00100000:2.0:1734016136.236388:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333891456:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016136.236429:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016136.236461:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116b79 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e68ef expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016136.236528:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116911 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e2 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016136.236544:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016136.236548:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016136.236554:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116b79 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [2490368->2498559] (req 2490368->2498559) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68ef expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016136.236605:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116911 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e2 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016136.236642:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116911 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e2 expref: 6 pid: 7684 timeout: 503 lvb_type: 0 00000100:00100000:2.0:1734016136.236664:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335371136:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016136.236825:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706d80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016136.243023:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335371136:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016136.243093:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116b79 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [2490368->2498559] (req 2490368->2498559) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68ef expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016136.243120:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016136.243213:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333891456:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6826us (7106us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016136.243225:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11428 00000100:00100000:0.0:1734016136.243819:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.244953:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333891584 00000100:00100000:2.0:1734016136.244966:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333891584 00010000:00010000:2.0:1734016136.245021:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116911 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e2 expref: 7 pid: 7684 timeout: 503 lvb_type: 0 00000100:00100000:2.0:1734016136.245784:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3161 00000100:00100000:2.0:1734016136.245796:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333891584:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016136.246199:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016136.246231:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116911 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e2 expref: 7 pid: 7684 timeout: 503 lvb_type: 0 00010000:00010000:2.0:1734016136.246253:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116911 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e2 expref: 7 pid: 7684 timeout: 503 lvb_type: 0 00010000:00010000:2.0:1734016136.246287:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116911 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e66e2 expref: 7 pid: 7684 timeout: 503 lvb_type: 0 00010000:00010000:2.0:1734016136.246880:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016136.246884:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016136.246897:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116b79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->2498559) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68ef expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016136.246911:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116b79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->2498559) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68ef expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016136.246973:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116b79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->2498559) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68ef expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016136.246995:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335371264:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016136.247790:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706d80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016136.252405:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.252686:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335371264:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016136.252723:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016136.252818:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333891584:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7021us (8999us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016136.252837:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3161 00000100:00100000:3.0:1734016136.253089:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333891712 00000100:00100000:3.0:1734016136.253102:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333891712 00000100:00100000:3.0:1734016136.253165:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11429 00000100:00100000:3.0:1734016136.253173:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333891712:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016136.253523:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 3402383 -> 3402383 00002000:00010000:3.0:1734016136.253527:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016136 -> 1734016136 00002000:00010000:3.0:1734016136.253529:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016136 -> 1734016133 00002000:00010000:3.0:1734016136.253532:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016136 -> 1734016136 00002000:00010000:3.0:1734016136.253534:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 56 -> 56 00000100:00100000:3.0:1734016136.253604:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333891712:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 431us (1220us total) trans 4294969511 rc 0/0 00000100:00100000:3.0:1734016136.253623:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11429 00000100:00100000:0.0:1734016136.256529:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.256668:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333891840 00000100:00100000:2.0:1734016136.256683:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333891840 00000100:00100000:2.0:1734016136.256768:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11430 00000100:00100000:2.0:1734016136.256779:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333891840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016136.256860:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016136.256902:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116b80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e68f6 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016136.257021:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335371392:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016136.257139:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706d80 going to sleep for 11 seconds 00002000:00010000:2.0:1734016136.259065:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016133 -> 1734016136 00000100:00100000:2.0:1734016136.259104:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335371392:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016136.259158:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116b80 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68f6 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.259176:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116b80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68f6 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.259750:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016136.260477:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333891840:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3691us (3956us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016136.260492:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11430 00000100:00100000:0.0:1734016136.263676:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.264047:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333891968 00000100:00100000:2.0:1734016136.264065:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333891968 00000100:00100000:2.0:1734016136.264157:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11431 00000100:00100000:2.0:1734016136.264168:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333891968:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016136.264205:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016136.264239:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116b87 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e68fd expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016136.264334:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335371520:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016136.264461:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706d80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016136.267260:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335371520:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016136.267339:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116b87 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68fd expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.267360:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116b87 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68fd expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.267420:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016136.267782:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333891968:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3613us (4129us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016136.267795:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11431 00000100:00100000:0.0:1734016136.271094:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.271225:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333892096 00000100:00100000:2.0:1734016136.271242:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333892096 00000100:00100000:2.0:1734016136.271310:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11432 00000100:00100000:2.0:1734016136.271320:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333892096:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016136.271718:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 3402383 -> 3402383 00002000:00010000:2.0:1734016136.271722:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016136 -> 1734016136 00002000:00010000:2.0:1734016136.271726:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016136 -> 1734016133 00002000:00010000:2.0:1734016136.271728:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016136 -> 1734016136 00002000:00010000:2.0:1734016136.271729:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 56 -> 56 00000100:00100000:2.0:1734016136.271907:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333892096:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 589us (833us total) trans 4294969512 rc 0/0 00000100:00100000:2.0:1734016136.271919:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11432 00000100:00100000:0.0:1734016136.274385:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.275834:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333892224 00000100:00100000:3.0:1734016136.275865:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333892224 00000100:00100000:3.0:1734016136.275982:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11433 00000100:00100000:3.0:1734016136.275994:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333892224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.276031:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.276070:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116b8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6904 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016136.276172:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335371648:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016136.276283:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016136.279344:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335371648:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016136.279407:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116b8e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6904 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.279427:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116b8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6904 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.279450:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016136.279773:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333892224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3780us (5401us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016136.279785:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11433 00000100:00100000:0.0:1734016136.282531:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.282644:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333892352 00000100:00100000:3.0:1734016136.282654:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333892352 00000100:00100000:3.0:1734016136.282707:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11434 00000100:00100000:3.0:1734016136.282715:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333892352:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.282742:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.282767:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116b95 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e690b expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016136.282862:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335371776:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016136.282929:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016136.286287:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335371776:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016136.286361:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116b95 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e690b expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.286388:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116b95 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e690b expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.286505:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016136.287199:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333892352:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4479us (4675us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016136.287212:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11434 00000100:00100000:0.0:1734016136.290060:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.290554:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333892480 00000100:00100000:3.0:1734016136.290572:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333892480 00000100:00100000:3.0:1734016136.290671:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11435 00000100:00100000:3.0:1734016136.290684:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333892480:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.290725:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.290761:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116b9c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6912 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016136.290901:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335371904:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016136.291019:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016136.295045:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335371904:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016136.295127:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116b9c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6912 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.295155:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116b9c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6912 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.295200:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016136.295289:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333892480:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4605us (5239us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016136.295304:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11435 00000100:00100000:1.0:1734016136.298622:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.298765:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333892608 00000100:00100000:3.0:1734016136.298784:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333892608 00000100:00100000:3.0:1734016136.298956:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11436 00000100:00100000:3.0:1734016136.298969:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333892608:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.299008:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.299041:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116ba3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6919 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016136.299159:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335372032:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016136.299747:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016136.302260:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335372032:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016136.302327:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116ba3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6919 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.302347:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116ba3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6919 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.302653:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016136.302976:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333892608:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4005us (4382us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016136.302996:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11436 00000100:00100000:0.0:1734016136.314708:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.314858:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333892864 00000100:00100000:2.0:1734016136.314873:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333892864 00002000:00100000:2.0:1734016136.314936:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (0->3403775) req@ffff880075fc7480 x1818247333892864/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:97/0 lens 488/0 e 0 to 0 dl 1734016147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016136.314949:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7480 with x1818247333892864 ext(0->3403775) 00002000:00010000:2.0:1734016136.314957:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc7480 00000100:00100000:2.0:1734016136.314989:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8889 00000100:00100000:2.0:1734016136.314999:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333892864:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016136.374955:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333892864:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 59941us (60250us total) trans 0 rc 3403776/3403776 00000100:00100000:3.0:1734016136.374974:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8889 00002000:00100000:3.0:1734016136.375001:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (0->3403775) req@ffff880075fc7480 x1818247333892864/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:97/0 lens 488/440 e 0 to 0 dl 1734016147 ref 1 fl Complete:/200/0 rc 3403776/3403776 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016136.375013:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7480 with x1818247333892864 ext(0->3403775) 00002000:00010000:3.0:1734016136.375021:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc7480 00000100:00100000:0.0:1734016136.382314:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.382587:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333892992 00000100:00100000:3.0:1734016136.382606:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333892992 00000100:00100000:3.0:1734016136.382713:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11437 00000100:00100000:3.0:1734016136.382727:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333892992:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.382758:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.382784:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116baa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6920 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016136.382928:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335372160:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016136.383026:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00002000:00010000:3.0:1734016136.402957:0:7682:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016136 -> 1734016137 00002000:00010000:3.0:1734016136.402970:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016133 -> 1734016136 00002000:00010000:3.0:1734016136.402973:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016136 -> 1734016137 00000100:00100000:3.0:1734016136.403019:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335372160:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016136.403099:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116baa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6920 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.403122:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116baa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6920 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.403178:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016136.403283:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333892992:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 20559us (20990us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016136.403297:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11437 00000100:00100000:0.0:1734016136.405781:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.405982:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333893120 00000100:00100000:3.0:1734016136.406001:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333893120 00000100:00100000:3.0:1734016136.406104:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11438 00000100:00100000:3.0:1734016136.406117:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333893120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.406154:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.406195:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116bb1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6927 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016136.406291:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335372288:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016136.406406:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016136.408400:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335372288:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016136.408457:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116bb1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6927 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.408475:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116bb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6927 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.408491:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016136.408556:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333893120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2440us (2801us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016136.408568:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11438 00000100:00100000:0.0:1734016136.415584:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.415826:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333893248 00000100:00100000:3.0:1734016136.415844:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333893248 00000100:00100000:3.0:1734016136.415910:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11439 00000100:00100000:3.0:1734016136.415921:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333893248:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.415951:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.415982:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27116bb8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e692e expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016136.416071:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335372416:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016136.416187:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016136.433956:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335372416:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016136.434057:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27116bb8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e692e expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.434086:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27116bb8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e692e expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.434365:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016136.435340:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333893248:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 19408us (19762us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016136.435360:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11439 00000100:00100000:0.0:1734016136.437759:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.437962:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333893376 00000100:00100000:3.0:1734016136.437980:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333893376 00000100:00100000:3.0:1734016136.438063:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11440 00000100:00100000:3.0:1734016136.438077:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333893376:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.438106:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.438136:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116bbf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6935 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016136.438235:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335372544:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016136.438361:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016136.442452:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335372544:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016136.442522:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116bbf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6935 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.442546:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116bbf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6935 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.442649:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016136.443013:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333893376:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4937us (5269us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016136.443032:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11440 00000100:00100000:0.0:1734016136.446933:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.447133:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333893504 00000100:00100000:3.0:1734016136.447154:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333893504 00000100:00100000:3.0:1734016136.447223:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11441 00000100:00100000:3.0:1734016136.447234:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333893504:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.447269:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.447303:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116bc6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e693c expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016136.447402:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335372672:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016136.447494:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00002000:00010000:3.0:1734016136.449455:0:7682:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime: 1734016136 -> 1734016137 00002000:00010000:3.0:1734016136.449464:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016136 -> 1734016137 00000100:00100000:3.0:1734016136.449494:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335372672:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016136.449539:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116bc6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e693c expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.449556:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116bc6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e693c expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.451031:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016136.454346:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333893504:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7053us (7374us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016136.454380:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11441 00000100:00100000:0.0:1734016136.461444:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.461636:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333893632 00000100:00100000:3.0:1734016136.461654:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333893632 00000100:00100000:3.0:1734016136.461741:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11442 00000100:00100000:3.0:1734016136.461754:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333893632:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.461867:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.461919:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116bcd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6943 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016136.462047:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335372800:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016136.462540:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016136.467503:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335372800:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016136.467586:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116bcd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6943 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.467626:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116bcd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6943 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.467926:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016136.468047:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333893632:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6293us (6631us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016136.468074:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11442 00000100:00100000:0.0:1734016136.478536:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.478770:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333893760 00000100:00100000:3.0:1734016136.478786:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333893760 00000100:00100000:3.0:1734016136.478914:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11443 00000100:00100000:3.0:1734016136.478927:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333893760:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.478955:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.478996:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116bd4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e694a expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016136.479108:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335372928:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016136.480380:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00002000:00010000:3.0:1734016136.482666:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016136 -> 1734016137 00000100:00100000:3.0:1734016136.482706:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335372928:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016136.482765:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116bd4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e694a expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.482781:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116bd4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e694a expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.486856:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016136.487006:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333893760:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8068us (8479us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016136.487023:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11443 00000100:00100000:0.0:1734016136.491660:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.498032:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333893888 00000100:00100000:3.0:1734016136.498055:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333893888 00000100:00100000:3.0:1734016136.498156:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11444 00000100:00100000:3.0:1734016136.498169:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333893888:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.498201:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.498234:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116bdb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6951 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.498291:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116b79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->2498559) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68ef expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.498308:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016136.498311:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016136.498316:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116bdb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [2473984->2478079] (req 2473984->2478079) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6951 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.498360:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116b79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->2498559) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68ef expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.498379:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116b79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->2498559) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68ef expref: 9 pid: 7682 timeout: 503 lvb_type: 0 00000100:00100000:3.0:1734016136.498394:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335373056:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016136.498504:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016136.504165:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.504402:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335373056:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016136.504461:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116bdb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [2473984->2478079] (req 2473984->2478079) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6951 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.504489:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016136.504651:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333893888:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6483us (13019us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016136.504664:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11444 00000100:00100000:3.0:1734016136.504726:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333894016 00000100:00100000:3.0:1734016136.504736:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333894016 00002000:00100000:3.0:1734016136.504784:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (2863104->2867199) req@ffff880073790380 x1818247333894016/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:97/0 lens 4584/0 e 0 to 0 dl 1734016147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016136.504826:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790380 with x1818247333894016 ext(2863104->2867199) 00010000:00010000:3.0:1734016136.504834:0:13914:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116b79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68ef expref: 10 pid: 7682 timeout: 503 lvb_type: 0 00010000:00010000:3.0:1734016136.504846:0:13914:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116b79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68ef expref: 10 pid: 7682 timeout: 503 lvb_type: 0 00002000:00010000:3.0:1734016136.504851:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880073790380 00000100:00100000:3.0:1734016136.504872:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 292 00000100:00100000:3.0:1734016136.504878:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333894016:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016136.509205:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333894016:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4307us (5048us total) trans 4294969513 rc 0/0 00000100:00100000:3.0:1734016136.509225:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 292 00002000:00100000:3.0:1734016136.509245:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (2863104->2867199) req@ffff880073790380 x1818247333894016/t4294969513(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:97/0 lens 4584/448 e 0 to 0 dl 1734016147 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016136.509256:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790380 with x1818247333894016 ext(2863104->2867199) 00010000:00010000:3.0:1734016136.509273:0:13914:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116b79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68ef expref: 12 pid: 7682 timeout: 503 lvb_type: 0 00010000:00010000:3.0:1734016136.509298:0:13914:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116b79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68ef expref: 12 pid: 7682 timeout: 503 lvb_type: 0 00002000:00010000:3.0:1734016136.509305:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880073790380 00000100:00100000:0.0:1734016136.523273:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.523714:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333894144 00000100:00100000:2.0:1734016136.523733:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333894144 00010000:00010000:2.0:1734016136.523858:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116b79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68ef expref: 12 pid: 7682 timeout: 503 lvb_type: 0 00000100:00100000:2.0:1734016136.523925:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3162 00000100:00100000:2.0:1734016136.523938:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247333894144:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016136.523963:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1734016136.523995:0:6466:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 56 -> 64 00010000:00010000:2.0:1734016136.524003:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116b79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2490368->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68ef expref: 12 pid: 7682 timeout: 503 lvb_type: 0 00010000:00010000:2.0:1734016136.524022:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116b79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2490368->2498559) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68ef expref: 12 pid: 7682 timeout: 503 lvb_type: 0 00010000:00010000:2.0:1734016136.524066:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116b79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2490368->2498559) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68ef expref: 12 pid: 7682 timeout: 503 lvb_type: 0 00010000:00010000:2.0:1734016136.524109:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016136.524112:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016136.524120:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116bdb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->2478079) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6951 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016136.524130:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116bdb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->2478079) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6951 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016136.524187:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116bdb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->2478079) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6951 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016136.524206:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335373184:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016136.524308:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706d80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016136.532058:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.532236:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333894400 00000100:00100000:3.0:1734016136.532259:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333894400 00002000:00100000:3.0:1734016136.532352:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (2473984->2478079) req@ffff8800750c0e00 x1818247333894400/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:97/0 lens 488/0 e 0 to 0 dl 1734016147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016136.532370:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0e00 with x1818247333894400 ext(2473984->2478079) 00002000:00010000:3.0:1734016136.532379:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c0e00 00000100:00100000:3.0:1734016136.532418:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8890 00000100:00100000:3.0:1734016136.532428:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333894400:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016136.532738:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333894400:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 310us (707us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016136.532748:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8890 00002000:00100000:3.0:1734016136.532754:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (2473984->2478079) req@ffff8800750c0e00 x1818247333894400/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:97/0 lens 488/4536 e 0 to 0 dl 1734016147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016136.532761:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0e00 with x1818247333894400 ext(2473984->2478079) 00002000:00010000:3.0:1734016136.532764:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c0e00 00000100:00100000:2.0:1734016136.532895:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335373184:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016136.532933:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016136.532967:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333894144:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9031us (9721us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016136.532977:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3162 00000100:00100000:0.0:1734016136.535933:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.536134:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333894656 00000100:00100000:2.0:1734016136.536149:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333894656 00002000:00100000:2.0:1734016136.536219:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2478080->2482175) req@ffff8800750c0380 x1818247333894656/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:97/0 lens 488/0 e 0 to 0 dl 1734016147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016136.536239:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0380 with x1818247333894656 ext(2478080->2482175) 00002000:00010000:2.0:1734016136.536249:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c0380 00000100:00100000:2.0:1734016136.536374:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8891 00000100:00100000:2.0:1734016136.536384:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333894656:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016136.536654:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333894656:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 269us (737us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016136.536662:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8891 00002000:00100000:2.0:1734016136.536673:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2478080->2482175) req@ffff8800750c0380 x1818247333894656/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:97/0 lens 488/4536 e 0 to 0 dl 1734016147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016136.536680:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0380 with x1818247333894656 ext(2478080->2482175) 00002000:00010000:2.0:1734016136.536683:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c0380 00000100:00100000:0.0:1734016136.541757:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016136.541867:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.546227:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333894784 00000100:00100000:3.0:1734016136.546257:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333894784 00000100:00100000:3.0:1734016136.546361:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333894912 00000100:00100000:3.0:1734016136.546365:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333894912 00000100:00100000:3.0:1734016136.546406:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11445 00000100:00100000:3.0:1734016136.546419:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333894784:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.546461:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.546496:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116be2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6958 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016136.546622:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335373312:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016136.546752:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016136.546851:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11446 00000100:00100000:2.0:1734016136.546861:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333894912:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016136.546871:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016136.546888:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116be9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e695f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016136.546907:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016136.546909:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016136.546921:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116be9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e695f expref: 12 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.546946:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116be9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e695f expref: 12 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.546968:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016136.547003:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333894912:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 143us (5136us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016136.547012:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11446 00002000:00010000:3.0:1734016136.549346:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016136 -> 1734016137 00000100:00100000:3.0:1734016136.549389:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335373312:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016136.549447:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116be2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6958 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.549465:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116be2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6958 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.549502:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016136.550414:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333894784:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3993us (8678us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016136.550426:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11445 00000100:00100000:0.0:1734016136.560198:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.560359:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333895040 00000100:00100000:3.0:1734016136.560376:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333895040 00000100:00100000:0.0:1734016136.561008:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11447 00000100:00100000:0.0:1734016136.561023:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333895040:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016136.561069:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016136.561102:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7582640/0x5e3a3adc27116bf0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6966 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016136.561201:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335373440:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016136.561845:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016136.567614:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335373440:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016136.567698:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7582640/0x5e3a3adc27116bf0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6966 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.567723:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7582640/0x5e3a3adc27116bf0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6966 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016136.567755:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:2.0:1734016136.567909:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333895040:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6887us (7737us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016136.567921:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11447 00000100:00100000:0.0:1734016136.572714:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.574626:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333895168 00000100:00100000:2.0:1734016136.574648:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333895168 00000100:00100000:2.0:1734016136.574757:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11448 00000100:00100000:2.0:1734016136.574768:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333895168:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016136.574796:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016136.574842:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116bf7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e696d expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016136.574949:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335373568:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016136.584816:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016136.599299:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335373568:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016136.599374:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116bf7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e696d expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016136.599397:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116bf7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e696d expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016136.599431:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:0.0:1734016136.599514:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333895168:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 24743us (26816us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016136.599529:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11448 00000100:00100000:3.0:1734016136.609133:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016136.609214:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333895296 00000100:00100000:0.0:1734016136.609229:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333895296 00000100:00100000:0.0:1734016136.609303:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11449 00000100:00100000:0.0:1734016136.609312:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333895296:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016136.609334:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016136.609363:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116bfe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6974 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016136.609403:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116ac3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e685c expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016136.609411:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016136.609413:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016136.609417:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116bfe lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6974 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016136.609459:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116ac3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e685c expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016136.609475:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116ac3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e685c expref: 8 pid: 7682 timeout: 503 lvb_type: 0 00000100:00100000:0.0:1734016136.609490:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335373696:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016136.609582:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00010000:00010000:2.0:1734016136.611072:0:6469:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1734016136.613981:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073bbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335373696:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016136.614049:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116bfe lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6974 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016136.614081:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:2.0:1734016136.615194:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247333895296:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5868us (6065us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016136.615212:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11449 00000100:00100000:0.0:1734016136.615491:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.617422:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333895424 00000100:00100000:2.0:1734016136.617448:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333895424 00010000:00010000:2.0:1734016136.617519:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116ac3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e685c expref: 9 pid: 7682 timeout: 503 lvb_type: 0 00000100:00100000:2.0:1734016136.617593:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3163 00000100:00100000:2.0:1734016136.617617:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333895424:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016136.617642:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016136.617675:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116ac3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e685c expref: 9 pid: 7682 timeout: 503 lvb_type: 0 00010000:00010000:2.0:1734016136.617692:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116ac3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e685c expref: 9 pid: 7682 timeout: 503 lvb_type: 0 00010000:00010000:2.0:1734016136.617731:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116ac3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e685c expref: 9 pid: 7682 timeout: 503 lvb_type: 0 00010000:00010000:2.0:1734016136.619311:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016136.619326:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016136.619355:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116bfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->3702783) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6974 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016136.619373:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116bfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->3702783) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6974 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016136.619466:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116bfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->3702783) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6974 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016136.619483:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335373824:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016136.619597:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00000100:00100000:2.0:1734016136.641914:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335373824:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016136.641969:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016136.642088:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333895424:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 24482us (26599us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016136.642109:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3163 00000100:00100000:0.0:1734016136.647038:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.647314:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333895680 00000100:00100000:2.0:1734016136.647329:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333895680 00002000:00100000:2.0:1734016136.647408:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff8800755b5c00 x1818247333895680/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:97/0 lens 488/0 e 0 to 0 dl 1734016147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016136.647422:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5c00 with x1818247333895680 ext(0->4194303) 00002000:00010000:2.0:1734016136.647431:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800755b5c00 00000100:00100000:2.0:1734016136.647466:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8892 00000100:00100000:2.0:1734016136.647476:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333895680:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016136.743518:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333895680:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 96011us (96472us total) trans 0 rc 4194304/4194304 00000100:00100000:3.0:1734016136.743543:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8892 00002000:00100000:3.0:1734016136.743566:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff8800755b5c00 x1818247333895680/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:97/0 lens 488/440 e 0 to 0 dl 1734016147 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016136.743580:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5c00 with x1818247333895680 ext(0->4194303) 00002000:00010000:3.0:1734016136.743587:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800755b5c00 00000100:00100000:0.0:1734016136.757321:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.757632:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333895808 00000100:00100000:3.0:1734016136.757651:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333895808 00002000:00100000:3.0:1734016136.757717:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (3698688->3706879) req@ffff8800755b5880 x1818247333895808/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:97/0 lens 8680/0 e 0 to 0 dl 1734016147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016136.757730:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5880 with x1818247333895808 ext(3698688->3706879) 00002000:00010000:3.0:1734016136.757738:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800755b5880 00000100:00100000:3.0:1734016136.757771:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8893 00000100:00100000:3.0:1734016136.757779:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333895808:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016136.773346:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333895808:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 15528us (16010us total) trans 4294968041 rc 0/0 00000100:00100000:3.0:1734016136.773376:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8893 00002000:00100000:3.0:1734016136.773402:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (3698688->3706879) req@ffff8800755b5880 x1818247333895808/t4294968041(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:97/0 lens 8680/448 e 0 to 0 dl 1734016147 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016136.773415:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5880 with x1818247333895808 ext(3698688->3706879) 00002000:00010000:3.0:1734016136.773428:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800755b5880 00000100:00100000:0.0:1734016136.799123:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.799841:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333895936 00000100:00100000:2.0:1734016136.799852:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333895936 00000100:00100000:2.0:1734016136.799916:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2332 00000100:00100000:2.0:1734016136.799924:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:10406:x1818247333895936:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:2.0:1734016136.800076:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:10406:x1818247333895936:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 151us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016136.800084:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2332 00000100:00100000:0.0:1734016136.806059:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.807533:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333896064 00000100:00100000:2.0:1734016136.807554:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333896064 00000100:00100000:2.0:1734016136.807673:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11450 00000100:00100000:2.0:1734016136.807686:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333896064:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016136.812795:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968041 is committed 00000001:00080000:0.0:1734016136.812872:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968040 is committed 00000100:00100000:3.0:1734016136.819718:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333896064:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 12013us (13659us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016136.819740:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11450 00000100:00100000:0.0:1734016136.839266:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.839415:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333896192 00000100:00100000:3.0:1734016136.839431:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333896192 00000100:00100000:3.0:1734016136.839509:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11451 00000100:00100000:3.0:1734016136.839522:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333896192:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016136.839921:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1734016136.839926:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016137 -> 1734016137 00002000:00010000:3.0:1734016136.839929:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016137 -> 1734016137 00002000:00010000:3.0:1734016136.839932:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016137 -> 1734016137 00002000:00010000:3.0:1734016136.839935:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 64 -> 72 00000100:00100000:3.0:1734016136.842001:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333896192:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 2467us (2738us total) trans 4294968042 rc 0/0 00000100:00100000:3.0:1734016136.842019:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11451 00000100:00100000:0.0:1734016136.845197:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.845339:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333896320 00000100:00100000:3.0:1734016136.845358:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333896320 00000100:00100000:3.0:1734016136.845438:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11452 00000100:00100000:3.0:1734016136.845450:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333896320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.845491:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.845529:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116c05 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e697b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016136.845650:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335373952:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016136.847592:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016136.849457:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335373952:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016136.849504:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116c05 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e697b expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.849523:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27116c05 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e697b expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.851164:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016136.851249:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333896320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5796us (6075us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016136.851263:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11452 00000100:00100000:0.0:1734016136.854257:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.854428:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333896448 00000100:00100000:3.0:1734016136.854437:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333896448 00000100:00100000:3.0:1734016136.854564:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11453 00000100:00100000:3.0:1734016136.854572:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333896448:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016136.854592:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016136.854620:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116c0c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6982 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.854651:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116bdb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2473984->2478079) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6951 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.854660:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116be9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e695f expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.854665:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016136.854667:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016136.854671:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116c0c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [2564096->2576383] (req 2564096->2576383) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6982 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.854704:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116be9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e695f expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016136.854715:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116be9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e695f expref: 11 pid: 8216 timeout: 503 lvb_type: 1 00000100:00100000:3.0:1734016136.854725:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335374080:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016136.854823:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116bdb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2473984->2478079) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6951 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.854837:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116bdb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2473984->2478079) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6951 expref: 8 pid: 7682 timeout: 503 lvb_type: 0 00000100:00100000:3.0:1734016136.854845:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075447100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335374208:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016136.854865:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016136.859612:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335374080:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016136.859634:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075447100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335374208:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016136.859680:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116c0c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [2564096->2576383] (req 2564096->2576383) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6982 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.859707:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016136.859778:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247333896448:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5204us (5532us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016136.859787:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11453 00000100:00100000:0.0:1734016136.860555:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016136.860676:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.860959:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333896704 00000100:00100000:2.0:1734016136.860971:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333896704 00010000:00010000:2.0:1734016136.861373:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116bdb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2473984->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6951 expref: 8 pid: 7682 timeout: 503 lvb_type: 0 00000100:00100000:2.0:1734016136.861419:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333896576 00000100:00100000:2.0:1734016136.861422:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333896576 00010000:00010000:2.0:1734016136.861437:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116be9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e695f expref: 12 pid: 8216 timeout: 503 lvb_type: 1 00000100:00100000:2.0:1734016136.861458:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3164 00000100:00100000:2.0:1734016136.861466:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333896704:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016136.861487:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016136.861517:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116bdb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2473984->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6951 expref: 8 pid: 7682 timeout: 503 lvb_type: 0 00010000:00010000:2.0:1734016136.861530:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116bdb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2473984->2478079) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6951 expref: 8 pid: 7682 timeout: 503 lvb_type: 0 00010000:00010000:2.0:1734016136.861561:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27116bdb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2473984->2478079) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6951 expref: 8 pid: 7682 timeout: 503 lvb_type: 0 00010000:00010000:2.0:1734016136.861581:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016136.861637:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333896704:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 171us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016136.861645:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3164 00000100:00100000:2.0:1734016136.861660:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3165 00000100:00100000:2.0:1734016136.861665:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333896576:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016136.861673:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016136.861681:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116be9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e695f expref: 12 pid: 8216 timeout: 503 lvb_type: 1 00010000:00010000:2.0:1734016136.861692:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116be9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e695f expref: 12 pid: 8216 timeout: 503 lvb_type: 1 00010000:00010000:2.0:1734016136.861703:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116be9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e695f expref: 12 pid: 8216 timeout: 503 lvb_type: 1 00010000:00010000:2.0:1734016136.861713:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016136.861715:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016136.861723:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116c0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->2576383) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6982 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016136.861734:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116c0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->2576383) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6982 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016136.861781:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116c0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->2576383) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6982 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016136.861796:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335374336:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016136.861885:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00000100:00100000:0.0:1734016136.867713:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016136.867867:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073793b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335374336:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016136.867918:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016136.867989:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333896576:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6319us (7309us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016136.868007:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3165 00000100:00100000:3.0:1734016136.868452:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333896832 00000100:00100000:3.0:1734016136.868464:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333896832 00000100:00100000:3.0:1734016136.869035:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11454 00000100:00100000:3.0:1734016136.869044:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333896832:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016136.869563:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 3402383 -> 3402383 00002000:00010000:3.0:1734016136.869567:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016137 -> 1734016137 00002000:00010000:3.0:1734016136.869569:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016137 -> 1734016136 00002000:00010000:3.0:1734016136.869572:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016137 -> 1734016136 00002000:00010000:3.0:1734016136.869574:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 64 -> 96 00000100:00100000:3.0:1734016136.869636:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333896832:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 593us (1945us total) trans 4294969514 rc 0/0 00000100:00100000:3.0:1734016136.869643:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11454 00000100:00100000:0.0:1734016136.873368:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016136.873912:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333896960 00000100:00100000:1.0:1734016136.873927:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333896960 00000100:00100000:1.0:1734016136.874002:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11455 00000100:00100000:1.0:1734016136.874012:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333896960:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016136.874042:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016136.874072:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116c13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6989 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016136.874162:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075887b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335374464:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016136.874260:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016136.876284:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075887b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335374464:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016136.876341:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116c13 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6989 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016136.876362:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116c13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6989 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016136.876385:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016136.876462:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333896960:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2449us (3110us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016136.876471:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11455 00000100:00100000:2.0:1734016136.880709:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016136.881328:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333897088 00000100:00100000:1.0:1734016136.881347:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333897088 00000100:00100000:1.0:1734016136.881704:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11456 00000100:00100000:1.0:1734016136.881716:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333897088:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016136.881745:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016136.881776:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc27116c1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6990 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016136.881893:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075887b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335374592:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016136.882272:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016136.885199:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075887b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335374592:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016136.885256:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc27116c1a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6990 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016136.885285:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc27116c1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6990 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016136.885311:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016136.885639:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333897088:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3922us (4947us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016136.885651:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11456 00000100:00100000:2.0:1734016136.896638:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016136.896968:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333897216 00000100:00100000:1.0:1734016136.896980:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333897216 00000100:00100000:1.0:1734016136.897115:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11457 00000100:00100000:1.0:1734016136.897124:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333897216:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016136.897152:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016136.897177:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27116c21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6997 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016136.897247:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075887b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335374720:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016136.897332:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00002000:00010000:1.0:1734016136.900931:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016136 -> 1734016137 00002000:00010000:1.0:1734016136.900941:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016136 -> 1734016137 00000100:00100000:1.0:1734016136.900967:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075887b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335374720:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016136.901013:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27116c21 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6997 expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016136.901029:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27116c21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6997 expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016136.901563:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016136.901677:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333897216:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4550us (5053us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016136.901692:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11457 00000100:00100000:0.0:1734016136.907589:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016136.907770:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333897344 00000100:00100000:1.0:1734016136.907786:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333897344 00000100:00100000:1.0:1734016136.908536:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11458 00000100:00100000:1.0:1734016136.908544:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:10406:x1818247333897344:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016136.908616:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016136.908640:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27116c28 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e699e expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016136.908679:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116c0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->2576383) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6982 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016136.908688:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016136.908690:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016136.908694:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27116c28 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [1961984->1966079] (req 1961984->1966079) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e699e expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016136.908734:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116c0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->2576383) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6982 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016136.908749:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116c0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->2576383) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6982 expref: 7 pid: 7684 timeout: 504 lvb_type: 0 00000100:00100000:1.0:1734016136.908768:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075887b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335374848:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016136.908888:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016136.916202:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075887b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335374848:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016136.916275:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27116c28 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [1961984->1966079] (req 1961984->1966079) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e699e expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016136.916310:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016136.917058:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:10406:x1818247333897344:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8510us (9483us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016136.917071:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11458 00000100:00100000:0.0:1734016136.917183:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.917374:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333897472 00000100:00100000:3.0:1734016136.917385:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333897472 00010000:00010000:3.0:1734016136.917428:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116c0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->2576383) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6982 expref: 8 pid: 7684 timeout: 504 lvb_type: 0 00000100:00100000:3.0:1734016136.917459:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3166 00000100:00100000:3.0:1734016136.917467:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333897472:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016136.917490:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016136.917520:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116c0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2564096->2576383) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6982 expref: 8 pid: 7684 timeout: 504 lvb_type: 0 00010000:00010000:3.0:1734016136.917535:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116c0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2564096->2576383) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6982 expref: 8 pid: 7684 timeout: 504 lvb_type: 0 00010000:00010000:3.0:1734016136.917571:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116c0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2564096->2576383) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6982 expref: 8 pid: 7684 timeout: 504 lvb_type: 0 00010000:00010000:3.0:1734016136.917613:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016136.917616:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016136.917623:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27116c28 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->1966079) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e699e expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.917633:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27116c28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->1966079) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e699e expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016136.917681:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27116c28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->1966079) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e699e expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016136.917694:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075447100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335374976:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016136.917749:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016136.926718:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075447100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335374976:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016136.926771:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016136.926927:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333897472:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9458us (9743us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016136.926942:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3166 00000100:00100000:0.0:1734016136.933041:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016136.933458:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333897728 00000100:00100000:3.0:1734016136.933478:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333897728 00002000:00100000:3.0:1734016136.933569:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (0->3403775) req@ffff880075874380 x1818247333897728/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:97/0 lens 488/0 e 0 to 0 dl 1734016147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016136.933583:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075874380 with x1818247333897728 ext(0->3403775) 00002000:00010000:3.0:1734016136.933591:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075874380 00000100:00100000:3.0:1734016136.934250:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8894 00000100:00100000:3.0:1734016136.934261:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333897728:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016136.990414:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333897728:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 56135us (57377us total) trans 0 rc 3403776/3403776 00000100:00100000:3.0:1734016136.990433:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8894 00002000:00100000:3.0:1734016136.990450:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (0->3403775) req@ffff880075874380 x1818247333897728/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:97/0 lens 488/440 e 0 to 0 dl 1734016147 ref 1 fl Complete:/200/0 rc 3403776/3403776 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016136.990470:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075874380 with x1818247333897728 ext(0->3403775) 00002000:00010000:3.0:1734016136.990478:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075874380 00000100:00100000:0.0:1734016137.002537:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016137.002686:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333897856 00000100:00100000:1.0:1734016137.002699:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333897856 00000100:00100000:1.0:1734016137.002778:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11459 00000100:00100000:1.0:1734016137.002791:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333897856:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016137.002955:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016137.002989:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27116c2f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e69a5 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016137.003047:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016137.003052:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016137.003064:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27116c2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->2281471) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69a5 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016137.003089:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27116c2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->2281471) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69a5 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016137.003113:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016137.003201:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247333897856:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 412us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016137.003210:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11459 00000100:00100000:0.0:1734016137.006529:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.006739:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333898112 00000100:00100000:3.0:1734016137.006755:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333898112 00002000:00100000:3.0:1734016137.006871:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (2277376->2281471) req@ffff880075877b80 x1818247333898112/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:98/0 lens 488/0 e 0 to 0 dl 1734016148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016137.006884:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075877b80 with x1818247333898112 ext(2277376->2281471) 00002000:00010000:3.0:1734016137.006892:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075877b80 00000100:00100000:3.0:1734016137.006928:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8895 00000100:00100000:3.0:1734016137.006938:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333898112:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016137.007188:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333898112:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 250us (684us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016137.007196:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8895 00002000:00100000:3.0:1734016137.007203:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (2277376->2281471) req@ffff880075877b80 x1818247333898112/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:98/0 lens 488/4536 e 0 to 0 dl 1734016148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016137.007211:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075877b80 with x1818247333898112 ext(2277376->2281471) 00002000:00010000:3.0:1734016137.007216:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075877b80 00000100:00100000:0.0:1734016137.010009:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.010173:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333898240 00000100:00100000:3.0:1734016137.010187:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333898240 00000100:00100000:3.0:1734016137.010248:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11460 00000100:00100000:3.0:1734016137.010259:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333898240:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016137.010289:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016137.010314:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116c36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e69ac expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016137.010394:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075447100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335375104:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016137.010485:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016137.019151:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075447100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335375104:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016137.019212:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116c36 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69ac expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016137.019230:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116c36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69ac expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016137.019259:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016137.019335:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333898240:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9074us (9335us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016137.019347:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11460 00000100:00100000:0.0:1734016137.021303:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.021447:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333898368 00000100:00100000:2.0:1734016137.021460:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333898368 00000100:00100000:2.0:1734016137.021540:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11461 00000100:00100000:2.0:1734016137.021553:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333898368:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016137.021586:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016137.021628:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116c3d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e69b3 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016137.021741:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335375232:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016137.022038:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00000100:00100000:2.0:1734016137.024176:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335375232:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016137.024225:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116c3d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69b3 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.024240:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116c3d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69b3 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.024259:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016137.025086:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333898368:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3530us (3799us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016137.025097:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11461 00000100:00100000:0.0:1734016137.030724:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.030896:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333898496 00000100:00100000:2.0:1734016137.030910:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333898496 00000100:00100000:2.0:1734016137.031082:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11462 00000100:00100000:2.0:1734016137.031093:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333898496:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016137.031124:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016137.031150:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116c44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e69ba expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016137.031241:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335375360:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016137.032268:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00000100:00100000:2.0:1734016137.038558:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335375360:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016137.038627:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116c44 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69ba expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.038654:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116c44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69ba expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.038673:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016137.038752:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333898496:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7659us (8040us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016137.038764:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11462 00000100:00100000:0.0:1734016137.041285:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.041576:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333898624 00000100:00100000:2.0:1734016137.041591:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333898624 00000100:00100000:2.0:1734016137.042967:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11463 00000100:00100000:2.0:1734016137.042979:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333898624:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016137.043009:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016137.043047:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116c4b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e69c1 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016137.043135:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335375488:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016137.043262:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00000100:00100000:2.0:1734016137.047766:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335375488:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016137.048029:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116c4b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69c1 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.048055:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116c4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69c1 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.048099:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016137.048199:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333898624:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5221us (6934us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016137.048212:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11463 00000100:00100000:0.0:1734016137.055534:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.055978:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333898880 00000100:00100000:3.0:1734016137.055996:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333898880 00000100:00100000:3.0:1734016137.056093:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2333 00000100:00100000:3.0:1734016137.056104:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+18:10406:x1818247333898880:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016137.056217:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016137.056274:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116b10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e688d expref: 18 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016137.056314:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016137.056322:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016137.056586:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116c52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016137.056617:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116b3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68b0 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016137.056625:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116c52 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016137.056671:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116b3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68b0 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016137.056686:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116b3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68b0 expref: 15 pid: 6479 timeout: 504 lvb_type: 0 00000100:00100000:3.0:1734016137.056700:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075447100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335375616:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016137.056798:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016137.062296:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016137.062375:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333899008 00000100:00100000:0.0:1734016137.062392:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333899008 00010000:00010000:0.0:1734016137.062481:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116b3a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68b0 expref: 16 pid: 6479 timeout: 504 lvb_type: 0 00000100:00100000:0.0:1734016137.062554:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3167 00000100:00100000:0.0:1734016137.062566:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1981:x1818247333899008:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016137.062596:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016137.062615:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116b3a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68b0 expref: 16 pid: 6479 timeout: 504 lvb_type: 0 00010000:00010000:0.0:1734016137.062638:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116b3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68b0 expref: 16 pid: 6479 timeout: 504 lvb_type: 0 00010000:00010000:0.0:1734016137.062685:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:0.0:1734016137.062694:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116c52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016137.062713:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116c52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016137.062723:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116c52 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016137.062755:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016137.062864:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1981:x1818247333899008:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 299us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016137.062873:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3167 00010000:00010000:2.0:1734016137.066955:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116b3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e68b0 expref: 15 pid: 6479 timeout: 504 lvb_type: 0 00000100:00100000:2.0:1734016137.067002:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075447100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335375616:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016137.067044:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116c52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016137.067056:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116c52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016137.067062:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116c52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:2.0:1734016137.067207:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968817 00000004:00010000:2.0:1734016137.067269:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012db0b480 reply state ffff88012e3b6000 transno 4294968818 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116c52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:2.0:1734016137.067278:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016137.067418:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+20:10406:x1818247333898880:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 11314us (11904us total) trans 4294968818 rc 0/0 00000100:00100000:2.0:1734016137.067429:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2333 00000020:00080000:2.0:1734016137.067436:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016137.070183:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116c52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016137.070210:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116c52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016137.070217:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116c52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016137.070222:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df5440 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016137.070226:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116c52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016137.070233:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116c52 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016137.070258:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016137.070261:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016137.070265:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116c52 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016137.070271:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27116c52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016137.071309:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.071720:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333899136 00000100:00100000:2.0:1734016137.071730:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333899136 00000100:00100000:2.0:1734016137.071949:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11464 00000100:00100000:2.0:1734016137.071957:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:10406:x1818247333899136:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016137.071983:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016137.072009:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116c59 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e69c8 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.072044:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27116c28 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1961984->1966079) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e699e expref: 13 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.072059:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27116c2f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2277376->2281471) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69a5 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.072065:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016137.072067:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016137.072070:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116c59 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69c8 expref: 13 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.072116:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27116c2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2277376->2281471) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69a5 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.072130:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27116c2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2277376->2281471) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69a5 expref: 7 pid: 7682 timeout: 504 lvb_type: 0 00000100:00100000:2.0:1734016137.072144:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335375744:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016137.072243:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27116c28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1961984->1966079) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e699e expref: 13 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.072251:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27116c28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1961984->1966079) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e699e expref: 13 pid: 7682 timeout: 504 lvb_type: 0 00000100:00100000:2.0:1734016137.072260:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335375872:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016137.072279:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016137.086777:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016137.086950:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333899264 00000100:00100000:1.0:1734016137.086963:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333899264 00010000:00010000:1.0:1734016137.087018:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27116c2f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2277376->2281471) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69a5 expref: 8 pid: 7682 timeout: 504 lvb_type: 0 00000100:00100000:1.0:1734016137.087065:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3168 00000100:00100000:1.0:1734016137.087074:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333899264:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016137.087096:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016137.087133:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27116c2f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2277376->2281471) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69a5 expref: 8 pid: 7682 timeout: 504 lvb_type: 0 00010000:00010000:1.0:1734016137.087150:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27116c2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2277376->2281471) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69a5 expref: 8 pid: 7682 timeout: 504 lvb_type: 0 00010000:00010000:1.0:1734016137.087199:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016137.087281:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333899264:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 207us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016137.087293:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3168 00010000:00010000:2.0:1734016137.087428:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27116c2f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2277376->2281471) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69a5 expref: 7 pid: 7682 timeout: 504 lvb_type: 0 00000100:00100000:0.0:1734016137.089895:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016137.093984:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333899392 00000100:00100000:1.0:1734016137.094009:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333899392 00010000:00010000:1.0:1734016137.094076:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27116c28 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e699e expref: 14 pid: 7682 timeout: 504 lvb_type: 0 00000100:00100000:1.0:1734016137.094155:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3169 00000100:00100000:1.0:1734016137.094167:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:1983:x1818247333899392:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016137.094200:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016137.094232:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27116c28 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1961984->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e699e expref: 14 pid: 7682 timeout: 504 lvb_type: 0 00010000:00010000:1.0:1734016137.094250:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27116c28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1961984->1966079) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e699e expref: 14 pid: 7682 timeout: 504 lvb_type: 0 00010000:00010000:1.0:1734016137.094294:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016137.094298:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016137.094307:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116c59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69c8 expref: 14 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016137.094319:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116c59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69c8 expref: 14 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016137.094375:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116c59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69c8 expref: 14 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016137.094393:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075887b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335376000:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016137.094503:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016137.098398:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335375744:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016137.098461:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc27116c28 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1961984->1966079) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e699e expref: 14 pid: 7682 timeout: 504 lvb_type: 0 00000100:00100000:2.0:1734016137.098486:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b4b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335375872:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016137.098546:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116c59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69c8 expref: 13 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.098569:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016137.098673:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:10406:x1818247333899136:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 26714us (27370us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016137.098687:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11464 00000100:00100000:1.0:1734016137.104141:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016137.104209:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016137.107573:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075887b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335376000:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016137.107623:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016137.107715:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333899392:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 13548us (17831us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016137.107733:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3169 00000100:00100000:2.0:1734016137.108411:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333899648 00000100:00100000:2.0:1734016137.108426:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333899648 00002000:00010000:2.0:1734016137.108475:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:2.0:1734016137.108480:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075884e00 with x1818247333899648 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1734016137.108497:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075884e00. 00000100:00100000:2.0:1734016137.108532:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8896 00000100:00100000:2.0:1734016137.108539:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333899648:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016137.108827:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 3402383 -> 4194304 00002000:00010000:2.0:1734016137.108831:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016137 -> 1734016137 00002000:00010000:2.0:1734016137.108833:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016137 -> 1734016136 00002000:00010000:2.0:1734016137.108836:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016137 -> 1734016137 00002000:00010000:2.0:1734016137.108838:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 96 -> 96 00000100:00100000:2.0:1734016137.108878:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333899648:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 339us (4762us total) trans 4294969515 rc 0/0 00000100:00100000:2.0:1734016137.108884:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8896 00002000:00010000:2.0:1734016137.108888:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:2.0:1734016137.108890:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075884e00 with x1818247333899648 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1734016137.108894:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075884e00. 00000100:00100000:2.0:1734016137.108907:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333899520 00000100:00100000:2.0:1734016137.108911:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333899520 00002000:00010000:2.0:1734016137.108926:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (6033451->18446744073709551615) 00002000:00100000:2.0:1734016137.108929:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075886300 with x1818247333899520 ext(6033451->18446744073709551615) 00002000:00010000:2.0:1734016137.108937:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075886300. 00000100:00100000:2.0:1734016137.108948:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8897 00000100:00100000:2.0:1734016137.108951:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333899520:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016137.109130:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 6033451 00002000:00010000:2.0:1734016137.109132:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016137 -> 1734016137 00002000:00010000:2.0:1734016137.109134:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016137 -> 1734016137 00002000:00010000:2.0:1734016137.109136:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016137 -> 1734016137 00002000:00010000:2.0:1734016137.109138:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 72 -> 72 00000100:00100000:2.0:1734016137.109156:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333899520:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 203us (4946us total) trans 4294968043 rc 0/0 00000100:00100000:2.0:1734016137.109161:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8897 00002000:00010000:2.0:1734016137.109163:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (6033451->18446744073709551615) 00002000:00100000:2.0:1734016137.109166:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075886300 with x1818247333899520 ext(6033451->18446744073709551615) 00002000:00010000:2.0:1734016137.109169:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075886300. 00000100:00100000:1.0:1734016137.113921:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.114076:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333899776 00000100:00100000:2.0:1734016137.114095:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333899776 00000100:00100000:2.0:1734016137.114175:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2334 00000100:00100000:2.0:1734016137.114189:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+19:10406:x1818247333899776:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016137.114246:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016137.114290:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116c60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e69cf expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.114507:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116c67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016137.114532:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116c67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016137.114552:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116c67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:2.0:1734016137.114610:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 10227755 00000004:00200000:2.0:1734016137.114616:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016137.114647:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116c67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016137.114675:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116c60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69cf expref: 21 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.114697:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116c67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69cf expref: 20 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.114709:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016137.114713:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016137.114718:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016137.115226:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+20:10406:x1818247333899776:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1039us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016137.115235:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2334 00000100:00100000:0.0:1734016137.120211:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.120347:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333899904 00000100:00100000:2.0:1734016137.120358:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333899904 00000100:00100000:2.0:1734016137.120967:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11465 00000100:00100000:2.0:1734016137.120978:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333899904:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016137.121018:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016137.121051:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116c6e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e69d6 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016137.121153:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335376128:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016137.124508:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00000100:00100000:0.0:1734016137.129255:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.129652:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b4b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335376128:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016137.129709:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116c6e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69d6 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016137.129733:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116c6e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69d6 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016137.129773:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:3.0:1734016137.129904:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333899904:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8925us (9706us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016137.129918:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11465 00000100:00100000:3.0:1734016137.129969:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333900032 00000100:00100000:3.0:1734016137.129983:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333900032 00000100:00100000:3.0:1734016137.130035:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11466 00000100:00100000:3.0:1734016137.130046:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333900032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016137.130080:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016137.130113:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c75 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e69dd expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016137.130212:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335376256:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016137.130277:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00002000:00010000:3.0:1734016137.137855:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016136 -> 1734016137 00000100:00100000:3.0:1734016137.137923:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335376256:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016137.138003:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c75 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69dd expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016137.138029:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c75 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69dd expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016137.138208:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016137.138860:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333900032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8812us (9621us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016137.138877:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11466 00000100:00100000:0.0:1734016137.140906:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.141218:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333900160 00000100:00100000:3.0:1734016137.141233:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333900160 00000100:00100000:3.0:1734016137.141436:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11467 00000100:00100000:3.0:1734016137.141448:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333900160:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016137.141484:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016137.141520:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c7c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e69e4 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016137.141573:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116c59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69c8 expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016137.141584:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016137.141587:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016137.141592:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c7c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69e4 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016137.141649:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116c59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69c8 expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016137.141667:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116c59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69c8 expref: 12 pid: 7684 timeout: 504 lvb_type: 0 00000100:00100000:3.0:1734016137.141683:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335376384:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016137.147584:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016137.152982:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016137.153075:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333900288 00000100:00100000:1.0:1734016137.153099:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333900288 00010000:00010000:1.0:1734016137.153171:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116c59 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69c8 expref: 13 pid: 7684 timeout: 504 lvb_type: 0 00000100:00100000:1.0:1734016137.153227:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3170 00000100:00100000:1.0:1734016137.153236:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333900288:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016137.153262:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016137.153305:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116c59 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69c8 expref: 13 pid: 7684 timeout: 504 lvb_type: 0 00010000:00010000:1.0:1734016137.153322:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116c59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69c8 expref: 13 pid: 7684 timeout: 504 lvb_type: 0 00010000:00010000:1.0:1734016137.153359:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016137.153362:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016137.153374:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 757760->761855) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69e4 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016137.153386:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 757760->761855) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69e4 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016137.153429:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 757760->761855) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69e4 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016137.153442:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075887800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335376512:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016137.153511:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7900 going to sleep for 11 seconds 00010000:00010000:3.0:1734016137.153607:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116c59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69c8 expref: 13 pid: 7684 timeout: 504 lvb_type: 0 00000100:00100000:3.0:1734016137.153632:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335376384:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016137.153664:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->761855) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69e4 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016137.153672:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016137.153707:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247333900160:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12260us (12819us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016137.153717:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11467 00000100:00100000:0.0:1734016137.159916:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016137.159979:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333900544 00000100:00100000:0.0:1734016137.159995:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333900544 00002000:00100000:0.0:1734016137.160077:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (757760->761855) req@ffff880073946300 x1818247333900544/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:98/0 lens 488/0 e 0 to 0 dl 1734016148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016137.160096:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073946300 with x1818247333900544 ext(757760->761855) 00002000:00010000:0.0:1734016137.160104:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073946300 00000100:00100000:0.0:1734016137.160154:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8898 00000100:00100000:0.0:1734016137.160163:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333900544:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016137.160432:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333900544:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 267us (534us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016137.160442:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8898 00002000:00100000:0.0:1734016137.160449:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (757760->761855) req@ffff880073946300 x1818247333900544/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:98/0 lens 488/4536 e 0 to 0 dl 1734016148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016137.160457:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073946300 with x1818247333900544 ext(757760->761855) 00002000:00010000:0.0:1734016137.160461:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073946300 00000100:00100000:2.0:1734016137.162662:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075887800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335376512:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016137.162697:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016137.162787:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333900288:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9549us (9827us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016137.162838:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3170 00000100:00100000:0.0:1734016137.167693:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.167919:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333900800 00000100:00100000:3.0:1734016137.167934:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333900800 00002000:00100000:3.0:1734016137.168009:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (761856->765951) req@ffff880073946680 x1818247333900800/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:98/0 lens 488/0 e 0 to 0 dl 1734016148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016137.168022:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073946680 with x1818247333900800 ext(761856->765951) 00002000:00010000:3.0:1734016137.168030:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073946680 00000100:00100000:3.0:1734016137.168073:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8899 00000100:00100000:3.0:1734016137.168084:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333900800:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016137.172871:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333900800:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 4749us (5160us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016137.172898:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8899 00002000:00100000:3.0:1734016137.172928:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (761856->765951) req@ffff880073946680 x1818247333900800/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:98/0 lens 488/4536 e 0 to 0 dl 1734016148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016137.172941:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073946680 with x1818247333900800 ext(761856->765951) 00002000:00010000:3.0:1734016137.172949:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073946680 00000100:00100000:3.0:1734016137.178557:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67a75f73-9674-4938-8c12-63813a36f078:3506:1818247335376640:0@lo:400:kworker.0 00000100:00100000:3.0:1734016137.178747:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016137.178892:0:6474:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335376640 00000100:00100000:0.0:1734016137.178911:0:6474:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335376640 00000100:00100000:0.0:1734016137.179049:0:6474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1734016137.179063:0:6474:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7610050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a75f73-9674-4938-8c12-63813a36f078+18:3506:x1818247335376640:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1734016137.179212:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016107 00000100:00100000:0.0:1734016137.179585:0:6474:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7610050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a75f73-9674-4938-8c12-63813a36f078+18:3506:x1818247335376640:12345-0@lo:400:kworker.0 Request processed in 525us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016137.179606:0:6474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1734016137.179694:0:3505:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335377024:0@lo:400:kworker.0 00000100:00100000:0.0:1734016137.179745:0:3505:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016137.179784:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3503:1818247335376768:0@lo:400:kworker.0 00000100:00100000:0.0:1734016137.179852:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016137.179871:0:3503:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1734016137.179876:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3503:1818247335376896:0@lo:400:kworker.0 00000100:00100000:0.0:1734016137.179899:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016137.179962:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335377024 00000100:00100000:0.0:1734016137.179967:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335377024 00000100:00100000:0.0:1734016137.180011:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1734016137.180016:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335377024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1734016137.180067:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335377024:12345-0@lo:400:kworker.0 Request processed in 50us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016137.180074:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1734016137.180113:0:3505:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335377024:0@lo:400:kworker.0 00000100:00080000:0.0:1734016137.180151:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016107 00000100:00100000:0.0:1734016137.180186:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335376768 00000100:00100000:0.0:1734016137.180189:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335376768 00000100:00100000:0.0:1734016137.180215:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335376896 00000100:00100000:0.0:1734016137.180217:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335376896 00000100:00100000:0.0:1734016137.180239:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1734016137.180246:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3503:x1818247335376768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1734016137.180290:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3503:x1818247335376768:12345-0@lo:400:kworker.0 Request processed in 45us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016137.180295:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1734016137.180303:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1734016137.180306:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3503:x1818247335376896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1734016137.180333:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3503:x1818247335376896:12345-0@lo:400:kworker.0 Request processed in 24us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016137.180340:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1734016137.180366:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3503:1818247335376896:0@lo:400:kworker.0 00000100:00100000:0.0:1734016137.180376:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3503:1818247335376768:0@lo:400:kworker.0 00000100:00080000:0.0:1734016137.180391:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016107 00000100:00100000:3.0:1734016137.180610:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67a75f73-9674-4938-8c12-63813a36f078:3506:1818247335376640:0@lo:400:kworker.0 00000100:00100000:3.0:1734016137.181287:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3506:1818247335377152:0@lo:400:kworker.0 00000100:00100000:3.0:1734016137.181332:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016137.181413:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335377280:0@lo:400:kworker.0 00000100:00100000:1.0:1734016137.181473:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016137.181932:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335377280 00000100:00100000:0.0:1734016137.181939:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335377280 00000100:00080000:0.0:1734016137.181960:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016107 00000100:00100000:0.0:1734016137.182001:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1734016137.182006:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335377280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016137.182737:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335377152 00000100:00100000:1.0:1734016137.182744:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335377152 00000100:00100000:1.0:1734016137.182793:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1734016137.182820:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3506:x1818247335377152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016137.182878:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3506:x1818247335377152:12345-0@lo:400:kworker.0 Request processed in 79us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016137.182886:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1734016137.182997:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3506:1818247335377152:0@lo:400:kworker.0 00000100:00080000:2.0:1734016137.183055:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016107 00000100:00100000:1.0:1734016137.184239:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335377280:0@lo:400:kworker.0 00000100:00100000:0.0:1734016137.184419:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335377280:12345-0@lo:400:kworker.0 Request processed in 2408us (2945us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016137.184430:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1734016137.189502:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.192941:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333900928 00000100:00100000:3.0:1734016137.192977:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333900928 00002000:00100000:3.0:1734016137.193093:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (757760->765951) req@ffff880073944e00 x1818247333900928/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:98/0 lens 8680/0 e 0 to 0 dl 1734016148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016137.193107:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073944e00 with x1818247333900928 ext(757760->765951) 00002000:00010000:3.0:1734016137.193113:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073944e00 00000100:00100000:3.0:1734016137.193166:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8900 00000100:00100000:3.0:1734016137.193177:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333900928:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016137.200044:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333900928:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 6851us (10544us total) trans 4294969516 rc 0/0 00000100:00100000:3.0:1734016137.200062:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8900 00002000:00100000:3.0:1734016137.200082:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (757760->765951) req@ffff880073944e00 x1818247333900928/t4294969516(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:98/0 lens 8680/448 e 0 to 0 dl 1734016148 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016137.200093:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073944e00 with x1818247333900928 ext(757760->765951) 00002000:00010000:3.0:1734016137.200102:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073944e00 00000100:00100000:0.0:1734016137.205008:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.205204:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333901056 00000100:00100000:2.0:1734016137.205234:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333901056 00000100:00100000:2.0:1734016137.205339:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11468 00000100:00100000:2.0:1734016137.205354:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333901056:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016137.214568:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969516 is committed 00000001:00080000:0.0:1734016137.214619:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969515 is committed 00000100:00100000:2.0:1734016137.215149:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333901056:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 9786us (10168us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016137.215167:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11468 00000100:00100000:0.0:1734016137.219037:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.219452:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333901184 00000100:00100000:2.0:1734016137.219472:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333901184 00000100:00100000:2.0:1734016137.220655:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11469 00000100:00100000:2.0:1734016137.220673:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333901184:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016137.220712:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016137.220758:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116c83 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e69eb expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016137.220868:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335377408:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016137.229983:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00002000:00010000:3.0:1734016137.230239:0:7683:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 96 -> 112 00000100:00100000:3.0:1734016137.230301:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335377408:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016137.230376:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116c83 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69eb expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016137.230404:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116c83 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69eb expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016137.230426:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:3.0:1734016137.230527:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333901184:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9854us (11505us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016137.230546:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11469 00000100:00100000:0.0:1734016137.233657:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.233795:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333901312 00000100:00100000:3.0:1734016137.233854:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333901312 00000100:00100000:3.0:1734016137.234550:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11470 00000100:00100000:3.0:1734016137.234560:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333901312:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016137.234607:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016137.234640:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27116c8a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e69f2 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016137.234737:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335377536:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016137.235270:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016137.245172:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335377536:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016137.245256:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27116c8a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69f2 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.245278:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27116c8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69f2 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.245321:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:2.0:1734016137.245423:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333901312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10861us (11779us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016137.245438:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11470 00000100:00100000:3.0:1734016137.251174:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335377664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1734016137.251330:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1734016137.251435:0:7685:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335377664 00000100:00100000:3.0:1734016137.251450:0:7685:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335377664 00000100:00100000:3.0:1734016137.251534:0:7685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1734016137.251544:0:7685:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335377664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1734016137.251607:0:7685:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 980042304 pending 0 free 3923025920 avail 3691442176 00000100:00100000:3.0:1734016137.251658:0:7685:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335377664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016137.251667:0:7685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1734016137.251740:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335377664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1734016137.252952:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.255282:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333901568 00000100:00100000:3.0:1734016137.255309:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333901568 00002000:00100000:3.0:1734016137.255391:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (1236992->5648383) req@ffff8800849b6d80 x1818247333901568/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:98/0 lens 504/0 e 0 to 0 dl 1734016148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016137.255402:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b6d80 with x1818247333901568 ext(1236992->5648383) 00002000:00010000:3.0:1734016137.255410:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800849b6d80 00000100:00100000:3.0:1734016137.255480:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8901 00000100:00100000:3.0:1734016137.255493:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333901568:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016137.261428:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333901568:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 5910us (8462us total) trans 0 rc 12288/12288 00000100:00100000:3.0:1734016137.261449:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8901 00002000:00100000:3.0:1734016137.261473:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (1236992->5648383) req@ffff8800849b6d80 x1818247333901568/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:98/0 lens 504/440 e 0 to 0 dl 1734016148 ref 1 fl Complete:/200/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016137.261487:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b6d80 with x1818247333901568 ext(1236992->5648383) 00002000:00010000:3.0:1734016137.261497:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800849b6d80 00000100:00100000:0.0:1734016137.264099:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.264270:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333901824 00000100:00100000:3.0:1734016137.264284:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333901824 00002000:00100000:3.0:1734016137.265408:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (5648384->5652479) req@ffff88007345f100 x1818247333901824/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:98/0 lens 488/0 e 0 to 0 dl 1734016148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016137.265426:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345f100 with x1818247333901824 ext(5648384->5652479) 00002000:00010000:3.0:1734016137.265434:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007345f100 00000100:00100000:3.0:1734016137.265483:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8902 00000100:00100000:3.0:1734016137.265493:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333901824:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016137.265839:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333901824:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 346us (1764us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016137.265849:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8902 00002000:00100000:3.0:1734016137.265858:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (5648384->5652479) req@ffff88007345f100 x1818247333901824/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:98/0 lens 488/4536 e 0 to 0 dl 1734016148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016137.265866:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345f100 with x1818247333901824 ext(5648384->5652479) 00002000:00010000:3.0:1734016137.265869:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007345f100 00000100:00100000:2.0:1734016137.273254:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016137.273365:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333901952 00000100:00100000:0.0:1734016137.273381:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333901952 00000100:00100000:0.0:1734016137.273457:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11471 00000100:00100000:0.0:1734016137.273468:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333901952:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016137.273505:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016137.273533:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27116c91 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e69f9 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016137.273622:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335377792:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016137.273716:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:2.0:1734016137.275469:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335377792:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016137.275521:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27116c91 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69f9 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.275547:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27116c91 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69f9 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.275647:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:2.0:1734016137.275959:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333901952:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2490us (2721us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016137.275972:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11471 00000100:00100000:0.0:1734016137.285139:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.285281:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333902080 00000100:00100000:2.0:1734016137.285295:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333902080 00000100:00100000:2.0:1734016137.285379:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11472 00000100:00100000:2.0:1734016137.285389:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333902080:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016137.285421:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016137.285451:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116c98 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a00 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016137.285537:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335377920:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016137.285637:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016137.288076:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335377920:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016137.288137:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116c98 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a00 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.288159:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116c98 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a00 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.288203:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016137.288270:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333902080:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2881us (3152us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016137.288282:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11472 00000100:00100000:0.0:1734016137.294251:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.294473:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333902208 00000100:00100000:2.0:1734016137.294496:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333902208 00000100:00100000:2.0:1734016137.295019:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11473 00000100:00100000:2.0:1734016137.295034:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:10406:x1818247333902208:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016137.295073:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016137.295118:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116c9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a07 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.295182:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116bfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->3702783) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6974 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.295194:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016137.295197:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016137.295203:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116c9f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1163264->1175551] (req 1163264->1175551) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a07 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.295263:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116bfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->3702783) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6974 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.295284:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116bfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->3702783) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6974 expref: 8 pid: 7684 timeout: 504 lvb_type: 0 00000100:00100000:2.0:1734016137.295307:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335378048:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016137.297360:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016137.319718:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.319897:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335378048:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016137.319951:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116c9f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1163264->1175551] (req 1163264->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a07 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.319974:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016137.320038:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333902208:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 25006us (25820us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016137.320049:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11473 00000100:00100000:3.0:1734016137.320149:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333902336 00000100:00100000:3.0:1734016137.320158:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333902336 00010000:00010000:3.0:1734016137.320193:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116bfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6974 expref: 9 pid: 7684 timeout: 504 lvb_type: 0 00000100:00100000:3.0:1734016137.322524:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3171 00000100:00100000:3.0:1734016137.322549:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333902336:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016137.322588:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016137.322642:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116bfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3698688->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6974 expref: 9 pid: 7684 timeout: 504 lvb_type: 0 00010000:00010000:3.0:1734016137.322665:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116bfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3698688->3702783) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6974 expref: 9 pid: 7684 timeout: 504 lvb_type: 0 00010000:00010000:3.0:1734016137.322713:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27116bfe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3698688->3702783) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6974 expref: 9 pid: 7684 timeout: 504 lvb_type: 0 00010000:00010000:3.0:1734016137.322766:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016137.322769:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016137.322781:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116c9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1175551) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a07 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016137.322794:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116c9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1175551) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a07 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016137.322873:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116c9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a07 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016137.322888:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075445180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335378176:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016137.323007:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016137.335679:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075445180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335378176:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016137.335732:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016137.335850:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333902336:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 13302us (16141us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016137.335869:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3171 00000100:00100000:0.0:1734016137.347096:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.347443:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333902592 00000100:00100000:2.0:1734016137.347459:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333902592 00002000:00100000:2.0:1734016137.347536:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff88008719fb80 x1818247333902592/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:98/0 lens 488/0 e 0 to 0 dl 1734016148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016137.347549:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719fb80 with x1818247333902592 ext(0->4194303) 00002000:00010000:2.0:1734016137.347556:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008719fb80 00000100:00100000:2.0:1734016137.347621:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8903 00000100:00100000:2.0:1734016137.347631:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333902592:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016137.427121:0:3506:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1734016137.427159:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335378304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1734016137.427277:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016137.427419:0:7686:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335378304 00000100:00100000:1.0:1734016137.427435:0:7686:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335378304 00000100:00100000:1.0:1734016137.427506:0:7686:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1734016137.427519:0:7686:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335378304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1734016137.427575:0:7686:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 28672 granted 544842304 pending 0 free 3923611648 avail 3692027904 00000100:00100000:1.0:1734016137.427661:0:7686:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335378304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016137.427670:0:7686:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1734016137.427854:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335378304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1734016137.434073:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333902592:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 86400us (86949us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1734016137.434104:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8903 00002000:00100000:0.0:1734016137.434134:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff88008719fb80 x1818247333902592/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:98/0 lens 488/440 e 0 to 0 dl 1734016148 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016137.434148:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719fb80 with x1818247333902592 ext(0->4194303) 00002000:00010000:0.0:1734016137.434156:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008719fb80 00000100:00100000:0.0:1734016137.453462:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.453622:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333902848 00000100:00100000:2.0:1734016137.453636:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333902848 00002000:00100000:2.0:1734016137.453696:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (0->4194303) req@ffff88008719ea00 x1818247333902848/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:98/0 lens 504/0 e 0 to 0 dl 1734016148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016137.453713:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719ea00 with x1818247333902848 ext(0->4194303) 00002000:00010000:2.0:1734016137.453720:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719ea00 00000100:00100000:2.0:1734016137.453766:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8904 00000100:00100000:2.0:1734016137.453774:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333902848:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016137.465794:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016137.481963:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016137.482145:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333903232 00000100:00100000:1.0:1734016137.482167:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333903232 00000100:00100000:1.0:1734016137.482272:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2335 00000100:00100000:1.0:1734016137.482285:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10406:x1818247333903232:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016137.482328:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016137.482358:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27116ca6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a0e expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016137.482506:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27116cad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016137.482529:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27116cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016137.482544:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27116cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:1.0:1734016137.482580:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 10227755 00000004:00200000:1.0:1734016137.482585:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016137.482625:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27116cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016137.482656:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27116ca6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a0e expref: 17 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016137.482688:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27116cad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a0e expref: 16 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016137.482702:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016137.482705:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016137.482709:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016137.482791:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333903232:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 507us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016137.482841:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2335 00000100:00100000:1.0:1734016137.483069:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333903104 00000100:00100000:1.0:1734016137.483075:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333903104 00002000:00100000:1.0:1734016137.483107:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (4194304->6037503) req@ffff88008719d180 x1818247333903104/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:98/0 lens 488/0 e 0 to 0 dl 1734016148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016137.483119:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719d180 with x1818247333903104 ext(4194304->6037503) 00002000:00010000:1.0:1734016137.483124:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008719d180 00000100:00100000:1.0:1734016137.483147:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8905 00000100:00100000:1.0:1734016137.483152:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333903104:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016137.556359:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333902848:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 102560us (102887us total) trans 0 rc 4186112/4186112 00000100:00100000:3.0:1734016137.556381:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8904 00002000:00100000:3.0:1734016137.556406:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (0->4194303) req@ffff88008719ea00 x1818247333902848/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:98/0 lens 504/440 e 0 to 0 dl 1734016148 ref 1 fl Complete:/200/0 rc 4186112/4186112 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016137.556420:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719ea00 with x1818247333902848 ext(0->4194303) 00002000:00010000:3.0:1734016137.556428:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719ea00 00000100:00100000:2.0:1734016137.569945:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333903104:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 86766us (104144us total) trans 0 rc 1843200/1843200 00000100:00100000:2.0:1734016137.569969:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8905 00002000:00100000:2.0:1734016137.569993:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (4194304->6037503) req@ffff88008719d180 x1818247333903104/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:98/0 lens 488/440 e 0 to 0 dl 1734016148 ref 1 fl Complete:/200/0 rc 1843200/1843200 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016137.570007:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719d180 with x1818247333903104 ext(4194304->6037503) 00002000:00010000:2.0:1734016137.570019:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008719d180 00000100:00100000:0.0:1734016137.573729:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.576314:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333903360 00000100:00100000:2.0:1734016137.576339:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333903360 00000100:00100000:1.0:1734016137.576834:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.577463:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333903488 00000100:00100000:2.0:1734016137.577469:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333903488 00000100:00100000:2.0:1734016137.577521:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11474 00000100:00100000:2.0:1734016137.577532:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333903360:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016137.577564:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016137.577599:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116cb4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a15 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.577629:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016137.577632:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016137.577641:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116cb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a15 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.577664:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116cb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a15 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.577678:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016137.577761:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333903360:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 230us (4063us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016137.577769:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11474 00000100:00100000:2.0:1734016137.577794:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11475 00000100:00100000:2.0:1734016137.577797:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333903488:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016137.577828:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016137.577840:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116cbb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a1c expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016137.577902:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335378432:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016137.577962:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00002000:00010000:2.0:1734016137.582088:0:8216:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016137 -> 1734016138 00002000:00010000:2.0:1734016137.582104:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016137 -> 1734016138 00002000:00010000:2.0:1734016137.582107:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016137 -> 1734016138 00000100:00100000:2.0:1734016137.582142:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335378432:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016137.582198:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116cbb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a1c expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.582219:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116cbb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a1c expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.583548:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016137.584686:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333903488:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6870us (7869us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016137.584702:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11475 00000100:00100000:0.0:1734016137.589055:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.589284:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333903616 00000100:00100000:2.0:1734016137.589302:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333903616 00000100:00100000:2.0:1734016137.590069:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11476 00000100:00100000:2.0:1734016137.590081:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333903616:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016137.590122:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016137.590163:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116cc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a23 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016137.590287:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335378560:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016137.590406:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016137.593394:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335378560:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016137.593446:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116cc2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a23 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.593462:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116cc2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a23 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.593565:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016137.594909:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333903616:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4825us (5878us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016137.594933:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11476 00000100:00100000:0.0:1734016137.598539:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.598669:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333903744 00000100:00100000:2.0:1734016137.598685:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333903744 00000100:00100000:2.0:1734016137.598768:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11477 00000100:00100000:2.0:1734016137.598780:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333903744:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016137.598844:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016137.598875:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116cc9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a2a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016137.598953:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335378688:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016137.599041:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016137.601300:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335378688:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016137.601375:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116cc9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a2a expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.601395:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116cc9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a2a expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.602045:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016137.602115:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333903744:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3335us (3595us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016137.602126:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11477 00000100:00100000:0.0:1734016137.604519:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.604784:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333903872 00000100:00100000:2.0:1734016137.604796:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333903872 00000100:00100000:2.0:1734016137.604912:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11478 00000100:00100000:2.0:1734016137.604928:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333903872:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016137.604972:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016137.605013:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116cd0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a31 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.605072:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->761855) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69e4 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.605082:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016137.605084:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016137.605090:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116cd0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [3346432->3350527] (req 3346432->3350527) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a31 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.605156:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->761855) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69e4 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.605177:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->761855) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69e4 expref: 6 pid: 7684 timeout: 504 lvb_type: 0 00000100:00100000:2.0:1734016137.605194:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335378816:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016137.605325:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016137.608866:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016137.608928:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333904000 00000100:00100000:0.0:1734016137.608941:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333904000 00002000:00100000:0.0:1734016137.609020:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (544768->552959) req@ffff88008719f800 x1818247333904000/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:98/0 lens 8680/0 e 0 to 0 dl 1734016148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016137.609032:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719f800 with x1818247333904000 ext(544768->552959) 00010000:00010000:0.0:1734016137.609047:0:13914:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c7c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->761855) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69e4 expref: 7 pid: 7684 timeout: 504 lvb_type: 0 00010000:00010000:0.0:1734016137.609067:0:13914:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c7c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->761855) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69e4 expref: 7 pid: 7684 timeout: 504 lvb_type: 0 00002000:00010000:0.0:1734016137.609076:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008719f800 00000100:00100000:0.0:1734016137.609105:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 293 00000100:00100000:0.0:1734016137.609114:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333904000:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016137.609968:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335378816:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016137.610016:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116cd0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [3346432->3350527] (req 3346432->3350527) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a31 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016137.610048:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:3.0:1734016137.610133:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333903872:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5209us (5627us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016137.610143:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11478 00000100:00100000:2.0:1734016137.612709:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333904000:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 3567us (3887us total) trans 4294969517 rc 0/0 00000100:00100000:2.0:1734016137.612738:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 293 00002000:00100000:2.0:1734016137.612761:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (544768->552959) req@ffff88008719f800 x1818247333904000/t4294969517(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:98/0 lens 8680/448 e 0 to 0 dl 1734016148 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016137.612781:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719f800 with x1818247333904000 ext(544768->552959) 00010000:00010000:2.0:1734016137.612796:0:13914:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->761855) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69e4 expref: 9 pid: 7684 timeout: 504 lvb_type: 0 00010000:00010000:2.0:1734016137.612843:0:13914:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->761855) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69e4 expref: 9 pid: 7684 timeout: 504 lvb_type: 0 00002000:00010000:2.0:1734016137.612853:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008719f800 00010000:00010000:3.0:1734016137.613734:0:8957:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1734016137.621418:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.621541:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333904128 00000100:00100000:3.0:1734016137.621553:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333904128 00010000:00010000:3.0:1734016137.621607:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->761855) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69e4 expref: 9 pid: 7684 timeout: 504 lvb_type: 0 00000100:00100000:3.0:1734016137.621689:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3172 00000100:00100000:3.0:1734016137.621696:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333904128:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016137.621715:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1734016137.621740:0:6466:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 112 -> 128 00010000:00010000:3.0:1734016137.621746:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 757760->761855) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69e4 expref: 9 pid: 7684 timeout: 504 lvb_type: 0 00010000:00010000:3.0:1734016137.621763:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 757760->761855) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69e4 expref: 9 pid: 7684 timeout: 504 lvb_type: 0 00010000:00010000:3.0:1734016137.621793:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116c7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 757760->761855) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69e4 expref: 9 pid: 7684 timeout: 504 lvb_type: 0 00010000:00010000:3.0:1734016137.621843:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016137.621846:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016137.621855:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116cd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3350527) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a31 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016137.621864:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116cd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3350527) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a31 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016137.621909:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116cd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3350527) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a31 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016137.621922:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335378944:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016137.621986:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016137.630051:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335378944:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016137.630108:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016137.632130:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333904128:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 10409us (10702us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016137.632154:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3172 00000100:00100000:0.0:1734016137.639598:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.640099:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333904384 00000100:00100000:2.0:1734016137.640113:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333904384 00002000:00100000:2.0:1734016137.640186:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (0->4194303) req@ffff88008719ed80 x1818247333904384/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:98/0 lens 488/0 e 0 to 0 dl 1734016148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016137.640198:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719ed80 with x1818247333904384 ext(0->4194303) 00002000:00010000:2.0:1734016137.640207:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719ed80 00000100:00100000:2.0:1734016137.640279:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8906 00000100:00100000:2.0:1734016137.640290:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333904384:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016137.704101:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333904384:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 63777us (64493us total) trans 0 rc 4194304/4194304 00000100:00100000:2.0:1734016137.704127:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8906 00002000:00100000:2.0:1734016137.704152:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (0->4194303) req@ffff88008719ed80 x1818247333904384/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:98/0 lens 488/440 e 0 to 0 dl 1734016148 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016137.704165:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719ed80 with x1818247333904384 ext(0->4194303) 00002000:00010000:2.0:1734016137.704172:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719ed80 00000100:00100000:0.0:1734016137.709389:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.711680:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333904512 00000100:00100000:3.0:1734016137.711705:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333904512 00002000:00100000:3.0:1734016137.711789:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (3346432->3358719) req@ffff88008719d500 x1818247333904512/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:98/0 lens 12776/0 e 0 to 0 dl 1734016148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016137.711824:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719d500 with x1818247333904512 ext(3346432->3358719) 00002000:00010000:3.0:1734016137.711832:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719d500 00000100:00100000:3.0:1734016137.711874:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8907 00000100:00100000:3.0:1734016137.711884:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333904512:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016137.714670:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333904512:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 2761us (5290us total) trans 4294969518 rc 0/0 00000100:00100000:3.0:1734016137.714693:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8907 00002000:00100000:3.0:1734016137.714712:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (3346432->3358719) req@ffff88008719d500 x1818247333904512/t4294969518(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:98/0 lens 12776/448 e 0 to 0 dl 1734016148 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016137.714725:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719d500 with x1818247333904512 ext(3346432->3358719) 00002000:00010000:3.0:1734016137.714734:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719d500 00000100:00100000:1.0:1734016137.718196:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016137.718400:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333904640 00000100:00100000:0.0:1734016137.718416:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333904640 00000100:00100000:0.0:1734016137.718502:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2336 00000100:00100000:0.0:1734016137.718514:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+20:10406:x1818247333904640:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:0.0:1734016137.719438:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+20:10406:x1818247333904640:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 920us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016137.719450:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2336 00000100:00100000:0.0:1734016137.721553:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.721741:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333904768 00000100:00100000:3.0:1734016137.721754:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333904768 00000100:00100000:3.0:1734016137.721860:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11479 00000100:00100000:3.0:1734016137.721869:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333904768:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016137.723935:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969518 is committed 00000001:00080000:0.0:1734016137.723971:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969517 is committed 00000100:00100000:3.0:1734016137.724957:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333904768:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2920us (3256us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016137.724975:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11479 00000100:00100000:0.0:1734016137.728385:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.728584:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333904896 00000100:00100000:3.0:1734016137.728605:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333904896 00000100:00100000:3.0:1734016137.728663:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11480 00000100:00100000:3.0:1734016137.728673:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333904896:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016137.728703:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016137.728734:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116cd7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a38 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016137.728876:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335379072:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016137.728982:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00002000:00010000:3.0:1734016137.731174:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 128 -> 152 00000100:00100000:3.0:1734016137.731237:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335379072:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016137.731315:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116cd7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a38 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016137.731339:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116cd7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a38 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016137.731359:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016137.732280:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333904896:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3601us (3912us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016137.732294:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11480 00000100:00100000:0.0:1734016137.735770:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.737355:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333905024 00000100:00100000:3.0:1734016137.737375:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333905024 00000100:00100000:3.0:1734016137.737467:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11481 00000100:00100000:3.0:1734016137.737479:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333905024:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016137.737613:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016137.737650:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116cde lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a3f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016137.737768:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335379200:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016137.737910:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016137.753281:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335379200:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016137.753344:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116cde lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a3f expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016137.753363:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116cde lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a3f expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016137.753422:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016137.753521:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333905024:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 16041us (17775us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016137.753531:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11481 00000100:00100000:1.0:1734016137.760090:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.765163:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333905152 00000100:00100000:3.0:1734016137.765197:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333905152 00002000:00100000:3.0:1734016137.765323:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (2187264->2195455) req@ffff880130408700 x1818247333905152/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:98/0 lens 8680/0 e 0 to 0 dl 1734016148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016137.765340:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880130408700 with x1818247333905152 ext(2187264->2195455) 00002000:00010000:3.0:1734016137.765349:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130408700 00000100:00100000:3.0:1734016137.765412:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8908 00000100:00100000:3.0:1734016137.765422:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333905152:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016137.766930:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333905152:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1495us (6845us total) trans 4294969519 rc 0/0 00000100:00100000:3.0:1734016137.766949:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8908 00002000:00100000:3.0:1734016137.766965:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (2187264->2195455) req@ffff880130408700 x1818247333905152/t4294969519(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:98/0 lens 8680/448 e 0 to 0 dl 1734016148 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016137.766977:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880130408700 with x1818247333905152 ext(2187264->2195455) 00002000:00010000:3.0:1734016137.766983:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130408700 00000100:00100000:0.0:1734016137.768731:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.768839:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333905280 00000100:00100000:3.0:1734016137.768851:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333905280 00000100:00100000:3.0:1734016137.768906:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11482 00000100:00100000:3.0:1734016137.768915:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333905280:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016137.770529:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969519 is committed 00000100:00100000:3.0:1734016137.771082:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333905280:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2158us (2352us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016137.771100:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11482 00000100:00100000:0.0:1734016137.777473:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.782873:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333905408 00000100:00100000:3.0:1734016137.782893:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333905408 00000100:00100000:3.0:1734016137.782993:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11483 00000100:00100000:3.0:1734016137.783009:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333905408:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016137.783044:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016137.783073:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116ce5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a46 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016137.783180:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335379328:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016137.783315:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00002000:00010000:3.0:1734016137.787468:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 152 -> 168 00000100:00100000:3.0:1734016137.787515:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335379328:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016137.787579:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116ce5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a46 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016137.787608:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116ce5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a46 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016137.787646:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016137.787720:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333905408:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4713us (10258us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016137.787735:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11483 00000100:00100000:1.0:1734016137.796429:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.797729:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333905536 00000100:00100000:3.0:1734016137.797749:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333905536 00000100:00100000:3.0:1734016137.797853:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11484 00000100:00100000:3.0:1734016137.797862:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333905536:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016137.797894:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016137.797924:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116cec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a4d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016137.798019:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335379456:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016137.798123:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016137.802214:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335379456:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016137.802279:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116cec lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a4d expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016137.802299:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116cec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a4d expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016137.802332:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016137.802420:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333905536:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4556us (6011us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016137.802431:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11484 00000100:00100000:1.0:1734016137.852338:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016137.853061:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.853175:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333905792 00000100:00100000:3.0:1734016137.853191:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333905792 00002000:00100000:2.0:1734016137.853461:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->4755455) req@ffff880130408380 x1818247333905792/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:98/0 lens 504/0 e 0 to 0 dl 1734016148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016137.853475:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880130408380 with x1818247333905792 ext(0->4755455) 00002000:00010000:2.0:1734016137.853483:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130408380 00000100:00100000:2.0:1734016137.853526:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8909 00000100:00100000:2.0:1734016137.853535:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333905792:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016137.861029:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333906048 00000100:00100000:0.0:1734016137.861057:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333906048 00002000:00100000:0.0:1734016137.861137:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (4190208->6037503) req@ffff88013040aa00 x1818247333906048/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:98/0 lens 504/0 e 0 to 0 dl 1734016148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016137.861152:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88013040aa00 with x1818247333906048 ext(4190208->6037503) 00002000:00010000:0.0:1734016137.861159:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013040aa00 00000100:00100000:0.0:1734016137.861209:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8910 00000100:00100000:0.0:1734016137.861220:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333906048:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016137.903841:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333906048:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 42575us (50736us total) trans 0 rc 1843200/1843200 00000100:00100000:0.0:1734016137.903857:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8910 00002000:00100000:0.0:1734016137.903877:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (4190208->6037503) req@ffff88013040aa00 x1818247333906048/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:98/0 lens 504/440 e 0 to 0 dl 1734016148 ref 1 fl Complete:/200/0 rc 1843200/1843200 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016137.903889:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88013040aa00 with x1818247333906048 ext(4190208->6037503) 00002000:00010000:0.0:1734016137.903897:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013040aa00 00000100:00100000:0.0:1734016137.926997:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333905792:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 73447us (74662us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1734016137.927016:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8909 00002000:00100000:0.0:1734016137.927034:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->4755455) req@ffff880130408380 x1818247333905792/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:98/0 lens 504/440 e 0 to 0 dl 1734016148 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016137.927045:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880130408380 with x1818247333905792 ext(0->4755455) 00002000:00010000:0.0:1734016137.927054:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130408380 00000100:00100000:0.0:1734016137.938530:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016137.939179:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333906304 00000100:00100000:2.0:1734016137.939192:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333906304 00000100:00100000:2.0:1734016137.939261:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2337 00000100:00100000:2.0:1734016137.939271:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+20:10406:x1818247333906304:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016137.939349:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016137.939394:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116c67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e69cf expref: 20 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.939432:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016137.939438:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016137.939662:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116cf3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016137.939679:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27116cad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a0e expref: 15 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.939688:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116cf3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016137.939737:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27116cad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a0e expref: 15 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.939752:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27116cad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a0e expref: 15 pid: 7704 timeout: 505 lvb_type: 0 00000100:00100000:2.0:1734016137.939768:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335379584:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016137.939891:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016137.948439:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335379584:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016137.948475:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116cf3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016137.949203:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.951160:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333906432 00000100:00100000:3.0:1734016137.951188:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333906432 00010000:00010000:3.0:1734016137.951271:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27116cad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a0e expref: 16 pid: 7704 timeout: 505 lvb_type: 0 00000100:00100000:3.0:1734016137.951374:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3173 00000100:00100000:3.0:1734016137.951385:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333906432:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016137.951413:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016137.951422:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27116cad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a0e expref: 16 pid: 7704 timeout: 505 lvb_type: 0 00010000:00010000:3.0:1734016137.951442:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27116cad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a0e expref: 16 pid: 7704 timeout: 505 lvb_type: 0 00010000:00010000:3.0:1734016137.951488:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e880/0x5e3a3adc27116cad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a0e expref: 16 pid: 7704 timeout: 505 lvb_type: 0 00010000:00010000:3.0:1734016137.952601:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016137.952613:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116cf3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016137.952628:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116cf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016137.952638:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116cf3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016137.952710:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016137.952832:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247333906432:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1417us (3603us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016137.952846:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3173 00010000:00010000:0.0:1734016137.953636:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116cf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016137.953651:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116cf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:0.0:1734016137.954760:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968819 00000004:00010000:0.0:1734016137.954968:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012b738380 reply state ffff88007bf5b000 transno 4294968820 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116cf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016137.954976:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016137.955113:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+22:10406:x1818247333906304:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 15837us (16593us total) trans 4294968820 rc 0/0 00000100:00100000:0.0:1734016137.955124:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2337 00000020:00080000:0.0:1734016137.955131:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016137.958980:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1734016137.959128:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116cf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016137.959153:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116cf3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016137.959162:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116cf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016137.959168:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd200 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016137.959176:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116cf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016137.959186:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116cf3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016137.959222:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016137.959226:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016137.959231:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116cf3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016137.959236:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116cf3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016137.959385:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333906560 00000100:00100000:2.0:1734016137.959398:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333906560 00000100:00100000:2.0:1734016137.959462:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11485 00000100:00100000:2.0:1734016137.959471:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247333906560:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016137.959503:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016137.959526:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116cfa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a54 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.959563:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116c9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1163264->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a07 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.959571:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116cb4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a15 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.959576:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016137.959578:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016137.959581:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116cfa lrc: 5/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a54 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.959627:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116cb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a15 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016137.959643:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116cb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a15 expref: 10 pid: 8216 timeout: 505 lvb_type: 1 00000100:00100000:2.0:1734016137.959658:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335379712:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016137.959760:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116c9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1163264->1175551) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a07 expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.959768:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116c9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1163264->1175551) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a07 expref: 5 pid: 7683 timeout: 505 lvb_type: 0 00000100:00100000:2.0:1734016137.959775:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335379840:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016137.959794:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016137.973111:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800849b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335379712:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016137.973136:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335379840:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016137.973186:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116cfa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a54 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016137.973211:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016137.973367:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:10406:x1818247333906560:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 13894us (14408us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016137.973379:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11485 00000100:00100000:3.0:1734016137.983534:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016137.985063:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333906688 00000100:00100000:0.0:1734016137.985085:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333906688 00010000:00010000:0.0:1734016137.985157:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116cb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a15 expref: 10 pid: 8216 timeout: 505 lvb_type: 1 00000100:00100000:1.0:1734016137.985453:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016137.986038:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333906816 00000100:00100000:0.0:1734016137.986043:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333906816 00010000:00010000:0.0:1734016137.986065:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116c9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1163264->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a07 expref: 6 pid: 7683 timeout: 505 lvb_type: 0 00000100:00100000:0.0:1734016137.986090:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3174 00000100:00100000:0.0:1734016137.986105:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075446300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333906688:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016137.986133:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016137.986178:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116cb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a15 expref: 10 pid: 8216 timeout: 505 lvb_type: 1 00010000:00010000:0.0:1734016137.986197:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116cb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a15 expref: 10 pid: 8216 timeout: 505 lvb_type: 1 00010000:00010000:0.0:1734016137.986241:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116cb4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a15 expref: 10 pid: 8216 timeout: 505 lvb_type: 1 00010000:00010000:0.0:1734016137.986284:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016137.986355:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075446300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333906688:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 256us (2851us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016137.986363:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3174 00000100:00100000:0.0:1734016137.986391:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3175 00000100:00100000:0.0:1734016137.986395:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333906816:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016137.986401:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016137.986406:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116c9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1163264->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a07 expref: 6 pid: 7683 timeout: 505 lvb_type: 0 00010000:00010000:0.0:1734016137.986418:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116c9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1163264->1175551) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a07 expref: 6 pid: 7683 timeout: 505 lvb_type: 0 00010000:00010000:0.0:1734016137.986432:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116c9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1163264->1175551) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a07 expref: 6 pid: 7683 timeout: 505 lvb_type: 0 00010000:00010000:0.0:1734016137.986442:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016137.986444:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016137.986454:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116cfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a54 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016137.986470:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116cfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a54 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016137.986520:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116cfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a54 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016137.986535:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b738e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335379968:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016137.986598:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1734016137.994020:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.994088:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016137.994140:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333906944 00000100:00100000:3.0:1734016137.994154:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333906944 00002000:00010000:3.0:1734016137.994223:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:3.0:1734016137.994229:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d0000 with x1818247333906944 ext(4194304->18446744073709551615) 00002000:00010000:3.0:1734016137.994251:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750d0000. 00000100:00100000:3.0:1734016137.994273:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333907072 00000100:00100000:3.0:1734016137.994276:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333907072 00002000:00010000:3.0:1734016137.994290:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (2557966->18446744073709551615) 00002000:00100000:3.0:1734016137.994293:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f2680 with x1818247333907072 ext(2557966->18446744073709551615) 00002000:00010000:3.0:1734016137.994302:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f2680. 00000100:00100000:3.0:1734016137.994331:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8911 00000100:00100000:3.0:1734016137.994339:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333906944:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016137.996113:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 6033451 -> 4194304 00002000:00010000:3.0:1734016137.996127:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016137 -> 1734016138 00002000:00010000:3.0:1734016137.996131:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016137 -> 1734016137 00002000:00010000:3.0:1734016137.996133:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016137 -> 1734016138 00002000:00010000:3.0:1734016137.996135:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 72 -> 72 00000100:00100000:3.0:1734016137.996249:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333906944:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1902us (2251us total) trans 4294968044 rc 0/0 00000100:00100000:3.0:1734016137.996263:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8911 00002000:00010000:3.0:1734016137.996272:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:3.0:1734016137.996278:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750d0000 with x1818247333906944 ext(4194304->18446744073709551615) 00002000:00010000:3.0:1734016137.996287:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750d0000. 00000100:00100000:3.0:1734016137.996335:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8912 00000100:00100000:3.0:1734016137.996346:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333907072:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:0.0:1734016137.998319:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b738e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335379968:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016137.998371:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016137.998442:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333906816:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 12042us (12987us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016137.998458:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3175 00002000:00010000:3.0:1734016138.001495:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 4194304 -> 2557966 00002000:00010000:3.0:1734016138.001511:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016138 -> 1734016138 00002000:00010000:3.0:1734016138.001515:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016138 -> 1734016138 00002000:00010000:3.0:1734016138.001517:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016138 -> 1734016138 00002000:00010000:3.0:1734016138.001520:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 168 -> 96 00000100:00100000:3.0:1734016138.002216:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333907072:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 5858us (8112us total) trans 4294969520 rc 0/0 00000100:00100000:3.0:1734016138.002240:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8912 00002000:00010000:3.0:1734016138.002250:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (2557966->18446744073709551615) 00002000:00100000:3.0:1734016138.002256:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f2680 with x1818247333907072 ext(2557966->18446744073709551615) 00002000:00010000:3.0:1734016138.002269:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801369f2680. 00000100:00100000:2.0:1734016138.010767:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016138.010986:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333907200 00000100:00100000:0.0:1734016138.011006:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333907200 00000100:00100000:0.0:1734016138.011445:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2338 00000100:00100000:0.0:1734016138.011459:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10406:x1818247333907200:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016138.011500:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016138.011537:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27116d01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a5b expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1734016138.011746:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016108 00010000:00010000:0.0:1734016138.012302:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27116d08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016138.012322:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27116d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016138.012338:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27116d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:0.0:1734016138.012375:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 6752270 00000004:00200000:0.0:1734016138.012382:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016138.012401:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27116d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016138.012433:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27116d01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a5b expref: 17 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016138.012470:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27116d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a5b expref: 16 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016138.012481:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:0.0:1734016138.012484:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016138.012489:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016138.017752:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333907200:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6272us (6982us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016138.017768:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2338 00000100:00100000:1.0:1734016138.029492:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.031380:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333907328 00000100:00100000:2.0:1734016138.031398:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333907328 00000100:00100000:2.0:1734016138.031508:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11486 00000100:00100000:2.0:1734016138.031517:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333907328:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.031545:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.031571:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116d0f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a62 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.031649:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335380096:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016138.031728:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00080000:3.0:1734016138.032068:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016108 00000100:00100000:1.0:1734016138.032233:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00002000:00010000:2.0:1734016138.036221:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016137 -> 1734016138 00000100:00100000:2.0:1734016138.036271:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335380096:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.036322:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116d0f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a62 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.036340:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116d0f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a62 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.036995:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016138.037062:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333907328:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5545us (7593us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.037071:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11486 00000100:00100000:0.0:1734016138.038739:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333907456 00000100:00100000:0.0:1734016138.038754:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333907456 00000100:00100000:0.0:1734016138.038875:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11487 00000100:00100000:0.0:1734016138.038885:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333907456:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016138.038912:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016138.038938:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27116d16 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a69 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016138.039018:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b738e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335380224:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016138.039100:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00080000:3.0:1734016138.039471:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016108 00000100:00100000:0.0:1734016138.041728:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b738e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335380224:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016138.041832:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27116d16 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a69 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016138.041855:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581b00/0x5e3a3adc27116d16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a69 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016138.041894:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581b00, rc 0) 00000100:00100000:0.0:1734016138.041997:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333907456:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3111us (9761us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016138.042013:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11487 00000100:00100000:0.0:1734016138.050852:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.050971:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333907712 00000100:00100000:2.0:1734016138.050982:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333907712 00000100:00100000:2.0:1734016138.051044:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11488 00000100:00100000:2.0:1734016138.051053:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333907712:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.051108:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.051134:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27116d1d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a77 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.051198:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335380352:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016138.051288:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016138.051321:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.051380:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333907584 00000100:00100000:2.0:1734016138.051383:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333907584 00000100:00100000:2.0:1734016138.051485:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11489 00000100:00100000:2.0:1734016138.051490:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333907584:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.051498:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.051511:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116d24 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a70 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.051539:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335380480:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016138.051560:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706900 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.056280:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335380352:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.056351:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27116d1d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a77 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.056372:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27116d1d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a77 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.056397:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016138.056509:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333907712:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5454us (5664us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.056527:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11488 00000100:00100000:3.0:1734016138.056701:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335380480:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016138.056729:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116d24 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a70 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.056740:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116d24 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a70 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.056757:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:3.0:1734016138.056781:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333907584:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5290us (5677us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.056789:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11489 00000100:00100000:1.0:1734016138.064193:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016138.064249:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.064972:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333907840 00000100:00100000:3.0:1734016138.064986:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333907840 00000100:00100000:3.0:1734016138.065045:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333907968 00000100:00100000:3.0:1734016138.065048:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333907968 00000100:00100000:3.0:1734016138.065344:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11490 00000100:00100000:3.0:1734016138.065354:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333907840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.065378:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.065405:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116d2b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a7e expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.065484:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335380608:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016138.065720:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11491 00000100:00100000:0.0:1734016138.065728:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333907968:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016138.065737:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016138.065752:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27116d32 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a85 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016138.065786:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b739500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335380736:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016138.065853:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1734016138.069948:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016138.072195:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335380608:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016138.072256:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116d2b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a7e expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.072274:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116d2b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a7e expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.072310:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016138.072395:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333907840:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7040us (8211us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.072405:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11490 00002000:00010000:2.0:1734016138.072533:0:8216:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size: 2557966 -> 2648252 00000100:00100000:2.0:1734016138.072547:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b739500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335380736:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.072569:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27116d32 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a85 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.072579:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27116d32 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a85 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.075690:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:2.0:1734016138.075835:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333907968:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10097us (11574us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.075848:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11491 00000100:00100000:0.0:1734016138.080182:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016138.080258:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.080379:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333908224 00000100:00100000:2.0:1734016138.080392:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333908224 00000100:00100000:2.0:1734016138.080457:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333908096 00000100:00100000:2.0:1734016138.080459:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333908096 00000100:00100000:2.0:1734016138.081126:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11492 00000100:00100000:2.0:1734016138.081137:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333908224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.081163:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.081186:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27116d39 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a93 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.081256:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335380864:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016138.081357:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11493 00000100:00100000:0.0:1734016138.081362:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333908096:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016138.081373:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016138.081386:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7581680/0x5e3a3adc27116d40 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a8c expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016138.081411:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b739f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335380992:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016138.082890:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016138.083053:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.085192:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b739f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335380992:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.085254:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581680/0x5e3a3adc27116d40 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a8c expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.085275:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581680/0x5e3a3adc27116d40 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a8c expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.085290:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581680, rc 0) 00000100:00100000:2.0:1734016138.085356:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333908096:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3992us (5096us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.085369:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11493 00000100:00100000:3.0:1734016138.085487:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335380864:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016138.085510:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27116d39 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a93 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.085520:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27116d39 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a93 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.085539:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:3.0:1734016138.085557:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333908224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4423us (5395us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.085566:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11492 00000100:00100000:0.0:1734016138.098001:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.098103:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333908352 00000100:00100000:3.0:1734016138.098118:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333908352 00000100:00100000:3.0:1734016138.098745:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11494 00000100:00100000:3.0:1734016138.098753:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333908352:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016138.098985:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1734016138.098989:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016138 -> 1734016138 00002000:00010000:3.0:1734016138.098991:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016138 -> 1734016137 00002000:00010000:3.0:1734016138.098992:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016138 -> 1734016138 00002000:00010000:3.0:1734016138.098994:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 72 -> 72 00000100:00080000:2.0:1734016138.099158:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016108 00000100:00100000:3.0:1734016138.101121:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333908352:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 2358us (3118us total) trans 4294968045 rc 0/0 00000100:00100000:3.0:1734016138.101136:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11494 00000100:00100000:0.0:1734016138.104319:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.104439:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333908480 00000100:00100000:2.0:1734016138.104448:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333908480 00000100:00080000:0.0:1734016138.105083:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016108 00000100:00100000:2.0:1734016138.105173:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2339 00000100:00100000:2.0:1734016138.105181:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+21:10406:x1818247333908480:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.105217:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.105244:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116d47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6a9a expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.105375:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116d4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016138.105393:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016138.105406:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016138.105435:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 6752270 00000004:00200000:2.0:1734016138.105439:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016138.105454:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016138.105477:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116d47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a9a expref: 23 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.105731:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116d4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a9a expref: 22 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.105739:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016138.105741:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016138.105745:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016138.106176:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+22:10406:x1818247333908480:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 995us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016138.106183:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2339 00000100:00100000:0.0:1734016138.109022:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016138.109065:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.109169:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333908736 00000100:00100000:3.0:1734016138.109180:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333908736 00000100:00100000:3.0:1734016138.109232:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333908608 00000100:00100000:3.0:1734016138.109234:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333908608 00000100:00100000:3.0:1734016138.109259:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11495 00000100:00100000:3.0:1734016138.109267:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333908736:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.109286:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.109302:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116d55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6aa8 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.109360:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335381120:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.109424:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016138.109438:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11496 00000100:00100000:3.0:1734016138.109443:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333908608:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.109451:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.109460:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116d5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6aa1 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.109482:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335381248:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.109500:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00002000:00010000:0.0:1734016138.113467:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016137 -> 1734016138 00000100:00100000:0.0:1734016138.113495:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335381248:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016138.113539:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116d5c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6aa1 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016138.113552:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27116d5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6aa1 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016138.113568:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:0.0:1734016138.113631:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333908608:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4185us (4563us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016138.113645:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11496 00000100:00100000:3.0:1734016138.115647:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335381120:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016138.115680:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116d55 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6aa8 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.115695:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116d55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6aa8 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.116656:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016138.116737:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333908736:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7467us (7721us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.116746:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11495 00000100:00100000:0.0:1734016138.126057:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016138.126202:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016138.126321:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333908864 00000100:00100000:1.0:1734016138.126337:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333908864 00000100:00100000:1.0:1734016138.126388:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333908992 00000100:00100000:1.0:1734016138.126390:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333908992 00000100:00100000:1.0:1734016138.127066:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11497 00000100:00100000:1.0:1734016138.127076:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333908864:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016138.127104:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016138.127134:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27116d63 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6aaf expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016138.127207:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013040a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335381376:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016138.127297:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016138.127615:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11498 00000100:00100000:3.0:1734016138.127621:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333908992:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.127629:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.127641:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116d6a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ab6 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.127670:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335381504:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.127696:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016138.130276:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013040a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335381376:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016138.130315:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27116d63 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6aaf expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016138.130327:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27116d63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6aaf expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016138.130342:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016138.130394:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333908864:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3319us (4360us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016138.130403:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11497 00000100:00100000:3.0:1734016138.130570:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335381504:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016138.130601:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116d6a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ab6 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.130609:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27116d6a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ab6 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.130836:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016138.130862:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333908992:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3241us (4659us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.130868:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11498 00000100:00100000:1.0:1734016138.134841:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016138.135319:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.135637:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333909248 00000100:00100000:3.0:1734016138.135649:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333909248 00000100:00100000:3.0:1734016138.135922:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333909120 00000100:00100000:3.0:1734016138.135926:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333909120 00000100:00100000:0.0:1734016138.136004:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11499 00000100:00100000:0.0:1734016138.136018:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333909248:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016138.136052:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016138.136083:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27116d71 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ac4 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016138.136172:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b73b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335381632:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016138.136258:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016138.136685:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11500 00000100:00100000:3.0:1734016138.136691:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333909120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.136700:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.136711:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116d78 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6abd expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.136739:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335381760:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.136777:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.139975:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b73b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335381632:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.140022:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27116d71 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ac4 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.140036:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581200/0x5e3a3adc27116d71 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ac4 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.140062:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581200, rc 0) 00000100:00100000:2.0:1734016138.140113:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333909248:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4098us (5316us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.140126:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11499 00000100:00100000:3.0:1734016138.140672:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335381760:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016138.140694:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116d78 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6abd expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.140704:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116d78 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6abd expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.140725:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016138.140745:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333909120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4054us (5427us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.140750:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11500 00000100:00100000:0.0:1734016138.142992:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016138.143046:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.143138:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333909504 00000100:00100000:3.0:1734016138.143147:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333909504 00000100:00100000:3.0:1734016138.143180:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333909376 00000100:00100000:3.0:1734016138.143182:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333909376 00000100:00100000:3.0:1734016138.143197:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11501 00000100:00100000:3.0:1734016138.143203:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333909504:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.143218:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.143236:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116d7f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ad2 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.143291:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335381888:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.143358:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016138.143386:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11502 00000100:00100000:3.0:1734016138.143390:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333909376:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.143396:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.143407:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116d86 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6acb expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.143445:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335382016:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.143461:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.145498:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335382016:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.145534:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116d86 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6acb expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.145546:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116d86 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6acb expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.145571:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:2.0:1734016138.145618:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333909376:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2226us (2570us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.145627:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11502 00000100:00100000:3.0:1734016138.146175:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335381888:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016138.146191:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116d7f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ad2 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.146199:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116d7f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ad2 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.146207:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016138.146346:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333909504:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3141us (3362us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.146351:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11501 00000100:00100000:0.0:1734016138.150159:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.150566:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333909632 00000100:00100000:3.0:1734016138.150589:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333909632 00000100:00100000:3.0:1734016138.150781:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11503 00000100:00100000:3.0:1734016138.150793:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333909632:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016138.151098:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1734016138.151102:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016138 -> 1734016138 00002000:00010000:3.0:1734016138.151104:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016138 -> 1734016137 00002000:00010000:3.0:1734016138.151107:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016138 -> 1734016138 00002000:00010000:3.0:1734016138.151108:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 72 -> 72 00000100:00100000:3.0:1734016138.151204:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333909632:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 414us (1074us total) trans 4294968046 rc 0/0 00000100:00100000:3.0:1734016138.151215:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11503 00000100:00100000:0.0:1734016138.154496:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.155077:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333909760 00000100:00100000:2.0:1734016138.155091:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333909760 00000100:00100000:2.0:1734016138.155150:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11504 00000100:00100000:2.0:1734016138.155156:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333909760:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016138.155409:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1734016138.155412:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016138 -> 1734016138 00002000:00010000:2.0:1734016138.155414:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016137 -> 1734016137 00002000:00010000:2.0:1734016138.155416:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016138 -> 1734016138 00002000:00010000:2.0:1734016138.155418:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 72 -> 72 00000100:00100000:2.0:1734016138.155502:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247333909760:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 345us (1021us total) trans 4294968047 rc 0/0 00000100:00100000:2.0:1734016138.155510:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11504 00000100:00100000:0.0:1734016138.163657:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016138.163761:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.167622:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333910016 00000100:00100000:3.0:1734016138.167636:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333910016 00000100:00100000:3.0:1734016138.167685:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333909888 00000100:00100000:3.0:1734016138.167687:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333909888 00000100:00100000:3.0:1734016138.168175:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11505 00000100:00100000:3.0:1734016138.168182:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333910016:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.168203:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.168224:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116d8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ae0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.168287:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335382144:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.168382:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016138.168809:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11506 00000100:00100000:0.0:1734016138.168816:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333909888:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016138.168826:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016138.168838:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27116d94 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ad9 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016138.168864:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335382272:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016138.168897:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:3.0:1734016138.172012:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335382144:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016138.172069:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116d8d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ae0 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.172085:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27116d8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ae0 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.172116:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00002000:00010000:1.0:1734016138.172254:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016137 -> 1734016138 00000100:00100000:1.0:1734016138.172270:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335382272:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016138.172299:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27116d94 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ad9 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016138.172313:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a75818c0/0x5e3a3adc27116d94 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ad9 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016138.172327:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75818c0, rc 0) 00000100:00100000:3.0:1734016138.172437:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333910016:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4252us (8794us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.172450:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11505 00000100:00100000:1.0:1734016138.175083:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333909888:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6253us (11308us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016138.175100:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11506 00000100:00100000:0.0:1734016138.180128:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016138.180196:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016138.181741:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333910272 00000100:00100000:1.0:1734016138.181768:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333910272 00000100:00100000:1.0:1734016138.182515:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333910144 00000100:00100000:1.0:1734016138.182520:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333910144 00000100:00100000:3.0:1734016138.182589:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11507 00000100:00100000:3.0:1734016138.182598:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333910272:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.182618:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.182641:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27116d9b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6aee expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.182705:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335382400:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.182781:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016138.183078:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11508 00000100:00100000:1.0:1734016138.183085:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333910144:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016138.183093:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016138.183104:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27116da2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ae7 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016138.183135:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335382528:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016138.183161:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016138.193484:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335382400:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016138.193525:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27116d9b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6aee expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.193538:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27116d9b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6aee expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.193553:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016138.193607:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333910272:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11009us (13497us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.193616:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11507 00000100:00100000:1.0:1734016138.194165:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335382528:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016138.194188:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27116da2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ae7 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016138.194198:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27116da2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ae7 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016138.194221:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016138.194245:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333910144:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11160us (14049us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016138.194251:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11508 00000100:00100000:2.0:1734016138.201157:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.201204:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016138.201278:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333910400 00000100:00100000:1.0:1734016138.201287:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333910400 00000100:00100000:1.0:1734016138.201322:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333910528 00000100:00100000:1.0:1734016138.201324:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333910528 00000100:00100000:1.0:1734016138.201339:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11509 00000100:00100000:1.0:1734016138.201346:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333910400:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016138.201364:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016138.201381:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27116da9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6af5 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016138.201453:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335382656:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016138.201541:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016138.201755:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11510 00000100:00100000:0.0:1734016138.201765:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333910528:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016138.201776:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016138.201792:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27116db0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6afc expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016138.201867:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335382784:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016138.201899:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016138.206935:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335382656:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016138.207011:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27116da9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6af5 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016138.207033:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27116da9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6af5 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016138.207066:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016138.207156:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333910400:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5809us (6005us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016138.207167:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11509 00000100:00100000:2.0:1734016138.207994:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335382784:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.208026:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27116db0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6afc expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.208039:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc27116db0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6afc expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.208059:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75818c0, rc 0) 00000100:00100000:2.0:1734016138.208089:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333910528:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6327us (6884us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.208099:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11510 00000100:00100000:0.0:1734016138.212248:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.212422:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333910656 00000100:00100000:2.0:1734016138.212442:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333910656 00000100:00100000:2.0:1734016138.212544:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11511 00000100:00100000:2.0:1734016138.212558:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:10406:x1818247333910656:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.212604:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.212644:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116db7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b03 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.212708:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116cfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a54 expref: 12 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.212720:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016138.212723:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016138.212730:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116db7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3084288->3088383] (req 3084288->3088383) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b03 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.212831:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116cfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a54 expref: 12 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.212850:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116cfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a54 expref: 12 pid: 8216 timeout: 505 lvb_type: 0 00000100:00100000:2.0:1734016138.212866:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335382912:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016138.212974:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00000100:00100000:0.0:1734016138.216739:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016138.216995:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333910784 00000100:00100000:1.0:1734016138.217013:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333910784 00010000:00010000:1.0:1734016138.217085:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116cfa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a54 expref: 13 pid: 8216 timeout: 505 lvb_type: 0 00000100:00100000:1.0:1734016138.217134:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3176 00000100:00100000:1.0:1734016138.217143:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333910784:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016138.217167:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016138.217204:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116cfa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a54 expref: 13 pid: 8216 timeout: 505 lvb_type: 0 00010000:00010000:1.0:1734016138.217220:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116cfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a54 expref: 13 pid: 8216 timeout: 505 lvb_type: 0 00010000:00010000:1.0:1734016138.217274:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016138.217277:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016138.217289:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116db7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3084288->3088383) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b03 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016138.217303:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3084288->3088383) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b03 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016138.217366:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3084288->3088383) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b03 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016138.217391:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335383040:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016138.217499:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7900 going to sleep for 11 seconds 00010000:00010000:2.0:1734016138.217643:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116cfa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a54 expref: 13 pid: 8216 timeout: 505 lvb_type: 0 00000100:00100000:2.0:1734016138.217679:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335382912:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016138.217727:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3084288->3088383) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b03 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.217738:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016138.217777:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333910656:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5223us (5558us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016138.217787:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11511 00000100:00100000:1.0:1734016138.221153:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335383040:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016138.221211:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016138.221287:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333910784:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4143us (4573us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016138.221309:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3176 00000100:00100000:0.0:1734016138.227394:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.227587:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333911040 00000100:00100000:3.0:1734016138.227605:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333911040 00002000:00100000:3.0:1734016138.227682:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (3084288->3088383) req@ffff8800750c5500 x1818247333911040/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:99/0 lens 488/0 e 0 to 0 dl 1734016149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016138.227695:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c5500 with x1818247333911040 ext(3084288->3088383) 00002000:00010000:3.0:1734016138.227702:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c5500 00000100:00100000:3.0:1734016138.227760:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8913 00000100:00100000:3.0:1734016138.227773:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333911040:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016138.228094:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333911040:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 324us (727us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016138.228104:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8913 00002000:00100000:3.0:1734016138.228111:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (3084288->3088383) req@ffff8800750c5500 x1818247333911040/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:99/0 lens 488/4536 e 0 to 0 dl 1734016149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016138.228118:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c5500 with x1818247333911040 ext(3084288->3088383) 00002000:00010000:3.0:1734016138.228121:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c5500 00000100:00100000:0.0:1734016138.232772:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016138.233040:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333911296 00000100:00100000:1.0:1734016138.233055:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333911296 00002000:00100000:1.0:1734016138.233127:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (3088384->3092479) req@ffff8800750c5880 x1818247333911296/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:99/0 lens 488/0 e 0 to 0 dl 1734016149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016138.233140:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c5880 with x1818247333911296 ext(3088384->3092479) 00002000:00010000:1.0:1734016138.233147:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c5880 00000100:00100000:1.0:1734016138.233185:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8914 00000100:00100000:1.0:1734016138.233192:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333911296:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016138.233448:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333911296:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 255us (703us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016138.233457:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8914 00002000:00100000:1.0:1734016138.233464:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (3088384->3092479) req@ffff8800750c5880 x1818247333911296/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:99/0 lens 488/4536 e 0 to 0 dl 1734016149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016138.233470:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c5880 with x1818247333911296 ext(3088384->3092479) 00002000:00010000:1.0:1734016138.233473:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c5880 00000100:00100000:0.0:1734016138.237604:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.238094:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333911424 00000100:00100000:3.0:1734016138.238108:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333911424 00002000:00100000:3.0:1734016138.238162:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (3084288->3092479) req@ffff8800750c5c00 x1818247333911424/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:99/0 lens 8680/0 e 0 to 0 dl 1734016149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016138.238175:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c5c00 with x1818247333911424 ext(3084288->3092479) 00002000:00010000:3.0:1734016138.238182:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c5c00 00000100:00100000:3.0:1734016138.238227:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8915 00000100:00100000:3.0:1734016138.238238:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333911424:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016138.239636:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333911424:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1393us (2052us total) trans 4294968048 rc 0/0 00000100:00100000:3.0:1734016138.239649:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8915 00002000:00100000:3.0:1734016138.239659:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (3084288->3092479) req@ffff8800750c5c00 x1818247333911424/t4294968048(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:99/0 lens 8680/448 e 0 to 0 dl 1734016149 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016138.239668:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c5c00 with x1818247333911424 ext(3084288->3092479) 00002000:00010000:3.0:1734016138.239672:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c5c00 00000100:00100000:0.0:1734016138.245006:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.245187:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333911552 00000100:00100000:2.0:1734016138.245201:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333911552 00000100:00100000:2.0:1734016138.245723:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11512 00000100:00100000:2.0:1734016138.245732:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333911552:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016138.247339:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968048 is committed 00000001:00080000:0.0:1734016138.247352:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968047 is committed 00000100:00100000:2.0:1734016138.249935:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333911552:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 4178us (4926us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016138.249953:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11512 00000100:00100000:0.0:1734016138.255081:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.255329:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333911680 00000100:00100000:2.0:1734016138.255345:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333911680 00000100:00100000:2.0:1734016138.255556:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11513 00000100:00100000:2.0:1734016138.255569:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333911680:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.255611:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.255648:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116dbe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b0a expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.255729:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335383168:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016138.256502:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00002000:00010000:2.0:1734016138.260277:0:7682:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks: 72 -> 88 00000100:00100000:2.0:1734016138.260320:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335383168:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.260370:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116dbe lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b0a expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.260385:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116dbe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b0a expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.260621:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016138.260942:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333911680:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5374us (5878us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.260952:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11513 00000100:00100000:0.0:1734016138.263329:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.263480:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333911808 00000100:00100000:2.0:1734016138.263491:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333911808 00000100:00100000:2.0:1734016138.263675:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11514 00000100:00100000:2.0:1734016138.263685:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333911808:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.263716:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.263743:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116dc5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b11 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.263869:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335383296:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016138.263959:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.266795:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335383296:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.266960:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116dc5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b11 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.266977:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116dc5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b11 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.267252:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016138.267659:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333911808:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3973us (4342us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.267672:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11514 00000100:00100000:1.0:1734016138.271390:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.271534:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333911936 00000100:00100000:2.0:1734016138.271556:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333911936 00000100:00100000:2.0:1734016138.271648:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11515 00000100:00100000:2.0:1734016138.271665:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333911936:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.271709:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.271757:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116dcc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b18 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.271932:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335383424:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016138.272064:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.275262:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335383424:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.275315:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116dcc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b18 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.275334:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116dcc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b18 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.275364:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016138.275757:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333911936:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4096us (4392us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.275771:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11515 00000100:00100000:0.0:1734016138.278756:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.279170:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333912064 00000100:00100000:2.0:1734016138.279184:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333912064 00000100:00100000:2.0:1734016138.279241:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11516 00000100:00100000:2.0:1734016138.279250:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333912064:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.279281:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.279318:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116dd3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b1f expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.279412:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335383552:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016138.279499:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.281943:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335383552:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.282012:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116dd3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b1f expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.282034:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116dd3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b1f expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.282569:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016138.282675:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333912064:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3422us (3934us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.282686:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11516 00000100:00100000:0.0:1734016138.286702:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.286841:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333912320 00000100:00100000:2.0:1734016138.286856:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333912320 00000100:00100000:2.0:1734016138.286972:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2340 00000100:00100000:2.0:1734016138.286983:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+22:10406:x1818247333912320:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016138.287071:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016138.287121:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116d4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a9a expref: 22 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.287148:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016138.287155:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016138.287423:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116dda lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016138.287442:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27116d08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a5b expref: 15 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.287449:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116dda lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016138.287495:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27116d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a5b expref: 15 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.287513:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27116d08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a5b expref: 15 pid: 6478 timeout: 505 lvb_type: 0 00000100:00100000:2.0:1734016138.287529:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335383680:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016138.288298:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.291646:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335383680:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016138.291704:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116dda lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016138.293140:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016138.293436:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333912448 00000100:00100000:1.0:1734016138.293447:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333912448 00010000:00010000:1.0:1734016138.293491:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27116d08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a5b expref: 16 pid: 6478 timeout: 505 lvb_type: 0 00000100:00100000:1.0:1734016138.293530:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3177 00000100:00100000:1.0:1734016138.293537:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1981:x1818247333912448:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016138.293557:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016138.293565:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27116d08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a5b expref: 16 pid: 6478 timeout: 505 lvb_type: 0 00010000:00010000:1.0:1734016138.293587:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27116d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a5b expref: 16 pid: 6478 timeout: 505 lvb_type: 0 00010000:00010000:1.0:1734016138.293616:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582400/0x5e3a3adc27116d08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a5b expref: 16 pid: 6478 timeout: 505 lvb_type: 0 00010000:00010000:1.0:1734016138.293653:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016138.293659:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116dda lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016138.293668:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116dda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016138.293674:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116dda lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:1.0:1734016138.293706:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016138.293766:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1981:x1818247333912448:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 229us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016138.293777:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3177 00010000:00010000:3.0:1734016138.293959:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116dda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016138.293968:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116dda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:3.0:1734016138.294122:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968821 00000004:00010000:3.0:1734016138.294194:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800750c6d80 reply state ffff880075a64000 transno 4294968822 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116dda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016138.294205:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016138.294317:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+24:10406:x1818247333912320:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 7336us (7640us total) trans 4294968822 rc 0/0 00000100:00100000:3.0:1734016138.294326:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2340 00000020:00080000:3.0:1734016138.294331:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016138.298510:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1734016138.299302:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116dda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016138.299320:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116dda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016138.299329:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116dda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016138.299337:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbf180 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016138.299345:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116dda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016138.299356:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116dda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016138.299386:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016138.299390:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016138.299398:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116dda lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016138.299402:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116dda lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016138.299991:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333912576 00000100:00100000:3.0:1734016138.300007:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333912576 00000100:00100000:3.0:1734016138.300497:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11517 00000100:00100000:3.0:1734016138.300508:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:10406:x1818247333912576:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.300540:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.300571:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116de1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b26 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.300623:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116db7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3084288->3088383) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b03 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.300630:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016138.300634:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016138.300640:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116de1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b26 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.300683:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116db7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3084288->3088383) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b03 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.300700:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3084288->3088383) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b03 expref: 5 pid: 7682 timeout: 505 lvb_type: 0 00000100:00100000:3.0:1734016138.300715:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335383808:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016138.301003:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016138.306344:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335383808:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016138.306406:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116de1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b26 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.306434:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016138.306509:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333912576:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6002us (8024us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016138.306520:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11517 00000100:00100000:0.0:1734016138.307599:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.307824:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333912704 00000100:00100000:2.0:1734016138.307834:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333912704 00010000:00010000:2.0:1734016138.307887:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3084288->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b03 expref: 6 pid: 7682 timeout: 505 lvb_type: 0 00000100:00100000:2.0:1734016138.307926:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3178 00000100:00100000:2.0:1734016138.307931:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333912704:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016138.307951:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016138.307988:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3084288->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b03 expref: 6 pid: 7682 timeout: 505 lvb_type: 0 00010000:00010000:2.0:1734016138.308003:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116db7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3084288->3088383) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b03 expref: 6 pid: 7682 timeout: 505 lvb_type: 0 00010000:00010000:2.0:1734016138.308035:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116db7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3084288->3088383) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b03 expref: 6 pid: 7682 timeout: 505 lvb_type: 0 00010000:00010000:2.0:1734016138.308055:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016138.308057:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016138.308063:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116de1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b26 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.308074:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116de1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b26 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.308114:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116de1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b26 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.308130:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335383936:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016138.308191:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016138.313060:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016138.313152:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.313550:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333912832 00000100:00100000:3.0:1734016138.313563:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333912832 00002000:00010000:3.0:1734016138.313627:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (454749->18446744073709551615) 00002000:00100000:3.0:1734016138.313634:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c7b80 with x1818247333912832 ext(454749->18446744073709551615) 00002000:00010000:3.0:1734016138.313650:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c7b80. 00000100:00100000:3.0:1734016138.313672:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333912960 00000100:00100000:3.0:1734016138.313674:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333912960 00002000:00010000:3.0:1734016138.313691:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:3.0:1734016138.313693:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c4e00 with x1818247333912960 ext(0->18446744073709551615) 00002000:00010000:3.0:1734016138.313703:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c4e00. 00000100:00100000:3.0:1734016138.313720:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8916 00000100:00100000:3.0:1734016138.313730:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333912832:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:1.0:1734016138.317024:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8917 00000100:00100000:1.0:1734016138.317047:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333912960:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016138.319571:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 2648252 -> 0 00002000:00010000:1.0:1734016138.319595:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016138 -> 1734016138 00002000:00010000:1.0:1734016138.319598:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016138 -> 1734016138 00002000:00010000:1.0:1734016138.319600:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016138 -> 1734016138 00002000:00010000:1.0:1734016138.319601:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 96 -> 0 00000100:00100000:1.0:1734016138.319751:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333912960:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 2692us (6580us total) trans 4294969521 rc 0/0 00000100:00100000:1.0:1734016138.319770:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8917 00002000:00010000:1.0:1734016138.319783:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:1.0:1734016138.319788:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c4e00 with x1818247333912960 ext(0->18446744073709551615) 00002000:00010000:1.0:1734016138.319840:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c4e00. 00000100:00100000:2.0:1734016138.320208:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335383936:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016138.320248:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016138.320279:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333912704:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 12347us (12685us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016138.320289:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3178 00000100:00080000:0.0:1734016138.320568:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016108 00002000:00010000:3.0:1734016138.322355:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 454749 00002000:00010000:3.0:1734016138.322365:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016138 -> 1734016138 00002000:00010000:3.0:1734016138.322368:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016138 -> 1734016138 00002000:00010000:3.0:1734016138.322371:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016138 -> 1734016138 00002000:00010000:3.0:1734016138.322374:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 88 -> 56 00000100:00100000:3.0:1734016138.323227:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333912832:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 9486us (10177us total) trans 4294968049 rc 0/0 00000100:00100000:3.0:1734016138.323247:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8916 00002000:00010000:3.0:1734016138.323257:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (454749->18446744073709551615) 00002000:00100000:3.0:1734016138.323261:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c7b80 with x1818247333912832 ext(454749->18446744073709551615) 00002000:00010000:3.0:1734016138.323271:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c7b80. 00000100:00100000:0.0:1734016138.337334:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.337467:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333913088 00000100:00100000:3.0:1734016138.337483:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333913088 00000100:00100000:3.0:1734016138.337570:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2341 00000100:00100000:3.0:1734016138.337588:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+23:10406:x1818247333913088:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.337625:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.337659:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116de8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b2d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.337786:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116def lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016138.337832:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016138.337846:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016138.337884:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 454749 00000004:00200000:3.0:1734016138.337890:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016138.337911:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016138.337942:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116de8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b2d expref: 25 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.337961:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116def lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b2d expref: 24 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.337969:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016138.337973:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016138.337977:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016138.338053:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+24:10406:x1818247333913088:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 474us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016138.338062:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2341 00000100:00100000:0.0:1734016138.352166:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.353595:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333913216 00000100:00100000:3.0:1734016138.353607:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333913216 00000100:00100000:1.0:1734016138.354711:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11518 00000100:00100000:1.0:1734016138.354724:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333913216:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016138.355050:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1734016138.355053:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016138 -> 1734016138 00002000:00010000:1.0:1734016138.355056:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016138 -> 1734016138 00002000:00010000:1.0:1734016138.355057:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016138 -> 1734016138 00002000:00010000:1.0:1734016138.355060:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 16 00000100:00100000:1.0:1734016138.355161:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333913216:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 438us (3003us total) trans 4294969522 rc 0/0 00000100:00100000:1.0:1734016138.355169:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11518 00000100:00100000:0.0:1734016138.357825:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016138.359484:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333913344 00000100:00100000:1.0:1734016138.359512:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333913344 00000100:00100000:1.0:1734016138.359640:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2342 00000100:00100000:1.0:1734016138.359655:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10406:x1818247333913344:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016138.359697:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016138.359739:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc27116df6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b34 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016138.359961:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116dfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016138.359984:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016138.360000:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:1.0:1734016138.360037:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 454749 00000004:00200000:1.0:1734016138.360042:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016138.360067:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016138.360099:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc27116df6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b34 expref: 17 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016138.360146:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b34 expref: 16 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016138.360156:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016138.360161:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016138.360166:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016138.360281:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333913344:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 628us (2495us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016138.360288:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2342 00000100:00100000:0.0:1734016138.366265:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.366388:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333913472 00000100:00100000:3.0:1734016138.366401:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333913472 00000100:00100000:3.0:1734016138.366461:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11519 00000100:00100000:3.0:1734016138.366469:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333913472:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.366496:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.366518:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116e04 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b3b expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.366620:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335384064:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.366713:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016138.366759:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.366874:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333913600 00000100:00100000:2.0:1734016138.366878:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333913600 00000100:00100000:2.0:1734016138.366905:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11520 00000100:00100000:2.0:1734016138.366910:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333913600:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.366919:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.366933:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116e0b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b42 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.366965:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335384192:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016138.366988:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.372881:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335384192:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.372882:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335384064:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.372936:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116e0b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b42 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.372936:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116e04 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b3b expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.372957:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27116e0b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b42 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.372957:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116e04 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b3b expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.373680:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016138.373797:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333913600:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6880us (7032us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.373847:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11520 00010000:00010000:3.0:1734016138.374383:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016138.374430:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333913472:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7960us (8182us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.374437:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11519 00000100:00100000:0.0:1734016138.383690:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016138.383767:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.383869:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333913728 00000100:00100000:2.0:1734016138.383886:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333913728 00000100:00100000:3.0:1734016138.383931:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333913856 00000100:00100000:3.0:1734016138.383935:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333913856 00000100:00100000:2.0:1734016138.383957:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11521 00000100:00100000:3.0:1734016138.383967:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11522 00000100:00100000:2.0:1734016138.383968:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333913728:12345-192.168.201.16@tcp:101:fsx.0 00000100:00100000:3.0:1734016138.383971:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333913856:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.384000:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.384000:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.384029:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116e19 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b49 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.384029:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116e12 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b50 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.384105:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335384320:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.384105:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335384448:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.384208:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.388786:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016138.389444:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335384448:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016138.389517:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116e12 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b50 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.389547:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116e12 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b50 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.389585:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016138.389640:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333913856:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5665us (5869us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.389651:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11522 00000100:00100000:2.0:1734016138.404497:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335384320:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.404551:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116e19 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b49 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.404572:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116e19 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b49 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.404621:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016138.404736:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333913728:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 20768us (21064us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.404746:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11521 00000100:00100000:0.0:1734016138.416255:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.416337:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333914112 00000100:00100000:3.0:1734016138.416353:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333914112 00000100:00100000:3.0:1734016138.416438:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2343 00000100:00100000:3.0:1734016138.416447:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+24:10406:x1818247333914112:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016138.416536:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016138.416589:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27116def lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b2d expref: 24 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.416638:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016138.416645:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016138.416977:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116e20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016138.416994:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116dfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b34 expref: 15 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.417002:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116e20 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016138.417044:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b34 expref: 15 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.417059:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116dfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b34 expref: 15 pid: 7704 timeout: 505 lvb_type: 0 00000100:00100000:3.0:1734016138.417074:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335384576:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016138.417168:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016138.420526:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.420562:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335384576:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016138.421587:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333914240 00000100:00100000:2.0:1734016138.421602:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333914240 00010000:00010000:2.0:1734016138.421677:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116dfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b34 expref: 16 pid: 7704 timeout: 505 lvb_type: 0 00010000:00010000:3.0:1734016138.422128:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116e20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016138.423098:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3179 00000100:00100000:2.0:1734016138.423116:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333914240:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016138.423147:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016138.423160:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116dfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b34 expref: 16 pid: 7704 timeout: 505 lvb_type: 0 00010000:00010000:2.0:1734016138.423176:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b34 expref: 16 pid: 7704 timeout: 505 lvb_type: 0 00010000:00010000:2.0:1734016138.423223:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116dfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b34 expref: 16 pid: 7704 timeout: 505 lvb_type: 0 00010000:00010000:2.0:1734016138.423268:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016138.423274:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116e20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016138.423290:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116e20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016138.423303:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116e20 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016138.423959:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016138.424044:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247333914240:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 931us (3535us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016138.424054:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3179 00010000:00010000:3.0:1734016138.424127:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116e20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016138.424134:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116e20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:3.0:1734016138.424283:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968823 00000004:00010000:3.0:1734016138.424353:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880130408e00 reply state ffff88012e3b2000 transno 4294968824 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116e20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016138.424365:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016138.424486:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+26:10406:x1818247333914112:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 8039us (8247us total) trans 4294968824 rc 0/0 00000100:00100000:3.0:1734016138.424493:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2343 00000020:00080000:3.0:1734016138.424497:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1734016138.432971:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116e20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016138.433005:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116e20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016138.433022:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116e20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016138.433032:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df7cc0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016138.433040:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116e20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016138.433049:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116e20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016138.433083:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016138.433087:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016138.433093:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116e20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016138.433101:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116e20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016138.435669:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.435735:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016138.436963:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333914368 00000100:00100000:0.0:1734016138.436984:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333914368 00002000:00010000:0.0:1734016138.437056:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4300614->18446744073709551615) 00002000:00100000:0.0:1734016138.437062:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7aac450 with x1818247333914368 ext(4300614->18446744073709551615) 00002000:00010000:0.0:1734016138.437086:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7aac450. 00000100:00100000:0.0:1734016138.437140:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333914496 00000100:00100000:0.0:1734016138.437143:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333914496 00002000:00010000:0.0:1734016138.437160:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:0.0:1734016138.437164:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7100 with x1818247333914496 ext(4194304->18446744073709551615) 00002000:00010000:0.0:1734016138.437178:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc7100. 00000100:00100000:0.0:1734016138.437225:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8918 00000100:00100000:0.0:1734016138.437237:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333914368:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:1.0:1734016138.437288:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8919 00000100:00100000:1.0:1734016138.437295:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333914496:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016138.437549:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 454749 -> 4300614 00002000:00010000:1.0:1734016138.437549:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1734016138.437553:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016138 -> 1734016139 00002000:00010000:1.0:1734016138.437553:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016138 -> 1734016139 00002000:00010000:0.0:1734016138.437555:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016138 -> 1734016138 00002000:00010000:1.0:1734016138.437556:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016138 -> 1734016138 00002000:00010000:0.0:1734016138.437557:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016138 -> 1734016139 00002000:00010000:1.0:1734016138.437557:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016138 -> 1734016139 00002000:00010000:0.0:1734016138.437560:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 56 -> 56 00002000:00010000:1.0:1734016138.437560:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:1.0:1734016138.437922:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333914496:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 623us (2183us total) trans 4294969523 rc 0/0 00000100:00100000:1.0:1734016138.437931:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8919 00002000:00010000:1.0:1734016138.437934:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:1.0:1734016138.437936:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7100 with x1818247333914496 ext(4194304->18446744073709551615) 00002000:00010000:1.0:1734016138.437942:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc7100. 00000100:00100000:0.0:1734016138.441660:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333914368:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 4394us (5974us total) trans 4294968050 rc 0/0 00000100:00100000:0.0:1734016138.441681:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8918 00002000:00010000:0.0:1734016138.441693:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4300614->18446744073709551615) 00002000:00100000:0.0:1734016138.441698:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7aac450 with x1818247333914368 ext(4300614->18446744073709551615) 00002000:00010000:0.0:1734016138.441716:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7aac450. 00000100:00100000:0.0:1734016138.461388:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.461539:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333914624 00000100:00100000:3.0:1734016138.461553:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333914624 00000100:00100000:3.0:1734016138.461634:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2344 00000100:00100000:3.0:1734016138.461643:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+25:10406:x1818247333914624:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.461675:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.461694:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116e27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b57 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.461888:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116e2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016138.461909:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016138.461925:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016138.461961:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 8494918 00000004:00200000:3.0:1734016138.461965:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016138.461988:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016138.462016:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27116e27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b57 expref: 27 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.462035:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116e2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b57 expref: 26 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.462042:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016138.462045:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016138.462050:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016138.462122:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+26:10406:x1818247333914624:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 480us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016138.462128:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2344 00000100:00100000:3.0:1734016138.471763:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.473709:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333914752 00000100:00100000:2.0:1734016138.473740:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333914752 00000100:00100000:2.0:1734016138.473890:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11523 00000100:00100000:2.0:1734016138.473904:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333914752:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016138.474441:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1734016138.474447:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016139 -> 1734016139 00002000:00010000:2.0:1734016138.474450:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016138 -> 1734016138 00002000:00010000:2.0:1734016138.474453:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016139 -> 1734016139 00002000:00010000:2.0:1734016138.474455:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:2.0:1734016138.474674:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333914752:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 772us (2926us total) trans 4294969524 rc 0/0 00000100:00100000:2.0:1734016138.474683:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11523 00000100:00100000:0.0:1734016138.478954:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016138.479028:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333914880 00000100:00100000:1.0:1734016138.479046:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333914880 00000100:00100000:1.0:1734016138.479126:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2345 00000100:00100000:1.0:1734016138.479138:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10406:x1818247333914880:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016138.479174:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016138.479212:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27116e35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b5e expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016138.479349:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27116e3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016138.479376:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27116e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016138.479391:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27116e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:1.0:1734016138.479426:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 8494918 00000004:00200000:1.0:1734016138.479432:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016138.479455:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27116e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016138.479491:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27116e35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b5e expref: 17 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016138.480186:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27116e3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b5e expref: 16 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016138.480197:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016138.480200:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016138.480205:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016138.480281:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333914880:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1146us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016138.480290:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2345 00000100:00100000:0.0:1734016138.488354:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016138.488410:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016138.488457:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333915136 00000100:00100000:0.0:1734016138.488470:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333915136 00000100:00100000:0.0:1734016138.488517:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333915008 00000100:00100000:0.0:1734016138.488518:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333915008 00000100:00100000:0.0:1734016138.489113:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11524 00000100:00100000:0.0:1734016138.489124:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880130408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333915136:12345-192.168.201.16@tcp:101:fsx.0 00000100:00100000:2.0:1734016138.489124:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11525 00000100:00100000:2.0:1734016138.489131:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88013040a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333915008:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016138.489146:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.489146:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016138.489167:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27116e4a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b6c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.489167:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116e43 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b65 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016138.489244:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b130380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335384832:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016138.489244:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335384704:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016138.489970:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.489970:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.491903:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335384704:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.491950:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116e43 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b65 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.491970:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116e43 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b65 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.492001:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016138.492057:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88013040a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333915008:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2924us (3644us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.492067:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11525 00000100:00100000:1.0:1734016138.492165:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b130380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335384832:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016138.492195:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27116e4a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b6c expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016138.492206:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27116e4a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b6c expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016138.492224:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582f40, rc 0) 00000100:00100000:1.0:1734016138.492247:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880130408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333915136:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3126us (3919us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016138.492253:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11524 00000100:00100000:0.0:1734016138.495262:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016138.495341:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016138.495391:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333915264 00000100:00100000:1.0:1734016138.495408:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333915264 00000100:00100000:1.0:1734016138.495492:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333915392 00000100:00100000:1.0:1734016138.495494:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333915392 00000100:00100000:1.0:1734016138.495525:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11526 00000100:00100000:1.0:1734016138.495535:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333915264:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016138.495583:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016138.495623:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27116e51 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b73 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016138.495731:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335384960:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016138.495889:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.495963:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11527 00000100:00100000:2.0:1734016138.495971:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333915392:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.495982:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.496001:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116e58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b7a expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.496039:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335385088:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016138.496078:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.500768:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335385088:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.500903:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116e58 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b7a expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.500922:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116e58 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b7a expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.500960:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016138.501056:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333915392:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5085us (5713us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.501068:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11527 00000100:00100000:1.0:1734016138.501459:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335384960:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016138.501484:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27116e51 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b73 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016138.501494:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27116e51 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b73 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016138.501508:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016138.501535:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333915264:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6001us (6298us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016138.501541:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11526 00000100:00100000:0.0:1734016138.514773:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016138.514841:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333915648 00000100:00100000:1.0:1734016138.514851:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333915648 00002000:00100000:1.0:1734016138.514896:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (1961984->1966079) req@ffff88012b130380 x1818247333915648/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:99/0 lens 488/0 e 0 to 0 dl 1734016149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016138.514905:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b130380 with x1818247333915648 ext(1961984->1966079) 00002000:00010000:1.0:1734016138.514911:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b130380 00000100:00100000:1.0:1734016138.515039:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8920 00000100:00100000:1.0:1734016138.515047:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333915648:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016138.515249:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333915648:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 201us (485us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016138.515257:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8920 00002000:00100000:1.0:1734016138.515264:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (1961984->1966079) req@ffff88012b130380 x1818247333915648/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:99/0 lens 488/4536 e 0 to 0 dl 1734016149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016138.515271:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b130380 with x1818247333915648 ext(1961984->1966079) 00002000:00010000:1.0:1734016138.515274:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b130380 00000100:00100000:0.0:1734016138.521006:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016138.521062:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.521150:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333915776 00000100:00100000:2.0:1734016138.521161:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333915776 00000100:00100000:2.0:1734016138.521220:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333915904 00000100:00100000:2.0:1734016138.521223:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333915904 00000100:00100000:2.0:1734016138.521246:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11528 00000100:00100000:2.0:1734016138.521256:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333915776:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.521278:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.521297:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116e5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b81 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.521364:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335385216:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016138.521441:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016138.521539:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11529 00000100:00100000:3.0:1734016138.521545:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333915904:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.521565:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.521583:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116e66 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b88 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.521613:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335385344:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.521639:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.527891:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335385216:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.527958:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116e5f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b81 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.527977:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116e5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b81 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.528005:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016138.528095:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333915776:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6839us (7104us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.528109:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11528 00000100:00100000:3.0:1734016138.530783:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335385344:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016138.530877:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116e66 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b88 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.530892:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116e66 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b88 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.530914:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016138.530967:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333915904:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9420us (9902us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.530976:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11529 00000100:00100000:0.0:1734016138.537962:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016138.538041:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.538173:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333916160 00000100:00100000:2.0:1734016138.538189:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333916160 00000100:00100000:2.0:1734016138.538265:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333916032 00000100:00100000:2.0:1734016138.538267:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333916032 00000100:00100000:2.0:1734016138.538305:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11530 00000100:00100000:2.0:1734016138.538316:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333916160:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.538351:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.538390:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27116e6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b96 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.538496:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335385472:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016138.538612:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016138.538724:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11531 00000100:00100000:3.0:1734016138.538733:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333916032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.538746:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.538763:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116e74 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b8f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.538830:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335385600:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.538861:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.541115:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335385472:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.541168:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27116e6d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b96 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.541184:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27116e6d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b96 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.541206:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016138.541274:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333916160:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2959us (3330us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.541286:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11530 00000100:00100000:3.0:1734016138.541660:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335385600:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016138.541692:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116e74 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b8f expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.541702:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116e74 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b8f expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.541714:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016138.541743:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333916032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3011us (3702us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.541749:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11531 00000100:00100000:0.0:1734016138.553496:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.554561:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333916288 00000100:00100000:3.0:1734016138.554583:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333916288 00000100:00100000:3.0:1734016138.554676:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11532 00000100:00100000:3.0:1734016138.554686:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:10406:x1818247333916288:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.554719:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.554757:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116e7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6b9d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.554824:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116de1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b26 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.554832:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016138.554835:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016138.554840:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116e7b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2945024->2957311] (req 2945024->2957311) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b9d expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.554880:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116de1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b26 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.554895:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b26 expref: 8 pid: 7682 timeout: 505 lvb_type: 0 00000100:00100000:3.0:1734016138.554914:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335385728:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016138.555004:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016138.563534:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.563685:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335385728:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016138.563722:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116e7b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2945024->2957311] (req 2945024->2957311) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b9d expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.563744:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016138.563853:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333916288:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9166us (10381us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016138.563865:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11532 00000100:00100000:2.0:1734016138.564149:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333916416 00000100:00100000:2.0:1734016138.564156:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333916416 00002000:00100000:2.0:1734016138.564192:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (1961984->1966079) req@ffff88007bd3f480 x1818247333916416/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:99/0 lens 4584/0 e 0 to 0 dl 1734016149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016138.564201:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3f480 with x1818247333916416 ext(1961984->1966079) 00010000:00010000:2.0:1734016138.564208:0:7688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b26 expref: 9 pid: 7682 timeout: 505 lvb_type: 0 00010000:00010000:2.0:1734016138.564221:0:7688:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b26 expref: 9 pid: 7682 timeout: 505 lvb_type: 0 00002000:00010000:2.0:1734016138.564228:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007bd3f480 00000100:00100000:2.0:1734016138.564249:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 294 00000100:00100000:2.0:1734016138.564256:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333916416:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016138.566291:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333916416:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 2014us (2751us total) trans 4294968051 rc 0/0 00000100:00100000:2.0:1734016138.566312:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 294 00002000:00100000:2.0:1734016138.566330:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (1961984->1966079) req@ffff88007bd3f480 x1818247333916416/t4294968051(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:99/0 lens 4584/448 e 0 to 0 dl 1734016149 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016138.566341:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3f480 with x1818247333916416 ext(1961984->1966079) 00010000:00010000:2.0:1734016138.566354:0:7688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b26 expref: 11 pid: 7682 timeout: 505 lvb_type: 0 00010000:00010000:2.0:1734016138.566378:0:7688:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b26 expref: 11 pid: 7682 timeout: 505 lvb_type: 0 00002000:00010000:2.0:1734016138.566385:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007bd3f480 00000100:00100000:1.0:1734016138.569521:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.570258:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333916544 00000100:00100000:2.0:1734016138.570270:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333916544 00010000:00010000:2.0:1734016138.570325:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b26 expref: 11 pid: 7682 timeout: 505 lvb_type: 0 00000100:00100000:2.0:1734016138.570367:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3180 00000100:00100000:2.0:1734016138.570375:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333916544:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016138.570401:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1734016138.570426:0:9876:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 56 -> 64 00010000:00010000:2.0:1734016138.570433:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b26 expref: 11 pid: 7682 timeout: 505 lvb_type: 0 00010000:00010000:2.0:1734016138.570448:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116de1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b26 expref: 11 pid: 7682 timeout: 505 lvb_type: 0 00010000:00010000:2.0:1734016138.570477:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116de1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b26 expref: 11 pid: 7682 timeout: 505 lvb_type: 0 00010000:00010000:2.0:1734016138.570510:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016138.570513:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016138.570521:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116e7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->2957311) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b9d expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.570535:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116e7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->2957311) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b9d expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.570586:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116e7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->2957311) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b9d expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.570598:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335385856:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016138.570677:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.589912:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335385856:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016138.589955:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016138.590051:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333916544:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 19674us (20544us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016138.590069:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3180 00000100:00100000:0.0:1734016138.605872:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.605994:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333916800 00000100:00100000:2.0:1734016138.606008:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333916800 00002000:00100000:2.0:1734016138.606095:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff88007bd3d500 x1818247333916800/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:99/0 lens 488/0 e 0 to 0 dl 1734016149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016138.606107:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3d500 with x1818247333916800 ext(0->4194303) 00002000:00010000:2.0:1734016138.606113:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007bd3d500 00000100:00100000:2.0:1734016138.606149:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8921 00000100:00100000:2.0:1734016138.606161:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333916800:12345-192.168.201.16@tcp:3:fsx.0 00010000:00010000:3.0:1734016138.623306:0:6468:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1734016138.708676:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333916800:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 102497us (102878us total) trans 0 rc 4194304/4194304 00000100:00100000:3.0:1734016138.708688:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8921 00002000:00100000:3.0:1734016138.708701:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff88007bd3d500 x1818247333916800/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:99/0 lens 488/440 e 0 to 0 dl 1734016149 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016138.708710:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3d500 with x1818247333916800 ext(0->4194303) 00002000:00010000:3.0:1734016138.708717:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007bd3d500 00000100:00100000:0.0:1734016138.717981:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.718086:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333916928 00000100:00100000:3.0:1734016138.718097:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333916928 00000100:00100000:2.0:1734016138.719273:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11533 00000100:00100000:2.0:1734016138.719286:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333916928:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.719313:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.719341:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116e82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ba4 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.719379:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016138.719382:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016138.719394:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116e82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ba4 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.719411:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116e82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ba4 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.719425:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016138.719510:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333916928:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 226us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016138.719519:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11533 00000100:00100000:0.0:1734016138.723923:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.724024:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333917056 00000100:00100000:3.0:1734016138.724039:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333917056 00000100:00100000:3.0:1734016138.724854:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11534 00000100:00100000:3.0:1734016138.724862:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247333917056:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016138.725085:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1734016138.725088:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016139 -> 1734016139 00002000:00010000:3.0:1734016138.725090:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016138 -> 1734016138 00002000:00010000:3.0:1734016138.725092:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016139 -> 1734016138 00002000:00010000:3.0:1734016138.725094:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 16 -> 24 00000100:00100000:3.0:1734016138.725168:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+14:1984:x1818247333917056:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 306us (1263us total) trans 4294969525 rc 0/0 00000100:00100000:3.0:1734016138.725174:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11534 00000100:00100000:0.0:1734016138.733501:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.738685:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333917184 00000100:00100000:3.0:1734016138.738703:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333917184 00000100:00100000:3.0:1734016138.738778:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11535 00000100:00100000:3.0:1734016138.738786:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333917184:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.738823:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.738846:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116e89 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6bab expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.738881:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116e7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->2957311) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b9d expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.738891:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116e82 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ba4 expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.738900:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016138.738901:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016138.738905:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116e89 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [1511424->1519615] (req 1511424->1519615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bab expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.738937:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116e82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ba4 expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.738948:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116e82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ba4 expref: 10 pid: 7683 timeout: 505 lvb_type: 1 00000100:00100000:3.0:1734016138.738961:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335385984:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016138.739037:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116e7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->2957311) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b9d expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.739044:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116e7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->2957311) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b9d expref: 7 pid: 8216 timeout: 505 lvb_type: 0 00000100:00100000:3.0:1734016138.739051:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335386112:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016138.739064:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016138.744191:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335385984:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016138.744208:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335386112:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016138.744254:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116e89 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [1511424->1519615] (req 1511424->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bab expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.744274:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016138.744338:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333917184:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5551us (10848us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016138.744354:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11535 00000100:00100000:0.0:1734016138.746137:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.756382:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333917312 00000100:00100000:2.0:1734016138.756400:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333917312 00010000:00010000:2.0:1734016138.756473:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116e82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ba4 expref: 11 pid: 7683 timeout: 505 lvb_type: 1 00000100:00100000:2.0:1734016138.756539:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3181 00000100:00100000:2.0:1734016138.756551:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333917312:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016138.756582:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016138.756604:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116e82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ba4 expref: 11 pid: 7683 timeout: 505 lvb_type: 1 00010000:00010000:2.0:1734016138.756625:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116e82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ba4 expref: 11 pid: 7683 timeout: 505 lvb_type: 1 00010000:00010000:2.0:1734016138.756652:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116e82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ba4 expref: 11 pid: 7683 timeout: 505 lvb_type: 1 00010000:00010000:2.0:1734016138.756700:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016138.756769:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333917312:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 220us (10652us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016138.756778:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3181 00000100:00100000:0.0:1734016138.764914:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016138.765047:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333917440 00000100:00100000:1.0:1734016138.765065:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333917440 00010000:00010000:1.0:1734016138.765120:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116e7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b9d expref: 7 pid: 8216 timeout: 505 lvb_type: 0 00000100:00100000:1.0:1734016138.765190:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3182 00000100:00100000:1.0:1734016138.765201:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333917440:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016138.765234:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016138.765279:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116e7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b9d expref: 7 pid: 8216 timeout: 505 lvb_type: 0 00010000:00010000:1.0:1734016138.765299:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116e7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->2957311) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b9d expref: 7 pid: 8216 timeout: 505 lvb_type: 0 00010000:00010000:1.0:1734016138.765346:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27116e7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->2957311) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b9d expref: 7 pid: 8216 timeout: 505 lvb_type: 0 00010000:00010000:1.0:1734016138.765395:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016138.765398:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016138.765409:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116e89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1519615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bab expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016138.765420:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116e89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1519615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bab expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016138.765473:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116e89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bab expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016138.765491:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335386240:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016138.765609:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016138.769108:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016138.769306:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335386240:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016138.769345:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016138.769408:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333917440:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4208us (4521us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016138.769428:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3182 00000100:00100000:3.0:1734016138.770774:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333917568 00000100:00100000:3.0:1734016138.770796:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333917568 00000100:00100000:3.0:1734016138.770901:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11536 00000100:00100000:3.0:1734016138.770913:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333917568:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016138.771274:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4300614 -> 4300614 00002000:00010000:3.0:1734016138.771278:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016139 -> 1734016139 00002000:00010000:3.0:1734016138.771281:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016138 -> 1734016138 00002000:00010000:3.0:1734016138.771284:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016139 -> 1734016139 00002000:00010000:3.0:1734016138.771287:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 64 -> 64 00000100:00100000:3.0:1734016138.771423:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333917568:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 511us (2332us total) trans 4294968052 rc 0/0 00000100:00100000:3.0:1734016138.771433:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11536 00000100:00100000:0.0:1734016138.775430:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.777577:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333917696 00000100:00100000:2.0:1734016138.777592:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333917696 00000100:00100000:2.0:1734016138.777673:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11537 00000100:00100000:2.0:1734016138.777684:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333917696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.777715:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.777750:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116e90 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6bb2 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.777865:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335386368:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016138.777962:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00002000:00010000:2.0:1734016138.781471:0:7683:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016138 -> 1734016139 00000100:00100000:2.0:1734016138.781524:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335386368:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.781595:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116e90 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bb2 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.781618:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27116e90 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bb2 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.781655:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016138.781721:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333917696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4038us (6311us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.781732:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11537 00000100:00100000:0.0:1734016138.793866:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.794245:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333917824 00000100:00100000:2.0:1734016138.794256:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333917824 00000100:00100000:2.0:1734016138.794442:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11538 00000100:00100000:2.0:1734016138.794449:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333917824:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.794465:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.794482:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116e97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6bb9 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.794538:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335386496:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016138.794730:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.798319:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335386496:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.798354:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116e97 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bb9 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.798369:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27116e97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bb9 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.798400:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016138.798456:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333917824:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4005us (4599us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.798465:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11538 00000100:00100000:0.0:1734016138.805551:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.805640:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333917952 00000100:00100000:2.0:1734016138.805653:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333917952 00000100:00100000:2.0:1734016138.805724:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11539 00000100:00100000:2.0:1734016138.805734:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:10406:x1818247333917952:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.805764:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.805789:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116e9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6bc0 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.805858:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116e89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bab expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.805867:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016138.805879:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016138.805885:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116e9e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [4407296->4415487] (req 4407296->4415487) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bc0 expref: 11 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.805920:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116e89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1519615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bab expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.805933:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116e89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1519615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bab expref: 6 pid: 8216 timeout: 505 lvb_type: 0 00000100:00100000:2.0:1734016138.805953:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335386624:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016138.806037:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016138.809678:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.809870:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335386624:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016138.809935:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116e9e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [4407296->4415487] (req 4407296->4415487) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bc0 expref: 11 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.809971:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016138.810064:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:10406:x1818247333917952:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4329us (4529us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016138.810080:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11539 00000100:00100000:1.0:1734016138.810471:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333918080 00000100:00100000:1.0:1734016138.810486:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333918080 00010000:00010000:1.0:1734016138.810529:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116e89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bab expref: 7 pid: 8216 timeout: 505 lvb_type: 0 00000100:00100000:1.0:1734016138.810579:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3183 00000100:00100000:1.0:1734016138.810587:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333918080:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016138.810607:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016138.810642:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116e89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bab expref: 7 pid: 8216 timeout: 505 lvb_type: 0 00010000:00010000:1.0:1734016138.810658:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116e89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->1519615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bab expref: 7 pid: 8216 timeout: 505 lvb_type: 0 00010000:00010000:1.0:1734016138.810697:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116e89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->1519615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bab expref: 7 pid: 8216 timeout: 505 lvb_type: 0 00010000:00010000:1.0:1734016138.810733:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016138.810737:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016138.810744:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116e9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4407296->4415487) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bc0 expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016138.810756:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116e9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4407296->4415487) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bc0 expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016138.810820:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116e9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4407296->4415487) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bc0 expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016138.810841:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335386752:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016138.810896:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800822e7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016138.816446:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335386752:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016138.816498:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016138.816606:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333918080:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6017us (6954us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016138.816626:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3183 00000100:00100000:0.0:1734016138.825076:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016138.825154:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.825289:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333918336 00000100:00100000:3.0:1734016138.825305:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333918336 00000100:00100000:3.0:1734016138.825387:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333918208 00000100:00100000:3.0:1734016138.825389:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333918208 00000100:00100000:3.0:1734016138.825424:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11540 00000100:00100000:3.0:1734016138.825438:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333918336:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.825473:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.825505:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116ea5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6bce expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.825604:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335386880:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.825689:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016138.825793:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11541 00000100:00100000:1.0:1734016138.825846:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333918208:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016138.825857:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016138.825877:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc27116eac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6bc7 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016138.825913:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335387008:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016138.825944:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c926c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016138.830309:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335386880:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016138.830402:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116ea5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bce expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.830426:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27116ea5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bce expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.830472:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016138.830576:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333918336:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5132us (5513us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.830590:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11540 00002000:00010000:1.0:1734016138.830755:0:7684:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size: 4300614 -> 4414343 00000100:00100000:1.0:1734016138.830775:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335387008:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016138.830832:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc27116eac lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bc7 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016138.830844:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc27116eac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bc7 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016138.830878:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016138.830903:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333918208:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5103us (5748us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016138.830910:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11541 00000100:00100000:0.0:1734016138.838419:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016138.839346:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333918464 00000100:00100000:1.0:1734016138.839360:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333918464 00000100:00100000:1.0:1734016138.839429:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11542 00000100:00100000:1.0:1734016138.839439:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333918464:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016138.839479:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016138.839510:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116eb3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6bd5 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016138.839605:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335387136:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016138.839729:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c926c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016138.840445:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.840579:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333918592 00000100:00100000:3.0:1734016138.840584:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333918592 00000100:00100000:3.0:1734016138.840621:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11543 00000100:00100000:3.0:1734016138.840626:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333918592:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.840639:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.840652:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116eba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6bdc expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.840685:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335387264:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.840727:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016138.844319:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335387136:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016138.844373:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116eb3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bd5 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016138.844392:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116eb3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bd5 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1734016138.844522:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335387264:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016138.844552:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116eba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bdc expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.844561:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116eba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bdc expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.844594:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016138.844661:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333918592:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4032us (4216us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.844674:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11543 00010000:00010000:1.0:1734016138.845594:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016138.845628:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333918464:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6188us (7227us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016138.845639:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11542 00000100:00100000:2.0:1734016138.850965:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016138.851223:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333918720 00000100:00100000:1.0:1734016138.851231:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333918720 00000100:00100000:1.0:1734016138.851276:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11544 00000100:00100000:1.0:1734016138.851282:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333918720:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016138.851299:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016138.851317:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27116ec1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6be3 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016138.851343:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116cd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3350527) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a31 expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016138.851350:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016138.851352:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016138.851356:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27116ec1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [2404352->2412543] (req 2404352->2412543) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6be3 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016138.851384:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116cd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3350527) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a31 expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016138.851394:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116cd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3350527) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a31 expref: 13 pid: 8216 timeout: 505 lvb_type: 0 00000100:00100000:1.0:1734016138.851407:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335387392:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016138.851472:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c926c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016138.861443:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016138.862146:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335387392:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016138.862208:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27116ec1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [2404352->2412543] (req 2404352->2412543) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6be3 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016138.862240:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016138.862328:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333918720:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11043us (11370us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016138.862337:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11544 00000100:00100000:2.0:1734016138.862992:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333918848 00000100:00100000:2.0:1734016138.863001:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333918848 00010000:00010000:2.0:1734016138.863031:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116cd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3350527) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a31 expref: 14 pid: 8216 timeout: 505 lvb_type: 0 00000100:00100000:2.0:1734016138.863521:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3184 00000100:00100000:2.0:1734016138.863529:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333918848:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016138.863550:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016138.863588:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116cd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3346432->3350527) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a31 expref: 14 pid: 8216 timeout: 505 lvb_type: 0 00010000:00010000:2.0:1734016138.863603:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116cd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3346432->3350527) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a31 expref: 14 pid: 8216 timeout: 505 lvb_type: 0 00010000:00010000:2.0:1734016138.863637:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116cd0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3346432->3350527) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6a31 expref: 14 pid: 8216 timeout: 505 lvb_type: 0 00010000:00010000:2.0:1734016138.863666:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016138.863668:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016138.863677:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27116ec1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2404352->2412543) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6be3 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.863687:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27116ec1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2404352->2412543) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6be3 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.863727:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27116ec1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2404352->2412543) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6be3 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.863739:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335387520:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016138.863792:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016138.869281:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016138.869545:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333918976 00000100:00100000:1.0:1734016138.869557:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333918976 00000100:00100000:1.0:1734016138.869670:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11545 00000100:00100000:1.0:1734016138.869679:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333918976:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016138.869913:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1734016138.869916:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016139 -> 1734016138 00002000:00010000:1.0:1734016138.869918:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016138 -> 1734016138 00002000:00010000:1.0:1734016138.869920:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016139 -> 1734016138 00002000:00010000:1.0:1734016138.869921:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:1.0:1734016138.869986:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333918976:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 307us (714us total) trans 4294969526 rc 0/0 00000100:00100000:1.0:1734016138.869992:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11545 00000100:00100000:2.0:1734016138.870072:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335387520:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016138.870092:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016138.870111:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333918848:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6583us (8683us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016138.870118:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3184 00000100:00100000:0.0:1734016138.871664:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.871760:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333919104 00000100:00100000:3.0:1734016138.871768:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333919104 00000100:00100000:3.0:1734016138.871838:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11546 00000100:00100000:3.0:1734016138.871845:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333919104:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.871865:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.871882:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116ec8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6bea expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.871949:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335387648:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.872007:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016138.873390:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335387648:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016138.873439:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116ec8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bea expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.873453:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27116ec8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bea expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.873472:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016138.874261:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333919104:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2412us (2601us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.874277:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11546 00000100:00100000:0.0:1734016138.879719:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.880026:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333919232 00000100:00100000:3.0:1734016138.880038:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333919232 00000100:00100000:3.0:1734016138.880599:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11547 00000100:00100000:3.0:1734016138.880609:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333919232:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.880641:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.880669:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116ecf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6bf1 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.880750:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335387776:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.881907:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016138.893107:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335387776:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016138.893215:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116ecf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bf1 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.893241:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27116ecf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bf1 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.893277:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016138.893410:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333919232:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12798us (13703us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.893428:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11547 00000100:00100000:0.0:1734016138.896384:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.896507:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333919360 00000100:00100000:3.0:1734016138.896523:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333919360 00000100:00100000:3.0:1734016138.896596:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11548 00000100:00100000:3.0:1734016138.896608:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333919360:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.896641:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.896667:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116ed6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6bf8 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.896750:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335387904:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.896894:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00002000:00010000:3.0:1734016138.899604:0:8216:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016138 -> 1734016139 00002000:00010000:3.0:1734016138.899612:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016138 -> 1734016139 00002000:00010000:3.0:1734016138.899614:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016138 -> 1734016139 00000100:00100000:3.0:1734016138.899642:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335387904:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016138.899685:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116ed6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bf8 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.899701:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27116ed6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bf8 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.899714:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016138.899774:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333919360:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3168us (3413us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.899783:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11548 00000100:00100000:0.0:1734016138.904537:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.904747:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333919488 00000100:00100000:3.0:1734016138.904757:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333919488 00000100:00100000:3.0:1734016138.904824:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11549 00000100:00100000:3.0:1734016138.904831:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247333919488:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.904855:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.904877:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116edd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6bff expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.904935:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335388032:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.905011:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016138.910790:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335388032:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016138.910916:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116edd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bff expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.910932:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27116edd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bff expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.910958:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016138.911054:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247333919488:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6222us (6529us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.911064:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11549 00000100:00100000:2.0:1734016138.913784:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.914093:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333919616 00000100:00100000:3.0:1734016138.914104:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333919616 00000100:00100000:3.0:1734016138.914430:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11550 00000100:00100000:3.0:1734016138.914442:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333919616:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.914472:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.914502:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116ee4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c06 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.914965:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335388160:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016138.915908:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00002000:00010000:3.0:1734016138.927277:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016138 -> 1734016139 00000100:00100000:3.0:1734016138.927343:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335388160:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016138.927431:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116ee4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c06 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.927461:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27116ee4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c06 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016138.927505:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016138.931657:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333919616:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 17183us (17858us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016138.931681:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11550 00000100:00100000:0.0:1734016138.936639:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.936769:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333919744 00000100:00100000:3.0:1734016138.936786:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333919744 00000100:00100000:3.0:1734016138.936910:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11551 00000100:00100000:3.0:1734016138.936917:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333919744:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016138.936951:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016138.936979:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116eeb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c0d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.937036:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116e9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4407296->4415487) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bc0 expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.937045:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016138.937047:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016138.937054:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116eeb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [5263360->5275647] (req 5263360->5275647) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c0d expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.937105:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116e9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4407296->4415487) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bc0 expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.937124:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4407296->4415487) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bc0 expref: 10 pid: 7683 timeout: 506 lvb_type: 0 00000100:00100000:3.0:1734016138.937140:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335388288:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016138.937249:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016138.944034:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016138.944081:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333919872 00000100:00100000:0.0:1734016138.944090:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333919872 00002000:00100000:0.0:1734016138.944133:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (4407296->4414342) req@ffff88012b73a300 x1818247333919872/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:99/0 lens 7536/0 e 0 to 0 dl 1734016149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016138.944143:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b73a300 with x1818247333919872 ext(4407296->4414342) 00010000:00010000:0.0:1734016138.944153:0:7688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116e9e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4407296->4415487) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bc0 expref: 11 pid: 7683 timeout: 506 lvb_type: 0 00010000:00010000:0.0:1734016138.944166:0:7688:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116e9e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4407296->4415487) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bc0 expref: 11 pid: 7683 timeout: 506 lvb_type: 0 00002000:00010000:0.0:1734016138.944172:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b73a300 00000100:00100000:3.0:1734016138.944299:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335388288:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016138.944324:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116eeb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [5263360->5275647] (req 5263360->5275647) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c0d expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.944335:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016138.944723:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333919744:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7804us (8103us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016138.944733:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11551 00000100:00100000:0.0:1734016138.945537:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 295 00000100:00100000:0.0:1734016138.945545:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333919872:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016138.947183:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333919872:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1635us (3159us total) trans 4294968053 rc 0/0 00000100:00100000:0.0:1734016138.947191:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 295 00002000:00100000:0.0:1734016138.947199:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (4407296->4414342) req@ffff88012b73a300 x1818247333919872/t4294968053(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:99/0 lens 7536/448 e 0 to 0 dl 1734016149 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016138.947207:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b73a300 with x1818247333919872 ext(4407296->4414342) 00010000:00010000:0.0:1734016138.947216:0:7688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4407296->4415487) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bc0 expref: 13 pid: 7683 timeout: 506 lvb_type: 0 00010000:00010000:0.0:1734016138.947227:0:7688:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4407296->4415487) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bc0 expref: 13 pid: 7683 timeout: 506 lvb_type: 0 00002000:00010000:0.0:1734016138.947232:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b73a300 00000100:00100000:0.0:1734016138.949508:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.949639:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333920000 00000100:00100000:2.0:1734016138.949653:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333920000 00010000:00010000:2.0:1734016138.949705:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4407296->4415487) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bc0 expref: 13 pid: 7683 timeout: 506 lvb_type: 0 00000100:00100000:2.0:1734016138.949750:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3185 00000100:00100000:2.0:1734016138.949760:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333920000:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016138.949782:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1734016138.949843:0:6466:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 64 -> 80 00010000:00010000:2.0:1734016138.949849:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4407296->4415487) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bc0 expref: 13 pid: 7683 timeout: 506 lvb_type: 0 00010000:00010000:2.0:1734016138.949863:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116e9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4407296->4415487) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bc0 expref: 13 pid: 7683 timeout: 506 lvb_type: 0 00010000:00010000:2.0:1734016138.949896:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116e9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4407296->4415487) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6bc0 expref: 13 pid: 7683 timeout: 506 lvb_type: 0 00010000:00010000:2.0:1734016138.949934:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016138.949936:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016138.949946:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116eeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5263360->5275647) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c0d expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.949957:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116eeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5263360->5275647) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c0d expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.950005:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116eeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5263360->5275647) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c0d expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.950018:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335388416:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016138.950100:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.952896:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335388416:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016138.952931:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016138.953930:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333920000:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4162us (4428us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016138.953945:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3185 00000100:00100000:2.0:1734016138.954182:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.954316:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333920128 00000100:00100000:3.0:1734016138.954328:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333920128 00000100:00100000:3.0:1734016138.954383:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11552 00000100:00100000:3.0:1734016138.954389:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333920128:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016138.954703:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4414343 -> 5271818 00002000:00010000:3.0:1734016138.954712:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016139 -> 1734016138 00002000:00010000:3.0:1734016138.954715:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016139 -> 1734016138 00002000:00010000:3.0:1734016138.954719:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016139 -> 1734016138 00002000:00010000:3.0:1734016138.954721:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 80 -> 104 00000100:00100000:3.0:1734016138.954767:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333920128:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 379us (587us total) trans 4294968054 rc 0/0 00000100:00100000:3.0:1734016138.954774:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11552 00000100:00100000:0.0:1734016138.957890:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016138.957926:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.959164:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333920384 00000100:00100000:2.0:1734016138.959172:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333920384 00000100:00100000:2.0:1734016138.959220:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333920256 00000100:00100000:2.0:1734016138.959222:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333920256 00000100:00100000:2.0:1734016138.959241:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11553 00000100:00100000:2.0:1734016138.959250:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247333920384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.959270:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.959288:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116ef2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c1b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.959347:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335388544:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016138.959430:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016138.959973:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11554 00000100:00100000:0.0:1734016138.959979:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333920256:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016138.959988:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016138.959999:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27116ef9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c14 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016138.960027:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b73b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335388672:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016138.960055:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.965411:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335388544:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.965446:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116ef2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c1b expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.965458:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27116ef2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c1b expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1734016138.966303:0:7682:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime: 1734016138 -> 1734016139 00002000:00010000:0.0:1734016138.966307:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016138 -> 1734016139 00002000:00010000:0.0:1734016138.966308:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016138 -> 1734016139 00000100:00100000:0.0:1734016138.966319:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b73b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335388672:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016138.966336:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27116ef9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c14 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016138.966344:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581f80/0x5e3a3adc27116ef9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c14 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016138.966359:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00010000:00010000:2.0:1734016138.966476:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:0.0:1734016138.966678:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333920256:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6697us (8750us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016138.966686:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11554 00000100:00100000:2.0:1734016138.966816:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247333920384:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7568us (8938us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.966820:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11553 00000100:00100000:0.0:1734016138.974048:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016138.974088:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.974192:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333920640 00000100:00100000:2.0:1734016138.974203:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333920640 00000100:00100000:2.0:1734016138.974236:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333920512 00000100:00100000:2.0:1734016138.974237:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333920512 00000100:00100000:2.0:1734016138.974249:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11555 00000100:00100000:2.0:1734016138.974254:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247333920640:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.974275:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.974295:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27116f00 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c29 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.974342:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335388800:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016138.974389:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016138.974436:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11556 00000100:00100000:1.0:1734016138.974441:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333920512:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016138.974447:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016138.974456:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27116f07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c22 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016138.974477:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335388928:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016138.974497:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c926c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.976855:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335388800:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.977398:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27116f00 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c29 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.977411:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27116f00 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c29 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1734016138.977972:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335388928:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016138.977990:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27116f07 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c22 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016138.977998:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27116f07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c22 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016138.978008:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016138.978047:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333920512:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3604us (3956us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016138.978054:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11556 00010000:00010000:2.0:1734016138.978132:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016138.978153:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247333920640:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3899us (4113us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.978158:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11555 00000100:00100000:1.0:1734016138.983728:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016138.983790:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.983977:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333920768 00000100:00100000:2.0:1734016138.983987:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333920768 00000100:00100000:2.0:1734016138.984028:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333920896 00000100:00100000:2.0:1734016138.984030:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333920896 00000100:00100000:2.0:1734016138.984045:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11557 00000100:00100000:2.0:1734016138.984051:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247333920768:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.984072:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.984092:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116f0e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c30 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016138.984158:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335389056:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016138.984431:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11558 00000100:00100000:1.0:1734016138.984436:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247333920896:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016138.984445:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016138.984459:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27116f15 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c37 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016138.984487:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335389184:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016138.985331:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016138.985480:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c926c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016138.988468:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335389056:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016138.988511:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116f0e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c30 expref: 13 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016138.988526:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27116f0e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c30 expref: 13 pid: 8216 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1734016138.988718:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335389184:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016138.988739:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27116f15 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c37 expref: 14 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016138.988751:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27116f15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c37 expref: 14 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016138.988766:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016138.988830:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247333920896:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4391us (5039us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016138.988838:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11558 00010000:00010000:2.0:1734016138.989131:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016138.989599:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247333920768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5547us (5888us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016138.989605:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11557 00000100:00100000:0.0:1734016138.992308:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016138.992426:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333921024 00000100:00100000:2.0:1734016138.992434:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333921024 00000100:00100000:2.0:1734016138.992758:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11559 00000100:00100000:2.0:1734016138.992767:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:10406:x1818247333921024:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016138.992795:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016138.993013:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116f1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c3e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.993054:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116eeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5263360->5275647) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c0d expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.993063:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016138.993065:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016138.993070:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116f1c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3162112->3170303] (req 3162112->3170303) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c3e expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.993108:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116eeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5263360->5275647) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c0d expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016138.993121:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116eeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5263360->5275647) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c0d expref: 7 pid: 8216 timeout: 506 lvb_type: 0 00000100:00100000:2.0:1734016138.993133:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335389312:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016138.993397:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016138.996850:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335389312:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016138.996893:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116f1c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3162112->3170303] (req 3162112->3170303) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c3e expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.996916:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:3.0:1734016138.996975:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:10406:x1818247333921024:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4208us (4673us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016138.996985:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11559 00000100:00100000:1.0:1734016138.997345:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016138.998058:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333921152 00000100:00100000:3.0:1734016138.998066:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333921152 00010000:00010000:3.0:1734016138.998104:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116eeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5263360->5275647) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c0d expref: 8 pid: 8216 timeout: 506 lvb_type: 0 00000100:00100000:3.0:1734016138.998140:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3186 00000100:00100000:3.0:1734016138.998147:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333921152:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016138.998162:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016138.998185:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116eeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5263360->5275647) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c0d expref: 8 pid: 8216 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016138.998199:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116eeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5263360->5275647) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c0d expref: 8 pid: 8216 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016138.998230:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27116eeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5263360->5275647) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c0d expref: 8 pid: 8216 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016138.998248:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016138.998250:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016138.998257:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116f1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c3e expref: 12 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.998266:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116f1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c3e expref: 12 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016138.998296:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116f1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c3e expref: 12 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016138.998310:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335389440:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016138.998353:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016139.001429:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335389440:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016139.001455:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016139.001501:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333921152:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3352us (4155us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016139.001514:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3186 00000100:00100000:0.0:1734016139.001982:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.002358:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333921280 00000100:00100000:3.0:1734016139.002365:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333921280 00000100:00100000:3.0:1734016139.003034:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11560 00000100:00100000:3.0:1734016139.003043:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333921280:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016139.003330:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5271818 -> 5271818 00002000:00010000:3.0:1734016139.003333:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016139 -> 1734016138 00002000:00010000:3.0:1734016139.003336:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016139 -> 1734016138 00002000:00010000:3.0:1734016139.003338:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016139 -> 1734016139 00002000:00010000:3.0:1734016139.003340:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 104 -> 128 00000100:00100000:3.0:1734016139.003386:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333921280:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 343us (1405us total) trans 4294968055 rc 0/0 00000100:00100000:3.0:1734016139.003394:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11560 00000100:00100000:0.0:1734016139.007019:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016139.007261:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333921408 00000100:00100000:1.0:1734016139.007278:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333921408 00000100:00100000:1.0:1734016139.007413:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11561 00000100:00100000:1.0:1734016139.007426:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333921408:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016139.007467:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016139.007501:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc27116f23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c45 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016139.007612:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335389568:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016139.007718:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c926c0 going to sleep for 11 seconds 00002000:00010000:1.0:1734016139.011533:0:7684:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime: 1734016138 -> 1734016139 00002000:00010000:1.0:1734016139.011648:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016138 -> 1734016139 00000100:00100000:1.0:1734016139.011688:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335389568:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016139.011755:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc27116f23 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c45 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.011786:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc27116f23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c45 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.011878:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016139.011969:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333921408:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4545us (4970us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016139.011982:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11561 00000100:00100000:0.0:1734016139.018665:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016139.018763:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333921536 00000100:00100000:1.0:1734016139.018777:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333921536 00000100:00100000:1.0:1734016139.019349:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11562 00000100:00100000:1.0:1734016139.019358:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333921536:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016139.019390:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016139.019421:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116f2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c4c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016139.019513:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335389696:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016139.019620:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c926c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016139.024649:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335389696:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016139.024710:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116f2a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c4c expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.024728:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc27116f2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c4c expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.025864:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016139.025967:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333921536:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6604us (7311us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016139.025983:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11562 00000100:00100000:0.0:1734016139.030653:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016139.030967:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333921664 00000100:00100000:1.0:1734016139.030982:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333921664 00000100:00100000:1.0:1734016139.031053:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11563 00000100:00100000:1.0:1734016139.031064:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333921664:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016139.031096:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016139.031132:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116f31 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c53 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016139.031235:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335389824:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016139.031779:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c926c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016139.039771:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335389824:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016139.039861:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116f31 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c53 expref: 14 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.039879:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27116f31 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c53 expref: 14 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.039922:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016139.041265:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333921664:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10190us (10617us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016139.041281:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11563 00000100:00100000:0.0:1734016139.046028:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016139.046158:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333921792 00000100:00100000:1.0:1734016139.046169:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333921792 00000100:00100000:1.0:1734016139.046326:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11564 00000100:00100000:1.0:1734016139.046336:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247333921792:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016139.046366:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016139.046395:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27116f38 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c5a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016139.046465:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335389952:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016139.046542:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c926c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016139.051897:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335389952:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016139.051963:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27116f38 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c5a expref: 14 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016139.051983:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27116f38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c5a expref: 14 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016139.052026:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:0.0:1734016139.052307:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247333921792:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5970us (6289us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016139.052322:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11564 00000100:00100000:0.0:1734016139.055438:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.055529:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333921920 00000100:00100000:2.0:1734016139.055537:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333921920 00000100:00100000:2.0:1734016139.055595:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11565 00000100:00100000:2.0:1734016139.055603:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333921920:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.055628:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.055654:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116f3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c61 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.055741:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335390080:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.055840:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016139.062185:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335390080:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016139.062250:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116f3f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c61 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.062269:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27116f3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c61 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.066041:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016139.068325:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333921920:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12695us (12873us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016139.068349:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11565 00000100:00100000:0.0:1734016139.073414:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.073619:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333922048 00000100:00100000:2.0:1734016139.073640:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333922048 00000100:00100000:2.0:1734016139.074065:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11566 00000100:00100000:2.0:1734016139.074079:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333922048:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.074112:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.074146:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116f46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c68 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.074235:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335390208:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.074340:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016139.078381:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335390208:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016139.078464:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116f46 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c68 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.078489:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27116f46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c68 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.078692:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016139.079122:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333922048:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5045us (5725us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016139.079132:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11566 00000100:00100000:0.0:1734016139.083085:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.083260:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333922176 00000100:00100000:2.0:1734016139.083271:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333922176 00000100:00100000:2.0:1734016139.083325:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11567 00000100:00100000:2.0:1734016139.083333:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:10406:x1818247333922176:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.083350:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.083368:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116f4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c6f expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.083399:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27116ec1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2404352->2412543) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6be3 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.083406:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016139.083408:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016139.083412:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116f4d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [811008->819199] (req 811008->819199) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c6f expref: 14 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.083448:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27116ec1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2404352->2412543) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6be3 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.083463:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27116ec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2404352->2412543) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6be3 expref: 7 pid: 7684 timeout: 506 lvb_type: 0 00000100:00100000:2.0:1734016139.083475:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335390336:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016139.083530:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016139.086879:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335390336:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016139.086930:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116f4d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [811008->819199] (req 811008->819199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c6f expref: 14 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.086954:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016139.087023:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:10406:x1818247333922176:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3689us (3950us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016139.087035:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11567 00000100:00100000:0.0:1734016139.087245:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.087518:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333922304 00000100:00100000:3.0:1734016139.087526:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333922304 00010000:00010000:3.0:1734016139.087556:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27116ec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2404352->2412543) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6be3 expref: 8 pid: 7684 timeout: 506 lvb_type: 0 00000100:00100000:3.0:1734016139.087587:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3187 00000100:00100000:3.0:1734016139.087594:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333922304:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016139.087609:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016139.087634:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27116ec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2404352->2412543) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6be3 expref: 8 pid: 7684 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016139.087647:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27116ec1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2404352->2412543) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6be3 expref: 8 pid: 7684 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016139.087675:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27116ec1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2404352->2412543) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6be3 expref: 8 pid: 7684 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016139.087705:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016139.087710:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016139.087719:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116f4d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 811008->819199) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c6f expref: 13 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.087729:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116f4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 811008->819199) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c6f expref: 13 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.087762:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116f4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 811008->819199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c6f expref: 13 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016139.087775:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335390464:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016139.087837:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016139.093730:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335390464:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016139.093763:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016139.093857:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333922304:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6262us (6611us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016139.093871:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3187 00000100:00100000:0.0:1734016139.117017:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.117163:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333922560 00000100:00100000:2.0:1734016139.117187:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333922560 00002000:00100000:2.0:1734016139.117273:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (0->4194303) req@ffff880073b9ea00 x1818247333922560/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/0 e 0 to 0 dl 1734016150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016139.117288:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9ea00 with x1818247333922560 ext(0->4194303) 00002000:00010000:2.0:1734016139.117297:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9ea00 00000100:00100000:2.0:1734016139.117357:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8922 00000100:00100000:2.0:1734016139.117367:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333922560:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016139.123219:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016139.123332:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333922816 00000100:00100000:1.0:1734016139.123348:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333922816 00002000:00100000:1.0:1734016139.123427:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff8800758f5500 x1818247333922816/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/0 e 0 to 0 dl 1734016150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016139.123439:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f5500 with x1818247333922816 ext(0->4194303) 00002000:00010000:1.0:1734016139.123450:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800758f5500 00000100:00100000:1.0:1734016139.123532:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8923 00000100:00100000:1.0:1734016139.123543:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247333922816:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016139.196909:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333922560:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 79521us (79895us total) trans 0 rc 4194304/4194304 00000100:00100000:2.0:1734016139.196928:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8922 00002000:00100000:2.0:1734016139.196949:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (0->4194303) req@ffff880073b9ea00 x1818247333922560/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/440 e 0 to 0 dl 1734016150 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016139.196961:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9ea00 with x1818247333922560 ext(0->4194303) 00002000:00010000:2.0:1734016139.196970:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9ea00 00000100:00100000:0.0:1734016139.217312:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016139.217363:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016139.219821:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016139.219866:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333923328 00000100:00100000:1.0:1734016139.219882:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333923328 00002000:00100000:1.0:1734016139.219960:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (4194304->5275647) req@ffff8800758f5880 x1818247333923328/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/0 e 0 to 0 dl 1734016150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016139.219979:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f5880 with x1818247333923328 ext(4194304->5275647) 00002000:00010000:1.0:1734016139.219987:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800758f5880 00000100:00100000:1.0:1734016139.220022:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8924 00000100:00100000:1.0:1734016139.220031:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+16:1982:x1818247333923328:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016139.222966:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333923072 00000100:00100000:3.0:1734016139.222993:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333923072 00000100:00100000:3.0:1734016139.223060:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11568 00000100:00100000:3.0:1734016139.223074:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333923072:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016139.223105:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1734016139.223118:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333923200 00000100:00100000:0.0:1734016139.223127:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333923200 00010000:00010000:3.0:1734016139.223134:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116f54 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c76 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016139.223155:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11569 00000100:00100000:0.0:1734016139.223160:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333923200:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016139.223169:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016139.223182:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27116f5b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c7d expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016139.223194:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016139.223196:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016139.223206:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27116f5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c7d expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1734016139.223212:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335390592:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016139.223223:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27116f5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c7d expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016139.223238:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582d00, rc 0) 00000100:00100000:3.0:1734016139.223274:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016139.224756:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+16:1981:x1818247333922816:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 101208us (101554us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016139.224772:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8923 00002000:00100000:1.0:1734016139.224788:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff8800758f5500 x1818247333922816/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/440 e 0 to 0 dl 1734016150 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016139.224831:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f5500 with x1818247333922816 ext(0->4194303) 00002000:00010000:1.0:1734016139.224838:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800758f5500 00000100:00100000:2.0:1734016139.225883:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333923200:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2714us (8512us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016139.225896:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11569 00000100:00100000:2.0:1734016139.230107:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335390592:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016139.230169:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116f54 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c76 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.230184:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116f54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c76 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.230215:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:2.0:1734016139.233134:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333923072:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10040us (15815us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016139.233164:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11568 00000100:00100000:0.0:1734016139.246320:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016139.247038:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333923328:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 27003us (27243us total) trans 0 rc 1081344/1081344 00000100:00100000:1.0:1734016139.247055:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8924 00002000:00100000:1.0:1734016139.247070:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (4194304->5275647) req@ffff8800758f5880 x1818247333923328/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/440 e 0 to 0 dl 1734016150 ref 1 fl Complete:/200/0 rc 1081344/1081344 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016139.247079:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f5880 with x1818247333923328 ext(4194304->5275647) 00002000:00010000:1.0:1734016139.247085:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800758f5880 00000100:00100000:2.0:1734016139.248521:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333923456 00000100:00100000:2.0:1734016139.248540:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333923456 00000100:00100000:2.0:1734016139.250482:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11570 00000100:00100000:2.0:1734016139.250507:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333923456:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.250548:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.250599:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116f62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c84 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.250693:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335390720:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.250797:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016139.256974:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335390720:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016139.257025:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116f62 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c84 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.257041:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27116f62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c84 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.257090:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016139.257296:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333923456:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6795us (10997us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016139.257305:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11570 00000100:00100000:0.0:1734016139.260356:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.261277:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333923584 00000100:00100000:3.0:1734016139.261289:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333923584 00000100:00100000:3.0:1734016139.261891:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11571 00000100:00100000:3.0:1734016139.261901:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247333923584:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016139.261929:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016139.261957:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116f69 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c8b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.262006:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116f4d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 811008->819199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c6f expref: 13 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.262014:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27116f5b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c7d expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016139.262020:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016139.262023:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016139.262027:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116f69 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [1990656->1998847] (req 1990656->1998847) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c8b expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.262081:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27116f5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c7d expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016139.262094:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27116f5b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c7d expref: 9 pid: 7683 timeout: 506 lvb_type: 1 00000100:00100000:3.0:1734016139.262107:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335390848:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016139.262338:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116f4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 811008->819199) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c6f expref: 13 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.262347:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116f4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 811008->819199) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c6f expref: 13 pid: 7684 timeout: 506 lvb_type: 0 00000100:00100000:3.0:1734016139.262356:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335390976:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016139.262376:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016139.270449:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335390848:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016139.270465:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335390976:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016139.270507:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116f69 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [1990656->1998847] (req 1990656->1998847) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c8b expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.270528:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016139.271190:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:10406:x1818247333923584:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9286us (10847us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016139.271206:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11571 00000100:00100000:0.0:1734016139.275479:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016139.275548:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.276196:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333923712 00000100:00100000:3.0:1734016139.276211:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333923712 00010000:00010000:3.0:1734016139.276271:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27116f5b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c7d expref: 9 pid: 7683 timeout: 506 lvb_type: 1 00000100:00100000:3.0:1734016139.276323:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333923840 00000100:00100000:3.0:1734016139.276326:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333923840 00010000:00010000:3.0:1734016139.276338:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116f4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 811008->819199) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c6f expref: 14 pid: 7684 timeout: 506 lvb_type: 0 00000100:00100000:3.0:1734016139.276364:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3188 00000100:00100000:3.0:1734016139.276375:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333923712:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016139.276401:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016139.276429:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27116f5b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c7d expref: 9 pid: 7683 timeout: 506 lvb_type: 1 00010000:00010000:3.0:1734016139.276442:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27116f5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c7d expref: 9 pid: 7683 timeout: 506 lvb_type: 1 00010000:00010000:3.0:1734016139.276475:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc27116f5b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c7d expref: 9 pid: 7683 timeout: 506 lvb_type: 1 00010000:00010000:3.0:1734016139.276504:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016139.276551:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333923712:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 177us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016139.276558:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3188 00000100:00100000:3.0:1734016139.276583:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3189 00000100:00100000:3.0:1734016139.276587:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247333923840:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016139.276594:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016139.276599:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116f4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 811008->819199) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c6f expref: 14 pid: 7684 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016139.276608:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116f4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 811008->819199) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c6f expref: 14 pid: 7684 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016139.276621:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27116f4d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 811008->819199) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c6f expref: 14 pid: 7684 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016139.276634:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016139.276636:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016139.276644:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116f69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->1998847) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c8b expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.276655:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116f69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->1998847) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c8b expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.276690:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116f69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->1998847) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c8b expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016139.276703:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335391104:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016139.276754:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016139.279183:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016139.279260:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333923968 00000100:00100000:0.0:1734016139.279272:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333923968 00000100:00100000:0.0:1734016139.279321:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11572 00000100:00100000:0.0:1734016139.279332:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333923968:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016139.279598:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1734016139.279602:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016139 -> 1734016138 00002000:00010000:0.0:1734016139.279604:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016139 -> 1734016138 00002000:00010000:0.0:1734016139.279606:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016139 -> 1734016138 00002000:00010000:0.0:1734016139.279609:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:2.0:1734016139.280018:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335391104:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016139.280054:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016139.280114:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333923840:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3521us (4562us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016139.280127:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3189 00000100:00100000:0.0:1734016139.282885:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333923968:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 3528us (3692us total) trans 4294969527 rc 0/0 00000100:00100000:0.0:1734016139.282914:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11572 00000100:00100000:3.0:1734016139.288503:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016139.288673:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333924096 00000100:00100000:0.0:1734016139.288690:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333924096 00000100:00100000:0.0:1734016139.288758:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11573 00000100:00100000:0.0:1734016139.288768:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333924096:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016139.288823:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016139.288855:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27116f70 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c92 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016139.288956:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335391232:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016139.289228:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016139.291161:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335391232:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016139.291207:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27116f70 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c92 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.291228:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7582d00/0x5e3a3adc27116f70 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c92 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.291247:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582d00, rc 0) 00000100:00100000:2.0:1734016139.291509:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333924096:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2740us (3019us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016139.291519:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11573 00000100:00100000:0.0:1734016139.293767:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.293939:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333924224 00000100:00100000:2.0:1734016139.293949:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333924224 00000100:00100000:2.0:1734016139.294606:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11574 00000100:00100000:2.0:1734016139.294617:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333924224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.294646:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.294678:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116f77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6c99 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.294755:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335391360:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.294849:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016139.303707:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335391360:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016139.303788:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116f77 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c99 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.303831:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116f77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c99 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.303888:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016139.304023:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333924224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9403us (10261us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016139.304039:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11574 00000100:00100000:0.0:1734016139.307349:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.309521:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333924352 00000100:00100000:2.0:1734016139.309546:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333924352 00000100:00100000:2.0:1734016139.309668:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11575 00000100:00100000:2.0:1734016139.309680:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333924352:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.309720:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.309760:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116f7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ca0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.309912:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335391488:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.310030:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:3.0:1734016139.313153:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335391488:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016139.313223:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116f7e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ca0 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016139.313246:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116f7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ca0 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016139.313285:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:3.0:1734016139.313377:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333924352:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3697us (6048us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016139.313664:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11575 00000100:00100000:0.0:1734016139.316387:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.316495:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333924480 00000100:00100000:3.0:1734016139.316507:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333924480 00000100:00100000:3.0:1734016139.316577:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11576 00000100:00100000:3.0:1734016139.316587:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333924480:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016139.316612:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016139.316636:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116f85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ca7 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.316674:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116f1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c3e expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.316682:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016139.316684:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016139.316688:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116f85 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2433024->2437119] (req 2433024->2437119) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ca7 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.316732:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116f1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c3e expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.316751:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116f1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c3e expref: 13 pid: 8216 timeout: 506 lvb_type: 0 00000100:00100000:3.0:1734016139.316767:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335391616:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016139.316905:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016139.325758:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335391616:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016139.325905:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116f85 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2433024->2437119] (req 2433024->2437119) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ca7 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.325936:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016139.326055:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247333924480:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9467us (9679us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016139.326067:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11576 00000100:00100000:0.0:1734016139.333387:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.335425:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333924608 00000100:00100000:2.0:1734016139.335449:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333924608 00010000:00010000:2.0:1734016139.335541:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116f1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c3e expref: 14 pid: 8216 timeout: 506 lvb_type: 0 00000100:00100000:2.0:1734016139.335592:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3190 00000100:00100000:2.0:1734016139.335600:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333924608:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016139.335626:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016139.335658:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116f1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c3e expref: 14 pid: 8216 timeout: 506 lvb_type: 0 00010000:00010000:2.0:1734016139.335676:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116f1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c3e expref: 14 pid: 8216 timeout: 506 lvb_type: 0 00010000:00010000:2.0:1734016139.335716:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27116f1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c3e expref: 14 pid: 8216 timeout: 506 lvb_type: 0 00010000:00010000:2.0:1734016139.335756:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016139.335758:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016139.335768:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116f85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2433024->2437119) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ca7 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.335777:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116f85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2433024->2437119) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ca7 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.336289:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116f85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2433024->2437119) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ca7 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.336307:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335391744:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016139.336446:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706c00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016139.350534:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.351607:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335391744:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016139.351650:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016139.351742:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333924608:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 16140us (18380us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016139.351758:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3190 00000100:00100000:1.0:1734016139.352611:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333924992 00000100:00100000:1.0:1734016139.352623:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333924992 00002000:00100000:1.0:1734016139.352678:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (0->4194303) req@ffff880074939880 x1818247333924992/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:100/0 lens 488/0 e 0 to 0 dl 1734016150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016139.352689:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074939880 with x1818247333924992 ext(0->4194303) 00002000:00010000:1.0:1734016139.352696:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074939880 00000100:00100000:1.0:1734016139.352724:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8925 00000100:00100000:1.0:1734016139.352731:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333924992:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016139.356319:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.361009:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333925120 00000100:00100000:2.0:1734016139.361037:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333925120 00002000:00100000:2.0:1734016139.361116:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (2433024->2437119) req@ffff8801369f2300 x1818247333925120/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:100/0 lens 488/0 e 0 to 0 dl 1734016150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016139.361129:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f2300 with x1818247333925120 ext(2433024->2437119) 00002000:00010000:2.0:1734016139.361135:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801369f2300 00000100:00100000:2.0:1734016139.361181:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8926 00000100:00100000:2.0:1734016139.361193:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333925120:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016139.361524:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333925120:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 331us (5222us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016139.361536:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8926 00002000:00100000:2.0:1734016139.361544:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (2433024->2437119) req@ffff8801369f2300 x1818247333925120/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:100/0 lens 488/4536 e 0 to 0 dl 1734016150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016139.361551:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f2300 with x1818247333925120 ext(2433024->2437119) 00002000:00010000:2.0:1734016139.361554:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801369f2300 00000100:00100000:0.0:1734016139.373063:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.373225:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333925248 00000100:00100000:2.0:1734016139.373238:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333925248 00002000:00100000:2.0:1734016139.373304:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (2433024->2437119) req@ffff880074938000 x1818247333925248/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:100/0 lens 4584/0 e 0 to 0 dl 1734016150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016139.373316:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074938000 with x1818247333925248 ext(2433024->2437119) 00002000:00010000:2.0:1734016139.373324:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880074938000 00000100:00100000:2.0:1734016139.373370:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8927 00000100:00100000:2.0:1734016139.373379:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333925248:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016139.374891:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333925248:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1498us (1838us total) trans 4294968056 rc 0/0 00000100:00100000:2.0:1734016139.374910:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8927 00002000:00100000:2.0:1734016139.374927:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (2433024->2437119) req@ffff880074938000 x1818247333925248/t4294968056(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:100/0 lens 4584/448 e 0 to 0 dl 1734016150 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016139.374937:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074938000 with x1818247333925248 ext(2433024->2437119) 00002000:00010000:2.0:1734016139.374946:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880074938000 00000100:00100000:3.0:1734016139.381174:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.388047:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333925376 00000100:00100000:2.0:1734016139.388066:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333925376 00000100:00100000:2.0:1734016139.388151:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11577 00000100:00100000:2.0:1734016139.388160:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333925376:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016139.417325:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968056 is committed 00000001:00080000:0.0:1734016139.417356:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968055 is committed 00000100:00100000:2.0:1734016139.417713:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333925376:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 29544us (36555us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016139.417727:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11577 00000100:00100000:2.0:1734016139.423692:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333924992:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 70935us (73157us total) trans 0 rc 4194304/4194304 00000100:00100000:2.0:1734016139.423713:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8925 00002000:00100000:2.0:1734016139.423742:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (0->4194303) req@ffff880074939880 x1818247333924992/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:100/0 lens 488/440 e 0 to 0 dl 1734016150 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016139.423754:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074939880 with x1818247333924992 ext(0->4194303) 00002000:00010000:2.0:1734016139.423765:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880074939880 00000100:00100000:3.0:1734016139.423992:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.424238:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.425840:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333925632 00000100:00100000:2.0:1734016139.425864:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333925632 00000100:00100000:2.0:1734016139.425940:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333925504 00000100:00100000:2.0:1734016139.425944:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333925504 00000100:00100000:2.0:1734016139.425976:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11578 00000100:00100000:2.0:1734016139.425987:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247333925632:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.426026:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.426058:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116f8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6cb5 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.426158:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335391872:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.429824:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016139.429884:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11579 00000100:00100000:2.0:1734016139.429900:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333925504:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.429937:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.429971:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116f93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6cae expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.430047:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335392000:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.430131:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00002000:00010000:3.0:1734016139.433724:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks: 128 -> 136 00000100:00100000:3.0:1734016139.433770:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335392000:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016139.433885:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116f93 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cae expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016139.433907:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116f93 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cae expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016139.433932:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:3.0:1734016139.434010:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333925504:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4114us (9770us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016139.434023:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11579 00002000:00010000:2.0:1734016139.434271:0:7682:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016138 -> 1734016139 00002000:00010000:2.0:1734016139.434276:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016138 -> 1734016139 00002000:00010000:2.0:1734016139.434278:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016138 -> 1734016139 00000100:00100000:2.0:1734016139.434295:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335391872:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016139.434319:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116f8c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cb5 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.434329:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116f8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cb5 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.434343:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016139.434383:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247333925632:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8399us (10397us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016139.434390:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11578 00000100:00100000:0.0:1734016139.437370:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016139.437445:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.438664:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333925760 00000100:00100000:2.0:1734016139.438681:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333925760 00000100:00100000:2.0:1734016139.438732:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333925888 00000100:00100000:2.0:1734016139.438734:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333925888 00000100:00100000:2.0:1734016139.438763:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11580 00000100:00100000:2.0:1734016139.438774:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333925760:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.438832:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.438866:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116f9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6cbc expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016139.439113:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11581 00000100:00100000:1.0:1734016139.439120:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247333925888:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016139.439129:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016139.439143:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27116fa1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6cc3 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016139.439224:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335392128:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016139.439321:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016139.440238:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335392256:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.440283:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:1.0:1734016139.442597:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335392128:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016139.442655:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27116fa1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cc3 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.442673:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27116fa1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cc3 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.442713:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016139.442777:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247333925888:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3654us (5329us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016139.442792:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11581 00000100:00100000:2.0:1734016139.443437:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335392256:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016139.443468:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116f9a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cbc expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.443480:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27116f9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cbc expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.443502:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016139.443530:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333925760:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4759us (6185us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016139.443537:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11580 00000100:00100000:0.0:1734016139.446448:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016139.446709:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.446865:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333926144 00000100:00100000:2.0:1734016139.446884:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333926144 00000100:00100000:2.0:1734016139.447528:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333926016 00000100:00100000:2.0:1734016139.447534:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333926016 00000100:00100000:1.0:1734016139.447592:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11582 00000100:00100000:1.0:1734016139.447603:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247333926144:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016139.447644:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016139.447673:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27116fa8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6cd1 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016139.447779:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335392384:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.447903:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11583 00000100:00100000:2.0:1734016139.447908:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333926016:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.447916:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.447933:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116faf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6cca expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.447967:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335392512:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.448039:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:1.0:1734016139.448791:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016139.451848:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335392512:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016139.451901:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116faf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cca expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016139.451925:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116faf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cca expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016139.451944:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:3.0:1734016139.452019:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333926016:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4108us (5308us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016139.452030:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11583 00000100:00100000:1.0:1734016139.453515:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335392384:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016139.453575:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27116fa8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cd1 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.453593:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27116fa8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cd1 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.454002:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016139.454434:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247333926144:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6829us (8003us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016139.454446:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11582 00000100:00100000:0.0:1734016139.457597:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016139.457738:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333926272 00000100:00100000:1.0:1734016139.457758:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333926272 00000100:00100000:1.0:1734016139.458008:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11584 00000100:00100000:1.0:1734016139.458021:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:10406:x1818247333926272:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016139.458063:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016139.458100:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116fb6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6cd8 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016139.458161:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116f85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2433024->2437119) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ca7 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016139.458172:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016139.458174:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016139.458179:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116fb6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [5529600->5537791] (req 5529600->5537791) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cd8 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016139.458232:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116f85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2433024->2437119) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ca7 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016139.458249:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116f85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2433024->2437119) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ca7 expref: 5 pid: 8216 timeout: 506 lvb_type: 0 00000100:00100000:1.0:1734016139.458267:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335392640:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016139.458381:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016139.464758:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335392640:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016139.464866:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116fb6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [5529600->5537791] (req 5529600->5537791) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cd8 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016139.464904:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016139.464992:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333926272:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6967us (7423us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016139.465003:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11584 00000100:00100000:0.0:1734016139.465999:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.466221:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333926400 00000100:00100000:3.0:1734016139.466230:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333926400 00010000:00010000:3.0:1734016139.466272:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116f85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2433024->2437119) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ca7 expref: 6 pid: 8216 timeout: 506 lvb_type: 0 00000100:00100000:3.0:1734016139.466312:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3191 00000100:00100000:3.0:1734016139.466320:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333926400:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016139.466343:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016139.466378:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116f85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2433024->2437119) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ca7 expref: 6 pid: 8216 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016139.466396:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116f85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2433024->2437119) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ca7 expref: 6 pid: 8216 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016139.466432:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116f85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2433024->2437119) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ca7 expref: 6 pid: 8216 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016139.466969:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016139.466975:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016139.466985:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116fb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5529600->5537791) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cd8 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.466995:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116fb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5529600->5537791) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cd8 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.467034:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116fb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5529600->5537791) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cd8 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016139.467048:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335392768:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016139.468471:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016139.471689:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.472080:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335392768:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016139.472119:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016139.472366:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333926528 00000100:00100000:1.0:1734016139.472376:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333926528 00000100:00100000:1.0:1734016139.472436:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11585 00000100:00100000:1.0:1734016139.472447:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333926528:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016139.472789:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5271818 -> 5535168 00002000:00010000:1.0:1734016139.472793:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016139 -> 1734016139 00002000:00010000:1.0:1734016139.472795:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016139 -> 1734016139 00002000:00010000:1.0:1734016139.472798:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016139 -> 1734016139 00002000:00010000:1.0:1734016139.472816:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 136 -> 152 00000100:00100000:3.0:1734016139.472912:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333926400:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6590us (6917us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016139.472923:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3191 00000100:00100000:1.0:1734016139.475379:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333926528:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 2902us (3676us total) trans 4294968057 rc 0/0 00000100:00100000:1.0:1734016139.475403:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11585 00000100:00100000:0.0:1734016139.478231:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016139.478373:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333926656 00000100:00100000:1.0:1734016139.478389:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333926656 00000100:00100000:1.0:1734016139.478455:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11586 00000100:00100000:1.0:1734016139.478464:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333926656:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016139.478496:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016139.478521:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc27116fbd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6cdf expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016139.478620:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335392896:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016139.478730:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00002000:00010000:1.0:1734016139.480425:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016139 -> 1734016140 00000100:00100000:1.0:1734016139.480465:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335392896:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016139.480512:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc27116fbd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cdf expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.480529:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc27116fbd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cdf expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.480618:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016139.481212:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333926656:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2742us (2992us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016139.481231:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11586 00000100:00100000:2.0:1734016139.484737:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016139.485136:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333926784 00000100:00100000:1.0:1734016139.485158:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333926784 00000100:00100000:1.0:1734016139.485263:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11587 00000100:00100000:1.0:1734016139.485276:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333926784:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016139.485321:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016139.485358:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27116fc4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ce6 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016139.485461:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335393024:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016139.485572:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016139.487617:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335393024:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016139.487687:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27116fc4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ce6 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.487708:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27116fc4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ce6 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.487746:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016139.488143:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333926784:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2867us (3429us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016139.488161:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11587 00000100:00100000:0.0:1734016139.492060:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016139.492206:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333926912 00000100:00100000:1.0:1734016139.492225:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333926912 00000100:00100000:1.0:1734016139.492309:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11588 00000100:00100000:1.0:1734016139.492322:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:10406:x1818247333926912:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016139.492369:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016139.492408:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27116fcb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ced expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016139.492480:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116f69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->1998847) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c8b expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016139.492491:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016139.492495:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016139.492500:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27116fcb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [4009984->4018175] (req 4009984->4018175) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ced expref: 14 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016139.492555:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116f69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->1998847) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c8b expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016139.492581:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116f69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->1998847) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c8b expref: 8 pid: 8216 timeout: 506 lvb_type: 0 00000100:00100000:1.0:1734016139.492598:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335393152:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016139.492719:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016139.504272:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335393152:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016139.504346:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27116fcb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [4009984->4018175] (req 4009984->4018175) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ced expref: 14 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016139.504371:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016139.504487:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+14:10406:x1818247333926912:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12165us (12456us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016139.504502:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11588 00000100:00100000:0.0:1734016139.505012:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.505427:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333927040 00000100:00100000:3.0:1734016139.505440:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333927040 00010000:00010000:3.0:1734016139.505492:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116f69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->1998847) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c8b expref: 9 pid: 8216 timeout: 506 lvb_type: 0 00000100:00100000:3.0:1734016139.505540:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3192 00000100:00100000:3.0:1734016139.505547:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333927040:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016139.505576:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016139.505608:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116f69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->1998847) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c8b expref: 9 pid: 8216 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016139.505628:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116f69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->1998847) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c8b expref: 9 pid: 8216 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016139.505670:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116f69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->1998847) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6c8b expref: 9 pid: 8216 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016139.505696:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016139.505698:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016139.505707:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27116fcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4018175) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ced expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.505718:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27116fcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4018175) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ced expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.505769:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27116fcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4018175) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ced expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016139.505783:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335393280:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016139.505910:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016139.525215:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.526041:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333927424 00000100:00100000:2.0:1734016139.526060:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333927424 00002000:00100000:2.0:1734016139.526162:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (4009984->4014079) req@ffff8800758f5c00 x1818247333927424/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/0 e 0 to 0 dl 1734016150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016139.526180:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f5c00 with x1818247333927424 ext(4009984->4014079) 00002000:00010000:2.0:1734016139.526189:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758f5c00 00000100:00100000:2.0:1734016139.526238:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8928 00000100:00100000:2.0:1734016139.526251:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333927424:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016139.526589:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333927424:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 337us (1397us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016139.526601:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8928 00002000:00100000:2.0:1734016139.526608:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (4009984->4014079) req@ffff8800758f5c00 x1818247333927424/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/4536 e 0 to 0 dl 1734016150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016139.526624:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f5c00 with x1818247333927424 ext(4009984->4014079) 00002000:00010000:2.0:1734016139.526627:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758f5c00 00000100:00100000:3.0:1734016139.526967:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335393280:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016139.527008:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016139.527049:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333927040:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 21501us (22037us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016139.527061:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3192 00000100:00100000:1.0:1734016139.527197:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.528253:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333927552 00000100:00100000:2.0:1734016139.528266:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333927552 00002000:00100000:2.0:1734016139.528323:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (5275648->5537791) req@ffff8800758f5f80 x1818247333927552/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/0 e 0 to 0 dl 1734016150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016139.528335:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f5f80 with x1818247333927552 ext(5275648->5537791) 00002000:00010000:2.0:1734016139.528341:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800758f5f80 00000100:00100000:2.0:1734016139.528388:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8929 00000100:00100000:2.0:1734016139.528398:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333927552:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016139.533167:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.533588:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333927808 00000100:00100000:3.0:1734016139.533610:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333927808 00002000:00100000:3.0:1734016139.533691:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (4014080->4018175) req@ffff88007bd28a80 x1818247333927808/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/0 e 0 to 0 dl 1734016150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016139.533707:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd28a80 with x1818247333927808 ext(4014080->4018175) 00002000:00010000:3.0:1734016139.533715:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd28a80 00000100:00100000:3.0:1734016139.533750:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8930 00000100:00100000:3.0:1734016139.533761:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247333927808:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016139.534125:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247333927808:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 362us (980us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016139.534137:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8930 00002000:00100000:3.0:1734016139.534145:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (4014080->4018175) req@ffff88007bd28a80 x1818247333927808/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/4536 e 0 to 0 dl 1734016150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016139.534152:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd28a80 with x1818247333927808 ext(4014080->4018175) 00002000:00010000:3.0:1734016139.534157:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd28a80 00000100:00100000:2.0:1734016139.534486:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333927552:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 6087us (7291us total) trans 0 rc 262144/262144 00000100:00100000:2.0:1734016139.534497:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8929 00002000:00100000:2.0:1734016139.534505:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (5275648->5537791) req@ffff8800758f5f80 x1818247333927552/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/440 e 0 to 0 dl 1734016150 ref 1 fl Complete:/200/0 rc 262144/262144 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016139.534515:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f5f80 with x1818247333927552 ext(5275648->5537791) 00002000:00010000:2.0:1734016139.534519:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800758f5f80 00000100:00100000:0.0:1734016139.539695:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016139.539790:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.540002:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333928064 00000100:00100000:3.0:1734016139.540019:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333928064 00000100:00100000:3.0:1734016139.540124:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333927936 00000100:00100000:3.0:1734016139.540127:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333927936 00000100:00100000:3.0:1734016139.540158:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11589 00000100:00100000:3.0:1734016139.540173:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333928064:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016139.540209:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016139.540239:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116fd2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6cfb expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016139.540340:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335393408:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016139.540440:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016139.540681:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11590 00000100:00100000:2.0:1734016139.540689:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333927936:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.540699:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.540717:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116fd9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6cf4 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.540763:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335393536:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.540795:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00002000:00010000:3.0:1734016139.547074:0:7682:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016139 -> 1734016140 00002000:00010000:3.0:1734016139.547092:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016139 -> 1734016140 00000100:00100000:3.0:1734016139.547138:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335393408:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016139.547216:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116fd2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cfb expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016139.547239:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27116fd2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cfb expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016139.548720:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016139.549491:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333928064:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9310us (9812us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016139.549510:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11589 00002000:00010000:0.0:1734016139.551477:0:7684:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime: 1734016139 -> 1734016140 00000100:00100000:0.0:1734016139.551531:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335393536:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016139.551618:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116fd9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cf4 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016139.551648:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27116fd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cf4 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016139.551684:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:0.0:1734016139.551782:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333927936:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11091us (11989us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016139.551794:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11590 00000100:00100000:0.0:1734016139.561455:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016139.563327:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.563980:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333928320 00000100:00100000:2.0:1734016139.563997:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333928320 00000100:00100000:2.0:1734016139.564075:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11591 00000100:00100000:2.0:1734016139.564088:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333928320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.564124:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.564158:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116fe0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d09 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.564255:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335393664:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.564343:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016139.564604:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333928192 00000100:00100000:1.0:1734016139.564609:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333928192 00000100:00100000:1.0:1734016139.564640:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11592 00000100:00100000:1.0:1734016139.564645:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333928192:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016139.564655:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016139.564672:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116fe7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d02 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016139.564709:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335393792:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016139.564744:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016139.571765:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335393664:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016139.571888:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116fe0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d09 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.571911:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27116fe0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d09 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.571964:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016139.572063:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333928320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7976us (10627us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016139.572078:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11591 00000100:00100000:1.0:1734016139.572228:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335393792:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016139.572256:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116fe7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d02 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.572267:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27116fe7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d02 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.572292:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016139.572314:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333928192:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7670us (9007us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016139.572321:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11592 00000100:00100000:0.0:1734016139.576224:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016139.576290:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.576378:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333928576 00000100:00100000:2.0:1734016139.576392:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333928576 00000100:00100000:2.0:1734016139.576450:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333928448 00000100:00100000:2.0:1734016139.576453:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333928448 00000100:00100000:2.0:1734016139.576473:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11593 00000100:00100000:2.0:1734016139.576480:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333928576:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.576504:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.576527:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27116fee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d17 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.576599:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335393920:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.576684:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016139.576777:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11594 00000100:00100000:3.0:1734016139.576785:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333928448:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016139.576795:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.579498:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116ff5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d10 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.579648:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335394048:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.579773:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00000100:00100000:2.0:1734016139.583414:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335393920:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016139.583473:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27116fee lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d17 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.583490:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27116fee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d17 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.583506:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016139.583578:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333928576:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7097us (7378us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016139.583592:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11593 00000100:00100000:3.0:1734016139.583703:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335394048:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016139.583728:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116ff5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d10 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016139.583737:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27116ff5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d10 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016139.583751:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:3.0:1734016139.583778:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333928448:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6994us (7488us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016139.583784:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11594 00000100:00100000:0.0:1734016139.586654:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016139.586724:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.586885:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333928704 00000100:00100000:3.0:1734016139.586902:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333928704 00000100:00100000:3.0:1734016139.586992:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333928832 00000100:00100000:3.0:1734016139.586995:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333928832 00000100:00100000:3.0:1734016139.587028:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11595 00000100:00100000:3.0:1734016139.587041:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333928704:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016139.587083:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016139.587118:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116ffc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d1e expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016139.587215:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335394176:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016139.587310:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016139.587489:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11596 00000100:00100000:2.0:1734016139.587498:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333928832:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.587510:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.587529:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117003 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d25 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.587613:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335394304:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.587640:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016139.594729:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335394304:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016139.594819:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117003 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d25 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.594842:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117003 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d25 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.594862:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016139.594981:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333928832:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7466us (8238us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016139.594996:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11596 00000100:00100000:3.0:1734016139.595355:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335394176:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016139.595400:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116ffc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d1e expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016139.595414:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27116ffc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d1e expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016139.595426:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016139.595468:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333928704:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8431us (8838us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016139.595477:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11595 00000100:00100000:0.0:1734016139.602268:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.602455:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333928960 00000100:00100000:3.0:1734016139.602472:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333928960 00000100:00100000:3.0:1734016139.602568:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11597 00000100:00100000:3.0:1734016139.602578:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247333928960:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016139.603047:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1734016139.603051:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016140 -> 1734016138 00002000:00010000:3.0:1734016139.603054:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016139 -> 1734016138 00002000:00010000:3.0:1734016139.603057:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016140 -> 1734016139 00002000:00010000:3.0:1734016139.603059:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 24 -> 32 00000100:00100000:3.0:1734016139.603132:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+15:1981:x1818247333928960:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 554us (889us total) trans 4294969528 rc 0/0 00000100:00100000:3.0:1734016139.603141:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11597 00000100:00100000:0.0:1734016139.606166:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.606505:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333929088 00000100:00100000:2.0:1734016139.606524:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333929088 00000100:00100000:2.0:1734016139.606627:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11598 00000100:00100000:2.0:1734016139.606638:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:10406:x1818247333929088:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.606684:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.606718:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711700a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d2c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.606768:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116fb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5529600->5537791) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cd8 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.606777:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016139.606779:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016139.606784:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711700a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2019328->2027519] (req 2019328->2027519) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d2c expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.606862:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116fb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5529600->5537791) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cd8 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.606878:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116fb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5529600->5537791) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cd8 expref: 7 pid: 8216 timeout: 506 lvb_type: 0 00000100:00100000:2.0:1734016139.606892:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335394432:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016139.606974:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016139.616368:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335394432:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016139.616432:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711700a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2019328->2027519] (req 2019328->2027519) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d2c expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.616470:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016139.616566:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333929088:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9921us (10415us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016139.616583:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11598 00000100:00100000:0.0:1734016139.619565:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.619869:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333929216 00000100:00100000:3.0:1734016139.619886:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333929216 00010000:00010000:3.0:1734016139.619959:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116fb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5529600->5537791) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cd8 expref: 8 pid: 8216 timeout: 506 lvb_type: 0 00000100:00100000:3.0:1734016139.620036:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3193 00000100:00100000:3.0:1734016139.620047:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333929216:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016139.620080:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016139.620123:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116fb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5529600->5537791) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cd8 expref: 8 pid: 8216 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016139.620147:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116fb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5529600->5537791) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cd8 expref: 8 pid: 8216 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016139.620200:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27116fb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5529600->5537791) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6cd8 expref: 8 pid: 8216 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016139.620244:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016139.620250:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016139.620263:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711700a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2027519) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d2c expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.620278:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711700a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2027519) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d2c expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.620339:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711700a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2027519) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d2c expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016139.620357:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335394560:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016139.620470:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1734016139.626518:0:8958:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1734016139.627525:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335394560:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016139.627585:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016139.627701:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333929216:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7653us (8171us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016139.627718:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3193 00000100:00100000:0.0:1734016139.649978:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.650130:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333929472 00000100:00100000:2.0:1734016139.650143:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333929472 00002000:00100000:2.0:1734016139.650212:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff8800749af800 x1818247333929472/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:100/0 lens 488/0 e 0 to 0 dl 1734016150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016139.650227:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749af800 with x1818247333929472 ext(0->4194303) 00002000:00010000:2.0:1734016139.650235:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800749af800 00000100:00100000:2.0:1734016139.650276:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8931 00000100:00100000:2.0:1734016139.650285:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333929472:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016139.771853:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333929472:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 121510us (121840us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016139.771874:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8931 00002000:00100000:1.0:1734016139.771893:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff8800749af800 x1818247333929472/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:100/0 lens 488/440 e 0 to 0 dl 1734016150 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016139.771905:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749af800 with x1818247333929472 ext(0->4194303) 00002000:00010000:1.0:1734016139.771914:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800749af800 00000100:00100000:0.0:1734016139.777725:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.778155:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333929600 00000100:00100000:2.0:1734016139.778186:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333929600 00000100:00100000:2.0:1734016139.778338:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11599 00000100:00100000:2.0:1734016139.778357:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333929600:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.778415:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.778464:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117011 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d33 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.778616:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335394688:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.778995:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00002000:00010000:2.0:1734016139.783888:0:7684:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016138 -> 1734016140 00002000:00010000:2.0:1734016139.783913:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016138 -> 1734016139 00002000:00010000:2.0:1734016139.783916:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016139 -> 1734016140 00000100:00100000:2.0:1734016139.783985:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335394688:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016139.784065:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117011 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d33 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.784090:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117011 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d33 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.784135:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016139.784246:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333929600:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5894us (6550us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016139.784258:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11599 00000100:00100000:0.0:1734016139.797166:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.797337:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333929728 00000100:00100000:2.0:1734016139.797356:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333929728 00000100:00100000:2.0:1734016139.797455:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11600 00000100:00100000:2.0:1734016139.797470:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333929728:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.797513:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.797550:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117018 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d3a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.797649:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335394816:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.797754:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016139.803322:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335394816:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016139.803422:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117018 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d3a expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.803451:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117018 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d3a expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.803508:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016139.803641:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333929728:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6171us (6496us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016139.803660:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11600 00000100:00100000:0.0:1734016139.807322:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.807487:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333929856 00000100:00100000:2.0:1734016139.807501:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333929856 00000100:00100000:2.0:1734016139.807591:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11601 00000100:00100000:2.0:1734016139.807601:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333929856:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.807643:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.807676:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711701f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d41 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.807721:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711700a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2027519) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d2c expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.807731:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016139.807733:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016139.807737:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711701f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3387392->3391487] (req 3387392->3391487) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d41 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.807774:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711700a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2027519) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d2c expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.807789:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711700a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2027519) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d2c expref: 5 pid: 7684 timeout: 506 lvb_type: 0 00000100:00100000:2.0:1734016139.807828:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335394944:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016139.807922:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016139.812090:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335394944:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016139.812136:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711701f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3387392->3391487] (req 3387392->3391487) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d41 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.812166:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016139.813709:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333929856:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6092us (6390us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016139.813729:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11601 00000100:00100000:0.0:1734016139.824701:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.824879:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333929984 00000100:00100000:3.0:1734016139.824895:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333929984 00010000:00010000:3.0:1734016139.824956:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711700a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2027519) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d2c expref: 6 pid: 7684 timeout: 506 lvb_type: 0 00000100:00100000:3.0:1734016139.825010:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3194 00000100:00100000:3.0:1734016139.825020:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333929984:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016139.825048:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016139.825087:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711700a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2027519) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d2c expref: 6 pid: 7684 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016139.825105:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711700a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2027519) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d2c expref: 6 pid: 7684 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016139.825155:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711700a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2027519) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d2c expref: 6 pid: 7684 timeout: 506 lvb_type: 0 00010000:00010000:3.0:1734016139.825197:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016139.825200:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016139.825215:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711701f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->3391487) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d41 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.825224:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711701f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->3391487) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d41 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016139.825275:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711701f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->3391487) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d41 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016139.825291:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335395072:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016139.825377:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016139.837269:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016139.837418:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333930240 00000100:00100000:1.0:1734016139.837436:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333930240 00002000:00100000:1.0:1734016139.837535:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (3387392->3391487) req@ffff8800749ad500 x1818247333930240/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/0 e 0 to 0 dl 1734016150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016139.837548:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad500 with x1818247333930240 ext(3387392->3391487) 00002000:00010000:1.0:1734016139.837566:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800749ad500 00000100:00100000:1.0:1734016139.837614:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8932 00000100:00100000:1.0:1734016139.837627:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333930240:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016139.838017:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333930240:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 391us (774us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016139.838027:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8932 00002000:00100000:1.0:1734016139.838033:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (3387392->3391487) req@ffff8800749ad500 x1818247333930240/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/4536 e 0 to 0 dl 1734016150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016139.838044:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad500 with x1818247333930240 ext(3387392->3391487) 00002000:00010000:1.0:1734016139.838047:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800749ad500 00000100:00100000:3.0:1734016139.838370:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335395072:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016139.838402:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016139.838457:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333929984:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 13438us (13780us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016139.838472:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3194 00000100:00100000:0.0:1734016139.843957:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016139.844044:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.844275:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333930368 00000100:00100000:3.0:1734016139.844296:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333930368 00000100:00100000:3.0:1734016139.844400:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333930496 00000100:00100000:3.0:1734016139.844403:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333930496 00000100:00100000:3.0:1734016139.844441:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11602 00000100:00100000:3.0:1734016139.844453:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333930368:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016139.844496:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016139.844538:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27117026 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d48 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016139.844658:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335395200:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016139.844768:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016139.845025:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11603 00000100:00100000:1.0:1734016139.845032:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333930496:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016139.845044:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016139.845060:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc2711702d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d4f expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016139.845106:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335395328:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016139.845166:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016139.848606:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335395200:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016139.848715:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27117026 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d48 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016139.848744:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27117026 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d48 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016139.848787:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016139.848963:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333930368:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4509us (5030us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016139.848980:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11602 00000100:00100000:1.0:1734016139.854527:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335395328:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016139.854601:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc2711702d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d4f expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.854623:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc2711702d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d4f expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.854667:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016139.854778:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333930496:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9741us (10729us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016139.854792:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11603 00000100:00100000:0.0:1734016139.866267:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016139.868343:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333930752 00000100:00100000:1.0:1734016139.868363:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333930752 00000100:00100000:1.0:1734016139.868458:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11604 00000100:00100000:1.0:1734016139.868471:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333930752:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016139.868498:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016139.868524:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27117034 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d5d expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016139.868614:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335395456:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016139.868719:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016139.868870:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.870037:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333930624 00000100:00100000:3.0:1734016139.870050:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333930624 00000100:00100000:3.0:1734016139.871029:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11605 00000100:00100000:3.0:1734016139.871044:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333930624:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016139.871082:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016139.871120:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711703b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d56 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016139.871215:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335395584:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016139.871331:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016139.872113:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335395456:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016139.872160:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27117034 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d5d expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.872176:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499cb40/0x5e3a3adc27117034 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d5d expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.872214:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016139.872264:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333930752:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3795us (6023us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016139.872276:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11604 00000100:00100000:2.0:1734016139.875114:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335395584:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016139.875161:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711703b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d56 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.875178:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711703b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d56 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.875207:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:2.0:1734016139.875260:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333930624:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4219us (6390us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016139.875272:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11605 00000100:00100000:0.0:1734016139.877685:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.878610:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333930880 00000100:00100000:2.0:1734016139.878628:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333930880 00000100:00100000:1.0:1734016139.878771:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.879274:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333931008 00000100:00100000:2.0:1734016139.879278:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333931008 00000100:00100000:2.0:1734016139.879305:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11606 00000100:00100000:2.0:1734016139.879318:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333930880:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.879346:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.879377:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117042 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d64 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.879461:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335395712:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.879567:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016139.879637:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11607 00000100:00100000:1.0:1734016139.879644:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333931008:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016139.879656:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016139.879675:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117049 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d6b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016139.879720:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335395840:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016139.879750:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016139.883232:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335395712:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016139.883311:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117042 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d64 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.883341:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117042 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d64 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.883357:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016139.883439:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333930880:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4121us (5766us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016139.883453:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11606 00000100:00100000:1.0:1734016139.883583:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335395840:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016139.883610:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117049 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d6b expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.883620:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117049 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d6b expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.883638:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016139.883659:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333931008:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4015us (4892us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016139.883665:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11607 00000100:00100000:0.0:1734016139.886996:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016139.887598:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016139.887702:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333931264 00000100:00100000:1.0:1734016139.887716:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333931264 00000100:00100000:1.0:1734016139.887773:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333931136 00000100:00100000:1.0:1734016139.887775:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333931136 00000100:00100000:1.0:1734016139.887850:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11608 00000100:00100000:1.0:1734016139.887862:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333931264:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016139.887902:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016139.887943:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27117050 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d79 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016139.888060:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335395968:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016139.888190:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016139.888498:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11609 00000100:00100000:2.0:1734016139.888509:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333931136:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.888523:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.888547:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117057 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d72 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.888611:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335396096:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.888663:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016139.896487:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335395968:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016139.896545:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27117050 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d79 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.896595:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27117050 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d79 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016139.896613:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016139.896680:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333931264:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8820us (9702us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016139.896692:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11608 00000100:00100000:2.0:1734016139.898048:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335396096:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016139.898089:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117057 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d72 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.898101:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117057 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d72 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.898111:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016139.898162:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333931136:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9655us (10565us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016139.898168:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11609 00000100:00100000:0.0:1734016139.900541:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.903328:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333931520 00000100:00100000:2.0:1734016139.903347:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333931520 00002000:00100000:2.0:1734016139.903418:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (3350528->3354623) req@ffff88007487ce00 x1818247333931520/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/0 e 0 to 0 dl 1734016150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016139.903430:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487ce00 with x1818247333931520 ext(3350528->3354623) 00002000:00010000:2.0:1734016139.903436:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487ce00 00000100:00100000:2.0:1734016139.903473:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8933 00000100:00100000:2.0:1734016139.903482:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+15:1984:x1818247333931520:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016139.903713:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+15:1984:x1818247333931520:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 231us (3185us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016139.903725:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8933 00002000:00100000:2.0:1734016139.903732:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (3350528->3354623) req@ffff88007487ce00 x1818247333931520/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/4536 e 0 to 0 dl 1734016150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016139.903740:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487ce00 with x1818247333931520 ext(3350528->3354623) 00002000:00010000:2.0:1734016139.903743:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487ce00 00000100:00100000:0.0:1734016139.910945:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.911313:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333931776 00000100:00100000:2.0:1734016139.911328:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333931776 00002000:00100000:2.0:1734016139.911387:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (3354624->3358719) req@ffff88007487c380 x1818247333931776/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/0 e 0 to 0 dl 1734016150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016139.911401:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487c380 with x1818247333931776 ext(3354624->3358719) 00002000:00010000:2.0:1734016139.911409:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487c380 00000100:00100000:2.0:1734016139.911444:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8934 00000100:00100000:2.0:1734016139.911451:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+15:1983:x1818247333931776:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016139.911742:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+15:1983:x1818247333931776:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 290us (813us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016139.911755:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8934 00002000:00100000:2.0:1734016139.911761:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (3354624->3358719) req@ffff88007487c380 x1818247333931776/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/4536 e 0 to 0 dl 1734016150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016139.911769:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487c380 with x1818247333931776 ext(3354624->3358719) 00002000:00010000:2.0:1734016139.911773:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487c380 00000100:00100000:0.0:1734016139.914333:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.915048:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333932032 00000100:00100000:2.0:1734016139.915062:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333932032 00002000:00100000:2.0:1734016139.915114:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (3358720->3362815) req@ffff88007487d500 x1818247333932032/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/0 e 0 to 0 dl 1734016150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016139.915129:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487d500 with x1818247333932032 ext(3358720->3362815) 00002000:00010000:2.0:1734016139.915134:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487d500 00000100:00100000:2.0:1734016139.915176:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8935 00000100:00100000:2.0:1734016139.915183:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+15:1984:x1818247333932032:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016139.915406:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+15:1984:x1818247333932032:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 222us (1090us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016139.915414:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8935 00002000:00100000:2.0:1734016139.915419:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (3358720->3362815) req@ffff88007487d500 x1818247333932032/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 488/4536 e 0 to 0 dl 1734016150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016139.915426:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487d500 with x1818247333932032 ext(3358720->3362815) 00002000:00010000:2.0:1734016139.915429:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007487d500 00000100:00100000:1.0:1734016139.921727:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.921911:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333932160 00000100:00100000:3.0:1734016139.921926:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333932160 00002000:00100000:3.0:1734016139.922013:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (3350528->4018175) req@ffff8800758f6680 x1818247333932160/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 504/0 e 0 to 0 dl 1734016150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016139.922023:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f6680 with x1818247333932160 ext(3350528->4018175) 00002000:00010000:3.0:1734016139.922030:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758f6680 00000100:00100000:3.0:1734016139.923171:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8936 00000100:00100000:3.0:1734016139.923184:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+15:1984:x1818247333932160:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016139.936251:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+17:1984:x1818247333932160:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 13040us (14519us total) trans 4294969529 rc 0/0 00000100:00100000:3.0:1734016139.936276:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8936 00002000:00100000:3.0:1734016139.936307:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (3350528->4018175) req@ffff8800758f6680 x1818247333932160/t4294969529(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 504/448 e 0 to 0 dl 1734016150 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016139.936318:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f6680 with x1818247333932160 ext(3350528->4018175) 00002000:00010000:3.0:1734016139.936326:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758f6680 00000100:00100000:0.0:1734016139.940782:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.941070:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333932288 00000100:00100000:3.0:1734016139.941091:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333932288 00000100:00100000:3.0:1734016139.941197:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2346 00000100:00100000:3.0:1734016139.941208:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+26:10406:x1818247333932288:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:3.0:1734016139.941454:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+26:10406:x1818247333932288:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 247us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016139.941463:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2346 00000100:00100000:0.0:1734016139.948481:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.949367:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333932416 00000100:00100000:2.0:1734016139.949385:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333932416 00000100:00100000:2.0:1734016139.949462:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11610 00000100:00100000:2.0:1734016139.949479:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+17:1982:x1818247333932416:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016139.957307:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969529 is committed 00000001:00080000:2.0:1734016139.957345:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969527 is committed 00000100:00100000:0.0:1734016139.961876:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333932416:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 12369us (13395us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016139.961906:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11610 00000100:00100000:0.0:1734016139.969938:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.970088:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333932544 00000100:00100000:2.0:1734016139.970108:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333932544 00000100:00100000:2.0:1734016139.970178:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11611 00000100:00100000:2.0:1734016139.970188:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333932544:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.970221:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.970252:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711705e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d80 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.970354:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335396224:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.970451:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016139.972523:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00002000:00010000:2.0:1734016139.974559:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016139 -> 1734016140 00000100:00100000:2.0:1734016139.974612:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335396224:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016139.974690:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711705e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d80 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.974715:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc2711705e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d80 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.974771:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016139.974900:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333932544:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4709us (4983us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016139.974917:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11611 00000100:00100000:2.0:1734016139.974974:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333932672 00000100:00100000:2.0:1734016139.974984:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333932672 00000100:00100000:2.0:1734016139.975030:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11612 00000100:00100000:2.0:1734016139.975040:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333932672:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.975072:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.975101:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117065 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d87 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016139.975182:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335396352:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016139.975237:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00002000:00010000:2.0:1734016139.977574:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016139 -> 1734016140 00002000:00010000:2.0:1734016139.977586:0:7682:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 32 -> 80 00000100:00100000:2.0:1734016139.977615:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335396352:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016139.977662:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117065 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d87 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.977680:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117065 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d87 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016139.977696:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016139.979002:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333932672:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3953us (6487us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016139.979017:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11612 00000100:00100000:0.0:1734016139.983092:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016139.987906:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333932800 00000100:00100000:2.0:1734016139.987937:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333932800 00000100:00100000:2.0:1734016139.988077:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11613 00000100:00100000:2.0:1734016139.988087:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:10406:x1818247333932800:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016139.988124:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016139.988154:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711706c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d8e expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.988205:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711701f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->3391487) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d41 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.988216:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016139.988219:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016139.988224:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711706c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3776512->3784703] (req 3776512->3784703) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d8e expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.988273:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711701f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->3391487) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d41 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.988290:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711701f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->3391487) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d41 expref: 7 pid: 7684 timeout: 507 lvb_type: 0 00000100:00100000:2.0:1734016139.988306:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335396480:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016139.988415:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016139.993600:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016139.993793:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333932928 00000100:00100000:3.0:1734016139.993840:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333932928 00002000:00100000:3.0:1734016139.993899:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (3387392->3391487) req@ffff88007487f480 x1818247333932928/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 4584/0 e 0 to 0 dl 1734016150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016139.993914:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487f480 with x1818247333932928 ext(3387392->3391487) 00010000:00010000:3.0:1734016139.993925:0:7689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711701f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->3391487) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d41 expref: 8 pid: 7684 timeout: 507 lvb_type: 0 00010000:00010000:3.0:1734016139.993942:0:7689:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711701f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->3391487) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d41 expref: 8 pid: 7684 timeout: 507 lvb_type: 0 00002000:00010000:3.0:1734016139.993949:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007487f480 00000100:00100000:3.0:1734016139.993982:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 296 00000100:00100000:3.0:1734016139.993994:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333932928:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016139.994891:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335396480:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016139.994940:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711706c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3776512->3784703] (req 3776512->3784703) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d8e expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016139.994964:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016139.995062:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333932800:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6976us (11996us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016139.995073:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11613 00000100:00100000:3.0:1734016140.000233:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333932928:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 6211us (6620us total) trans 4294968058 rc 0/0 00000100:00100000:3.0:1734016140.000263:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 296 00002000:00100000:3.0:1734016140.000286:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (3387392->3391487) req@ffff88007487f480 x1818247333932928/t4294968058(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:100/0 lens 4584/448 e 0 to 0 dl 1734016150 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016140.000305:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007487f480 with x1818247333932928 ext(3387392->3391487) 00010000:00010000:3.0:1734016140.000322:0:7689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711701f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->3391487) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d41 expref: 10 pid: 7684 timeout: 507 lvb_type: 0 00010000:00010000:3.0:1734016140.000349:0:7689:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711701f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->3391487) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d41 expref: 10 pid: 7684 timeout: 507 lvb_type: 0 00002000:00010000:3.0:1734016140.000358:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007487f480 00000100:00100000:0.0:1734016140.005424:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.005615:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333933056 00000100:00100000:3.0:1734016140.005632:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333933056 00010000:00010000:3.0:1734016140.006276:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711701f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->3391487) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d41 expref: 10 pid: 7684 timeout: 507 lvb_type: 0 00000100:00100000:1.0:1734016140.007795:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3195 00000100:00100000:1.0:1734016140.007838:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333933056:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016140.007875:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1734016140.007916:0:9876:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 152 -> 160 00010000:00010000:1.0:1734016140.007925:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711701f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3387392->3391487) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d41 expref: 10 pid: 7684 timeout: 507 lvb_type: 0 00010000:00010000:1.0:1734016140.007946:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711701f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3387392->3391487) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d41 expref: 10 pid: 7684 timeout: 507 lvb_type: 0 00010000:00010000:1.0:1734016140.007982:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711701f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3387392->3391487) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d41 expref: 10 pid: 7684 timeout: 507 lvb_type: 0 00010000:00010000:1.0:1734016140.008020:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016140.008023:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016140.008032:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711706c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->3784703) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d8e expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.008043:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711706c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->3784703) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d8e expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.008090:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711706c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->3784703) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d8e expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.008105:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335396608:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016140.008214:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00000100:00080000:2.0:1734016140.009475:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016110 00000100:00100000:1.0:1734016140.012844:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335396608:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016140.012876:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016140.012941:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333933056:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5105us (7541us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016140.012956:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3195 00000100:00100000:0.0:1734016140.013361:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.013589:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333933184 00000100:00100000:2.0:1734016140.013601:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333933184 00000100:00100000:2.0:1734016140.013660:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11614 00000100:00100000:2.0:1734016140.013669:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333933184:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016140.014083:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5535168 -> 5535168 00002000:00010000:2.0:1734016140.014089:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016140 -> 1734016140 00002000:00010000:2.0:1734016140.014092:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016140 -> 1734016139 00002000:00010000:2.0:1734016140.014095:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016140 -> 1734016140 00002000:00010000:2.0:1734016140.014097:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 160 -> 176 00000100:00100000:2.0:1734016140.014136:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333933184:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 468us (776us total) trans 4294968059 rc 0/0 00000100:00100000:2.0:1734016140.014141:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11614 00000100:00080000:3.0:1734016140.014583:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016110 00000100:00100000:0.0:1734016140.017416:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.017582:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333933312 00000100:00100000:2.0:1734016140.017603:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333933312 00000100:00080000:3.0:1734016140.017792:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016110 00000100:00100000:2.0:1734016140.017924:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11615 00000100:00100000:2.0:1734016140.017937:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333933312:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.017974:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.018011:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117073 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d95 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016140.018120:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335396736:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.018243:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.020618:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335396736:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.020698:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117073 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d95 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.020723:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117073 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d95 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.020768:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016140.020904:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333933312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2964us (3502us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.020918:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11615 00000100:00100000:0.0:1734016140.024001:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.024189:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333933440 00000100:00100000:2.0:1734016140.024204:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333933440 00000100:00100000:2.0:1734016140.024280:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11616 00000100:00100000:2.0:1734016140.024292:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333933440:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.024325:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.024356:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711707a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6d9c expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016140.024441:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335396864:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.024513:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.031419:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335396864:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.031503:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711707a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d9c expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.031530:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711707a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d9c expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.031576:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016140.031659:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333933440:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7368us (7680us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.031672:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11616 00000100:00100000:0.0:1734016140.034636:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.036184:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333933568 00000100:00100000:2.0:1734016140.036203:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333933568 00000100:00100000:2.0:1734016140.036504:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11617 00000100:00100000:2.0:1734016140.036517:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333933568:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.036560:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.036588:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117081 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6da3 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016140.036677:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335396992:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.036783:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016140.039248:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335396992:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016140.039308:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117081 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6da3 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016140.039330:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117081 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6da3 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016140.040660:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:1.0:1734016140.041155:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333933568:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4633us (6530us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016140.041168:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11617 00000100:00100000:0.0:1734016140.046569:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.046739:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333933824 00000100:00100000:3.0:1734016140.046755:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333933824 00002000:00100000:3.0:1734016140.047128:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (2519040->2523135) req@ffff88012e604380 x1818247333933824/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:101/0 lens 488/0 e 0 to 0 dl 1734016151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016140.047143:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604380 with x1818247333933824 ext(2519040->2523135) 00002000:00010000:3.0:1734016140.047151:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e604380 00000100:00100000:3.0:1734016140.047196:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8937 00000100:00100000:3.0:1734016140.047207:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333933824:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016140.047483:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333933824:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 278us (947us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016140.047497:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8937 00002000:00100000:3.0:1734016140.047503:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (2519040->2523135) req@ffff88012e604380 x1818247333933824/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:101/0 lens 488/4536 e 0 to 0 dl 1734016151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016140.047512:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e604380 with x1818247333933824 ext(2519040->2523135) 00002000:00010000:3.0:1734016140.047515:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e604380 00000100:00100000:0.0:1734016140.051294:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.051608:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333933952 00000100:00100000:2.0:1734016140.051627:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333933952 00002000:00100000:2.0:1734016140.051713:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (2519040->2523135) req@ffff88012e607100 x1818247333933952/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:101/0 lens 4584/0 e 0 to 0 dl 1734016151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.051725:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e607100 with x1818247333933952 ext(2519040->2523135) 00002000:00010000:2.0:1734016140.051733:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e607100 00000100:00100000:2.0:1734016140.051784:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8938 00000100:00100000:2.0:1734016140.051792:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333933952:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016140.053475:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333933952:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1672us (2196us total) trans 4294968060 rc 0/0 00000100:00100000:0.0:1734016140.053491:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8938 00002000:00100000:0.0:1734016140.053503:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (2519040->2523135) req@ffff88012e607100 x1818247333933952/t4294968060(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:101/0 lens 4584/448 e 0 to 0 dl 1734016151 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016140.053512:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e607100 with x1818247333933952 ext(2519040->2523135) 00002000:00010000:0.0:1734016140.053519:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e607100 00000100:00100000:0.0:1734016140.056972:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.057303:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333934080 00000100:00100000:1.0:1734016140.057319:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333934080 00000100:00100000:1.0:1734016140.057630:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11618 00000100:00100000:1.0:1734016140.057642:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333934080:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016140.059702:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968060 is committed 00000001:00080000:2.0:1734016140.059752:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968058 is committed 00000100:00100000:1.0:1734016140.060467:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333934080:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2811us (3512us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016140.060484:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11618 00000100:00100000:0.0:1734016140.064078:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.064208:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333934208 00000100:00100000:1.0:1734016140.064227:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333934208 00000100:00100000:1.0:1734016140.064401:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11619 00000100:00100000:1.0:1734016140.064413:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333934208:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.064437:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.064468:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117088 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6daa expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.064574:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335397120:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.065311:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00002000:00010000:1.0:1734016140.069107:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016139 -> 1734016140 00002000:00010000:1.0:1734016140.069125:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks: 176 -> 184 00000100:00100000:1.0:1734016140.069169:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335397120:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016140.069250:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117088 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6daa expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.069275:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117088 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6daa expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.069878:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016140.069994:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333934208:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5577us (5937us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016140.070012:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11619 00000100:00100000:1.0:1734016140.076406:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.077254:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333934336 00000100:00100000:2.0:1734016140.077272:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333934336 00000100:00100000:2.0:1734016140.078152:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11620 00000100:00100000:2.0:1734016140.078166:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333934336:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.078213:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.078252:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711708f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6db1 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016140.078379:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335397248:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.078503:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.083566:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335397248:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.083633:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711708f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6db1 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.083653:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711708f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6db1 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.083680:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016140.083789:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333934336:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5626us (7401us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.083838:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11620 00000100:00100000:0.0:1734016140.116919:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.117862:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333934592 00000100:00100000:2.0:1734016140.117874:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333934592 00002000:00100000:2.0:1734016140.117927:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff88012e606a00 x1818247333934592/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:101/0 lens 504/0 e 0 to 0 dl 1734016151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.117937:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e606a00 with x1818247333934592 ext(0->4194303) 00002000:00010000:2.0:1734016140.117942:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e606a00 00000100:00100000:2.0:1734016140.117974:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8939 00000100:00100000:2.0:1734016140.117980:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333934592:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016140.194527:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333934592:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 76516us (77598us total) trans 0 rc 4190208/4190208 00000100:00100000:2.0:1734016140.194559:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8939 00002000:00100000:2.0:1734016140.194582:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff88012e606a00 x1818247333934592/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:101/0 lens 504/440 e 0 to 0 dl 1734016151 ref 1 fl Complete:/200/0 rc 4190208/4190208 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.194597:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e606a00 with x1818247333934592 ext(0->4194303) 00002000:00010000:2.0:1734016140.194607:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e606a00 00000100:00100000:0.0:1734016140.207540:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.213181:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333934720 00000100:00100000:2.0:1734016140.213201:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333934720 00000100:00100000:2.0:1734016140.213288:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11621 00000100:00100000:2.0:1734016140.213297:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333934720:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.213325:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.213359:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117096 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6db8 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016140.213438:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335397376:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.213538:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.224891:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335397376:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.224956:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117096 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6db8 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.224976:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117096 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6db8 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.225030:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016140.225130:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333934720:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11832us (17610us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.225144:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11621 00000100:00100000:0.0:1734016140.233280:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.233434:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333934848 00000100:00100000:2.0:1734016140.233451:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333934848 00000100:00100000:2.0:1734016140.233536:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11622 00000100:00100000:2.0:1734016140.233557:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333934848:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.233587:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.233631:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711709d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6dbf expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016140.233737:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335397504:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.233916:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.244529:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335397504:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.244632:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711709d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dbf expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.244655:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711709d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dbf expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.245569:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016140.245678:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333934848:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12128us (12409us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.245697:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11622 00000100:00100000:0.0:1734016140.253423:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.253572:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333934976 00000100:00100000:2.0:1734016140.253590:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333934976 00000100:00100000:2.0:1734016140.253669:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11623 00000100:00100000:2.0:1734016140.253682:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333934976:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.253714:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.253746:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271170a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6dc6 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016140.253850:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335397632:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.254521:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.259420:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335397632:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.259493:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271170a4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dc6 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.259515:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271170a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dc6 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.259558:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016140.263429:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333934976:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9725us (10009us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.263451:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11623 00000100:00100000:0.0:1734016140.270447:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.271768:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333935104 00000100:00100000:2.0:1734016140.271783:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333935104 00000100:00100000:3.0:1734016140.272845:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11624 00000100:00100000:3.0:1734016140.272863:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:10406:x1818247333935104:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.272892:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.272923:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271170ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6dcd expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.272969:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711706c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->3784703) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d8e expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.272978:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016140.272982:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016140.272987:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271170ab lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2637824->2641919] (req 2637824->2641919) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dcd expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.273032:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711706c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->3784703) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d8e expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.273047:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711706c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->3784703) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d8e expref: 5 pid: 7682 timeout: 507 lvb_type: 0 00000100:00100000:3.0:1734016140.273061:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335397760:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016140.273492:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016140.279199:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335397760:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016140.279249:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271170ab lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2637824->2641919] (req 2637824->2641919) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dcd expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.279273:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016140.280695:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333935104:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7823us (10257us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016140.280708:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11624 00000100:00100000:0.0:1734016140.285297:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.286062:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333935232 00000100:00100000:1.0:1734016140.286081:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333935232 00010000:00010000:1.0:1734016140.286154:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711706c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->3784703) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d8e expref: 6 pid: 7682 timeout: 507 lvb_type: 0 00000100:00100000:1.0:1734016140.286228:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3196 00000100:00100000:1.0:1734016140.286241:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333935232:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016140.286271:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016140.286315:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711706c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3776512->3784703) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d8e expref: 6 pid: 7682 timeout: 507 lvb_type: 0 00010000:00010000:1.0:1734016140.286336:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711706c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3776512->3784703) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d8e expref: 6 pid: 7682 timeout: 507 lvb_type: 0 00010000:00010000:1.0:1734016140.286382:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc2711706c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3776512->3784703) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6d8e expref: 6 pid: 7682 timeout: 507 lvb_type: 0 00010000:00010000:1.0:1734016140.286430:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016140.286437:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016140.286448:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271170ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2637824->2641919) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dcd expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.286460:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271170ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2637824->2641919) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dcd expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.286534:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271170ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2637824->2641919) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dcd expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.286561:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335397888:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016140.286671:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016140.290344:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.290524:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333935488 00000100:00100000:1.0:1734016140.290528:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335397888:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016140.290535:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333935488 00010000:00010000:1.0:1734016140.290574:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1734016140.290619:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (2637824->2641919) req@ffff8800756ee680 x1818247333935488/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:101/0 lens 488/0 e 0 to 0 dl 1734016151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.290631:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ee680 with x1818247333935488 ext(2637824->2641919) 00002000:00010000:2.0:1734016140.290637:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756ee680 00000100:00100000:1.0:1734016140.290648:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333935232:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4408us (5377us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016140.290662:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3196 00000100:00100000:2.0:1734016140.290684:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8940 00000100:00100000:2.0:1734016140.290694:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333935488:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016140.294385:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333935488:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 3665us (4044us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016140.294403:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8940 00002000:00100000:2.0:1734016140.294423:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (2637824->2641919) req@ffff8800756ee680 x1818247333935488/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:101/0 lens 488/4536 e 0 to 0 dl 1734016151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.294435:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ee680 with x1818247333935488 ext(2637824->2641919) 00002000:00010000:2.0:1734016140.294445:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756ee680 00000100:00100000:0.0:1734016140.298683:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.299077:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333935616 00000100:00100000:2.0:1734016140.299091:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333935616 00002000:00100000:2.0:1734016140.299162:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (2637824->2641919) req@ffff8800756ece00 x1818247333935616/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:101/0 lens 4584/0 e 0 to 0 dl 1734016151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.299174:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ece00 with x1818247333935616 ext(2637824->2641919) 00002000:00010000:2.0:1734016140.299180:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756ece00 00000100:00100000:2.0:1734016140.299230:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8941 00000100:00100000:2.0:1734016140.299241:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333935616:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016140.301197:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333935616:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1944us (2516us total) trans 4294968061 rc 0/0 00000100:00100000:2.0:1734016140.301212:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8941 00002000:00100000:2.0:1734016140.301225:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (2637824->2641919) req@ffff8800756ece00 x1818247333935616/t4294968061(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:101/0 lens 4584/448 e 0 to 0 dl 1734016151 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.301233:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ece00 with x1818247333935616 ext(2637824->2641919) 00002000:00010000:2.0:1734016140.301239:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756ece00 00000100:00100000:0.0:1734016140.303336:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.303740:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333935744 00000100:00100000:3.0:1734016140.303756:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333935744 00000100:00100000:3.0:1734016140.303901:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11625 00000100:00100000:3.0:1734016140.303916:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333935744:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016140.306125:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968061 is committed 00000100:00100000:3.0:1734016140.306588:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333935744:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2666us (3265us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016140.306604:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11625 00000100:00100000:0.0:1734016140.309834:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.309978:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333936000 00000100:00100000:2.0:1734016140.309989:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333936000 00002000:00100000:2.0:1734016140.310190:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (69632->73727) req@ffff8800756ee300 x1818247333936000/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:101/0 lens 488/0 e 0 to 0 dl 1734016151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.310200:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ee300 with x1818247333936000 ext(69632->73727) 00002000:00010000:2.0:1734016140.310207:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ee300 00000100:00100000:2.0:1734016140.310231:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8942 00000100:00100000:2.0:1734016140.310237:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333936000:12345-192.168.201.16@tcp:3:fsx.0 00000100:00080000:3.0:1734016140.310504:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016110 00000100:00100000:2.0:1734016140.310908:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333936000:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 668us (1121us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016140.310917:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8942 00002000:00100000:2.0:1734016140.310923:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (69632->73727) req@ffff8800756ee300 x1818247333936000/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:101/0 lens 488/4536 e 0 to 0 dl 1734016151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.310930:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ee300 with x1818247333936000 ext(69632->73727) 00002000:00010000:2.0:1734016140.310933:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ee300 00000100:00100000:0.0:1734016140.313907:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.314089:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333936256 00000100:00100000:2.0:1734016140.314102:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333936256 00002000:00100000:2.0:1734016140.314159:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (77824->81919) req@ffff8800756ed880 x1818247333936256/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:101/0 lens 488/0 e 0 to 0 dl 1734016151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.314171:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ed880 with x1818247333936256 ext(77824->81919) 00002000:00010000:2.0:1734016140.314179:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ed880 00000100:00100000:2.0:1734016140.314210:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8943 00000100:00100000:2.0:1734016140.314220:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333936256:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016140.314449:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333936256:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 228us (564us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016140.314457:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8943 00002000:00100000:2.0:1734016140.314464:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (77824->81919) req@ffff8800756ed880 x1818247333936256/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:101/0 lens 488/4536 e 0 to 0 dl 1734016151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.314471:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ed880 with x1818247333936256 ext(77824->81919) 00002000:00010000:2.0:1734016140.314475:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756ed880 00000100:00100000:0.0:1734016140.318051:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.318763:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333936384 00000100:00100000:3.0:1734016140.318777:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333936384 00000100:00100000:3.0:1734016140.318909:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11626 00000100:00100000:3.0:1734016140.318919:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333936384:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016140.319268:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1734016140.319271:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016140 -> 1734016140 00002000:00010000:3.0:1734016140.319273:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016140 -> 1734016139 00002000:00010000:3.0:1734016140.319276:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016140 -> 1734016140 00002000:00010000:3.0:1734016140.319279:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:3.0:1734016140.319518:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333936384:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 599us (1476us total) trans 4294969530 rc 0/0 00000100:00100000:3.0:1734016140.319526:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11626 00000100:00100000:0.0:1734016140.322747:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.322984:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333936512 00000100:00100000:3.0:1734016140.323000:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333936512 00000100:00100000:0.0:1734016140.323362:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11627 00000100:00100000:0.0:1734016140.323377:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333936512:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016140.323791:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5535168 -> 5535168 00002000:00010000:0.0:1734016140.323834:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016140 -> 1734016140 00002000:00010000:0.0:1734016140.323840:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016140 -> 1734016140 00002000:00010000:0.0:1734016140.323842:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016140 -> 1734016140 00002000:00010000:0.0:1734016140.323845:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 184 -> 208 00000100:00100000:0.0:1734016140.323934:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333936512:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 560us (1209us total) trans 4294968062 rc 0/0 00000100:00100000:0.0:1734016140.323944:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11627 00000100:00100000:0.0:1734016140.327388:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.327460:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.327869:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333936640 00000100:00100000:1.0:1734016140.327870:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333936768 00000100:00100000:1.0:1734016140.327887:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333936768 00000100:00100000:2.0:1734016140.327887:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333936640 00000100:00100000:1.0:1734016140.327970:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11628 00000100:00100000:2.0:1734016140.327978:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11629 00000100:00100000:2.0:1734016140.327983:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333936640:12345-192.168.201.16@tcp:101:fsx.0 00000100:00100000:1.0:1734016140.327984:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333936768:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.328021:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.328021:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.328055:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271170b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ddb expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.328055:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271170b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6dd4 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.328152:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335398016:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.328152:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335398144:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.329230:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.329326:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00002000:00010000:2.0:1734016140.331901:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016139 -> 1734016140 00000100:00100000:2.0:1734016140.331940:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335398016:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.331984:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271170b2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ddb expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.332000:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271170b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ddb expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.332021:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:2.0:1734016140.332073:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333936768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4093us (4611us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.332083:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11628 00000100:00100000:3.0:1734016140.332867:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335398144:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016140.332901:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271170b9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dd4 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.332912:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271170b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dd4 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.332939:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:3.0:1734016140.332983:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333936640:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4999us (5615us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016140.332992:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11629 00000100:00100000:0.0:1734016140.335192:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.335259:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.335299:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333937024 00000100:00100000:3.0:1734016140.335310:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333937024 00000100:00100000:3.0:1734016140.335368:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333936896 00000100:00100000:3.0:1734016140.335370:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333936896 00000100:00100000:2.0:1734016140.335381:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11630 00000100:00100000:2.0:1734016140.335398:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333937024:12345-192.168.201.16@tcp:101:fsx.0 00000100:00100000:3.0:1734016140.335417:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11631 00000100:00100000:3.0:1734016140.335422:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333936896:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.335456:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.335490:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc271170c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6de2 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.335531:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.335556:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271170c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6de9 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.335584:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335398272:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.335588:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335398400:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.335717:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:3.0:1734016140.336294:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.339913:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335398400:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.339991:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271170c7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6de9 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.340011:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271170c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6de9 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.340034:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016140.340123:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333937024:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4727us (4940us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.340139:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11630 00000100:00100000:2.0:1734016140.340235:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335398272:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.340268:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc271170c0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6de2 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.340280:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc271170c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6de2 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.340293:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:2.0:1734016140.340314:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333936896:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4892us (5055us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.340322:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11631 00000100:00100000:0.0:1734016140.343648:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.343779:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.343971:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333937152 00000100:00100000:3.0:1734016140.343985:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333937152 00000100:00100000:3.0:1734016140.344050:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333937280 00000100:00100000:3.0:1734016140.344053:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333937280 00000100:00100000:3.0:1734016140.344076:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11632 00000100:00100000:3.0:1734016140.344086:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333937152:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.344114:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.344138:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271170ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6df0 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.344204:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335398528:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016140.344275:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016140.344401:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11633 00000100:00100000:1.0:1734016140.344408:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333937280:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.344417:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.344429:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271170d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6df7 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.344456:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335398656:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.344484:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016140.346612:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335398656:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016140.346668:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271170d5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6df7 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.346684:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc271170d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6df7 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.346771:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:3.0:1734016140.347189:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335398528:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016140.347217:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271170ce lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6df0 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.347229:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271170ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6df0 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.347250:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016140.347319:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333937152:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3231us (3848us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016140.347337:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11632 00000100:00100000:1.0:1734016140.347424:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333937280:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3015us (3644us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016140.347431:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11633 00000100:00100000:0.0:1734016140.350282:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.350504:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333937408 00000100:00100000:1.0:1734016140.350523:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333937408 00000100:00100000:1.0:1734016140.350614:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11634 00000100:00100000:1.0:1734016140.350627:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:10406:x1818247333937408:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.350660:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.350696:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271170dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6dfe expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.350741:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271170ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2637824->2641919) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dcd expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.350755:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016140.350758:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016140.350763:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271170dc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [819200->831487] (req 819200->831487) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dfe expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.350837:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271170ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2637824->2641919) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dcd expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.350853:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271170ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2637824->2641919) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dcd expref: 7 pid: 8216 timeout: 507 lvb_type: 0 00000100:00100000:1.0:1734016140.350869:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335398784:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016140.350967:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016140.354618:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.354947:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335398784:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016140.354993:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271170dc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [819200->831487] (req 819200->831487) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dfe expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.355021:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016140.355106:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333937408:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4483us (4852us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016140.355120:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11634 00000100:00100000:2.0:1734016140.355586:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333937536 00000100:00100000:2.0:1734016140.355596:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333937536 00010000:00010000:2.0:1734016140.355638:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271170ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2637824->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dcd expref: 8 pid: 8216 timeout: 507 lvb_type: 0 00000100:00100000:2.0:1734016140.355673:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3197 00000100:00100000:2.0:1734016140.355682:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333937536:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016140.355700:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016140.355722:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271170ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2637824->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dcd expref: 8 pid: 8216 timeout: 507 lvb_type: 0 00010000:00010000:2.0:1734016140.355732:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271170ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2637824->2641919) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dcd expref: 8 pid: 8216 timeout: 507 lvb_type: 0 00010000:00010000:2.0:1734016140.355758:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271170ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2637824->2641919) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dcd expref: 8 pid: 8216 timeout: 507 lvb_type: 0 00010000:00010000:2.0:1734016140.355780:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016140.355782:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016140.355791:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271170dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->831487) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dfe expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.355871:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271170dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->831487) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dfe expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.355937:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271170dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->831487) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dfe expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016140.355952:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335398912:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016140.356026:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:3.0:1734016140.359462:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335398912:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016140.359517:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016140.359621:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333937536:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3936us (5021us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016140.359641:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3197 00000100:00100000:0.0:1734016140.361377:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.361619:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333937664 00000100:00100000:1.0:1734016140.361635:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333937664 00000100:00100000:1.0:1734016140.361714:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11635 00000100:00100000:1.0:1734016140.361725:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333937664:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016140.362259:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5535168 -> 5535168 00002000:00010000:1.0:1734016140.362264:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016140 -> 1734016140 00002000:00010000:1.0:1734016140.362267:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016140 -> 1734016140 00002000:00010000:1.0:1734016140.362270:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016140 -> 1734016140 00002000:00010000:1.0:1734016140.362274:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 208 -> 232 00000100:00100000:1.0:1734016140.362362:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333937664:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 638us (1007us total) trans 4294968063 rc 0/0 00000100:00100000:1.0:1734016140.362372:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11635 00000100:00100000:0.0:1734016140.365760:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.365946:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333937792 00000100:00100000:1.0:1734016140.365962:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333937792 00000100:00100000:1.0:1734016140.366044:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11636 00000100:00100000:1.0:1734016140.366055:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333937792:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.366086:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.366114:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc271170e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e05 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.366199:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335399040:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.366979:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016140.369858:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335399040:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016140.369921:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc271170e3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e05 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.369945:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc271170e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e05 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.370520:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016140.370622:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333937792:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4567us (4877us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016140.370637:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11636 00000100:00100000:2.0:1734016140.375195:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.375361:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333937920 00000100:00100000:1.0:1734016140.375387:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333937920 00000100:00100000:1.0:1734016140.375497:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11637 00000100:00100000:1.0:1734016140.375513:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333937920:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.375554:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.375586:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc271170ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e0c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.375690:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335399168:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.376419:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016140.379282:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335399168:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016140.379320:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc271170ea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e0c expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.379334:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc271170ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e0c expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.379352:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016140.379406:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333937920:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3898us (4241us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016140.379419:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11637 00000100:00100000:2.0:1734016140.383222:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.384012:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333938048 00000100:00100000:1.0:1734016140.384031:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333938048 00000100:00100000:1.0:1734016140.384539:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11638 00000100:00100000:1.0:1734016140.384558:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333938048:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.384593:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.384631:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271170f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e13 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.384722:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335399296:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.385446:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016140.388500:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335399296:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016140.388586:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271170f1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e13 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.388611:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271170f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e13 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.388644:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016140.389418:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333938048:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4855us (6203us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016140.389436:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11638 00000100:00100000:1.0:1734016140.393277:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.393391:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333938176 00000100:00100000:2.0:1734016140.393402:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333938176 00000100:00100000:2.0:1734016140.393471:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11639 00000100:00100000:2.0:1734016140.393479:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333938176:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.393506:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.393537:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271170f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e1a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.393584:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271170dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->831487) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dfe expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.393591:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016140.393594:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016140.393597:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271170f8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3940352->3948543] (req 3940352->3948543) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e1a expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.393635:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271170dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->831487) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dfe expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.393653:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271170dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->831487) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dfe expref: 6 pid: 7684 timeout: 507 lvb_type: 0 00000100:00100000:2.0:1734016140.393665:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335399424:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016140.393741:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.398985:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.399166:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335399424:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016140.399220:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271170f8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3940352->3948543] (req 3940352->3948543) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e1a expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016140.399242:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:0.0:1734016140.399311:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333938176:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5832us (6050us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016140.399322:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11639 00000100:00100000:3.0:1734016140.399717:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333938304 00000100:00100000:3.0:1734016140.399728:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333938304 00010000:00010000:3.0:1734016140.399771:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271170dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->831487) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dfe expref: 7 pid: 7684 timeout: 507 lvb_type: 0 00000100:00100000:3.0:1734016140.399821:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3198 00000100:00100000:3.0:1734016140.399828:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333938304:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016140.399854:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016140.400471:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271170dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 819200->831487) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dfe expref: 7 pid: 7684 timeout: 507 lvb_type: 0 00010000:00010000:3.0:1734016140.400491:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271170dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 819200->831487) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dfe expref: 7 pid: 7684 timeout: 507 lvb_type: 0 00010000:00010000:3.0:1734016140.400531:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271170dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 819200->831487) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6dfe expref: 7 pid: 7684 timeout: 507 lvb_type: 0 00010000:00010000:3.0:1734016140.400908:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016140.400912:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016140.400925:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271170f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e1a expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.400939:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271170f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e1a expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.400989:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271170f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e1a expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.401004:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335399552:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016140.402146:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.405150:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.405408:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335399552:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016140.405439:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016140.406570:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333938432 00000100:00100000:1.0:1734016140.406581:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333938432 00000100:00100000:1.0:1734016140.406641:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11640 00000100:00100000:1.0:1734016140.406650:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333938432:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016140.406968:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5535168 -> 5535168 00002000:00010000:1.0:1734016140.406972:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016140 -> 1734016140 00002000:00010000:1.0:1734016140.406975:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016140 -> 1734016140 00002000:00010000:1.0:1734016140.406977:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016140 -> 1734016140 00002000:00010000:1.0:1734016140.406980:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 232 -> 248 00000100:00100000:3.0:1734016140.407175:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333938304:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7341us (8205us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016140.407189:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3198 00000100:00100000:1.0:1734016140.407827:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333938432:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1145us (2666us total) trans 4294968064 rc 0/0 00000100:00100000:1.0:1734016140.407837:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11640 00000100:00100000:2.0:1734016140.410984:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.411048:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.411567:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333938688 00000100:00100000:1.0:1734016140.411583:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333938688 00000100:00100000:1.0:1734016140.411659:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333938560 00000100:00100000:1.0:1734016140.411662:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333938560 00000100:00100000:1.0:1734016140.412012:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11641 00000100:00100000:1.0:1734016140.412023:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333938688:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.412056:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.412086:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271170ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e28 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.412180:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335399680:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.412283:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016140.413779:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11642 00000100:00100000:3.0:1734016140.413797:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333938560:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.413845:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.413885:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117106 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e21 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.413955:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335399808:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016140.414030:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00002000:00010000:2.0:1734016140.417280:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016140 -> 1734016141 00000100:00100000:2.0:1734016140.417337:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335399680:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.417390:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271170ff lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e28 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.417408:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271170ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e28 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.417435:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:2.0:1734016140.417513:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333938688:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5492us (6548us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.417523:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11641 00002000:00010000:3.0:1734016140.419170:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016140 -> 1734016141 00000100:00100000:3.0:1734016140.419205:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335399808:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016140.419248:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117106 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e21 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.419263:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117106 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e21 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.419564:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016140.420192:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333938560:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6395us (9137us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016140.420206:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11642 00000100:00100000:0.0:1734016140.423094:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.423168:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.423349:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333938816 00000100:00100000:3.0:1734016140.423366:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333938816 00000100:00100000:3.0:1734016140.423427:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333938944 00000100:00100000:3.0:1734016140.423430:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333938944 00000100:00100000:3.0:1734016140.423457:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11643 00000100:00100000:3.0:1734016140.423467:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333938816:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.423496:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.423528:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711710d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e2f expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.423649:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335399936:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016140.423748:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016140.424160:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11644 00000100:00100000:0.0:1734016140.424167:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333938944:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016140.424177:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016140.424193:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27117114 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e36 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016140.424233:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800756a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335400064:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016140.424266:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.429150:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800756a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335400064:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.429200:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27117114 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e36 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.429221:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581440/0x5e3a3adc27117114 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e36 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.429292:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:2.0:1734016140.429620:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333938944:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5451us (6449us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.429629:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11644 00000100:00100000:3.0:1734016140.430110:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335399936:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016140.430146:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711710d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e2f expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.430165:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711710d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e2f expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.430189:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016140.430215:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333938816:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6750us (7139us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016140.430223:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11643 00000100:00100000:0.0:1734016140.435767:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.435927:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333939200 00000100:00100000:2.0:1734016140.435945:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333939200 00002000:00100000:2.0:1734016140.436034:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (3620864->3624959) req@ffff8800756a4e00 x1818247333939200/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:101/0 lens 488/0 e 0 to 0 dl 1734016151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.436046:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a4e00 with x1818247333939200 ext(3620864->3624959) 00002000:00010000:2.0:1734016140.436054:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756a4e00 00000100:00100000:2.0:1734016140.436086:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8944 00000100:00100000:2.0:1734016140.436097:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333939200:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016140.436392:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333939200:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 296us (648us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016140.436399:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8944 00002000:00100000:2.0:1734016140.436404:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (3620864->3624959) req@ffff8800756a4e00 x1818247333939200/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:101/0 lens 488/4536 e 0 to 0 dl 1734016151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.436410:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a4e00 with x1818247333939200 ext(3620864->3624959) 00002000:00010000:2.0:1734016140.436413:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756a4e00 00000100:00100000:0.0:1734016140.441225:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.441894:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333939456 00000100:00100000:2.0:1734016140.441906:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333939456 00002000:00100000:2.0:1734016140.441962:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (3624960->3629055) req@ffff8800756a6300 x1818247333939456/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:101/0 lens 488/0 e 0 to 0 dl 1734016151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.441973:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6300 with x1818247333939456 ext(3624960->3629055) 00002000:00010000:2.0:1734016140.441979:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756a6300 00000100:00100000:2.0:1734016140.442560:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8945 00000100:00100000:2.0:1734016140.442570:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333939456:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016140.443150:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333939456:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 578us (1944us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016140.443159:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8945 00002000:00100000:2.0:1734016140.443168:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (3624960->3629055) req@ffff8800756a6300 x1818247333939456/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:101/0 lens 488/4536 e 0 to 0 dl 1734016151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.443175:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6300 with x1818247333939456 ext(3624960->3629055) 00002000:00010000:2.0:1734016140.443179:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756a6300 00000100:00100000:0.0:1734016140.447588:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.447711:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333939712 00000100:00100000:2.0:1734016140.447722:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333939712 00002000:00100000:2.0:1734016140.447783:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (3051520->3055615) req@ffff8800756a6a00 x1818247333939712/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:101/0 lens 488/0 e 0 to 0 dl 1734016151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.447794:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6a00 with x1818247333939712 ext(3051520->3055615) 00002000:00010000:2.0:1734016140.447876:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a6a00 00000100:00100000:2.0:1734016140.447906:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8946 00000100:00100000:2.0:1734016140.447914:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333939712:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016140.448396:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333939712:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 481us (820us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016140.448408:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8946 00002000:00100000:2.0:1734016140.448414:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (3051520->3055615) req@ffff8800756a6a00 x1818247333939712/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:101/0 lens 488/4536 e 0 to 0 dl 1734016151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.448421:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6a00 with x1818247333939712 ext(3051520->3055615) 00002000:00010000:2.0:1734016140.448423:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a6a00 00000100:00100000:0.0:1734016140.451951:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.452452:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333939840 00000100:00100000:2.0:1734016140.452464:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333939840 00002000:00100000:2.0:1734016140.452531:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (69632->3055615) req@ffff8800756a6680 x1818247333939840/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:101/0 lens 504/0 e 0 to 0 dl 1734016151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.452551:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6680 with x1818247333939840 ext(69632->3055615) 00002000:00010000:2.0:1734016140.452558:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a6680 00000100:00100000:2.0:1734016140.452586:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8947 00000100:00100000:2.0:1734016140.452597:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333939840:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016140.457550:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333939840:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 4927us (5584us total) trans 4294969531 rc 0/0 00000100:00100000:2.0:1734016140.457568:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8947 00002000:00100000:2.0:1734016140.457595:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (69632->3055615) req@ffff8800756a6680 x1818247333939840/t4294969531(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:101/0 lens 504/448 e 0 to 0 dl 1734016151 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.457607:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756a6680 with x1818247333939840 ext(69632->3055615) 00002000:00010000:2.0:1734016140.457616:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800756a6680 00000100:00100000:0.0:1734016140.460199:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.460391:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333939968 00000100:00100000:3.0:1734016140.460407:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333939968 00000100:00100000:3.0:1734016140.460482:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11645 00000100:00100000:3.0:1734016140.460492:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333939968:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016140.462937:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969531 is committed 00000100:00100000:3.0:1734016140.463341:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333939968:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2837us (3143us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016140.463362:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11645 00000100:00100000:0.0:1734016140.466235:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.466865:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333940096 00000100:00100000:3.0:1734016140.466882:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333940096 00000100:00100000:3.0:1734016140.467529:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11646 00000100:00100000:3.0:1734016140.467537:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333940096:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.467570:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.467592:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711711b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e3d expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.467658:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335400192:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016140.467728:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016140.468982:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.469626:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333940224 00000100:00100000:3.0:1734016140.469639:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333940224 00000100:00100000:3.0:1734016140.472168:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11647 00000100:00100000:3.0:1734016140.472182:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333940224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.472211:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.472245:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27117122 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e44 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.472330:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335400320:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016140.472425:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00002000:00010000:3.0:1734016140.474253:0:7682:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime: 1734016140 -> 1734016141 00002000:00010000:3.0:1734016140.474265:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016140 -> 1734016141 00000100:00100000:3.0:1734016140.474300:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335400192:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016140.474353:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711711b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e3d expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.474373:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc2711711b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e3d expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.474405:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016140.475964:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333940096:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8404us (9725us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016140.475979:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11646 00002000:00010000:3.0:1734016140.477023:0:7683:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016140 -> 1734016141 00002000:00010000:3.0:1734016140.477032:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016140 -> 1734016141 00002000:00010000:3.0:1734016140.477035:0:7683:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 80 -> 112 00000100:00100000:3.0:1734016140.477067:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335400320:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016140.477115:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27117122 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e44 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.477136:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27117122 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e44 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.477151:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016140.477223:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333940224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5043us (8249us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016140.477233:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11647 00000100:00100000:0.0:1734016140.480076:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.480148:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.480298:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333940480 00000100:00100000:3.0:1734016140.480313:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333940480 00000100:00100000:3.0:1734016140.480648:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333940352 00000100:00100000:3.0:1734016140.480652:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333940352 00000100:00100000:2.0:1734016140.480686:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11648 00000100:00100000:2.0:1734016140.480696:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333940480:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.480725:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.480748:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117129 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e52 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016140.480867:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335400448:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016140.481024:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11649 00000100:00100000:3.0:1734016140.481031:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333940352:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.481040:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.481055:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27117130 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e4b expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.481090:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335400576:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.481577:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:3.0:1734016140.481680:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016140.485276:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335400576:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016140.485338:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27117130 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e4b expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.485368:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27117130 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e4b expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.485387:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016140.485466:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333940352:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4434us (5315us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016140.485477:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11649 00000100:00100000:2.0:1734016140.485631:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335400448:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.485653:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117129 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e52 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.485662:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117129 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e52 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.485692:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016140.485715:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333940480:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5021us (5655us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.485721:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11648 00000100:00100000:0.0:1734016140.489050:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.489663:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.489837:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333940736 00000100:00100000:2.0:1734016140.489855:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333940736 00000100:00100000:3.0:1734016140.490105:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333940608 00000100:00100000:3.0:1734016140.490111:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333940608 00000100:00100000:3.0:1734016140.490189:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11650 00000100:00100000:3.0:1734016140.490202:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333940608:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.490238:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.490276:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117137 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e59 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.490381:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335400704:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016140.490478:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.490585:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11651 00000100:00100000:2.0:1734016140.490590:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333940736:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.490600:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.490616:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc2711713e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e60 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016140.490652:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335400832:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.490678:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.493288:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335400832:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.493343:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc2711713e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e60 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.493360:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc2711713e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e60 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.493373:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016140.493432:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333940736:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2840us (4404us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.493444:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11651 00000100:00100000:3.0:1734016140.494422:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335400704:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016140.494463:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117137 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e59 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.494478:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117137 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e59 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.494511:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016140.494567:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333940608:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4369us (4904us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016140.494579:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11650 00000100:00100000:0.0:1734016140.497627:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.497705:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.498323:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333940992 00000100:00100000:3.0:1734016140.498342:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333940992 00000100:00100000:3.0:1734016140.498406:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333940864 00000100:00100000:3.0:1734016140.498408:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333940864 00000100:00100000:3.0:1734016140.498445:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11652 00000100:00100000:3.0:1734016140.498455:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333940992:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.498492:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.498528:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27117145 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e6e expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.498642:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335400960:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016140.498745:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.498822:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11653 00000100:00100000:2.0:1734016140.498830:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333940864:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.498839:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.498856:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711714c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e67 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016140.498896:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335401088:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.498923:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:3.0:1734016140.503553:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335400960:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016140.503612:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27117145 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e6e expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.503629:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27117145 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e6e expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.503664:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016140.505332:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333940992:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6854us (7703us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016140.505350:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11652 00000100:00100000:3.0:1734016140.507861:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335401088:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016140.507909:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711714c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e67 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.507928:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711714c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e67 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.507943:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:3.0:1734016140.508016:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333940864:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9184us (10309us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016140.508025:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11653 00000100:00100000:0.0:1734016140.512725:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.513378:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333941120 00000100:00100000:3.0:1734016140.513396:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333941120 00000100:00100000:3.0:1734016140.513518:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11654 00000100:00100000:3.0:1734016140.513530:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333941120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.513577:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.513627:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117153 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e75 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.513694:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271170f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e1a expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.513704:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016140.513709:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016140.513713:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117153 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1028096->1036287] (req 1028096->1036287) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e75 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.513774:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271170f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e1a expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.513793:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271170f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e1a expref: 8 pid: 7684 timeout: 507 lvb_type: 0 00000100:00100000:3.0:1734016140.513838:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335401216:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016140.513948:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016140.517849:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335401216:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016140.518357:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117153 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1028096->1036287] (req 1028096->1036287) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e75 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.518383:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016140.518463:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333941120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4934us (5759us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016140.518475:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11654 00000100:00100000:0.0:1734016140.518729:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.519169:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333941248 00000100:00100000:3.0:1734016140.519177:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333941248 00010000:00010000:3.0:1734016140.519209:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271170f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e1a expref: 9 pid: 7684 timeout: 507 lvb_type: 0 00000100:00100000:3.0:1734016140.519235:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3199 00000100:00100000:3.0:1734016140.519242:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e719c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333941248:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016140.519262:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016140.519287:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271170f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e1a expref: 9 pid: 7684 timeout: 507 lvb_type: 0 00010000:00010000:3.0:1734016140.519300:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271170f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e1a expref: 9 pid: 7684 timeout: 507 lvb_type: 0 00010000:00010000:3.0:1734016140.519326:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271170f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e1a expref: 9 pid: 7684 timeout: 507 lvb_type: 0 00010000:00010000:3.0:1734016140.519351:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016140.519355:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016140.519362:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117153 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1028096->1036287) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e75 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.519371:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117153 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1028096->1036287) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e75 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.519399:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117153 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1028096->1036287) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e75 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.519411:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335401344:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016140.519463:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016140.528458:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335401344:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016140.528489:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016140.528559:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e719c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333941248:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9315us (9828us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016140.528576:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3199 00000100:00100000:0.0:1734016140.541401:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.541582:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333941504 00000100:00100000:2.0:1734016140.541594:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333941504 00002000:00100000:2.0:1734016140.541665:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff880075609500 x1818247333941504/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:101/0 lens 488/0 e 0 to 0 dl 1734016151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.541677:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609500 with x1818247333941504 ext(0->4194303) 00002000:00010000:2.0:1734016140.541684:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075609500 00000100:00100000:2.0:1734016140.541720:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8948 00000100:00100000:2.0:1734016140.541731:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333941504:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016140.586361:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333941504:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 44601us (44953us total) trans 0 rc 4194304/4194304 00000100:00100000:2.0:1734016140.586380:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8948 00002000:00100000:2.0:1734016140.586401:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff880075609500 x1818247333941504/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:101/0 lens 488/440 e 0 to 0 dl 1734016151 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.586412:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609500 with x1818247333941504 ext(0->4194303) 00002000:00010000:2.0:1734016140.586420:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075609500 00000100:00100000:0.0:1734016140.594018:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.594146:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333941632 00000100:00100000:3.0:1734016140.594161:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333941632 00000100:00100000:3.0:1734016140.594227:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11655 00000100:00100000:3.0:1734016140.594237:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333941632:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.594273:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.594302:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711715a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e7c expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.594342:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016140.594344:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016140.594353:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711715a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e7c expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.594373:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711715a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e7c expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.594387:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016140.594449:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333941632:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 213us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016140.594456:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11655 00000100:00100000:1.0:1734016140.597442:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.597589:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333941888 00000100:00100000:2.0:1734016140.597605:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333941888 00000100:00100000:2.0:1734016140.597715:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2347 00000100:00100000:2.0:1734016140.597725:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333941888:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016140.597860:0:7704:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016140.597910:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27116e3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b5e expref: 16 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.597939:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016140.597944:0:7704:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016140.598201:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117161 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016140.598218:0:7704:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116e2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b57 expref: 25 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.598225:0:7704:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117161 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016140.598263:0:7704:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116e2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b57 expref: 25 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.598278:0:7704:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116e2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b57 expref: 25 pid: 6478 timeout: 507 lvb_type: 0 00000100:00100000:2.0:1734016140.598292:0:7704:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335401472:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016140.598365:0:7704:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00000100:00080000:3.0:1734016140.598832:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016110 00000100:00100000:2.0:1734016140.601009:0:7704:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335401472:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016140.601039:0:7704:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117161 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:1.0:1734016140.602120:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.602212:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333942016 00000100:00100000:3.0:1734016140.602224:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333942016 00010000:00010000:3.0:1734016140.602284:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116e2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b57 expref: 26 pid: 6478 timeout: 507 lvb_type: 0 00000100:00100000:3.0:1734016140.602337:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3200 00000100:00100000:3.0:1734016140.602349:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+26:1981:x1818247333942016:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016140.602376:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016140.602385:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116e2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b57 expref: 26 pid: 6478 timeout: 507 lvb_type: 0 00010000:00010000:3.0:1734016140.602400:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116e2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b57 expref: 26 pid: 6478 timeout: 507 lvb_type: 0 00010000:00010000:3.0:1734016140.602433:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27116e2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6b57 expref: 26 pid: 6478 timeout: 507 lvb_type: 0 00010000:00010000:3.0:1734016140.602465:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016140.602472:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117161 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016140.602486:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016140.602496:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117161 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016140.602537:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016140.602602:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+25:1981:x1818247333942016:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 256us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016140.602611:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3200 00000100:00080000:0.0:1734016140.603085:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016110 00010000:00010000:2.0:1734016140.603912:0:7704:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016140.603922:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:2.0:1734016140.604086:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968825 00000004:00010000:2.0:1734016140.604155:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800758f7800 reply state ffff880075a60000 transno 4294968826 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:2.0:1734016140.604165:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016140.604445:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:10406:x1818247333941888:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 6719us (7029us total) trans 4294968826 rc 0/0 00000100:00100000:2.0:1734016140.604455:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2347 00000020:00080000:2.0:1734016140.604462:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016140.607389:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016140.607417:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117161 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016140.607427:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117161 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016140.607434:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd200 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016140.607440:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117161 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016140.607449:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117161 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016140.607472:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016140.607475:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016140.607480:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117161 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016140.607485:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117161 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00000100:00100000:3.0:1734016140.608747:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.608862:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333942144 00000100:00100000:0.0:1734016140.608887:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333942144 00000100:00100000:0.0:1734016140.608944:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11656 00000100:00100000:0.0:1734016140.608952:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333942144:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016140.608972:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016140.608996:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7583180/0x5e3a3adc27117168 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e83 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016140.609037:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117153 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1028096->1036287) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e75 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016140.609046:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711715a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e7c expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016140.609053:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016140.609055:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016140.609060:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7583180/0x5e3a3adc27117168 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e83 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016140.609106:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711715a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e7c expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016140.609121:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711715a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e7c expref: 8 pid: 7682 timeout: 507 lvb_type: 1 00000100:00100000:0.0:1734016140.609137:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335401600:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016140.609243:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117153 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1028096->1036287) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e75 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016140.609251:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117153 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1028096->1036287) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e75 expref: 8 pid: 7682 timeout: 507 lvb_type: 0 00000100:00100000:0.0:1734016140.609260:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335401728:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016140.609279:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016140.616232:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335401600:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016140.616249:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335401728:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016140.616298:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7583180/0x5e3a3adc27117168 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e83 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016140.616328:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:0.0:1734016140.616407:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247333942144:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7454us (7674us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016140.616419:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11656 00000100:00100000:0.0:1734016140.617679:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.617722:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.618208:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333942272 00000100:00100000:3.0:1734016140.618218:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333942272 00010000:00010000:3.0:1734016140.618261:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711715a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e7c expref: 9 pid: 7682 timeout: 507 lvb_type: 1 00000100:00100000:3.0:1734016140.618365:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333942400 00000100:00100000:3.0:1734016140.618367:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333942400 00010000:00010000:3.0:1734016140.618378:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117153 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1028096->1036287) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e75 expref: 8 pid: 7682 timeout: 507 lvb_type: 0 00000100:00100000:1.0:1734016140.618447:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3201 00000100:00100000:1.0:1734016140.618456:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333942272:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016140.618481:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016140.618510:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711715a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e7c expref: 9 pid: 7682 timeout: 507 lvb_type: 1 00010000:00010000:1.0:1734016140.618520:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711715a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e7c expref: 9 pid: 7682 timeout: 507 lvb_type: 1 00010000:00010000:1.0:1734016140.618552:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711715a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e7c expref: 9 pid: 7682 timeout: 507 lvb_type: 1 00010000:00010000:1.0:1734016140.618716:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016140.618779:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333942272:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 323us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016140.618788:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3201 00000100:00100000:1.0:1734016140.618847:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3202 00000100:00100000:1.0:1734016140.618851:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333942400:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016140.618860:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016140.618867:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117153 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1028096->1036287) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e75 expref: 8 pid: 7682 timeout: 507 lvb_type: 0 00010000:00010000:1.0:1734016140.620301:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117153 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1028096->1036287) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e75 expref: 8 pid: 7682 timeout: 507 lvb_type: 0 00010000:00010000:1.0:1734016140.620324:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117153 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1028096->1036287) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e75 expref: 8 pid: 7682 timeout: 507 lvb_type: 0 00010000:00010000:1.0:1734016140.620344:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016140.620347:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016140.620353:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7583180/0x5e3a3adc27117168 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e83 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.620364:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7583180/0x5e3a3adc27117168 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e83 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.620413:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7583180/0x5e3a3adc27117168 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e83 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.620427:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335401856:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016140.620498:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92a80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016140.622141:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.622179:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333942528 00000100:00100000:0.0:1734016140.622188:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333942528 00000100:00100000:0.0:1734016140.622254:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11657 00000100:00100000:0.0:1734016140.622263:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333942528:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016140.622292:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016140.622317:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711716f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e8a expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016140.622356:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27116fcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4018175) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ced expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016140.622363:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016140.622366:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016140.622370:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711716f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e8a expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016140.622400:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27116fcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4018175) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ced expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016140.622415:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27116fcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4018175) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ced expref: 7 pid: 8216 timeout: 507 lvb_type: 0 00000100:00100000:0.0:1734016140.622428:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007560ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335401984:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016140.622478:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016140.623034:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335401856:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016140.623054:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016140.623084:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333942400:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4231us (5360us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016140.623094:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3202 00010000:00010000:2.0:1734016140.628043:0:6469:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1734016140.628919:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007560ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335401984:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016140.628969:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711716f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e8a expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016140.628994:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580900, rc 0) 00000100:00100000:0.0:1734016140.629072:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333942528:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6807us (6940us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016140.629082:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11657 00000100:00100000:3.0:1734016140.630411:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.630669:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333942656 00000100:00100000:1.0:1734016140.630684:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333942656 00010000:00010000:1.0:1734016140.630732:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27116fcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ced expref: 8 pid: 8216 timeout: 507 lvb_type: 0 00000100:00100000:1.0:1734016140.630783:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3203 00000100:00100000:1.0:1734016140.630792:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333942656:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016140.630855:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016140.630890:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27116fcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4009984->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ced expref: 8 pid: 8216 timeout: 507 lvb_type: 0 00010000:00010000:1.0:1734016140.630906:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27116fcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4009984->4018175) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ced expref: 8 pid: 8216 timeout: 507 lvb_type: 0 00010000:00010000:1.0:1734016140.630935:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27116fcb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4009984->4018175) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ced expref: 8 pid: 8216 timeout: 507 lvb_type: 0 00010000:00010000:1.0:1734016140.630957:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016140.630959:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016140.630967:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711716f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e8a expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.630978:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711716f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e8a expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.631019:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711716f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e8a expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.631034:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335402112:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016140.631109:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92a80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016140.634918:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.636057:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.636094:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333942784 00000100:00100000:0.0:1734016140.636106:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333942784 00002000:00010000:0.0:1734016140.636155:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (2754863->18446744073709551615) 00002000:00100000:0.0:1734016140.636162:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560ad80 with x1818247333942784 ext(2754863->18446744073709551615) 00002000:00010000:0.0:1734016140.636178:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007560ad80. 00000100:00100000:0.0:1734016140.636213:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333942912 00000100:00100000:0.0:1734016140.636216:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333942912 00002000:00010000:0.0:1734016140.636228:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:0.0:1734016140.636231:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609f80 with x1818247333942912 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016140.636238:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075609f80. 00000100:00100000:0.0:1734016140.636253:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8949 00000100:00100000:0.0:1734016140.636261:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333942784:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:2.0:1734016140.636707:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8950 00000100:00100000:2.0:1734016140.636713:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333942912:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016140.640048:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 4194304 -> 0 00002000:00010000:2.0:1734016140.640067:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016141 -> 1734016141 00002000:00010000:2.0:1734016140.640071:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016141 -> 1734016139 00002000:00010000:2.0:1734016140.640074:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016141 -> 1734016141 00002000:00010000:2.0:1734016140.640076:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 112 -> 0 00000100:00100000:2.0:1734016140.640192:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333942912:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 3467us (4128us total) trans 4294969532 rc 0/0 00000100:00100000:2.0:1734016140.640210:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8950 00002000:00010000:2.0:1734016140.640218:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:2.0:1734016140.640222:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609f80 with x1818247333942912 ext(0->18446744073709551615) 00002000:00010000:2.0:1734016140.640230:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075609f80. 00002000:00010000:0.0:1734016140.644303:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5535168 -> 2754863 00002000:00010000:0.0:1734016140.644319:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016141 -> 1734016141 00002000:00010000:0.0:1734016140.644322:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016141 -> 1734016140 00002000:00010000:0.0:1734016140.644325:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016141 -> 1734016141 00002000:00010000:0.0:1734016140.644328:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 248 -> 120 00000100:00100000:0.0:1734016140.644418:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333942784:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 8147us (9505us total) trans 4294968065 rc 0/0 00000100:00100000:0.0:1734016140.644432:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8949 00002000:00010000:0.0:1734016140.644442:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (2754863->18446744073709551615) 00002000:00100000:0.0:1734016140.644447:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007560ad80 with x1818247333942784 ext(2754863->18446744073709551615) 00002000:00010000:0.0:1734016140.644456:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007560ad80. 00000100:00100000:1.0:1734016140.644722:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335402112:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016140.644751:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016140.644775:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333942656:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 13984us (14372us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016140.644786:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3203 00000100:00100000:0.0:1734016140.656365:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.656535:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333943040 00000100:00100000:2.0:1734016140.656556:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333943040 00000100:00100000:2.0:1734016140.656667:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2348 00000100:00100000:2.0:1734016140.656677:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+25:10406:x1818247333943040:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.656725:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.656761:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117176 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e91 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.656997:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711717d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016140.657022:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711717d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016140.657040:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711717d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:2.0:1734016140.657086:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 2754863 00000004:00200000:2.0:1734016140.657092:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016140.657128:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711717d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016140.657167:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117176 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e91 expref: 27 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.657226:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711717d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e91 expref: 26 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.657241:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016140.657245:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016140.657250:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016140.659497:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+26:10406:x1818247333943040:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2796us (3134us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016140.659515:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2348 00000100:00100000:0.0:1734016140.665155:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.665294:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.666769:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333943296 00000100:00100000:2.0:1734016140.666792:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333943296 00000100:00100000:2.0:1734016140.666899:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333943168 00000100:00100000:2.0:1734016140.666903:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333943168 00000100:00100000:2.0:1734016140.666946:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11658 00000100:00100000:2.0:1734016140.666959:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333943296:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.667011:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.667055:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117184 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e9f expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016140.667181:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335402240:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.667319:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:1.0:1734016140.667432:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11659 00000100:00100000:1.0:1734016140.667442:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333943168:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.667454:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.667475:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc2711718b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6e98 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.667518:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335402368:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.667566:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92a80 going to sleep for 11 seconds 00002000:00010000:1.0:1734016140.670616:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016140 -> 1734016141 00000100:00100000:1.0:1734016140.670690:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335402368:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016140.670774:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc2711718b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e98 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.670795:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc2711718b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e98 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1734016140.671308:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016139 -> 1734016141 00000100:00100000:2.0:1734016140.671329:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335402240:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.671360:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117184 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e9f expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.671369:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117184 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e9f expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.671417:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016140.672612:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333943168:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5159us (7307us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016140.672625:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11659 00010000:00010000:2.0:1734016140.672715:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016140.672759:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333943296:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5802us (7639us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.672765:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11658 00000100:00100000:2.0:1734016140.676847:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.676909:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.677078:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333943424 00000100:00100000:1.0:1734016140.677091:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333943424 00000100:00100000:1.0:1734016140.677147:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333943552 00000100:00100000:1.0:1734016140.677149:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333943552 00000100:00100000:1.0:1734016140.677168:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11660 00000100:00100000:1.0:1734016140.677176:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333943424:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.677208:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.677242:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27117192 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ea6 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.677338:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335402496:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.677439:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92a80 going to sleep for 11 seconds 00000100:00100000:3.0:1734016140.677532:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11661 00000100:00100000:3.0:1734016140.677547:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333943552:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.677557:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.677569:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27117199 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ead expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.677603:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335402624:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016140.677627:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016140.680311:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335402624:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016140.680378:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27117199 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ead expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.680399:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27117199 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ead expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.680446:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016140.680522:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333943552:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2980us (3609us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016140.680544:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11661 00000100:00100000:1.0:1734016140.682096:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335402496:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016140.682155:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27117192 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ea6 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.682176:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27117192 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ea6 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.682206:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016140.682272:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333943424:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5096us (5481us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016140.682283:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11660 00000100:00100000:0.0:1734016140.686549:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.686727:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333943680 00000100:00100000:1.0:1734016140.686742:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333943680 00000100:00100000:1.0:1734016140.687285:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11662 00000100:00100000:1.0:1734016140.687297:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333943680:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016140.690324:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 2754863 -> 2754863 00002000:00010000:1.0:1734016140.690340:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016141 -> 1734016141 00002000:00010000:1.0:1734016140.690343:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016141 -> 1734016140 00002000:00010000:1.0:1734016140.690346:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016141 -> 1734016141 00002000:00010000:1.0:1734016140.690348:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 120 -> 120 00000100:00100000:1.0:1734016140.690558:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333943680:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 3246us (4025us total) trans 4294968066 rc 0/0 00000100:00100000:1.0:1734016140.690575:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11662 00000100:00100000:0.0:1734016140.693142:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.693223:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.693529:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333943808 00000100:00100000:3.0:1734016140.693554:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333943808 00000100:00100000:3.0:1734016140.693635:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333943936 00000100:00100000:3.0:1734016140.693638:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333943936 00000100:00100000:3.0:1734016140.693664:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11663 00000100:00100000:3.0:1734016140.693675:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333943808:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.693712:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.693752:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271171a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6eb4 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.693893:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335402752:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016140.693982:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016140.694026:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11664 00000100:00100000:3.0:1734016140.694031:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333943936:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.694041:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.694057:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271171a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ebb expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.694092:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335402880:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016140.694118:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e300 going to sleep for 11 seconds 00002000:00010000:3.0:1734016140.697045:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016140 -> 1734016141 00000100:00100000:3.0:1734016140.697102:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335402752:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016140.697173:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271171a0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6eb4 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.697203:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271171a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6eb4 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.697224:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016140.697302:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333943808:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3627us (4187us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016140.697314:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11663 00000100:00100000:2.0:1734016140.697434:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335402880:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.697455:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271171a7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ebb expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.697464:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271171a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ebb expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.697478:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:2.0:1734016140.697500:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333943936:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3468us (4276us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.697506:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11664 00000100:00100000:0.0:1734016140.701098:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.701176:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.701317:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333944192 00000100:00100000:3.0:1734016140.701333:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333944192 00000100:00100000:3.0:1734016140.701398:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333944064 00000100:00100000:3.0:1734016140.701400:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333944064 00000100:00100000:3.0:1734016140.701764:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11665 00000100:00100000:3.0:1734016140.701775:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333944192:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.701845:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.701878:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271171ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ec9 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.701974:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335403008:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016140.702070:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.702219:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11666 00000100:00100000:2.0:1734016140.702228:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333944064:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.702242:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.702258:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271171b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ec2 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016140.702297:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335403136:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.702329:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:3.0:1734016140.704545:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335403008:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016140.704596:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271171ae lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ec9 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.704613:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271171ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ec9 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.704629:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016140.704681:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333944192:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2907us (3607us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016140.704691:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11665 00000100:00100000:2.0:1734016140.704832:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335403136:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.704859:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271171b5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ec2 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.704869:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271171b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ec2 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.704877:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016140.704894:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333944064:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2668us (3719us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.704898:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11666 00000100:00100000:0.0:1734016140.707359:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.707440:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.707644:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333944448 00000100:00100000:3.0:1734016140.707659:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333944448 00000100:00100000:3.0:1734016140.707717:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333944320 00000100:00100000:3.0:1734016140.707720:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333944320 00000100:00100000:3.0:1734016140.707740:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11667 00000100:00100000:3.0:1734016140.707749:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333944448:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.707781:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.707831:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271171bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ed7 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.707916:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335403264:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016140.708015:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016140.708104:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11668 00000100:00100000:1.0:1734016140.708111:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333944320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.708120:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.708138:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271171c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ed0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.708184:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335403392:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.708218:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.710384:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335403264:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.710437:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271171bc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ed7 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.710452:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271171bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ed7 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.710466:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:2.0:1734016140.710553:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333944448:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2789us (3200us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.710563:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11667 00000100:00100000:0.0:1734016140.710661:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335403392:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016140.710686:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271171c3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ed0 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016140.710696:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271171c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ed0 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016140.710711:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:0.0:1734016140.710731:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333944320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2620us (3291us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016140.710737:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11668 00000100:00100000:0.0:1734016140.713935:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.714132:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333944576 00000100:00100000:2.0:1734016140.714154:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333944576 00000100:00100000:2.0:1734016140.714235:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11669 00000100:00100000:2.0:1734016140.714248:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333944576:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.714283:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.714323:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271171ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ede expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.714382:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7583180/0x5e3a3adc27117168 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e83 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.714392:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016140.714394:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016140.714399:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271171ca lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [6094848->6107135] (req 6094848->6107135) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ede expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.714454:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7583180/0x5e3a3adc27117168 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e83 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.714474:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a7583180/0x5e3a3adc27117168 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e83 expref: 8 pid: 7683 timeout: 507 lvb_type: 0 00000100:00100000:2.0:1734016140.714491:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335403520:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016140.715072:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.717754:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335403520:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016140.717849:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271171ca lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [6094848->6107135] (req 6094848->6107135) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ede expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.717879:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016140.717954:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247333944576:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3709us (4043us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016140.717968:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11669 00000100:00100000:0.0:1734016140.718702:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.719173:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333944704 00000100:00100000:2.0:1734016140.719184:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333944704 00010000:00010000:2.0:1734016140.719231:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7583180/0x5e3a3adc27117168 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e83 expref: 9 pid: 7683 timeout: 507 lvb_type: 0 00000100:00100000:2.0:1734016140.719285:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3204 00000100:00100000:2.0:1734016140.719297:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333944704:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016140.719322:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016140.719358:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a7583180/0x5e3a3adc27117168 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e83 expref: 9 pid: 7683 timeout: 507 lvb_type: 0 00010000:00010000:2.0:1734016140.719372:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a7583180/0x5e3a3adc27117168 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e83 expref: 9 pid: 7683 timeout: 507 lvb_type: 0 00010000:00010000:2.0:1734016140.719405:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7583180/0x5e3a3adc27117168 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e83 expref: 9 pid: 7683 timeout: 507 lvb_type: 0 00010000:00010000:2.0:1734016140.720410:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016140.720418:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016140.720438:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271171ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6094848->6107135) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ede expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.720451:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271171ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6094848->6107135) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ede expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.720512:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271171ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6094848->6107135) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ede expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016140.720529:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335403648:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016140.721453:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:0.0:1734016140.724795:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.724979:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335403648:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016140.725016:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016140.725115:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333944704:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5817us (6412us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016140.725138:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3204 00000100:00100000:2.0:1734016140.725448:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333944832 00000100:00100000:2.0:1734016140.725461:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333944832 00000100:00100000:2.0:1734016140.725519:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11670 00000100:00100000:2.0:1734016140.725528:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333944832:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016140.725985:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 2754863 -> 2754863 00002000:00010000:2.0:1734016140.725989:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016141 -> 1734016141 00002000:00010000:2.0:1734016140.725992:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016141 -> 1734016140 00002000:00010000:2.0:1734016140.725994:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016141 -> 1734016140 00002000:00010000:2.0:1734016140.725996:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 120 -> 144 00000100:00100000:2.0:1734016140.726031:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333944832:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 505us (1255us total) trans 4294968067 rc 0/0 00000100:00100000:2.0:1734016140.726041:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11670 00000100:00100000:0.0:1734016140.729154:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.729272:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333944960 00000100:00100000:2.0:1734016140.729283:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333944960 00000100:00100000:2.0:1734016140.730462:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2349 00000100:00100000:2.0:1734016140.730480:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:10406:x1818247333944960:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.730532:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.730581:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271171d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ee5 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.730722:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271171d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016140.730744:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271171d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016140.730761:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271171d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:2.0:1734016140.730792:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 2754863 00000004:00200000:2.0:1734016140.730797:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016140.730841:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271171d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016140.730867:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271171d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ee5 expref: 19 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.730918:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271171d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ee5 expref: 18 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.730927:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016140.730931:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016140.730936:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016140.731040:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:10406:x1818247333944960:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 563us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016140.731048:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2349 00000100:00100000:0.0:1734016140.735219:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.735399:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333945088 00000100:00100000:1.0:1734016140.735417:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333945088 00000100:00100000:1.0:1734016140.735677:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11671 00000100:00100000:1.0:1734016140.735691:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333945088:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.735728:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.735765:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271171df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6eec expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.736130:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335403776:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.736548:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92f00 going to sleep for 11 seconds 00002000:00010000:1.0:1734016140.738701:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016140 -> 1734016141 00002000:00010000:1.0:1734016140.738718:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016140 -> 1734016141 00000100:00100000:1.0:1734016140.738754:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335403776:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016140.738854:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271171df lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6eec expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.738875:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271171df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6eec expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.738911:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016140.738982:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333945088:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3292us (3776us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016140.738997:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11671 00000100:00100000:0.0:1734016140.743040:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.743199:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333945216 00000100:00100000:1.0:1734016140.743212:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333945216 00000100:00100000:1.0:1734016140.743792:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11672 00000100:00100000:1.0:1734016140.744554:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333945216:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.744586:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.744620:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc271171e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ef3 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.744716:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335403904:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.745358:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92f00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016140.747369:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335403904:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016140.747421:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc271171e6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ef3 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.747440:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc271171e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ef3 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.747477:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016140.747552:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333945216:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3750us (4530us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016140.747562:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11672 00000100:00100000:0.0:1734016140.751064:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.751175:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333945344 00000100:00100000:1.0:1734016140.751188:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333945344 00000100:00100000:1.0:1734016140.751758:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11673 00000100:00100000:1.0:1734016140.751769:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333945344:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.751873:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.751895:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271171ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6efa expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.751964:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335404032:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.752030:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92f00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016140.755991:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335404032:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016140.756072:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271171ed lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6efa expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.756098:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271171ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6efa expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.756139:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016140.756235:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333945344:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4465us (5185us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016140.756255:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11673 00000100:00100000:0.0:1734016140.759880:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.759985:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333945472 00000100:00100000:1.0:1734016140.759999:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333945472 00000100:00100000:1.0:1734016140.760069:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11674 00000100:00100000:1.0:1734016140.760079:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333945472:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.760111:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.760141:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271171f4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f01 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.760192:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711716f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e8a expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.760201:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016140.760204:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016140.760209:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271171f4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [65536->77823] (req 65536->77823) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f01 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.760257:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711716f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e8a expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.760274:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711716f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e8a expref: 7 pid: 7683 timeout: 507 lvb_type: 0 00000100:00100000:1.0:1734016140.760289:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335404160:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016140.760401:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92f00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016140.763955:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335404160:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016140.764007:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271171f4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [65536->77823] (req 65536->77823) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f01 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.764032:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016140.764120:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333945472:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4041us (4258us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016140.764132:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11674 00000100:00100000:0.0:1734016140.764236:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.764553:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333945600 00000100:00100000:3.0:1734016140.764562:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333945600 00010000:00010000:3.0:1734016140.764596:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711716f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e8a expref: 8 pid: 7683 timeout: 507 lvb_type: 0 00000100:00100000:3.0:1734016140.764628:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3205 00000100:00100000:3.0:1734016140.764636:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075651180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333945600:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016140.764653:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016140.764680:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711716f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e8a expref: 8 pid: 7683 timeout: 507 lvb_type: 0 00010000:00010000:3.0:1734016140.764692:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711716f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e8a expref: 8 pid: 7683 timeout: 507 lvb_type: 0 00010000:00010000:3.0:1734016140.764723:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580900/0x5e3a3adc2711716f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e8a expref: 8 pid: 7683 timeout: 507 lvb_type: 0 00010000:00010000:3.0:1734016140.764740:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016140.764742:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016140.764749:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271171f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->77823) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f01 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.764758:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271171f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->77823) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f01 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.764786:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271171f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->77823) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f01 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.764823:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335404288:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016140.764877:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016140.767555:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335404288:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016140.767588:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016140.768866:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075651180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333945600:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4210us (4610us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016140.768885:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3205 00000100:00100000:1.0:1734016140.769232:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.769335:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333945728 00000100:00100000:0.0:1734016140.769345:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333945728 00000100:00100000:0.0:1734016140.769395:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11675 00000100:00100000:0.0:1734016140.769403:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333945728:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016140.769757:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 74129 00002000:00010000:0.0:1734016140.769761:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016141 -> 1734016140 00002000:00010000:0.0:1734016140.769764:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016141 -> 1734016139 00002000:00010000:0.0:1734016140.769766:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016141 -> 1734016140 00002000:00010000:0.0:1734016140.769768:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 24 00000100:00100000:0.0:1734016140.769849:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333945728:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 447us (619us total) trans 4294969533 rc 0/0 00000100:00100000:0.0:1734016140.769856:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11675 00000100:00100000:0.0:1734016140.772518:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.772636:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.772851:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333945856 00000100:00100000:3.0:1734016140.772865:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333945856 00000100:00100000:3.0:1734016140.772915:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333945984 00000100:00100000:3.0:1734016140.772917:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333945984 00000100:00100000:3.0:1734016140.772949:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11676 00000100:00100000:3.0:1734016140.772959:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333945856:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.772984:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.773011:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271171fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f08 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.773081:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335404416:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016140.773148:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.773211:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11677 00000100:00100000:2.0:1734016140.773217:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333945984:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.773226:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.773236:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117202 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f0f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016140.773267:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335404544:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.773289:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00002000:00010000:2.0:1734016140.775055:0:8216:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016140 -> 1734016141 00002000:00010000:2.0:1734016140.775067:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016139 -> 1734016141 00002000:00010000:2.0:1734016140.775070:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016140 -> 1734016141 00000100:00100000:2.0:1734016140.775092:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335404544:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.775125:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117202 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f0f expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.775138:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117202 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f0f expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.775155:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016140.775215:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333945984:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1995us (2577us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.775225:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11677 00000100:00100000:3.0:1734016140.776456:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335404416:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016140.776487:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271171fb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f08 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.776500:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271171fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f08 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.777521:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016140.778078:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333945856:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5112us (5568us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016140.778098:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11676 00000100:00100000:0.0:1734016140.781405:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.781548:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.781649:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333946112 00000100:00100000:3.0:1734016140.781667:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333946240 00000100:00100000:2.0:1734016140.781671:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333946112 00000100:00100000:3.0:1734016140.781672:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333946240 00000100:00100000:3.0:1734016140.781746:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11678 00000100:00100000:2.0:1734016140.781890:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11679 00000100:00100000:3.0:1734016140.781893:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333946240:12345-192.168.201.16@tcp:101:fsx.0 00000100:00100000:2.0:1734016140.781895:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333946112:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.781921:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.781921:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.781949:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117209 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f16 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.781949:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27117210 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f1d expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016140.782031:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335404800:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016140.782031:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335404672:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.782336:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:3.0:1734016140.782336:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016140.786056:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335404672:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016140.786120:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27117210 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f1d expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.786138:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27117210 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f1d expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.786171:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016140.786258:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333946240:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4361us (4713us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016140.786273:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11678 00000100:00100000:3.0:1734016140.788631:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335404800:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016140.788696:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117209 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f16 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.788718:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117209 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f16 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.788734:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:3.0:1734016140.788858:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333946112:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6958us (7473us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016140.788872:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11679 00000100:00100000:0.0:1734016140.793399:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.793527:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333946368 00000100:00100000:3.0:1734016140.793547:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333946368 00000100:00100000:3.0:1734016140.793676:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11680 00000100:00100000:3.0:1734016140.793686:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333946368:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016140.794203:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 2754863 -> 2754863 00002000:00010000:3.0:1734016140.794207:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016141 -> 1734016141 00002000:00010000:3.0:1734016140.794209:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016141 -> 1734016140 00002000:00010000:3.0:1734016140.794211:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016141 -> 1734016140 00002000:00010000:3.0:1734016140.794213:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 144 -> 152 00000100:00100000:3.0:1734016140.794614:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333946368:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 927us (1233us total) trans 4294968068 rc 0/0 00000100:00100000:3.0:1734016140.794623:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11680 00000100:00100000:0.0:1734016140.797990:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.798211:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333946624 00000100:00100000:3.0:1734016140.798224:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333946624 00000100:00100000:3.0:1734016140.798303:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11681 00000100:00100000:3.0:1734016140.798313:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333946624:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.798341:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1734016140.798483:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1734016140.798557:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117217 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f2b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.798630:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333946496 00000100:00100000:1.0:1734016140.798635:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333946496 00000100:00100000:3.0:1734016140.798636:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335404928:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.798660:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11682 00000100:00100000:1.0:1734016140.798664:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333946496:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.798674:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.798686:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc2711721e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f24 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.798718:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e240 going to sleep for 11 seconds 00000100:00100000:1.0:1734016140.798721:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335405056:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.798752:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92f00 going to sleep for 11 seconds 00002000:00010000:1.0:1734016140.802051:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016140 -> 1734016141 00002000:00010000:1.0:1734016140.802062:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016140 -> 1734016141 00000100:00100000:3.0:1734016140.802073:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335404928:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.802075:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335405056:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016140.802116:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc2711721e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f24 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.802116:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117217 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f2b expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.802132:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc2711721e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f24 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.802132:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117217 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f2b expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.802164:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00010000:00010000:1.0:1734016140.802165:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:3.0:1734016140.802285:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333946624:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3970us (4309us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016140.802297:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11681 00000100:00100000:1.0:1734016140.802504:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333946496:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3838us (4020us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016140.802510:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11682 00000100:00100000:0.0:1734016140.806048:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.806963:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.807340:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333946752 00000100:00100000:1.0:1734016140.807353:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333946752 00000100:00100000:1.0:1734016140.807410:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333946880 00000100:00100000:1.0:1734016140.807412:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333946880 00000100:00100000:1.0:1734016140.807441:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11683 00000100:00100000:1.0:1734016140.807450:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333946752:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.807498:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.807528:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc27117225 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f32 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.807633:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335405184:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.807747:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92f00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016140.808363:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11684 00000100:00100000:0.0:1734016140.808370:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333946880:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016140.808381:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016140.808396:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc2711722c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f39 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016140.808437:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335405312:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016140.808467:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016140.811660:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335405184:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016140.811745:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc27117225 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f32 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.811772:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc27117225 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f32 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.813269:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016140.813433:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333946752:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5974us (7401us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016140.813450:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11683 00000100:00100000:0.0:1734016140.814770:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007487df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335405312:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016140.814871:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc2711722c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f39 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016140.814895:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc2711722c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f39 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016140.814919:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581d40, rc 0) 00000100:00100000:0.0:1734016140.814960:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333946880:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6589us (8001us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016140.814970:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11684 00000100:00100000:2.0:1734016140.819227:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.819313:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333947008 00000100:00100000:0.0:1734016140.819331:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333947008 00000100:00100000:0.0:1734016140.819461:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11685 00000100:00100000:0.0:1734016140.819473:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333947008:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016140.820201:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 2754863 -> 2754863 00002000:00010000:0.0:1734016140.820206:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016141 -> 1734016140 00002000:00010000:0.0:1734016140.820208:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016141 -> 1734016140 00002000:00010000:0.0:1734016140.820211:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016141 -> 1734016140 00002000:00010000:0.0:1734016140.820213:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 152 -> 152 00000100:00100000:0.0:1734016140.820303:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333947008:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 830us (1092us total) trans 4294968069 rc 0/0 00000100:00100000:0.0:1734016140.820314:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11685 00000100:00100000:0.0:1734016140.824267:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.824375:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.824946:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333947264 00000100:00100000:2.0:1734016140.824962:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333947264 00000100:00100000:2.0:1734016140.825361:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333947136 00000100:00100000:2.0:1734016140.825365:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333947136 00000100:00100000:1.0:1734016140.825439:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11686 00000100:00100000:1.0:1734016140.825454:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333947264:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.825492:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.825524:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27117233 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f47 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.825624:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335405440:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.825725:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92f00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.825781:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11687 00000100:00100000:2.0:1734016140.825788:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007487ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333947136:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.825815:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.825832:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711723a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f40 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016140.825871:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335405568:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.825900:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016140.828885:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335405440:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016140.828949:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27117233 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f47 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.828967:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27117233 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f47 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1734016140.829108:0:7683:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime: 1734016140 -> 1734016141 00002000:00010000:2.0:1734016140.829113:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016140 -> 1734016141 00002000:00010000:2.0:1734016140.829115:0:7683:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016140 -> 1734016141 00000100:00100000:2.0:1734016140.829131:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335405568:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.829161:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711723a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f40 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.829172:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc2711723a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f40 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.829193:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016140.829254:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333947136:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3465us (4877us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.829266:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11687 00010000:00010000:1.0:1734016140.830145:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016140.830183:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007487df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333947264:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4732us (5937us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016140.830191:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11686 00000100:00100000:0.0:1734016140.836035:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.836102:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.836298:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333947520 00000100:00100000:1.0:1734016140.836315:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333947520 00000100:00100000:1.0:1734016140.836714:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333947392 00000100:00100000:1.0:1734016140.836717:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333947392 00000100:00100000:1.0:1734016140.836746:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11688 00000100:00100000:1.0:1734016140.836756:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333947520:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.836796:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.836857:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27117241 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f55 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.836960:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335405696:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.837051:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92f00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.837121:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11689 00000100:00100000:2.0:1734016140.837128:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333947392:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.837138:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.837154:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117248 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f4e expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016140.837199:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335405824:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.837225:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.840101:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335405824:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.840160:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117248 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f4e expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.840177:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117248 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f4e expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.840199:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016140.840276:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333947392:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3146us (4171us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.840288:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11689 00000100:00100000:1.0:1734016140.840528:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335405696:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016140.840560:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27117241 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f55 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.840570:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27117241 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f55 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.840579:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016140.840603:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333947520:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3850us (4580us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016140.840608:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11688 00000100:00100000:0.0:1734016140.844860:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.844932:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.845055:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333947648 00000100:00100000:1.0:1734016140.845071:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333947648 00000100:00100000:1.0:1734016140.845141:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333947776 00000100:00100000:1.0:1734016140.845145:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333947776 00000100:00100000:1.0:1734016140.845262:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11690 00000100:00100000:1.0:1734016140.845274:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333947648:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.845303:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.845333:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc2711724f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f5c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.845411:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335405952:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016140.845514:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11691 00000100:00100000:0.0:1734016140.845519:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333947776:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016140.845528:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016140.845550:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27117256 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f63 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016140.845582:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335406080:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.846333:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92f00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016140.846492:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016140.849407:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335406080:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016140.849497:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27117256 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f63 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016140.849521:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27117256 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f63 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016140.849551:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581d40, rc 0) 00000100:00100000:0.0:1734016140.849640:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333947776:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4116us (4703us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016140.849653:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11691 00000100:00100000:1.0:1734016140.849972:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335405952:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016140.850013:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc2711724f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f5c expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.850028:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc2711724f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f5c expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.850042:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016140.850069:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333947648:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4799us (5284us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016140.850077:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11690 00000100:00100000:0.0:1734016140.853466:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.854002:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.854740:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333947904 00000100:00100000:1.0:1734016140.854768:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333947904 00000100:00100000:1.0:1734016140.854915:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333948032 00000100:00100000:1.0:1734016140.854919:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333948032 00000100:00100000:1.0:1734016140.854947:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11692 00000100:00100000:1.0:1734016140.854960:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333947904:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.855008:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.855050:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc2711725d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f6a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.855174:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335406208:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.855303:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92f00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016140.855843:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11693 00000100:00100000:2.0:1734016140.855855:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333948032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016140.855871:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016140.855892:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117264 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f71 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016140.855951:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335406336:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016140.856003:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016140.859251:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335406208:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016140.859331:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc2711725d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f6a expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.859354:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc2711725d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f6a expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.859371:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016140.859458:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333947904:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4499us (6011us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016140.859473:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11692 00000100:00100000:2.0:1734016140.861589:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335406336:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016140.861654:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117264 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f71 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.861675:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117264 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f71 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016140.861701:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016140.863654:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333948032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7774us (9623us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016140.863671:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11693 00000100:00100000:0.0:1734016140.867187:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.867348:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333948160 00000100:00100000:2.0:1734016140.867365:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333948160 00000100:00100000:2.0:1734016140.867446:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11694 00000100:00100000:2.0:1734016140.867457:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333948160:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016140.868116:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 74129 -> 2136811 00002000:00010000:2.0:1734016140.868121:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016141 -> 1734016140 00002000:00010000:2.0:1734016140.868124:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016141 -> 1734016139 00002000:00010000:2.0:1734016140.868127:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016141 -> 1734016140 00002000:00010000:2.0:1734016140.868130:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 24 -> 32 00000100:00100000:2.0:1734016140.868322:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333948160:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 866us (1164us total) trans 4294969534 rc 0/0 00000100:00100000:2.0:1734016140.868331:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11694 00000100:00100000:1.0:1734016140.873099:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.873213:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333948288 00000100:00100000:2.0:1734016140.873224:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333948288 00000100:00100000:2.0:1734016140.873284:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11695 00000100:00100000:2.0:1734016140.873296:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333948288:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016140.873672:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 2754863 -> 2754863 00002000:00010000:2.0:1734016140.873676:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016141 -> 1734016140 00002000:00010000:2.0:1734016140.873679:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016141 -> 1734016140 00002000:00010000:2.0:1734016140.873681:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016141 -> 1734016140 00002000:00010000:2.0:1734016140.873682:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 152 -> 152 00000100:00100000:2.0:1734016140.873880:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333948288:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 584us (802us total) trans 4294968070 rc 0/0 00000100:00100000:2.0:1734016140.873891:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11695 00000100:00100000:0.0:1734016140.878118:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.879060:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333948416 00000100:00100000:1.0:1734016140.879085:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333948416 00000100:00100000:1.0:1734016140.879174:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11696 00000100:00100000:1.0:1734016140.879185:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247333948416:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.879219:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.879265:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc2711726b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f78 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.879316:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271171ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6094848->6107135) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ede expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.879327:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016140.879329:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016140.879337:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc2711726b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3710976->3719167] (req 3710976->3719167) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f78 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.879387:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271171ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6094848->6107135) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ede expref: 12 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.879408:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271171ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6094848->6107135) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ede expref: 12 pid: 7684 timeout: 508 lvb_type: 0 00000100:00100000:1.0:1734016140.879429:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335406464:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016140.879548:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92f00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016140.883947:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335406464:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016140.884011:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc2711726b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3710976->3719167] (req 3710976->3719167) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f78 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.884048:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016140.884130:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:10406:x1818247333948416:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4944us (6032us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016140.884143:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11696 00000100:00100000:0.0:1734016140.885633:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.886167:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333948544 00000100:00100000:3.0:1734016140.886180:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333948544 00010000:00010000:3.0:1734016140.886229:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271171ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6094848->6107135) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ede expref: 13 pid: 7684 timeout: 508 lvb_type: 0 00000100:00100000:3.0:1734016140.886596:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3206 00000100:00100000:3.0:1734016140.886607:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333948544:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016140.886635:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016140.886674:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271171ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6094848->6107135) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ede expref: 13 pid: 7684 timeout: 508 lvb_type: 0 00010000:00010000:3.0:1734016140.886699:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271171ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6094848->6107135) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ede expref: 13 pid: 7684 timeout: 508 lvb_type: 0 00010000:00010000:3.0:1734016140.886741:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271171ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6094848->6107135) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ede expref: 13 pid: 7684 timeout: 508 lvb_type: 0 00010000:00010000:3.0:1734016140.887038:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016140.887042:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016140.887054:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc2711726b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->3719167) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f78 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.887065:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc2711726b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->3719167) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f78 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.887120:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc2711726b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->3719167) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f78 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016140.887139:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335406592:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016140.887250:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016140.889498:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335406592:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016140.889527:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016140.889587:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333948544:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 2980us (3961us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016140.889602:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3206 00000100:00100000:0.0:1734016140.891051:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.891210:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333948672 00000100:00100000:1.0:1734016140.891222:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333948672 00000100:00100000:1.0:1734016140.891291:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11697 00000100:00100000:1.0:1734016140.891300:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333948672:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.891336:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.891364:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27117272 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f7f expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016140.891447:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335406720:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016140.891549:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92f00 going to sleep for 11 seconds 00002000:00010000:1.0:1734016140.893994:0:7684:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016140 -> 1734016141 00002000:00010000:1.0:1734016140.894009:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016139 -> 1734016141 00002000:00010000:1.0:1734016140.894012:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016140 -> 1734016141 00000100:00100000:1.0:1734016140.894055:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335406720:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016140.894131:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27117272 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f7f expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.894153:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27117272 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f7f expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.894722:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016140.894843:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333948672:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3542us (3806us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016140.894856:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11697 00000100:00100000:1.0:1734016140.903211:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.903291:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333948928 00000100:00100000:0.0:1734016140.903306:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333948928 00002000:00100000:0.0:1734016140.903377:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->3715071) req@ffff8800758f7100 x1818247333948928/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:101/0 lens 504/0 e 0 to 0 dl 1734016151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016140.903388:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f7100 with x1818247333948928 ext(0->3715071) 00002000:00010000:0.0:1734016140.903394:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800758f7100 00000100:00100000:0.0:1734016140.903435:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8951 00000100:00100000:0.0:1734016140.903445:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333948928:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016140.944926:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333948928:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 41454us (41700us total) trans 0 rc 2756608/2756608 00000100:00100000:2.0:1734016140.944951:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8951 00002000:00100000:2.0:1734016140.944975:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->3715071) req@ffff8800758f7100 x1818247333948928/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:101/0 lens 504/440 e 0 to 0 dl 1734016151 ref 1 fl Complete:/200/0 rc 2756608/2756608 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.944987:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f7100 with x1818247333948928 ext(0->3715071) 00002000:00010000:2.0:1734016140.944996:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800758f7100 00000100:00100000:0.0:1734016140.949510:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.950364:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333949184 00000100:00100000:2.0:1734016140.950386:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333949184 00002000:00100000:2.0:1734016140.950474:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (3715072->3719167) req@ffff8800749aea00 x1818247333949184/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:101/0 lens 488/0 e 0 to 0 dl 1734016151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016140.950489:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749aea00 with x1818247333949184 ext(3715072->3719167) 00002000:00010000:2.0:1734016140.950498:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800749aea00 00000100:00100000:3.0:1734016140.951700:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8952 00000100:00100000:3.0:1734016140.951719:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333949184:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016140.952130:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333949184:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 412us (2640us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016140.952140:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8952 00002000:00100000:3.0:1734016140.952153:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (3715072->3719167) req@ffff8800749aea00 x1818247333949184/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:101/0 lens 488/440 e 0 to 0 dl 1734016151 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016140.952164:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749aea00 with x1818247333949184 ext(3715072->3719167) 00002000:00010000:3.0:1734016140.952169:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800749aea00 00000100:00100000:0.0:1734016140.956625:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.957501:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333949312 00000100:00100000:1.0:1734016140.957526:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333949312 00000100:00100000:1.0:1734016140.957625:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11698 00000100:00100000:1.0:1734016140.957637:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333949312:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016140.957683:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016140.957723:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27117279 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f86 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016140.957779:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016140.957782:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016140.957797:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27117279 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f86 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.957849:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27117279 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f86 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016140.957868:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016140.957957:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333949312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 321us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016140.957967:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11698 00000100:00100000:0.0:1734016140.961794:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016140.962215:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333949568 00000100:00100000:2.0:1734016140.962234:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333949568 00000100:00100000:2.0:1734016140.962351:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2350 00000100:00100000:2.0:1734016140.962366:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:10406:x1818247333949568:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016140.962478:0:7704:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016140.962545:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271171d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ee5 expref: 18 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.962587:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016140.962593:0:7704:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016140.962955:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117280 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016140.962978:0:7704:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711717d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e91 expref: 25 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.962987:0:7704:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117280 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016140.963037:0:7704:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711717d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e91 expref: 25 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016140.963055:0:7704:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711717d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e91 expref: 25 pid: 7704 timeout: 508 lvb_type: 0 00000100:00100000:2.0:1734016140.963071:0:7704:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335406848:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016140.963179:0:7704:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00000100:00100000:0.0:1734016140.966446:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.966867:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333949696 00000100:00100000:3.0:1734016140.966884:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333949696 00010000:00010000:3.0:1734016140.966964:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711717d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e91 expref: 26 pid: 7704 timeout: 508 lvb_type: 0 00000100:00100000:3.0:1734016140.967028:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3207 00000100:00100000:3.0:1734016140.967043:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+26:1981:x1818247333949696:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016140.967077:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016140.967088:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711717d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e91 expref: 26 pid: 7704 timeout: 508 lvb_type: 0 00010000:00010000:3.0:1734016140.967110:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711717d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e91 expref: 26 pid: 7704 timeout: 508 lvb_type: 0 00010000:00010000:3.0:1734016140.967164:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016140.967173:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117280 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016140.967194:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117280 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016140.967208:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117280 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016140.967244:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016140.968048:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+26:1981:x1818247333949696:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1004us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016140.968059:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3207 00010000:00010000:2.0:1734016140.968220:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711717d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6e91 expref: 25 pid: 7704 timeout: 508 lvb_type: 0 00000100:00100000:2.0:1734016140.968242:0:7704:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335406848:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016140.968274:0:7704:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117280 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016140.968283:0:7704:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117280 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016140.968288:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117280 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000001:00080000:2.0:1734016140.968450:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968827 00000004:00010000:2.0:1734016140.968524:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012e605880 reply state ffff880075a66000 transno 4294968828 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117280 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:2.0:1734016140.968541:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016140.968663:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:10406:x1818247333949568:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 6301us (6897us total) trans 4294968828 rc 0/0 00000100:00100000:2.0:1734016140.968670:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2350 00000020:00080000:2.0:1734016140.968676:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1734016140.972682:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117280 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016140.972713:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117280 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016140.972723:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117280 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016140.972731:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbe1c0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016140.972738:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117280 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016140.972749:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117280 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016140.972785:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016140.972788:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016140.972797:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117280 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016140.972836:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117280 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016140.973487:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.974630:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333949824 00000100:00100000:3.0:1734016140.974647:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333949824 00000100:00100000:3.0:1734016140.974743:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11699 00000100:00100000:3.0:1734016140.974755:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:10406:x1818247333949824:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.974793:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.974890:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117287 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f8d expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.974934:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc2711726b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->3719167) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f78 expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.974945:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27117279 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f86 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.974952:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016140.974955:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016140.974959:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117287 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f8d expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.975002:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27117279 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f86 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016140.975019:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27117279 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f86 expref: 12 pid: 7684 timeout: 508 lvb_type: 1 00000100:00100000:3.0:1734016140.975032:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335406976:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016140.975142:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc2711726b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->3719167) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f78 expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.975158:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc2711726b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->3719167) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f78 expref: 10 pid: 7684 timeout: 508 lvb_type: 0 00000100:00100000:3.0:1734016140.975166:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335407104:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016140.975188:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016140.984738:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335406976:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016140.986269:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016140.986314:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016140.986449:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333949952 00000100:00100000:0.0:1734016140.986460:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333949952 00010000:00010000:0.0:1734016140.986502:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27117279 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f86 expref: 13 pid: 7684 timeout: 508 lvb_type: 1 00000100:00100000:0.0:1734016140.986547:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333950080 00000100:00100000:0.0:1734016140.986550:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333950080 00010000:00010000:0.0:1734016140.986562:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc2711726b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f78 expref: 11 pid: 7684 timeout: 508 lvb_type: 0 00000100:00100000:0.0:1734016140.986796:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3208 00000100:00100000:0.0:1734016140.986822:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333949952:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016140.986849:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016140.986883:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27117279 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f86 expref: 13 pid: 7684 timeout: 508 lvb_type: 1 00010000:00010000:0.0:1734016140.986896:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27117279 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f86 expref: 13 pid: 7684 timeout: 508 lvb_type: 1 00010000:00010000:0.0:1734016140.986935:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27117279 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f86 expref: 13 pid: 7684 timeout: 508 lvb_type: 1 00010000:00010000:0.0:1734016140.986964:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016140.987034:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333949952:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 215us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016140.987048:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3208 00000100:00100000:0.0:1734016140.987069:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3209 00000100:00100000:0.0:1734016140.987074:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333950080:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016140.987086:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016140.987092:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc2711726b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f78 expref: 11 pid: 7684 timeout: 508 lvb_type: 0 00010000:00010000:0.0:1734016140.987104:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc2711726b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->3719167) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f78 expref: 11 pid: 7684 timeout: 508 lvb_type: 0 00010000:00010000:0.0:1734016140.987119:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016140.987122:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016140.987130:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f8d expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016140.987142:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f8d expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016140.987187:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f8d expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016140.987200:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e604700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335407232:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016140.987252:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1734016140.987884:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc2711726b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->3719167) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f78 expref: 11 pid: 7684 timeout: 508 lvb_type: 0 00000100:00100000:3.0:1734016140.987903:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335407104:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016140.987947:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f8d expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.987959:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016140.987990:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:10406:x1818247333949824:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 13238us (14517us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016140.988001:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11699 00000100:00100000:2.0:1734016140.995155:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e604700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335407232:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016140.995208:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016140.995281:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333950080:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 8203us (8964us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016140.995300:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3209 00000100:00100000:0.0:1734016140.998723:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016140.999061:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333950208 00000100:00100000:3.0:1734016140.999078:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333950208 00000100:00100000:3.0:1734016140.999163:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11700 00000100:00100000:3.0:1734016140.999174:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333950208:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016140.999207:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016140.999237:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711728e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f94 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.999286:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271171f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->77823) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f01 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.999295:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016140.999298:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016140.999303:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711728e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f94 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.999347:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271171f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->77823) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f01 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016140.999364:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271171f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->77823) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f01 expref: 9 pid: 7682 timeout: 508 lvb_type: 0 00000100:00100000:3.0:1734016140.999377:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335407360:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016140.999455:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.004093:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335407360:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016141.004154:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711728e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f94 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.004181:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016141.004249:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247333950208:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5076us (5551us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016141.004264:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11700 00000100:00100000:0.0:1734016141.004678:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016141.005422:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333950336 00000100:00100000:2.0:1734016141.005438:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333950336 00010000:00010000:2.0:1734016141.005506:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271171f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->77823) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f01 expref: 10 pid: 7682 timeout: 508 lvb_type: 0 00000100:00100000:2.0:1734016141.005559:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3210 00000100:00100000:2.0:1734016141.005569:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333950336:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016141.005597:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016141.005644:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271171f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 65536->77823) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f01 expref: 10 pid: 7682 timeout: 508 lvb_type: 0 00010000:00010000:2.0:1734016141.005662:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271171f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 65536->77823) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f01 expref: 10 pid: 7682 timeout: 508 lvb_type: 0 00010000:00010000:2.0:1734016141.005710:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc271171f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 65536->77823) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f01 expref: 10 pid: 7682 timeout: 508 lvb_type: 0 00010000:00010000:2.0:1734016141.005757:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016141.005760:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016141.005772:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711728e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f94 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.005785:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711728e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f94 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.005884:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711728e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f94 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016141.005903:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335407488:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016141.006003:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016141.009454:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016141.009523:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.009763:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333950592 00000100:00100000:3.0:1734016141.009778:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333950592 00002000:00010000:3.0:1734016141.009905:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:3.0:1734016141.009913:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e606300 with x1818247333950592 ext(0->18446744073709551615) 00002000:00010000:3.0:1734016141.009932:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e606300. 00000100:00100000:3.0:1734016141.009958:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333950464 00000100:00100000:3.0:1734016141.009961:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333950464 00002000:00010000:3.0:1734016141.009978:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (3531493->18446744073709551615) 00002000:00100000:3.0:1734016141.009981:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605180 with x1818247333950464 ext(3531493->18446744073709551615) 00002000:00010000:3.0:1734016141.009993:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e605180. 00000100:00100000:3.0:1734016141.010012:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8953 00000100:00100000:3.0:1734016141.010022:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333950592:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016141.010390:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 2136811 -> 0 00002000:00010000:3.0:1734016141.010394:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016141 -> 1734016141 00002000:00010000:3.0:1734016141.010397:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016141 -> 1734016139 00002000:00010000:3.0:1734016141.010399:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016141 -> 1734016141 00002000:00010000:3.0:1734016141.010402:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 32 -> 0 00000100:00100000:2.0:1734016141.010687:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8954 00000100:00100000:2.0:1734016141.010698:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333950464:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016141.010978:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 2754863 -> 3531493 00002000:00010000:2.0:1734016141.010981:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016140 -> 1734016141 00002000:00010000:2.0:1734016141.010984:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016140 -> 1734016140 00002000:00010000:2.0:1734016141.010987:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016140 -> 1734016141 00002000:00010000:2.0:1734016141.010989:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 152 -> 128 00000100:00100000:0.0:1734016141.012241:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335407488:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016141.012284:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016141.012650:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333950592:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 2624us (3208us total) trans 4294969535 rc 0/0 00000100:00100000:3.0:1734016141.012667:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8953 00002000:00010000:3.0:1734016141.012678:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:3.0:1734016141.012682:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e606300 with x1818247333950592 ext(0->18446744073709551615) 00002000:00010000:3.0:1734016141.012697:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e606300. 00000100:00100000:2.0:1734016141.012834:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333950464:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 2134us (3307us total) trans 4294968071 rc 0/0 00000100:00100000:2.0:1734016141.012845:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8954 00002000:00010000:2.0:1734016141.012850:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (3531493->18446744073709551615) 00002000:00100000:2.0:1734016141.012853:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e605180 with x1818247333950464 ext(3531493->18446744073709551615) 00002000:00010000:2.0:1734016141.012865:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e605180. 00000100:00100000:0.0:1734016141.012954:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333950336:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7385us (8276us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016141.012966:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3210 00000100:00100000:0.0:1734016141.015713:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016141.015854:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333950720 00000100:00100000:2.0:1734016141.015868:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333950720 00000100:00100000:2.0:1734016141.015936:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2351 00000100:00100000:2.0:1734016141.015945:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:10406:x1818247333950720:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016141.015982:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016141.016008:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117295 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6f9b expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.016139:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711729c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016141.016156:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711729c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016141.016170:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711729c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:2.0:1734016141.016196:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 3531493 00000004:00200000:2.0:1734016141.016201:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016141.016221:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711729c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016141.016244:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117295 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f9b expref: 21 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.016263:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711729c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f9b expref: 20 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.016274:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016141.016277:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016141.016281:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016141.016365:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:10406:x1818247333950720:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 421us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016141.016371:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2351 00000100:00100000:0.0:1734016141.019163:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.019414:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333950848 00000100:00100000:3.0:1734016141.019426:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333950848 00000100:00100000:3.0:1734016141.019560:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11701 00000100:00100000:3.0:1734016141.019570:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:10406:x1818247333950848:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.019609:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.019639:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271172a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6fa2 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.019686:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117287 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f8d expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.019696:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016141.019699:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016141.019702:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271172a3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa2 expref: 13 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.019748:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f8d expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.019764:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f8d expref: 9 pid: 7682 timeout: 508 lvb_type: 0 00000100:00100000:3.0:1734016141.019780:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335407616:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016141.020617:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.024417:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335407616:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016141.024469:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271172a3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa2 expref: 13 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.024493:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016141.024566:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:10406:x1818247333950848:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4996us (5420us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016141.024581:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11701 00000100:00100000:0.0:1734016141.025509:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016141.025908:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333950976 00000100:00100000:2.0:1734016141.025920:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333950976 00010000:00010000:2.0:1734016141.025970:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f8d expref: 10 pid: 7682 timeout: 508 lvb_type: 0 00000100:00100000:2.0:1734016141.026011:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3211 00000100:00100000:2.0:1734016141.026021:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333950976:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016141.026044:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016141.026080:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f8d expref: 10 pid: 7682 timeout: 508 lvb_type: 0 00010000:00010000:2.0:1734016141.026096:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f8d expref: 10 pid: 7682 timeout: 508 lvb_type: 0 00010000:00010000:2.0:1734016141.026138:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117287 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f8d expref: 10 pid: 7682 timeout: 508 lvb_type: 0 00010000:00010000:2.0:1734016141.026178:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016141.026180:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016141.026191:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271172a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 430080->434175) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa2 expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.026203:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271172a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 430080->434175) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa2 expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.026253:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271172a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 430080->434175) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa2 expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016141.026267:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335407744:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016141.026341:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00000100:00100000:0.0:1734016141.035684:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335407744:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016141.035739:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016141.035890:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333950976:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9866us (10380us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016141.035911:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3211 00000100:00100000:2.0:1734016141.036232:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.036774:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333951232 00000100:00100000:3.0:1734016141.036792:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333951232 00002000:00100000:3.0:1734016141.036934:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->3534847) req@ffff880075fc5880 x1818247333951232/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:102/0 lens 488/0 e 0 to 0 dl 1734016152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.036952:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc5880 with x1818247333951232 ext(0->3534847) 00002000:00010000:3.0:1734016141.036960:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075fc5880 00000100:00100000:3.0:1734016141.037016:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8955 00000100:00100000:3.0:1734016141.037031:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333951232:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016141.094129:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333951232:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 57087us (57885us total) trans 0 rc 3534848/3534848 00000100:00100000:3.0:1734016141.094144:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8955 00002000:00100000:3.0:1734016141.094158:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->3534847) req@ffff880075fc5880 x1818247333951232/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:102/0 lens 488/440 e 0 to 0 dl 1734016152 ref 1 fl Complete:/200/0 rc 3534848/3534848 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.094167:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc5880 with x1818247333951232 ext(0->3534847) 00002000:00010000:3.0:1734016141.094173:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075fc5880 00000100:00100000:0.0:1734016141.102621:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016141.103698:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333951360 00000100:00100000:2.0:1734016141.103723:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333951360 00000100:00100000:2.0:1734016141.103856:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2352 00000100:00100000:2.0:1734016141.103871:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+25:10406:x1818247333951360:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016141.103919:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016141.103960:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271172aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6fa9 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.104159:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271172b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016141.104179:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271172b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016141.104195:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271172b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:2.0:1734016141.104237:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 3531493 00000004:00200000:2.0:1734016141.104244:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016141.104270:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271172b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016141.104295:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271172aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa9 expref: 27 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.104337:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271172b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa9 expref: 26 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.104347:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016141.104350:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016141.104354:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016141.105741:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+26:10406:x1818247333951360:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1847us (3129us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016141.105761:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2352 00000100:00100000:0.0:1734016141.110094:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.110252:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333951488 00000100:00100000:3.0:1734016141.110278:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333951488 00000100:00100000:3.0:1734016141.111332:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11702 00000100:00100000:3.0:1734016141.111350:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333951488:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.111390:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.111431:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271172b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6fb0 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.112130:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335407872:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016141.112390:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e240 going to sleep for 11 seconds 00002000:00010000:3.0:1734016141.116757:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016139 -> 1734016141 00000100:00100000:3.0:1734016141.116915:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335407872:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016141.116986:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271172b8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fb0 expref: 10 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.117007:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271172b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fb0 expref: 10 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.117071:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016141.117198:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333951488:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5849us (7142us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016141.117214:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11702 00000100:00100000:0.0:1734016141.119053:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.119211:0:6475:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333951616 00000100:00100000:1.0:1734016141.119224:0:6475:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333951616 00000100:00100000:1.0:1734016141.119301:0:6475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 334 00000100:00100000:1.0:1734016141.119310:0:6475:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99867e87-1bc2-4e49-bd45-a757ae2fdd76+12:1981:x1818247333951616:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:1.0:1734016141.119401:0:6475:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99867e87-1bc2-4e49-bd45-a757ae2fdd76+12:1981:x1818247333951616:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 91us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016141.119409:0:6475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 334 00000100:00080000:0.0:1734016141.120059:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016111 00000100:00100000:0.0:1734016141.123107:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.123263:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333951744 00000100:00100000:3.0:1734016141.123278:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333951744 00000100:00100000:3.0:1734016141.123364:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11703 00000100:00100000:3.0:1734016141.123376:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333951744:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.123416:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.123455:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271172bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6fb7 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.123580:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335408000:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016141.123684:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.126165:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335408000:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016141.126249:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271172bf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fb7 expref: 10 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.126271:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc271172bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fb7 expref: 10 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.126845:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016141.126977:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333951744:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3599us (3885us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016141.126991:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11703 00000100:00100000:0.0:1734016141.132326:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.132617:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333951872 00000100:00100000:3.0:1734016141.132638:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333951872 00000100:00100000:3.0:1734016141.132737:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11704 00000100:00100000:3.0:1734016141.132750:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333951872:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.132793:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.132872:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271172c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6fbe expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.132917:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016141.132920:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016141.132933:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271172c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fbe expref: 10 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.132961:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271172c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fbe expref: 10 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.132987:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016141.133074:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333951872:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 325us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016141.133083:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11704 00000100:00100000:0.0:1734016141.136164:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.137094:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333952000 00000100:00100000:1.0:1734016141.137115:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333952000 00000100:00100000:1.0:1734016141.137747:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11705 00000100:00100000:1.0:1734016141.137760:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333952000:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016141.137832:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016141.137871:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc271172cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6fc5 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016141.137969:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335408128:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016141.138104:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92c00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016141.140650:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335408128:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016141.140724:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc271172cd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fc5 expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.140745:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc271172cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fc5 expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.140788:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016141.141712:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333952000:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3948us (5579us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016141.141728:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11705 00000100:00100000:0.0:1734016141.145649:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.146615:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333952128 00000100:00100000:1.0:1734016141.146637:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333952128 00000100:00100000:1.0:1734016141.146725:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11706 00000100:00100000:1.0:1734016141.146735:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333952128:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016141.146777:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016141.146827:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271172d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6fcc expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016141.146936:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335408256:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016141.147070:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92c00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016141.149339:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335408256:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016141.149407:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271172d4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fcc expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.149430:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc271172d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fcc expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.149467:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016141.149848:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333952128:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3112us (4223us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016141.149864:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11706 00000100:00100000:0.0:1734016141.155231:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.156046:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333952384 00000100:00100000:3.0:1734016141.156060:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333952384 00002000:00100000:3.0:1734016141.156147:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1499136->3534847) req@ffff8800756ed180 x1818247333952384/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 504/0 e 0 to 0 dl 1734016152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.156162:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ed180 with x1818247333952384 ext(1499136->3534847) 00002000:00010000:3.0:1734016141.156173:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756ed180 00000100:00100000:3.0:1734016141.156211:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8956 00000100:00100000:3.0:1734016141.156222:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333952384:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016141.169082:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333952384:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 12829us (13833us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1734016141.169104:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8956 00002000:00100000:3.0:1734016141.169128:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1499136->3534847) req@ffff8800756ed180 x1818247333952384/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 504/440 e 0 to 0 dl 1734016152 ref 1 fl Complete:/200/0 rc 782336/782336 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.169140:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ed180 with x1818247333952384 ext(1499136->3534847) 00002000:00010000:3.0:1734016141.169149:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756ed180 00000100:00100000:0.0:1734016141.175389:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.176164:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333952640 00000100:00100000:3.0:1734016141.176181:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333952640 00002000:00100000:3.0:1734016141.176256:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1503232->1507327) req@ffff8800749adc00 x1818247333952640/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 488/0 e 0 to 0 dl 1734016152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.176279:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749adc00 with x1818247333952640 ext(1503232->1507327) 00002000:00010000:3.0:1734016141.176287:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800749adc00 00000100:00100000:3.0:1734016141.176320:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8957 00000100:00100000:3.0:1734016141.176328:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333952640:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016141.178037:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333952640:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 1693us (2663us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016141.178050:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8957 00002000:00100000:3.0:1734016141.178064:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1503232->1507327) req@ffff8800749adc00 x1818247333952640/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 488/4536 e 0 to 0 dl 1734016152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.178074:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749adc00 with x1818247333952640 ext(1503232->1507327) 00002000:00010000:3.0:1734016141.178079:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800749adc00 00000100:00100000:0.0:1734016141.182505:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.182708:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333952768 00000100:00100000:1.0:1734016141.182728:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333952768 00000100:00100000:1.0:1734016141.183252:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11707 00000100:00100000:1.0:1734016141.183265:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333952768:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016141.183323:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016141.183371:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271172db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6fd3 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016141.183519:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335408384:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016141.183707:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92c00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016141.186467:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335408384:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016141.186561:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271172db lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fd3 expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.186592:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271172db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fd3 expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.186700:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016141.186794:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333952768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3529us (4308us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016141.186855:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11707 00000100:00100000:0.0:1734016141.190445:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.190839:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333952896 00000100:00100000:1.0:1734016141.190854:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333952896 00000100:00100000:1.0:1734016141.190922:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11708 00000100:00100000:1.0:1734016141.190932:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333952896:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016141.190958:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016141.190982:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc271172e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6fda expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016141.191068:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335408512:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016141.191154:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92c00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016141.198336:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335408512:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016141.198409:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc271172e2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fda expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.198431:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc271172e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fda expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.198479:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016141.198573:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333952896:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7640us (8151us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016141.198587:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11708 00000100:00100000:0.0:1734016141.201002:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016141.201165:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333953152 00000100:00100000:2.0:1734016141.201182:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333953152 00000100:00100000:2.0:1734016141.201250:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2353 00000100:00100000:2.0:1734016141.201258:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:10406:x1818247333953152:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016141.201344:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016141.201393:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711729c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f9b expref: 20 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.201448:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016141.201457:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016141.201781:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271172e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016141.201862:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271172b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa9 expref: 25 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.201872:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271172e9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016141.201926:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271172b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa9 expref: 25 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.201947:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271172b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa9 expref: 25 pid: 6478 timeout: 508 lvb_type: 0 00000100:00100000:2.0:1734016141.201965:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335408640:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016141.202059:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.207275:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335408640:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016141.207349:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271172e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:0.0:1734016141.207565:0:6461:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968829 is committed 00000001:00080000:0.0:1734016141.207592:0:6461:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968824 is committed 00000100:00100000:1.0:1734016141.208346:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016141.208695:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333953280 00000100:00100000:0.0:1734016141.208707:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333953280 00010000:00010000:0.0:1734016141.208761:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271172b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa9 expref: 18 pid: 6478 timeout: 508 lvb_type: 0 00000100:00100000:0.0:1734016141.208848:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3212 00000100:00100000:0.0:1734016141.208859:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247333953280:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016141.208895:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016141.208905:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271172b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa9 expref: 18 pid: 6478 timeout: 508 lvb_type: 0 00010000:00010000:0.0:1734016141.208919:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271172b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa9 expref: 18 pid: 6478 timeout: 508 lvb_type: 0 00010000:00010000:0.0:1734016141.208951:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271172b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa9 expref: 18 pid: 6478 timeout: 508 lvb_type: 0 00010000:00010000:0.0:1734016141.208977:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:0.0:1734016141.208984:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271172e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016141.208994:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271172e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016141.209003:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271172e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:0.0:1734016141.209044:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016141.209082:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271172e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016141.209090:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271172e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:0.0:1734016141.209111:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+17:1982:x1818247333953280:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 252us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016141.209119:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3212 00000001:00080000:3.0:1734016141.209222:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968829 00000004:00010000:3.0:1734016141.209283:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012b132d80 reply state ffff88012cfa1000 transno 4294968830 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271172e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016141.209291:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016141.209375:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333953152:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 8118us (8395us total) trans 4294968830 rc 0/0 00000100:00100000:3.0:1734016141.209382:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2353 00000020:00080000:3.0:1734016141.209386:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016141.214321:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1734016141.214429:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271172e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016141.214449:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271172e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016141.214456:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271172e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016141.214463:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcfc0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016141.214469:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271172e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016141.214478:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271172e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016141.214504:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016141.214509:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016141.214513:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271172e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016141.214518:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271172e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:1.0:1734016141.214664:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333953408 00000100:00100000:1.0:1734016141.214679:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333953408 00000100:00100000:1.0:1734016141.214752:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11709 00000100:00100000:1.0:1734016141.214762:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:10406:x1818247333953408:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016141.214782:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016141.214831:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271172f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6fe1 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016141.214870:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271172a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 430080->434175) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa2 expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016141.214878:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271172c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fbe expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.214884:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016141.214886:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016141.214890:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271172f0 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fe1 expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016141.214928:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271172c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fbe expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.214947:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271172c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fbe expref: 11 pid: 7682 timeout: 508 lvb_type: 1 00000100:00100000:1.0:1734016141.214959:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335408768:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016141.215059:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271172a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 430080->434175) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa2 expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016141.215068:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271172a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 430080->434175) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa2 expref: 12 pid: 7682 timeout: 508 lvb_type: 0 00000100:00100000:1.0:1734016141.215076:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335408896:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016141.215095:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92c00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016141.224424:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016141.224512:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016141.224564:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333953664 00000100:00100000:0.0:1734016141.224579:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333953664 00000100:00100000:1.0:1734016141.224614:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335408768:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016141.224631:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271172a3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 430080->434175) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa2 expref: 13 pid: 7682 timeout: 508 lvb_type: 0 00000100:00100000:1.0:1734016141.224631:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335408896:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016141.224675:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271172f0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fe1 expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016141.224688:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333953536 00000100:00100000:0.0:1734016141.224691:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333953536 00010000:00010000:0.0:1734016141.224701:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271172c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fbe expref: 12 pid: 7682 timeout: 508 lvb_type: 1 00000100:00100000:0.0:1734016141.224728:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3213 00000100:00100000:0.0:1734016141.224737:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333953664:12345-192.168.201.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1734016141.224738:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3214 00000100:00100000:3.0:1734016141.224745:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247333953536:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016141.224758:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016141.224758:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016141.224786:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271172a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 430080->434175) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa2 expref: 13 pid: 7682 timeout: 508 lvb_type: 0 00010000:00010000:0.0:1734016141.224798:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271172a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 430080->434175) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa2 expref: 13 pid: 7682 timeout: 508 lvb_type: 0 00010000:00010000:0.0:1734016141.224882:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271172a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 430080->434175) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fa2 expref: 13 pid: 7682 timeout: 508 lvb_type: 0 00010000:00010000:0.0:1734016141.224921:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016141.224983:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333953664:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 246us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016141.224993:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3213 00010000:00010000:3.0:1734016141.225327:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271172c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fbe expref: 12 pid: 7682 timeout: 508 lvb_type: 1 00010000:00010000:3.0:1734016141.225341:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271172c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fbe expref: 12 pid: 7682 timeout: 508 lvb_type: 1 00010000:00010000:3.0:1734016141.225358:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271172c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fbe expref: 12 pid: 7682 timeout: 508 lvb_type: 1 00010000:00010000:3.0:1734016141.225379:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016141.225383:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016141.225391:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271172f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fe1 expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.225404:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271172f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fe1 expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.225458:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271172f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fe1 expref: 11 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.225477:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335409024:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016141.225571:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00010000:00010000:1.0:1734016141.226715:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016141.226791:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:10406:x1818247333953408:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12027us (12491us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016141.226820:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11709 00000100:00100000:2.0:1734016141.230439:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.230575:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335409024:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016141.230609:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016141.230676:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333953536:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5929us (6161us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016141.230693:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3214 00000100:00100000:2.0:1734016141.231118:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016141.231968:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333953920 00000100:00100000:0.0:1734016141.231983:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333953920 00000100:00100000:1.0:1734016141.232009:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333953792 00000100:00100000:1.0:1734016141.232014:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333953792 00002000:00010000:0.0:1734016141.232028:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00010000:1.0:1734016141.232028:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (3682196->18446744073709551615) 00002000:00100000:0.0:1734016141.232033:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc4a80 with x1818247333953920 ext(0->18446744073709551615) 00002000:00100000:1.0:1734016141.232033:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc5500 with x1818247333953792 ext(3682196->18446744073709551615) 00002000:00010000:0.0:1734016141.232047:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc4a80. 00002000:00010000:1.0:1734016141.232047:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075fc5500. 00000100:00100000:0.0:1734016141.233847:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8958 00000100:00100000:0.0:1734016141.233869:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333953920:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016141.234128:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1734016141.234131:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016141 -> 1734016141 00002000:00010000:0.0:1734016141.234134:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016141 -> 1734016139 00002000:00010000:0.0:1734016141.234136:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016141 -> 1734016141 00002000:00010000:0.0:1734016141.234138:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1734016141.234220:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333953920:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 356us (3803us total) trans 4294969536 rc 0/0 00000100:00100000:0.0:1734016141.234229:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8958 00002000:00010000:0.0:1734016141.234236:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:0.0:1734016141.234239:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc4a80 with x1818247333953920 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016141.234245:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc4a80. 00000100:00100000:0.0:1734016141.234266:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8959 00000100:00100000:0.0:1734016141.234272:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333953792:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016141.234471:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 3531493 -> 3682196 00002000:00010000:0.0:1734016141.234474:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016141 -> 1734016141 00002000:00010000:0.0:1734016141.234477:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016140 -> 1734016140 00002000:00010000:0.0:1734016141.234479:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016141 -> 1734016141 00002000:00010000:0.0:1734016141.234481:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 128 -> 128 00000100:00100000:0.0:1734016141.234501:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333953792:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 229us (3384us total) trans 4294968072 rc 0/0 00000100:00100000:0.0:1734016141.234507:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8959 00002000:00010000:0.0:1734016141.234510:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (3682196->18446744073709551615) 00002000:00100000:0.0:1734016141.234514:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc5500 with x1818247333953792 ext(3682196->18446744073709551615) 00002000:00010000:0.0:1734016141.234519:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075fc5500. 00000100:00100000:2.0:1734016141.242062:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.242996:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333954048 00000100:00100000:3.0:1734016141.243018:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333954048 00000100:00100000:3.0:1734016141.243127:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2354 00000100:00100000:3.0:1734016141.243141:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+17:10406:x1818247333954048:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.243190:0:6478:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.243231:0:6478:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc271172f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6fe8 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.243397:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271172fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016141.243417:0:6478:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271172fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016141.243432:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271172fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000004:00200000:3.0:1734016141.243464:0:6478:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 3682196 00000004:00200000:3.0:1734016141.243469:0:6478:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016141.243496:0:6478:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271172fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016141.243541:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc271172f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fe8 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.243582:0:6478:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271172fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fe8 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.243593:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016141.243597:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016141.243601:0:6478:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016141.243704:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:10406:x1818247333954048:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 567us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016141.243711:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2354 00000100:00100000:0.0:1734016141.252266:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016141.254047:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.254162:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333954176 00000100:00100000:3.0:1734016141.254181:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333954176 00000100:00100000:3.0:1734016141.254252:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333954304 00000100:00100000:3.0:1734016141.254255:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333954304 00000100:00100000:3.0:1734016141.254283:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11710 00000100:00100000:3.0:1734016141.254293:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333954176:12345-192.168.201.16@tcp:101:fsx.0 00000100:00100000:1.0:1734016141.254323:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11711 00010000:00010000:3.0:1734016141.254329:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1734016141.254330:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333954304:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016141.254342:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016141.254363:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711730c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ff6 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.254363:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117305 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6fef expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016141.254447:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335409280:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016141.254447:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335409152:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016141.257780:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.258085:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00002000:00010000:3.0:1734016141.263108:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016140 -> 1734016141 00000100:00100000:3.0:1734016141.263184:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335409152:192.168.201.16@tcp:106: 00002000:00010000:1.0:1734016141.263254:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016139 -> 1734016141 00010000:00010000:3.0:1734016141.263268:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117305 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fef expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1734016141.263279:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335409280:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016141.263299:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117305 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fef expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.263309:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711730c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ff6 expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.263319:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc2711730c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ff6 expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.263334:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016141.263433:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333954176:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9138us (11181us total) trans 0 rc 301/301 00010000:00010000:1.0:1734016141.263437:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:3.0:1734016141.263447:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11710 00000100:00100000:1.0:1734016141.263464:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333954304:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9133us (9428us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016141.263470:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11711 00000100:00100000:0.0:1734016141.267318:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016141.267406:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.267673:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333954560 00000100:00100000:3.0:1734016141.267687:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333954560 00000100:00100000:3.0:1734016141.268245:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333954432 00000100:00100000:3.0:1734016141.268249:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333954432 00000100:00100000:1.0:1734016141.268328:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11712 00000100:00100000:1.0:1734016141.268341:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333954560:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016141.268391:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016141.268430:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27117313 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7004 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016141.268559:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335409408:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016141.268684:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.268960:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11713 00000100:00100000:3.0:1734016141.268966:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333954432:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.268979:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.269012:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711731a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e6ffd expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.269061:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335409536:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016141.269092:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.274588:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335409536:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016141.274673:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711731a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ffd expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.274701:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711731a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6ffd expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.274730:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016141.274858:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333954432:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5889us (7449us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016141.274873:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11713 00000100:00100000:1.0:1734016141.275068:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335409408:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016141.275102:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27117313 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7004 expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.275116:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc27117313 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7004 expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.276749:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016141.276884:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333954560:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8533us (9574us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016141.276898:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11712 00000100:00100000:0.0:1734016141.286522:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016141.287641:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333954688 00000100:00100000:2.0:1734016141.287663:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333954688 00000100:00100000:2.0:1734016141.287768:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2355 00000100:00100000:2.0:1734016141.287781:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10406:x1818247333954688:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016141.287853:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016141.289363:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117321 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e700b expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.289550:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117328 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016141.289571:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016141.289589:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:2.0:1734016141.289626:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 3682196 00000004:00200000:2.0:1734016141.289631:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016141.289664:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:2.0:1734016141.289701:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117321 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e700b expref: 17 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.289745:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117328 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e700b expref: 16 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.289755:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016141.289758:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016141.289762:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016141.289875:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333954688:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2096us (3378us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016141.289886:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2355 00000100:00100000:0.0:1734016141.293558:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.293723:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333954816 00000100:00100000:1.0:1734016141.293742:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333954816 00000100:00100000:1.0:1734016141.293865:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11714 00000100:00100000:1.0:1734016141.293877:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333954816:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016141.294299:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 3682196 -> 4298598 00002000:00010000:1.0:1734016141.294305:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016141 -> 1734016141 00002000:00010000:1.0:1734016141.294308:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016141 -> 1734016140 00002000:00010000:1.0:1734016141.294310:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016141 -> 1734016141 00002000:00010000:1.0:1734016141.294314:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 128 -> 144 00000100:00100000:1.0:1734016141.294403:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247333954816:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 528us (876us total) trans 4294968073 rc 0/0 00000100:00100000:1.0:1734016141.294415:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11714 00000100:00100000:1.0:1734016141.297918:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.297980:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.298307:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333955072 00000100:00100000:3.0:1734016141.298318:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333955072 00000100:00100000:3.0:1734016141.298738:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333954944 00000100:00100000:3.0:1734016141.298741:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333954944 00000100:00100000:0.0:1734016141.298795:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11715 00000100:00100000:0.0:1734016141.298831:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333955072:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016141.298862:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016141.298887:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc2711732f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7019 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016141.298991:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335409664:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016141.299103:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.299366:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11716 00000100:00100000:3.0:1734016141.299374:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247333954944:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.299387:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.299401:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27117336 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7012 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.299439:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335409792:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016141.299486:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00002000:00010000:3.0:1734016141.305476:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016140 -> 1734016141 00000100:00100000:3.0:1734016141.305554:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335409792:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016141.305620:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27117336 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7012 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.305640:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27117336 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7012 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.305670:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016141.305763:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247333954944:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6388us (7781us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016141.305777:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11716 00000100:00100000:2.0:1734016141.306491:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335409664:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016141.306515:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc2711732f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7019 expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016141.306542:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc2711732f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7019 expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016141.306569:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581d40, rc 0) 00000100:00100000:2.0:1734016141.306597:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333955072:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7770us (8799us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016141.306604:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11715 00000100:00100000:0.0:1734016141.313104:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016141.314136:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333955200 00000100:00100000:2.0:1734016141.314151:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333955200 00000100:00100000:2.0:1734016141.314598:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11717 00000100:00100000:2.0:1734016141.314609:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247333955200:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016141.314639:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016141.314670:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711733d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7020 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.314718:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711728e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f94 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.314729:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016141.314731:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016141.314735:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711733d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [1073152->1077247] (req 1073152->1077247) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7020 expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.314781:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711728e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f94 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.314822:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711728e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f94 expref: 9 pid: 7682 timeout: 508 lvb_type: 0 00000100:00100000:2.0:1734016141.314836:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335409920:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016141.314955:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00000100:00100000:2.0:1734016141.321959:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335409920:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016141.322025:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711733d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [1073152->1077247] (req 1073152->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7020 expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.322057:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016141.322151:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:10406:x1818247333955200:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7542us (9064us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016141.322162:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11717 00000100:00100000:1.0:1734016141.322312:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.323712:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333955328 00000100:00100000:3.0:1734016141.323734:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333955328 00010000:00010000:3.0:1734016141.323793:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711728e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f94 expref: 10 pid: 7682 timeout: 508 lvb_type: 0 00000100:00100000:3.0:1734016141.323872:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3215 00000100:00100000:3.0:1734016141.323882:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333955328:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016141.323911:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016141.323940:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711728e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f94 expref: 10 pid: 7682 timeout: 508 lvb_type: 0 00010000:00010000:3.0:1734016141.323959:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711728e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f94 expref: 10 pid: 7682 timeout: 508 lvb_type: 0 00010000:00010000:3.0:1734016141.323995:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711728e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6f94 expref: 10 pid: 7682 timeout: 508 lvb_type: 0 00010000:00010000:3.0:1734016141.324026:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016141.324030:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016141.324040:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711733d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1077247) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7020 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.324052:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711733d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1077247) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7020 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.324104:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711733d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7020 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.324120:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335410048:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016141.324195:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.327767:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335410048:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016141.327851:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016141.327947:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333955328:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4062us (5634us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016141.327966:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3215 00000100:00100000:0.0:1734016141.328304:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016141.328655:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333955456 00000100:00100000:2.0:1734016141.328668:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333955456 00000100:00100000:2.0:1734016141.328728:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11718 00000100:00100000:2.0:1734016141.328739:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333955456:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016141.328773:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016141.328842:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117344 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7027 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016141.328958:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335410176:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016141.329041:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00000100:00100000:2.0:1734016141.334651:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335410176:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016141.334732:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117344 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7027 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016141.334752:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117344 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7027 expref: 13 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016141.334874:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016141.334968:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333955456:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6230us (6665us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016141.334980:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11718 00000100:00100000:0.0:1734016141.340114:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.340286:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333955712 00000100:00100000:3.0:1734016141.340303:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333955712 00002000:00100000:3.0:1734016141.340384:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (1073152->1077247) req@ffff8800750c6300 x1818247333955712/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:102/0 lens 488/0 e 0 to 0 dl 1734016152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.340396:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c6300 with x1818247333955712 ext(1073152->1077247) 00002000:00010000:3.0:1734016141.340404:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c6300 00000100:00100000:3.0:1734016141.340441:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8960 00000100:00100000:3.0:1734016141.340452:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333955712:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016141.340744:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333955712:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 292us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016141.340752:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8960 00002000:00100000:3.0:1734016141.340759:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (1073152->1077247) req@ffff8800750c6300 x1818247333955712/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:102/0 lens 488/440 e 0 to 0 dl 1734016152 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.340773:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c6300 with x1818247333955712 ext(1073152->1077247) 00002000:00010000:3.0:1734016141.340776:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c6300 00000100:00100000:0.0:1734016141.347089:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016141.347244:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333955840 00000100:00100000:2.0:1734016141.347260:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333955840 00000100:00100000:2.0:1734016141.347339:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11719 00000100:00100000:2.0:1734016141.347350:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333955840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016141.347378:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016141.347405:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711734b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e702e expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.347440:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016141.347442:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016141.347451:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711734b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e702e expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016141.347473:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711734b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e702e expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016141.347491:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016141.347568:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333955840:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 220us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016141.347576:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11719 00000100:00100000:0.0:1734016141.350451:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.350643:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333955968 00000100:00100000:3.0:1734016141.350658:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333955968 00000100:00100000:3.0:1734016141.351230:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11720 00000100:00100000:3.0:1734016141.351247:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:10406:x1818247333955968:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.351288:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.351324:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117352 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7035 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.351384:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711733d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7020 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.351396:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711734b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e702e expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.351406:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016141.351409:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016141.351413:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117352 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [1982464->1986559] (req 1982464->1986559) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7035 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.351479:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711734b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e702e expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.351496:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711734b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e702e expref: 11 pid: 7684 timeout: 508 lvb_type: 1 00000100:00100000:3.0:1734016141.351521:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335410304:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016141.351660:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711733d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1077247) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7020 expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.351668:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711733d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1077247) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7020 expref: 9 pid: 7684 timeout: 508 lvb_type: 0 00000100:00100000:3.0:1734016141.351678:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335410432:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016141.351705:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016141.355846:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.355919:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016141.356042:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333956096 00000100:00100000:0.0:1734016141.356060:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333956096 00010000:00010000:0.0:1734016141.356134:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711734b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e702e expref: 12 pid: 7684 timeout: 508 lvb_type: 1 00000100:00100000:0.0:1734016141.356183:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333956224 00000100:00100000:0.0:1734016141.356186:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333956224 00010000:00010000:0.0:1734016141.356197:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711733d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7020 expref: 10 pid: 7684 timeout: 508 lvb_type: 0 00000100:00100000:0.0:1734016141.356219:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3216 00000100:00100000:0.0:1734016141.356229:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333956096:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016141.356253:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016141.356286:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711734b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e702e expref: 12 pid: 7684 timeout: 508 lvb_type: 1 00010000:00010000:0.0:1734016141.356300:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711734b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e702e expref: 12 pid: 7684 timeout: 508 lvb_type: 1 00010000:00010000:0.0:1734016141.356342:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016141.356405:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333956096:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 177us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016141.356414:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3216 00000100:00100000:0.0:1734016141.356440:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3217 00000100:00100000:0.0:1734016141.356444:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333956224:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016141.356460:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016141.356466:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711733d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1073152->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7020 expref: 10 pid: 7684 timeout: 508 lvb_type: 0 00010000:00010000:0.0:1734016141.356478:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711733d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1073152->1077247) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7020 expref: 10 pid: 7684 timeout: 508 lvb_type: 0 00010000:00010000:0.0:1734016141.356493:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016141.356496:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016141.356506:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117352 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1982464->1986559) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7035 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016141.356519:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117352 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1982464->1986559) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7035 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016141.356580:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117352 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1982464->1986559) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7035 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016141.356599:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335410560:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016141.356646:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00010000:00010000:3.0:1734016141.357491:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc2711734b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e702e expref: 11 pid: 7684 timeout: 508 lvb_type: 1 00000100:00100000:3.0:1734016141.357520:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335410304:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016141.357548:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711733d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1077247) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7020 expref: 10 pid: 7684 timeout: 508 lvb_type: 0 00000100:00100000:3.0:1734016141.357558:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335410432:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016141.357596:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117352 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->1986559) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7035 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.357609:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016141.358482:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:10406:x1818247333955968:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7228us (8047us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016141.358502:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11720 00000100:00100000:0.0:1734016141.363250:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335410560:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016141.363290:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016141.364400:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333956224:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7939us (8466us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016141.364419:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3217 00000100:00100000:2.0:1734016141.364963:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016141.365116:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.365773:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333956608 00000100:00100000:3.0:1734016141.365789:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333956608 00002000:00100000:3.0:1734016141.365908:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (1982464->1986559) req@ffff880075fc7480 x1818247333956608/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 488/0 e 0 to 0 dl 1734016152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.365926:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7480 with x1818247333956608 ext(1982464->1986559) 00002000:00010000:3.0:1734016141.365936:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc7480 00000100:00100000:3.0:1734016141.365984:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333956736 00000100:00100000:3.0:1734016141.365988:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333956736 00002000:00100000:3.0:1734016141.366013:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (3534848->4194303) req@ffff880075fc6680 x1818247333956736/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 488/0 e 0 to 0 dl 1734016152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.366020:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc6680 with x1818247333956736 ext(3534848->4194303) 00002000:00010000:3.0:1734016141.366025:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075fc6680 00000100:00100000:3.0:1734016141.366046:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8961 00000100:00100000:3.0:1734016141.366059:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333956608:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016141.366414:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333956608:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 355us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016141.366422:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8961 00002000:00100000:3.0:1734016141.366429:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (1982464->1986559) req@ffff880075fc7480 x1818247333956608/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 488/440 e 0 to 0 dl 1734016152 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.366437:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc7480 with x1818247333956608 ext(1982464->1986559) 00002000:00010000:3.0:1734016141.366440:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075fc7480 00000100:00100000:3.0:1734016141.366461:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8962 00000100:00100000:3.0:1734016141.366466:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333956736:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016141.386332:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333956736:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 19836us (21187us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1734016141.386353:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8962 00002000:00100000:2.0:1734016141.386374:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (3534848->4194303) req@ffff880075fc6680 x1818247333956736/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 488/440 e 0 to 0 dl 1734016152 ref 1 fl Complete:/200/0 rc 659456/659456 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016141.386385:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc6680 with x1818247333956736 ext(3534848->4194303) 00002000:00010000:2.0:1734016141.386392:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075fc6680 00000100:00100000:1.0:1734016141.386860:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016141.386942:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333956992 00000100:00100000:2.0:1734016141.386956:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333956992 00002000:00100000:2.0:1734016141.387017:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->1990655) req@ffff8800758f7480 x1818247333956992/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 504/0 e 0 to 0 dl 1734016152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016141.387025:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f7480 with x1818247333956992 ext(0->1990655) 00002000:00010000:2.0:1734016141.387028:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758f7480 00000100:00100000:2.0:1734016141.387064:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8963 00000100:00100000:2.0:1734016141.387073:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333956992:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016141.395582:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333956992:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 8479us (8694us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016141.395611:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8963 00002000:00100000:0.0:1734016141.395638:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->1990655) req@ffff8800758f7480 x1818247333956992/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 504/440 e 0 to 0 dl 1734016152 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016141.395655:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f7480 with x1818247333956992 ext(0->1990655) 00002000:00010000:0.0:1734016141.395664:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758f7480 00000100:00100000:0.0:1734016141.407284:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016141.407632:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333957120 00000100:00100000:2.0:1734016141.407651:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333957120 00002000:00100000:2.0:1734016141.407743:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (1982464->1990655) req@ffff8800750c7480 x1818247333957120/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 8680/0 e 0 to 0 dl 1734016152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016141.407757:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c7480 with x1818247333957120 ext(1982464->1990655) 00002000:00010000:2.0:1734016141.407768:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c7480 00000100:00100000:2.0:1734016141.408168:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8964 00000100:00100000:2.0:1734016141.408178:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333957120:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016141.410124:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1983:x1818247333957120:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1920us (2840us total) trans 4294969537 rc 0/0 00000100:00100000:2.0:1734016141.410147:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8964 00002000:00100000:2.0:1734016141.410171:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (1982464->1990655) req@ffff8800750c7480 x1818247333957120/t4294969537(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 8680/448 e 0 to 0 dl 1734016152 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016141.410183:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c7480 with x1818247333957120 ext(1982464->1990655) 00002000:00010000:2.0:1734016141.410194:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c7480 00000100:00100000:0.0:1734016141.412666:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016141.412850:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333957248 00000100:00100000:2.0:1734016141.412866:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333957248 00000100:00100000:2.0:1734016141.415219:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2356 00000100:00100000:2.0:1734016141.415242:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333957248:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:2.0:1734016141.415596:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333957248:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 360us (2947us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016141.415607:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2356 00000100:00100000:0.0:1734016141.418439:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.419916:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333957376 00000100:00100000:3.0:1734016141.419935:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333957376 00000100:00100000:3.0:1734016141.420024:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11721 00000100:00100000:3.0:1734016141.420034:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247333957376:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016141.421779:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969537 is committed 00000001:00080000:0.0:1734016141.421939:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969534 is committed 00000100:00100000:3.0:1734016141.422997:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333957376:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2953us (4564us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016141.423015:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11721 00000100:00100000:0.0:1734016141.434780:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016141.436488:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333957632 00000100:00100000:2.0:1734016141.436520:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333957632 00002000:00100000:2.0:1734016141.436621:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->3534847) req@ffff8800750c5880 x1818247333957632/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 488/0 e 0 to 0 dl 1734016152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016141.436634:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c5880 with x1818247333957632 ext(0->3534847) 00002000:00010000:2.0:1734016141.436640:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c5880 00000100:00100000:2.0:1734016141.438131:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8965 00000100:00100000:2.0:1734016141.438154:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1983:x1818247333957632:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016141.483858:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1983:x1818247333957632:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 45689us (49088us total) trans 0 rc 3534848/3534848 00000100:00100000:3.0:1734016141.483879:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8965 00002000:00100000:3.0:1734016141.483900:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->3534847) req@ffff8800750c5880 x1818247333957632/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 488/440 e 0 to 0 dl 1734016152 ref 1 fl Complete:/200/0 rc 3534848/3534848 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.483913:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c5880 with x1818247333957632 ext(0->3534847) 00002000:00010000:3.0:1734016141.483922:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c5880 00000100:00100000:1.0:1734016141.506152:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.506331:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333957760 00000100:00100000:3.0:1734016141.506349:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333957760 00002000:00100000:3.0:1734016141.506435:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (1724416->1732607) req@ffff8800758f6d80 x1818247333957760/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 8680/0 e 0 to 0 dl 1734016152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.506448:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f6d80 with x1818247333957760 ext(1724416->1732607) 00002000:00010000:3.0:1734016141.506457:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800758f6d80 00000100:00100000:3.0:1734016141.506494:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8966 00000100:00100000:3.0:1734016141.506504:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1983:x1818247333957760:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016141.509194:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1983:x1818247333957760:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 2669us (3045us total) trans 4294968074 rc 0/0 00000100:00100000:3.0:1734016141.509220:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8966 00002000:00100000:3.0:1734016141.509243:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (1724416->1732607) req@ffff8800758f6d80 x1818247333957760/t4294968074(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 8680/448 e 0 to 0 dl 1734016152 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.509255:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f6d80 with x1818247333957760 ext(1724416->1732607) 00002000:00010000:3.0:1734016141.509263:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800758f6d80 00000100:00100000:0.0:1734016141.515025:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.515684:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333957888 00000100:00100000:3.0:1734016141.515706:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333957888 00000100:00100000:3.0:1734016141.515855:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11722 00000100:00100000:3.0:1734016141.515870:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1982:x1818247333957888:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016141.518727:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968074 is committed 00000001:00080000:2.0:1734016141.518791:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968070 is committed 00000100:00100000:3.0:1734016141.521957:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333957888:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 6057us (6931us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016141.521995:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11722 00000100:00100000:0.0:1734016141.528059:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.528607:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333958016 00000100:00100000:3.0:1734016141.528629:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333958016 00000100:00100000:3.0:1734016141.528740:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11723 00000100:00100000:3.0:1734016141.528756:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333958016:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.528796:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.528899:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117359 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e703c expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.529022:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335410688:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016141.529167:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:0.0:1734016141.529303:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016141.529353:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333958144 00000100:00100000:0.0:1734016141.529357:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333958144 00000100:00100000:0.0:1734016141.529395:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11724 00000100:00100000:0.0:1734016141.529401:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333958144:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016141.529411:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016141.529429:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27117360 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7043 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016141.529485:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335410816:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016141.529516:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00002000:00010000:1.0:1734016141.533377:0:8216:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size: 0 -> 1990656 00002000:00010000:1.0:1734016141.533398:0:8216:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016141 -> 1734016142 00002000:00010000:1.0:1734016141.533401:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016141 -> 1734016142 00002000:00010000:1.0:1734016141.533404:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016141 -> 1734016142 00002000:00010000:1.0:1734016141.533406:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 0 -> 16 00000100:00100000:1.0:1734016141.533464:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335410816:192.168.201.16@tcp:106: 00002000:00010000:2.0:1734016141.533620:0:7682:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime: 1734016141 -> 1734016142 00002000:00010000:2.0:1734016141.533625:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016141 -> 1734016142 00002000:00010000:2.0:1734016141.533627:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016141 -> 1734016142 00002000:00010000:2.0:1734016141.533629:0:7682:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks: 144 -> 160 00000100:00100000:2.0:1734016141.533656:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335410688:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016141.533700:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117359 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e703c expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016141.533733:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117359 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e703c expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016141.533766:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:2.0:1734016141.533877:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333958016:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5124us (5847us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016141.533897:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11723 00010000:00010000:1.0:1734016141.536223:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27117360 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7043 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.536268:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581d40/0x5e3a3adc27117360 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7043 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.536320:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581d40, rc 0) 00000100:00100000:1.0:1734016141.536468:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333958144:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7060us (7162us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016141.536486:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11724 00000100:00100000:0.0:1734016141.540538:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016141.540623:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.540749:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333958272 00000100:00100000:1.0:1734016141.540768:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333958272 00000100:00100000:1.0:1734016141.540915:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333958400 00000100:00100000:1.0:1734016141.540918:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333958400 00000100:00100000:1.0:1734016141.540951:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11725 00000100:00100000:1.0:1734016141.540967:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333958272:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016141.541007:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016141.541047:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499e880/0x5e3a3adc27117367 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e704a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016141.541166:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335410944:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016141.541285:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92c00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016141.541381:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11726 00000100:00100000:2.0:1734016141.541389:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333958400:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016141.541399:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016141.541416:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711736e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7051 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016141.541455:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335411072:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016141.541482:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00000100:00100000:2.0:1734016141.544685:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335411072:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016141.544766:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711736e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7051 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016141.544793:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711736e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7051 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1734016141.544996:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335410944:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016141.545037:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499e880/0x5e3a3adc27117367 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e704a expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.545050:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499e880/0x5e3a3adc27117367 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e704a expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.545073:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016141.545170:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333958272:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4203us (4661us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016141.545186:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11725 00010000:00010000:2.0:1734016141.545708:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016141.545738:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333958400:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4348us (5114us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016141.545746:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11726 00000100:00100000:0.0:1734016141.553732:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.553898:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333958656 00000100:00100000:3.0:1734016141.553914:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333958656 00002000:00100000:3.0:1734016141.554002:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2154496->2158591) req@ffff8800750c4a80 x1818247333958656/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 488/0 e 0 to 0 dl 1734016152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.554016:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c4a80 with x1818247333958656 ext(2154496->2158591) 00002000:00010000:3.0:1734016141.554025:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c4a80 00000100:00100000:3.0:1734016141.554086:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8967 00000100:00100000:3.0:1734016141.554098:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333958656:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016141.554408:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333958656:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 311us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016141.554417:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8967 00002000:00100000:3.0:1734016141.554423:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2154496->2158591) req@ffff8800750c4a80 x1818247333958656/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 488/440 e 0 to 0 dl 1734016152 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.554430:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c4a80 with x1818247333958656 ext(2154496->2158591) 00002000:00010000:3.0:1734016141.554434:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c4a80 00000100:00100000:0.0:1734016141.557176:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.557385:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333958912 00000100:00100000:1.0:1734016141.557404:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333958912 00002000:00100000:1.0:1734016141.557513:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (2158592->2162687) req@ffff88012db08000 x1818247333958912/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 488/0 e 0 to 0 dl 1734016152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016141.557546:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db08000 with x1818247333958912 ext(2158592->2162687) 00002000:00010000:1.0:1734016141.557556:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db08000 00000100:00100000:1.0:1734016141.557623:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8968 00000100:00100000:1.0:1734016141.557637:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333958912:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016141.558052:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333958912:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 415us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016141.558062:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8968 00002000:00100000:1.0:1734016141.558071:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (2158592->2162687) req@ffff88012db08000 x1818247333958912/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 488/440 e 0 to 0 dl 1734016152 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016141.558079:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db08000 with x1818247333958912 ext(2158592->2162687) 00002000:00010000:1.0:1734016141.558086:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db08000 00000100:00100000:0.0:1734016141.562164:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016141.562254:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.562506:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333959168 00000100:00100000:1.0:1734016141.562532:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333959168 00000100:00100000:1.0:1734016141.562703:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333959040 00000100:00100000:1.0:1734016141.562707:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333959040 00000100:00100000:2.0:1734016141.562783:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11727 00000100:00100000:2.0:1734016141.562794:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333959168:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016141.562891:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016141.562929:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117375 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e705f expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016141.563033:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335411200:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016141.563137:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706300 going to sleep for 11 seconds 00000100:00100000:1.0:1734016141.563896:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11728 00000100:00100000:1.0:1734016141.563908:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333959040:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016141.563923:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016141.563946:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499e880/0x5e3a3adc2711737c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7058 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016141.564003:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335411328:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016141.564068:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92c00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016141.566583:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075fc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335411200:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016141.566660:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117375 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e705f expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016141.566681:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117375 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e705f expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1734016141.566868:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335411328:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016141.566899:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499e880/0x5e3a3adc2711737c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7058 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.566911:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499e880/0x5e3a3adc2711737c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7058 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.567533:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00010000:00010000:2.0:1734016141.568007:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:1.0:1734016141.570827:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333959040:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6866us (8516us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016141.570845:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11728 00000100:00100000:2.0:1734016141.572532:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333959168:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9715us (10370us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016141.572549:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11727 00000100:00100000:0.0:1734016141.576596:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016141.576668:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.576935:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333959296 00000100:00100000:1.0:1734016141.576950:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333959296 00000100:00100000:1.0:1734016141.577023:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333959424 00000100:00100000:1.0:1734016141.577026:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333959424 00000100:00100000:1.0:1734016141.577054:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11729 00000100:00100000:1.0:1734016141.577061:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333959296:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016141.577088:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016141.577122:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27117383 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7066 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016141.577212:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335411456:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016141.577304:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.577454:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11730 00000100:00100000:3.0:1734016141.577463:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333959424:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.577473:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.577486:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711738a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e706d expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.577536:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335411584:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016141.577567:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016141.580624:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335411456:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016141.580701:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27117383 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7066 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.580731:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27117383 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7066 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1734016141.581084:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335411584:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016141.581117:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711738a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e706d expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.581133:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711738a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e706d expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.581153:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016141.581247:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333959424:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3782us (4576us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016141.581261:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11730 00010000:00010000:1.0:1734016141.582054:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016141.582090:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333959296:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5027us (5514us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016141.582100:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11729 00000100:00100000:0.0:1734016141.587336:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.587711:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333959552 00000100:00100000:3.0:1734016141.587729:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333959552 00002000:00100000:3.0:1734016141.587853:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (528384->540671) req@ffff880073944a80 x1818247333959552/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 12776/0 e 0 to 0 dl 1734016152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.587866:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073944a80 with x1818247333959552 ext(528384->540671) 00002000:00010000:3.0:1734016141.587875:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073944a80 00000100:00100000:3.0:1734016141.587933:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8969 00000100:00100000:3.0:1734016141.587942:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333959552:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016141.590015:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333959552:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 2047us (2685us total) trans 4294969538 rc 0/0 00000100:00100000:3.0:1734016141.590036:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8969 00002000:00100000:3.0:1734016141.590057:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (528384->540671) req@ffff880073944a80 x1818247333959552/t4294969538(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:102/0 lens 12776/448 e 0 to 0 dl 1734016152 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.590068:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073944a80 with x1818247333959552 ext(528384->540671) 00002000:00010000:3.0:1734016141.590076:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073944a80 00000100:00100000:0.0:1734016141.592656:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.592879:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333959680 00000100:00100000:1.0:1734016141.592905:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333959680 00000100:00100000:1.0:1734016141.593020:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11731 00000100:00100000:1.0:1734016141.593035:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333959680:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016141.595418:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969538 is committed 00000100:00100000:1.0:1734016141.596836:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333959680:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 3790us (4196us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016141.596855:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11731 00000100:00100000:0.0:1734016141.601012:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016141.601091:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.601216:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333959808 00000100:00100000:1.0:1734016141.601233:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333959808 00000100:00100000:1.0:1734016141.601310:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333959936 00000100:00100000:1.0:1734016141.601313:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333959936 00000100:00100000:1.0:1734016141.601345:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11732 00000100:00100000:1.0:1734016141.601355:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333959808:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016141.601392:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016141.601428:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27117391 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7074 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016141.601534:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335411712:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016141.601626:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92c00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.601708:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11733 00000100:00100000:3.0:1734016141.601716:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333959936:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.601728:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.601741:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117398 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e707b expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.601776:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335411840:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016141.601834:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00002000:00010000:3.0:1734016141.603924:0:7683:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 16 -> 40 00000100:00100000:3.0:1734016141.603963:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335411840:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016141.604006:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117398 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e707b expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.604022:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117398 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e707b expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1734016141.604656:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335411712:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016141.604691:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27117391 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7074 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.604702:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27117391 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7074 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.604734:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00010000:00010000:3.0:1734016141.605008:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:1.0:1734016141.605415:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333959808:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4058us (4428us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016141.605428:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11732 00000100:00100000:3.0:1734016141.606133:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333959936:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4413us (5038us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016141.606142:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11733 00000100:00100000:0.0:1734016141.612984:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.613310:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333960064 00000100:00100000:3.0:1734016141.613336:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333960064 00000100:00100000:3.0:1734016141.613446:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11734 00000100:00100000:3.0:1734016141.613460:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333960064:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.613517:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.613574:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711739f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7082 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.613654:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117352 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->1986559) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7035 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.613667:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016141.613670:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016141.613675:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711739f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [1724416->1736703] (req 1724416->1736703) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7082 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.613724:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117352 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->1986559) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7035 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.613744:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117352 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->1986559) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7035 expref: 6 pid: 7682 timeout: 508 lvb_type: 0 00000100:00100000:3.0:1734016141.613761:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335411968:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016141.614691:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.621698:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335411968:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016141.621769:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711739f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [1724416->1736703] (req 1724416->1736703) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7082 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.621830:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016141.621945:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333960064:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8485us (8995us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016141.621959:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11734 00000100:00100000:0.0:1734016141.622491:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.622757:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333960192 00000100:00100000:1.0:1734016141.622772:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333960192 00010000:00010000:1.0:1734016141.622844:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117352 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->1986559) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7035 expref: 7 pid: 7682 timeout: 508 lvb_type: 0 00000100:00100000:1.0:1734016141.622877:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3218 00000100:00100000:1.0:1734016141.622888:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333960192:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016141.622916:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016141.622954:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117352 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->1986559) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7035 expref: 7 pid: 7682 timeout: 508 lvb_type: 0 00010000:00010000:1.0:1734016141.622974:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117352 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->1986559) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7035 expref: 7 pid: 7682 timeout: 508 lvb_type: 0 00010000:00010000:1.0:1734016141.623020:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117352 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->1986559) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7035 expref: 7 pid: 7682 timeout: 508 lvb_type: 0 00010000:00010000:1.0:1734016141.623043:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016141.623048:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016141.623059:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711739f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1736703) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7082 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016141.623070:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711739f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1736703) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7082 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016141.623115:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711739f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1736703) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7082 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016141.623129:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335412096:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016141.623203:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92c00 going to sleep for 11 seconds 00010000:00010000:3.0:1734016141.633320:0:8957:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1734016141.633773:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.634016:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333960320 00000100:00100000:3.0:1734016141.634033:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333960320 00000100:00100000:3.0:1734016141.634131:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11735 00000100:00100000:3.0:1734016141.634146:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247333960320:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016141.634646:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 1990656 -> 1990656 00002000:00010000:3.0:1734016141.634651:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016142 -> 1734016142 00002000:00010000:3.0:1734016141.634653:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016142 -> 1734016142 00002000:00010000:3.0:1734016141.634655:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016142 -> 1734016141 00002000:00010000:3.0:1734016141.634656:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 40 -> 64 00000100:00100000:2.0:1734016141.634916:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335412096:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016141.634955:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016141.638939:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333960192:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 16005us (16403us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016141.638967:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3218 00000100:00100000:3.0:1734016141.639283:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333960320:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 5136us (5523us total) trans 4294969539 rc 0/0 00000100:00100000:3.0:1734016141.639303:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11735 00000100:00100000:0.0:1734016141.643605:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.643770:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333960448 00000100:00100000:3.0:1734016141.643787:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333960448 00000100:00100000:3.0:1734016141.643919:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11736 00000100:00100000:3.0:1734016141.643929:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333960448:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.643964:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.643992:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271173a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7089 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.644081:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335412224:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016141.644167:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.650111:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335412224:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016141.650205:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271173a6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7089 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.650237:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271173a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7089 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.650295:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016141.651989:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333960448:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8033us (8374us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016141.652018:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11736 00000100:00100000:0.0:1734016141.656621:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.656864:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333960576 00000100:00100000:3.0:1734016141.656886:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333960576 00000100:00100000:3.0:1734016141.656989:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11737 00000100:00100000:3.0:1734016141.657003:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333960576:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.657055:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.657106:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc271173ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7090 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.657235:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335412352:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016141.657351:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.659984:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335412352:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016141.660047:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc271173ad lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7090 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.660065:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc271173ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7090 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.660453:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016141.660715:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333960576:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3711us (4124us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016141.660730:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11737 00000100:00100000:0.0:1734016141.668100:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.668936:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333960704 00000100:00100000:3.0:1734016141.668959:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333960704 00000100:00100000:3.0:1734016141.669076:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11738 00000100:00100000:3.0:1734016141.669092:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333960704:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.669144:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.669193:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc271173b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7097 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.669333:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335412480:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016141.669479:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.675284:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335412480:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016141.675362:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc271173b4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7097 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.675386:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc271173b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7097 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.676881:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016141.677949:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333960704:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8840us (9847us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016141.677975:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11738 00000100:00100000:0.0:1734016141.683711:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.684228:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333960832 00000100:00100000:3.0:1734016141.684243:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333960832 00000100:00100000:3.0:1734016141.684397:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11739 00000100:00100000:3.0:1734016141.684405:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333960832:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.684437:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.684472:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271173bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e709e expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.684564:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335412608:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016141.685183:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.689133:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335412608:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016141.689179:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271173bb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e709e expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.689196:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271173bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e709e expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.689223:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016141.689305:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333960832:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4898us (5616us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016141.689317:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11739 00000100:00100000:0.0:1734016141.692987:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.693217:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333961088 00000100:00100000:3.0:1734016141.693235:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333961088 00002000:00100000:3.0:1734016141.693303:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2338816->2342911) req@ffff880073945180 x1818247333961088/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:102/0 lens 488/0 e 0 to 0 dl 1734016152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.693319:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073945180 with x1818247333961088 ext(2338816->2342911) 00002000:00010000:3.0:1734016141.693327:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073945180 00000100:00100000:3.0:1734016141.693495:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8970 00000100:00100000:3.0:1734016141.693504:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333961088:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016141.693796:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333961088:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 291us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016141.693838:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8970 00002000:00100000:3.0:1734016141.693844:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2338816->2342911) req@ffff880073945180 x1818247333961088/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:102/0 lens 488/440 e 0 to 0 dl 1734016152 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.693851:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073945180 with x1818247333961088 ext(2338816->2342911) 00002000:00010000:3.0:1734016141.693855:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073945180 00000100:00100000:0.0:1734016141.697087:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.698917:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333961216 00000100:00100000:3.0:1734016141.698937:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333961216 00000100:00100000:3.0:1734016141.699363:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11740 00000100:00100000:3.0:1734016141.699377:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333961216:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.699411:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.699447:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271173c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e70a5 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.699544:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335412736:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016141.699653:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.704961:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335412736:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016141.705036:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271173c2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70a5 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.705060:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271173c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70a5 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.705683:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016141.705856:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333961216:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6478us (8787us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016141.705869:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11740 00000100:00100000:0.0:1734016141.711548:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.712314:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333961344 00000100:00100000:3.0:1734016141.712338:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333961344 00002000:00100000:3.0:1734016141.712423:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2338816->2342911) req@ffff880073947480 x1818247333961344/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:102/0 lens 4584/0 e 0 to 0 dl 1734016152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.712442:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073947480 with x1818247333961344 ext(2338816->2342911) 00002000:00010000:3.0:1734016141.712453:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073947480 00000100:00100000:3.0:1734016141.712504:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8971 00000100:00100000:3.0:1734016141.712514:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333961344:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016141.718326:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333961344:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 5777us (6775us total) trans 4294969540 rc 0/0 00000100:00100000:3.0:1734016141.718360:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8971 00002000:00100000:3.0:1734016141.718394:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2338816->2342911) req@ffff880073947480 x1818247333961344/t4294969540(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:102/0 lens 4584/448 e 0 to 0 dl 1734016152 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.718410:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073947480 with x1818247333961344 ext(2338816->2342911) 00002000:00010000:3.0:1734016141.718423:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073947480 00000100:00100000:0.0:1734016141.724604:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.727684:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333961472 00000100:00100000:3.0:1734016141.727719:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333961472 00000100:00100000:3.0:1734016141.727925:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11741 00000100:00100000:3.0:1734016141.727938:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333961472:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016141.730024:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969540 is committed 00000100:00100000:3.0:1734016141.731102:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333961472:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 3151us (6499us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016141.731128:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11741 00000100:00100000:0.0:1734016141.739625:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.739853:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333961600 00000100:00100000:3.0:1734016141.739876:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333961600 00000100:00100000:1.0:1734016141.741191:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11742 00000100:00100000:1.0:1734016141.741212:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333961600:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016141.741253:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016141.741298:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc271173c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e70ac expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016141.741425:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335412864:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016141.741557:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00002000:00010000:1.0:1734016141.744581:0:8216:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size: 1990656 -> 2342912 00002000:00010000:1.0:1734016141.744594:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016141 -> 1734016142 00002000:00010000:1.0:1734016141.744596:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 64 -> 72 00000100:00100000:1.0:1734016141.744626:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335412864:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016141.744668:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc271173c9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70ac expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.744688:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc271173c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70ac expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.744706:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016141.744771:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333961600:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3564us (5165us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016141.744782:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11742 00000100:00100000:0.0:1734016141.751148:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.751325:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333961728 00000100:00100000:1.0:1734016141.751343:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333961728 00000100:00100000:1.0:1734016141.751420:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11743 00000100:00100000:1.0:1734016141.751432:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333961728:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016141.751466:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016141.751494:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271173d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e70b3 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016141.751596:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335412992:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016141.751693:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016141.757284:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335412992:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016141.757391:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271173d0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70b3 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.757421:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc271173d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70b3 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.757457:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016141.759768:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333961728:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8323us (8622us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016141.759785:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11743 00000100:00100000:2.0:1734016141.765946:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.766287:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333961856 00000100:00100000:1.0:1734016141.766306:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333961856 00000100:00100000:1.0:1734016141.766402:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11744 00000100:00100000:1.0:1734016141.766414:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333961856:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016141.766450:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016141.766483:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271173d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e70ba expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016141.766593:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335413120:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016141.766710:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016141.769661:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335413120:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016141.769722:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271173d7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70ba expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.769743:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271173d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70ba expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.769770:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016141.769891:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333961856:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3478us (3967us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016141.769902:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11744 00000100:00100000:0.0:1734016141.772681:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.772871:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333961984 00000100:00100000:1.0:1734016141.772886:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333961984 00000100:00100000:1.0:1734016141.772956:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11745 00000100:00100000:1.0:1734016141.772968:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333961984:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016141.773366:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 2342912 -> 2342912 00002000:00010000:1.0:1734016141.773370:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016142 -> 1734016142 00002000:00010000:1.0:1734016141.773373:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016142 -> 1734016142 00002000:00010000:1.0:1734016141.773375:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016142 -> 1734016141 00002000:00010000:1.0:1734016141.773378:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 72 -> 96 00000100:00100000:1.0:1734016141.773457:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333961984:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 489us (790us total) trans 4294969541 rc 0/0 00000100:00100000:1.0:1734016141.773466:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11745 00000100:00100000:2.0:1734016141.779628:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.779825:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333962112 00000100:00100000:3.0:1734016141.779840:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333962112 00000100:00100000:3.0:1734016141.779919:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11746 00000100:00100000:3.0:1734016141.779931:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333962112:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.779967:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.779999:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271173de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e70c1 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.780087:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335413248:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016141.780176:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00002000:00010000:3.0:1734016141.789763:0:7683:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016141 -> 1734016142 00000100:00100000:3.0:1734016141.789832:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335413248:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016141.789892:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271173de lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70c1 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.789911:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271173de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70c1 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.790500:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016141.790608:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333962112:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10677us (11014us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016141.790623:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11746 00000100:00100000:0.0:1734016141.793918:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.794014:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333962240 00000100:00100000:3.0:1734016141.794031:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333962240 00000100:00100000:3.0:1734016141.794230:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11747 00000100:00100000:3.0:1734016141.794244:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333962240:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.794281:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.794310:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271173e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e70c8 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.794407:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335413376:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016141.794509:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.797536:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335413376:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016141.797606:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271173e5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70c8 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.797631:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271173e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70c8 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.797663:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016141.798464:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333962240:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4215us (4553us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016141.798480:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11747 00000100:00100000:0.0:1734016141.803480:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.805751:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333962368 00000100:00100000:3.0:1734016141.805777:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333962368 00000100:00100000:3.0:1734016141.806568:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11748 00000100:00100000:3.0:1734016141.806577:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333962368:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.806604:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.806632:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271173ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e70cf expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.806704:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335413504:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016141.806822:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.812053:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335413504:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016141.812131:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271173ec lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70cf expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.812152:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc271173ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70cf expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.812415:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016141.812504:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333962368:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5925us (9058us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016141.812517:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11748 00000100:00100000:2.0:1734016141.821908:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.832532:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333962496 00000100:00100000:3.0:1734016141.832564:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333962496 00000100:00100000:3.0:1734016141.832676:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11749 00000100:00100000:3.0:1734016141.832689:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:10406:x1818247333962496:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.832724:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.832750:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271173f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e70d6 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.832817:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271172f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fe1 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.832828:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016141.832831:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016141.832834:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271173f3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [4890624->4898815] (req 4890624->4898815) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70d6 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.832874:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271172f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fe1 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.832889:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271172f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fe1 expref: 5 pid: 7684 timeout: 508 lvb_type: 0 00000100:00100000:3.0:1734016141.832904:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335413632:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016141.832993:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:0.0:1734016141.840216:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.840633:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335413632:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016141.840693:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271173f3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [4890624->4898815] (req 4890624->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70d6 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.840728:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:2.0:1734016141.843820:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333962624 00000100:00100000:2.0:1734016141.843841:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333962624 00010000:00010000:2.0:1734016141.843904:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271172f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fe1 expref: 6 pid: 7684 timeout: 508 lvb_type: 0 00000100:00100000:2.0:1734016141.843959:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3219 00000100:00100000:2.0:1734016141.843967:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333962624:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016141.843989:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016141.844024:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271172f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fe1 expref: 6 pid: 7684 timeout: 508 lvb_type: 0 00010000:00010000:2.0:1734016141.844039:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271172f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fe1 expref: 6 pid: 7684 timeout: 508 lvb_type: 0 00010000:00010000:2.0:1734016141.844081:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271172f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fe1 expref: 6 pid: 7684 timeout: 508 lvb_type: 0 00010000:00010000:2.0:1734016141.844108:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016141.844111:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016141.844118:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271173f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4890624->4898815) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70d6 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.844129:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271173f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4890624->4898815) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70d6 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.844179:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271173f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4890624->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70d6 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016141.844195:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335413760:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016141.844543:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333962496:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11853us (22657us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016141.844556:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11749 00000100:00100000:2.0:1734016141.845055:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706900 going to sleep for 11 seconds 00000100:00100000:2.0:1734016141.852255:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335413760:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016141.852304:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016141.852389:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333962624:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 8420us (12192us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016141.852406:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3219 00000100:00100000:0.0:1734016141.856036:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.858551:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333962752 00000100:00100000:3.0:1734016141.858588:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333962752 00000100:00100000:3.0:1734016141.858718:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11750 00000100:00100000:3.0:1734016141.858733:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333962752:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016141.859221:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4298598 -> 4298598 00002000:00010000:3.0:1734016141.859224:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016142 -> 1734016142 00002000:00010000:3.0:1734016141.859227:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016142 -> 1734016142 00002000:00010000:3.0:1734016141.859229:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016142 -> 1734016141 00002000:00010000:3.0:1734016141.859231:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 160 -> 176 00000100:00100000:3.0:1734016141.859342:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333962752:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 610us (3326us total) trans 4294968075 rc 0/0 00000100:00100000:3.0:1734016141.859351:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11750 00000100:00100000:3.0:1734016141.865323:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.865608:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333962880 00000100:00100000:1.0:1734016141.865625:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333962880 00000100:00100000:1.0:1734016141.865703:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11751 00000100:00100000:1.0:1734016141.865715:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333962880:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016141.866151:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 2342912 -> 2342912 00002000:00010000:1.0:1734016141.866156:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016142 -> 1734016141 00002000:00010000:1.0:1734016141.866158:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016142 -> 1734016142 00002000:00010000:1.0:1734016141.866160:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016142 -> 1734016141 00002000:00010000:1.0:1734016141.866163:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 96 -> 96 00000100:00100000:1.0:1734016141.866299:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333962880:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 584us (990us total) trans 4294969542 rc 0/0 00000100:00100000:1.0:1734016141.866307:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11751 00000100:00100000:0.0:1734016141.869147:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.870386:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333963008 00000100:00100000:1.0:1734016141.870406:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333963008 00000100:00100000:1.0:1734016141.870496:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11752 00000100:00100000:1.0:1734016141.870507:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333963008:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016141.870544:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016141.870577:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271173fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e70dd expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016141.870677:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335413888:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016141.870831:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016141.871420:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.871683:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333963136 00000100:00100000:3.0:1734016141.871690:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333963136 00000100:00100000:3.0:1734016141.871736:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11753 00000100:00100000:3.0:1734016141.871744:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333963136:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.871758:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.871775:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117401 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e70e4 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.871847:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335414016:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016141.871888:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00002000:00010000:1.0:1734016141.874379:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016141 -> 1734016142 00000100:00100000:1.0:1734016141.874413:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335413888:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016141.874456:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271173fa lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70dd expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.874475:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc271173fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70dd expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.874507:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016141.874570:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333963008:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4064us (5439us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016141.874582:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11752 00002000:00010000:3.0:1734016141.874928:0:7683:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016141 -> 1734016142 00002000:00010000:3.0:1734016141.874933:0:7683:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016141 -> 1734016142 00000100:00100000:3.0:1734016141.874952:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335414016:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016141.874979:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117401 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70e4 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.874989:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117401 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70e4 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.875004:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016141.875031:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333963136:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3286us (3611us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016141.875036:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11753 00000100:00100000:0.0:1734016141.879338:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016141.879402:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.880100:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333963264 00000100:00100000:1.0:1734016141.880120:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333963264 00000100:00100000:1.0:1734016141.880203:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333963392 00000100:00100000:1.0:1734016141.880205:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333963392 00000100:00100000:1.0:1734016141.880250:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11754 00000100:00100000:1.0:1734016141.880263:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333963264:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016141.880294:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016141.880339:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27117408 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e70eb expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016141.880447:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335414144:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016141.880570:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016141.880659:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11755 00000100:00100000:2.0:1734016141.880669:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333963392:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016141.880681:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016141.880699:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711740f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e70f2 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016141.880748:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335414272:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016141.880776:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016141.883120:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335414144:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016141.883164:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27117408 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70eb expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.883179:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27117408 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70eb expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.883754:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016141.883888:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333963264:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3626us (4563us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016141.883904:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11754 00000100:00100000:2.0:1734016141.884277:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335414272:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016141.884318:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711740f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70f2 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016141.884328:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711740f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70f2 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016141.884347:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016141.884375:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333963392:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3709us (4974us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016141.884381:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11755 00000100:00100000:0.0:1734016141.890764:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.893181:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333963648 00000100:00100000:3.0:1734016141.893202:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333963648 00002000:00100000:3.0:1734016141.893263:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (1601536->1605631) req@ffff88007345c700 x1818247333963648/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:102/0 lens 488/0 e 0 to 0 dl 1734016152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.893275:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345c700 with x1818247333963648 ext(1601536->1605631) 00002000:00010000:3.0:1734016141.893282:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345c700 00000100:00100000:3.0:1734016141.893310:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8972 00000100:00100000:3.0:1734016141.893318:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333963648:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016141.893611:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333963648:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 293us (2862us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016141.893619:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8972 00002000:00100000:3.0:1734016141.893626:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (1601536->1605631) req@ffff88007345c700 x1818247333963648/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:102/0 lens 488/4536 e 0 to 0 dl 1734016152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.893634:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345c700 with x1818247333963648 ext(1601536->1605631) 00002000:00010000:3.0:1734016141.893637:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345c700 00000100:00100000:1.0:1734016141.893945:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016141.894185:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333963904 00000100:00100000:0.0:1734016141.894192:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333963904 00002000:00100000:0.0:1734016141.894224:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (3534848->4194303) req@ffff8800758f4a80 x1818247333963904/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:102/0 lens 488/0 e 0 to 0 dl 1734016152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016141.894232:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f4a80 with x1818247333963904 ext(3534848->4194303) 00002000:00010000:0.0:1734016141.894237:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800758f4a80 00000100:00100000:0.0:1734016141.894265:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8973 00000100:00100000:0.0:1734016141.894270:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333963904:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016141.906382:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.906602:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333964160 00000100:00100000:3.0:1734016141.906617:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333964160 00002000:00100000:3.0:1734016141.906694:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->2338815) req@ffff88007345f100 x1818247333964160/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:102/0 lens 504/0 e 0 to 0 dl 1734016152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016141.906708:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345f100 with x1818247333964160 ext(0->2338815) 00002000:00010000:3.0:1734016141.906715:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345f100 00000100:00100000:3.0:1734016141.906769:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8974 00000100:00100000:3.0:1734016141.906780:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333964160:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016141.911178:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333963904:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 16887us (17218us total) trans 0 rc 659456/659456 00000100:00100000:1.0:1734016141.911200:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8973 00002000:00100000:1.0:1734016141.911218:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (3534848->4194303) req@ffff8800758f4a80 x1818247333963904/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:102/0 lens 488/440 e 0 to 0 dl 1734016152 ref 1 fl Complete:/200/0 rc 659456/659456 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016141.911228:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f4a80 with x1818247333963904 ext(3534848->4194303) 00002000:00010000:1.0:1734016141.911236:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800758f4a80 00000100:00100000:2.0:1734016141.948266:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333964160:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 41458us (41879us total) trans 0 rc 2334720/2334720 00000100:00100000:2.0:1734016141.948291:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8974 00002000:00100000:2.0:1734016141.948310:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->2338815) req@ffff88007345f100 x1818247333964160/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:102/0 lens 504/440 e 0 to 0 dl 1734016152 ref 1 fl Complete:/200/0 rc 2334720/2334720 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016141.948321:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345f100 with x1818247333964160 ext(0->2338815) 00002000:00010000:2.0:1734016141.948329:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345f100 00000100:00100000:0.0:1734016141.954207:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016141.954282:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.956160:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333964288 00000100:00100000:1.0:1734016141.956177:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333964288 00000100:00100000:1.0:1734016141.956258:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333964416 00000100:00100000:1.0:1734016141.956262:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333964416 00000100:00100000:1.0:1734016141.956290:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11756 00000100:00100000:1.0:1734016141.956298:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333964288:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016141.956323:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016141.956351:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27117416 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e70f9 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016141.956425:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335414400:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016141.956542:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016141.956598:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11757 00000100:00100000:1.0:1734016141.956604:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333964416:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016141.956616:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016141.956632:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc2711741d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7100 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016141.956668:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335414528:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016141.956691:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92300 going to sleep for 11 seconds 00000100:00100000:2.0:1734016141.959141:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335414528:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016141.959195:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc2711741d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7100 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016141.959211:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc2711741d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7100 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1734016141.959841:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335414400:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016141.959862:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27117416 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70f9 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016141.959872:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27117416 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70f9 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016141.959913:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:2.0:1734016141.960155:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333964416:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3547us (5869us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016141.960164:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11757 00010000:00010000:1.0:1734016141.960632:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016141.960661:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333964288:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4363us (6476us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016141.960667:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11756 00000100:00100000:0.0:1734016141.964745:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.964907:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333964544 00000100:00100000:1.0:1734016141.964931:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333964544 00000100:00100000:1.0:1734016141.965012:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11758 00000100:00100000:1.0:1734016141.965025:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:10406:x1818247333964544:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016141.965067:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016141.965109:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117424 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7107 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016141.965177:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271173f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4890624->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70d6 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016141.965185:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016141.965188:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016141.965192:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117424 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7107 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016141.965256:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271173f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4890624->4898815) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70d6 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016141.965276:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271173f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4890624->4898815) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70d6 expref: 7 pid: 7683 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1734016141.965294:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335414656:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016141.965400:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016141.970412:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.970646:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335414656:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016141.970719:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117424 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7107 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016141.970758:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016141.970906:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333964544:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5883us (6185us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016141.971000:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333964672 00000100:00100000:2.0:1734016141.971011:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333964672 00010000:00010000:2.0:1734016141.971073:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271173f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4890624->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70d6 expref: 8 pid: 7683 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1734016141.971126:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3220 00000100:00100000:2.0:1734016141.971139:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333964672:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016141.971168:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1734016141.971216:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11758 00010000:00010000:2.0:1734016141.971556:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271173f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4890624->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70d6 expref: 8 pid: 7683 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1734016141.971578:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271173f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4890624->4898815) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70d6 expref: 8 pid: 7683 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1734016141.971794:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271173f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4890624->4898815) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e70d6 expref: 8 pid: 7683 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1734016141.971880:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016141.971883:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016141.971896:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->184319) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7107 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.971910:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117424 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->184319) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7107 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016141.971966:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117424 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->184319) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7107 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016141.971984:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335414784:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016141.972071:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016141.975857:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016141.975975:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333964800 00000100:00100000:1.0:1734016141.975991:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333964800 00000100:00100000:1.0:1734016141.976065:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11759 00000100:00100000:1.0:1734016141.976076:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333964800:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016141.976419:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4298598 -> 4298598 00002000:00010000:1.0:1734016141.976424:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016142 -> 1734016142 00002000:00010000:1.0:1734016141.976426:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016142 -> 1734016142 00002000:00010000:1.0:1734016141.976429:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016142 -> 1734016141 00002000:00010000:1.0:1734016141.976432:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 176 -> 184 00000100:00100000:1.0:1734016141.976507:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333964800:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 432us (671us total) trans 4294968076 rc 0/0 00000100:00100000:1.0:1734016141.976524:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11759 00000100:00100000:2.0:1734016141.976642:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335414784:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016141.976674:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016141.976703:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333964672:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5566us (6317us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016141.976711:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3220 00000100:00100000:0.0:1734016141.980218:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.982912:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333964928 00000100:00100000:3.0:1734016141.982936:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333964928 00000100:00100000:3.0:1734016141.983034:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11760 00000100:00100000:3.0:1734016141.983045:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333964928:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.983082:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.983115:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711742b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e710e expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.983198:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335414912:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016141.983299:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.985235:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335414912:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016141.985272:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711742b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e710e expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.985292:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711742b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e710e expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.985958:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016141.986040:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333964928:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2996us (5838us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016141.986051:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11760 00000100:00100000:0.0:1734016141.988886:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.989036:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333965056 00000100:00100000:3.0:1734016141.989050:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333965056 00000100:00100000:3.0:1734016141.989122:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11761 00000100:00100000:3.0:1734016141.989134:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333965056:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.989166:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.989199:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117432 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7115 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016141.989285:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335415040:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016141.989371:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016141.991612:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335415040:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016141.991670:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117432 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7115 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.991694:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117432 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7115 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016141.992081:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016141.992501:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333965056:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3365us (3625us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016141.992523:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11761 00000100:00100000:0.0:1734016141.996170:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016141.996397:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333965184 00000100:00100000:3.0:1734016141.996412:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333965184 00000100:00100000:3.0:1734016141.996492:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11762 00000100:00100000:3.0:1734016141.996501:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333965184:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016141.996538:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016141.996566:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117439 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e711c expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.996609:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->184319) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7107 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.996618:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016141.996621:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016141.996624:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117439 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3162112->3170303] (req 3162112->3170303) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e711c expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.996659:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117424 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->184319) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7107 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016141.996675:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117424 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->184319) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7107 expref: 6 pid: 8216 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1734016141.996692:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335415168:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016141.996753:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016142.002675:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335415168:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016142.002738:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117439 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3162112->3170303] (req 3162112->3170303) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e711c expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.002768:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016142.003603:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333965184:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7096us (7446us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.003615:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11762 00000100:00100000:0.0:1734016142.004123:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.004293:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333965312 00000100:00100000:3.0:1734016142.004302:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333965312 00010000:00010000:3.0:1734016142.004348:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117424 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->184319) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7107 expref: 7 pid: 8216 timeout: 509 lvb_type: 0 00000100:00080000:0.0:1734016142.004461:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016112 00000100:00100000:3.0:1734016142.004735:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3221 00000100:00100000:3.0:1734016142.004743:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333965312:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016142.004769:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016142.004821:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117424 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 180224->184319) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7107 expref: 7 pid: 8216 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1734016142.004838:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117424 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 180224->184319) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7107 expref: 7 pid: 8216 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1734016142.004882:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117424 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 180224->184319) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7107 expref: 7 pid: 8216 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1734016142.006791:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016142.006810:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016142.006825:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e711c expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.006839:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e711c expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.006913:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e711c expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016142.006928:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335415296:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016142.007044:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016142.014745:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335415296:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016142.014795:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016142.015533:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.015701:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333965312:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 10954us (11576us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.015715:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3221 00000100:00100000:3.0:1734016142.015785:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333965440 00000100:00100000:3.0:1734016142.015795:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333965440 00000100:00100000:3.0:1734016142.015880:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11763 00000100:00100000:3.0:1734016142.015887:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333965440:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016142.016186:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4298598 -> 4298598 00002000:00010000:3.0:1734016142.016191:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016142 -> 1734016141 00002000:00010000:3.0:1734016142.016194:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016142 -> 1734016142 00002000:00010000:3.0:1734016142.016197:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016141 -> 1734016141 00002000:00010000:3.0:1734016142.016199:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 184 -> 184 00000100:00080000:1.0:1734016142.016425:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016112 00000100:00100000:3.0:1734016142.018871:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333965440:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 2963us (3318us total) trans 4294968077 rc 0/0 00000100:00100000:3.0:1734016142.018893:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11763 00000100:00100000:2.0:1734016142.022309:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.022387:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.022536:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333965568 00000100:00100000:3.0:1734016142.022556:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333965568 00000100:00100000:3.0:1734016142.022612:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333965696 00000100:00100000:3.0:1734016142.022615:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333965696 00000100:00100000:3.0:1734016142.022666:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11764 00000100:00100000:3.0:1734016142.022677:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333965568:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.022720:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.022754:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117440 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7123 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016142.022871:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335415424:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016142.022955:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016142.023101:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11765 00000100:00100000:3.0:1734016142.023106:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333965696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.023116:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.023128:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27117447 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e712a expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016142.023163:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335415552:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016142.023186:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00080000:0.0:1734016142.023316:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016112 00000100:00100000:3.0:1734016142.026612:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335415552:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016142.026693:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27117447 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e712a expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.026721:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27117447 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e712a expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1734016142.026858:0:7683:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime: 1734016141 -> 1734016142 00002000:00010000:0.0:1734016142.026864:0:7683:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016141 -> 1734016142 00000100:00100000:0.0:1734016142.026883:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335415424:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016142.026915:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117440 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7123 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016142.026925:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117440 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7123 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.027249:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00010000:00010000:0.0:1734016142.027488:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016142.027987:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333965696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4874us (5594us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016142.028002:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11765 00000100:00100000:0.0:1734016142.028904:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333965568:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6222us (6611us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016142.028912:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11764 00000100:00100000:0.0:1734016142.034892:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016142.034961:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.035119:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333965952 00000100:00100000:3.0:1734016142.035136:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333965952 00000100:00100000:3.0:1734016142.035214:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333965824 00000100:00100000:3.0:1734016142.035217:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333965824 00000100:00100000:3.0:1734016142.035245:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11766 00000100:00100000:3.0:1734016142.035255:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333965952:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.035294:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.035323:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711744e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7138 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016142.035428:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335415680:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016142.035546:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016142.035621:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11767 00000100:00100000:1.0:1734016142.035632:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333965824:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.035646:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.035667:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc27117455 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7131 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016142.035719:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335415808:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016142.035761:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:2.0:1734016142.038742:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335415680:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016142.038841:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711744e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7138 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016142.038859:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc2711744e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7138 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1734016142.039312:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335415808:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016142.039342:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc27117455 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7131 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.039354:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d200/0x5e3a3adc27117455 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7131 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016142.040015:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:2.0:1734016142.040114:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333965952:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4855us (5236us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016142.040129:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11766 00010000:00010000:1.0:1734016142.041194:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016142.041238:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333965824:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5604us (6273us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016142.041245:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11767 00000100:00100000:0.0:1734016142.045554:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016142.048311:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.049355:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333966208 00000100:00100000:1.0:1734016142.049370:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333966208 00000100:00100000:1.0:1734016142.049429:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333966080 00000100:00100000:1.0:1734016142.049432:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333966080 00000100:00100000:1.0:1734016142.049473:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11768 00000100:00100000:1.0:1734016142.049482:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333966208:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.049509:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.049545:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc2711745c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7146 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016142.049617:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335415936:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016142.049698:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016142.049793:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11769 00000100:00100000:3.0:1734016142.049819:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333966080:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.049827:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.049840:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117463 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e713f expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016142.049872:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335416064:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016142.049897:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e300 going to sleep for 11 seconds 00000100:00100000:1.0:1734016142.055355:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335415936:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016142.055412:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc2711745c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7146 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.055432:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc2711745c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7146 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.055464:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:3.0:1734016142.055674:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335416064:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016142.055700:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117463 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e713f expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.055709:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117463 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e713f expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.055728:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:1.0:1734016142.056244:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333966208:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6760us (10698us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016142.056255:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11768 00000100:00100000:3.0:1734016142.056735:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333966080:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6934us (8435us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016142.056743:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11769 00000100:00100000:0.0:1734016142.061401:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.062132:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333966336 00000100:00100000:3.0:1734016142.062152:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333966336 00000100:00100000:3.0:1734016142.062250:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11770 00000100:00100000:3.0:1734016142.062263:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333966336:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.062301:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.062346:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711746a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e714d expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.062410:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e711c expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.062421:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016142.062424:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016142.062429:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711746a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e714d expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.062479:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e711c expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.062500:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117439 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e711c expref: 8 pid: 7683 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1734016142.062523:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335416192:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016142.062632:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e300 going to sleep for 11 seconds 00000100:00100000:0.0:1734016142.066186:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.066322:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335416192:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016142.066397:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711746a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e714d expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.066432:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016142.066531:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333966336:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4269us (5149us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.066549:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11770 00000100:00100000:2.0:1734016142.066692:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333966464 00000100:00100000:2.0:1734016142.066705:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333966464 00010000:00010000:2.0:1734016142.066753:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117439 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e711c expref: 9 pid: 7683 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1734016142.068261:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3222 00000100:00100000:2.0:1734016142.068277:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333966464:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016142.068299:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016142.068340:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117439 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e711c expref: 9 pid: 7683 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1734016142.068360:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e711c expref: 9 pid: 7683 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1734016142.068396:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117439 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3162112->3170303) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e711c expref: 9 pid: 7683 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1734016142.070704:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016142.070717:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016142.070738:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711746a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->438271) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e714d expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.070755:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711746a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->438271) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e714d expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.070870:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711746a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->438271) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e714d expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016142.070888:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335416320:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016142.070988:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016142.075196:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.075586:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335416320:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016142.075624:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016142.075703:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333966464:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7426us (9541us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016142.075721:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3222 00000100:00100000:3.0:1734016142.076256:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333966720 00000100:00100000:3.0:1734016142.076266:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333966720 00002000:00100000:3.0:1734016142.076322:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (434176->438271) req@ffff88008719d880 x1818247333966720/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:103/0 lens 488/0 e 0 to 0 dl 1734016153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016142.076333:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719d880 with x1818247333966720 ext(434176->438271) 00002000:00010000:3.0:1734016142.076339:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008719d880 00000100:00100000:3.0:1734016142.076364:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8975 00000100:00100000:3.0:1734016142.076373:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333966720:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016142.076616:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333966720:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 245us (1449us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016142.076625:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8975 00002000:00100000:3.0:1734016142.076630:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (434176->438271) req@ffff88008719d880 x1818247333966720/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:103/0 lens 488/4536 e 0 to 0 dl 1734016153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016142.076639:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719d880 with x1818247333966720 ext(434176->438271) 00002000:00010000:3.0:1734016142.076642:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008719d880 00000100:00100000:1.0:1734016142.081208:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.081531:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333966976 00000100:00100000:2.0:1734016142.081548:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333966976 00002000:00100000:2.0:1734016142.081640:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (438272->442367) req@ffff8800758f5180 x1818247333966976/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:103/0 lens 488/0 e 0 to 0 dl 1734016153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016142.081655:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f5180 with x1818247333966976 ext(438272->442367) 00002000:00010000:2.0:1734016142.081663:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800758f5180 00000100:00100000:2.0:1734016142.081724:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8976 00000100:00100000:2.0:1734016142.081734:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333966976:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016142.082128:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333966976:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 394us (941us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016142.082137:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8976 00002000:00100000:2.0:1734016142.082146:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (438272->442367) req@ffff8800758f5180 x1818247333966976/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:103/0 lens 488/4536 e 0 to 0 dl 1734016153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016142.082160:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f5180 with x1818247333966976 ext(438272->442367) 00002000:00010000:2.0:1734016142.082164:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800758f5180 00000100:00100000:0.0:1734016142.086015:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.087313:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333967104 00000100:00100000:3.0:1734016142.087330:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333967104 00002000:00100000:3.0:1734016142.087394:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (434176->442367) req@ffff88008719df80 x1818247333967104/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:103/0 lens 8680/0 e 0 to 0 dl 1734016153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016142.087406:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719df80 with x1818247333967104 ext(434176->442367) 00002000:00010000:3.0:1734016142.087412:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008719df80 00000100:00100000:3.0:1734016142.087609:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8977 00000100:00100000:3.0:1734016142.087618:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333967104:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016142.089028:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333967104:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1399us (3015us total) trans 4294968078 rc 0/0 00000100:00100000:3.0:1734016142.089042:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8977 00002000:00100000:3.0:1734016142.089056:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (434176->442367) req@ffff88008719df80 x1818247333967104/t4294968078(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:103/0 lens 8680/448 e 0 to 0 dl 1734016153 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016142.089066:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719df80 with x1818247333967104 ext(434176->442367) 00002000:00010000:3.0:1734016142.089073:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008719df80 00000100:00100000:0.0:1734016142.091050:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.091165:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333967232 00000100:00100000:3.0:1734016142.091179:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333967232 00000100:00100000:3.0:1734016142.091236:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11771 00000100:00100000:3.0:1734016142.091245:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333967232:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016142.094087:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968078 is committed 00000001:00080000:2.0:1734016142.094116:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968077 is committed 00000100:00100000:3.0:1734016142.094964:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333967232:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 3709us (3913us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.094979:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11771 00000100:00100000:1.0:1734016142.098335:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.098486:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333967360 00000100:00100000:3.0:1734016142.098507:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333967360 00000100:00100000:3.0:1734016142.098582:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11772 00000100:00100000:3.0:1734016142.098595:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333967360:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.098635:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.098666:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117471 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7154 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016142.098762:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335416448:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016142.098885:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e300 going to sleep for 11 seconds 00002000:00010000:3.0:1734016142.101057:0:7683:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks: 184 -> 200 00000100:00100000:3.0:1734016142.101103:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335416448:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016142.101155:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117471 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7154 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.101169:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117471 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7154 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.101181:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016142.101244:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333967360:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2649us (2931us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016142.101254:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11772 00000100:00100000:0.0:1734016142.104407:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.105355:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333967488 00000100:00100000:3.0:1734016142.105370:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333967488 00000100:00100000:3.0:1734016142.105503:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11773 00000100:00100000:3.0:1734016142.105525:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333967488:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.105566:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.105601:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117478 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e715b expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016142.105696:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335416576:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016142.106298:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016142.109326:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335416576:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016142.109388:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117478 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e715b expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.109409:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117478 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e715b expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.109632:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016142.110036:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333967488:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4517us (5648us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016142.110049:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11773 00000100:00100000:0.0:1734016142.112686:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.112889:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333967616 00000100:00100000:3.0:1734016142.112906:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333967616 00000100:00100000:1.0:1734016142.113475:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11774 00000100:00100000:1.0:1734016142.113488:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333967616:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.113533:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.113566:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711747f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7162 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.113619:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711739f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1736703) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7082 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.113628:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016142.113631:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016142.113636:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711747f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [3416064->3424255] (req 3416064->3424255) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7162 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.113690:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711739f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1736703) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7082 expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.113706:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711739f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1736703) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7082 expref: 9 pid: 7683 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1734016142.113719:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335416704:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016142.113835:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016142.119697:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335416704:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016142.119754:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711747f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [3416064->3424255] (req 3416064->3424255) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7162 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.119788:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016142.119931:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333967616:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6443us (7261us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016142.119951:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11774 00000100:00100000:0.0:1734016142.122126:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.122490:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333967744 00000100:00100000:2.0:1734016142.122505:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333967744 00010000:00010000:2.0:1734016142.122570:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711739f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1736703) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7082 expref: 10 pid: 7683 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1734016142.122622:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3223 00000100:00100000:2.0:1734016142.122631:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333967744:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016142.122652:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016142.122679:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711739f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1724416->1736703) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7082 expref: 10 pid: 7683 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1734016142.122692:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711739f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1724416->1736703) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7082 expref: 10 pid: 7683 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1734016142.122719:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711739f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1724416->1736703) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7082 expref: 10 pid: 7683 timeout: 509 lvb_type: 0 00000100:00080000:0.0:1734016142.122988:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016112 00010000:00010000:2.0:1734016142.123601:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016142.123604:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016142.123617:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711747f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->3424255) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7162 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.123633:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711747f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->3424255) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7162 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.123678:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711747f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->3424255) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7162 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016142.123694:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335416832:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016142.124609:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016142.131960:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335416832:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016142.131994:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016142.132067:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333967744:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9433us (9961us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016142.132086:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3223 00000100:00100000:0.0:1734016142.132711:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.132865:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333967872 00000100:00100000:1.0:1734016142.132877:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333967872 00000100:00100000:1.0:1734016142.133004:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11775 00000100:00100000:1.0:1734016142.133013:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333967872:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016142.133279:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 2342912 -> 2342912 00002000:00010000:1.0:1734016142.133283:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016142 -> 1734016141 00002000:00010000:1.0:1734016142.133286:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016142 -> 1734016142 00002000:00010000:1.0:1734016142.133288:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016142 -> 1734016141 00002000:00010000:1.0:1734016142.133290:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 96 -> 96 00000100:00100000:1.0:1734016142.135548:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333967872:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 2514us (2820us total) trans 4294969543 rc 0/0 00000100:00100000:1.0:1734016142.135572:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11775 00000100:00100000:0.0:1734016142.140777:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.141155:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333968128 00000100:00100000:3.0:1734016142.141179:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333968128 00000100:00100000:3.0:1734016142.141327:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2357 00000100:00100000:3.0:1734016142.141339:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:10406:x1818247333968128:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016142.141451:0:6478:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016142.141508:0:6478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271172fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e6fe8 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.141566:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016142.141573:0:6478:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016142.141899:0:6478:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117486 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016142.141918:0:6478:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117328 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e700b expref: 15 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.141926:0:6478:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117486 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016142.141974:0:6478:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117328 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e700b expref: 15 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.141993:0:6478:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117328 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e700b expref: 15 pid: 7704 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1734016142.142007:0:6478:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335416960:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016142.142105:0:6478:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00080000:0.0:1734016142.142208:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016112 00000100:00100000:0.0:1734016142.148196:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.148347:0:6478:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1818247335416960:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016142.148388:0:6478:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117486 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:2.0:1734016142.149302:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333968256 00000100:00100000:2.0:1734016142.149319:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333968256 00010000:00010000:2.0:1734016142.149390:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117328 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e700b expref: 16 pid: 7704 timeout: 509 lvb_type: 0 00000100:00080000:0.0:1734016142.149766:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016112 00000100:00100000:2.0:1734016142.150091:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3224 00000100:00100000:2.0:1734016142.150101:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247333968256:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016142.150125:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016142.150135:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117328 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e700b expref: 16 pid: 7704 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1734016142.150147:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117328 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e700b expref: 16 pid: 7704 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1734016142.150173:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117328 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e700b expref: 16 pid: 7704 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1734016142.150208:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016142.150213:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117486 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016142.150226:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117486 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016142.150234:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117486 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 00010000:00010000:2.0:1734016142.150272:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016142.150329:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247333968256:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 229us (2155us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016142.150337:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3224 00010000:00010000:3.0:1734016142.150740:0:6478:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117486 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016142.150749:0:6478:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117486 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000001:00080000:3.0:1734016142.150918:0:6478:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968831 00000004:00010000:3.0:1734016142.150980:0:6478:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88008719ca80 reply state ffff880075e35000 transno 4294968832 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117486 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 00000100:00100000:3.0:1734016142.150991:0:6478:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016142.151098:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c598caf-7141-4c19-8566-0b7731516db9+20:10406:x1818247333968128:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 9760us (10344us total) trans 4294968832 rc 0/0 00000100:00100000:3.0:1734016142.151105:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2357 00000020:00080000:3.0:1734016142.151109:0:6478:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016142.155225:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.155523:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333968384 00000100:00100000:1.0:1734016142.155542:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333968384 00000100:00100000:1.0:1734016142.155628:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11776 00000100:00100000:1.0:1734016142.155639:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:10406:x1818247333968384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.155671:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.155708:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711748d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7169 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.155768:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711746a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->438271) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e714d expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.155776:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016142.155781:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016142.155784:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711748d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7169 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.155860:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711746a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->438271) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e714d expref: 5 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.155876:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711746a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->438271) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e714d expref: 5 pid: 7683 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1734016142.155890:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335417088:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016142.155970:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00010000:00010000:3.0:1734016142.156928:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117486 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016142.156946:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117486 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016142.156956:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117486 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016142.156962:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df7180 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016142.156968:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117486 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016142.156977:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117486 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016142.157003:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016142.157006:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016142.157012:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117486 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00010000:00010000:3.0:1734016142.157018:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117486 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 00000100:00100000:1.0:1734016142.160541:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335417088:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016142.160615:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711748d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7169 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.160653:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016142.160737:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333968384:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5099us (5534us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016142.160749:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11776 00000100:00100000:0.0:1734016142.161584:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.161738:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333968512 00000100:00100000:1.0:1734016142.161749:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333968512 00010000:00010000:1.0:1734016142.161787:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711746a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->438271) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e714d expref: 6 pid: 7683 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1734016142.161861:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3225 00000100:00100000:1.0:1734016142.161869:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b23c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333968512:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016142.161890:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016142.161921:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711746a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 434176->438271) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e714d expref: 6 pid: 7683 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1734016142.161934:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711746a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 434176->438271) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e714d expref: 6 pid: 7683 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1734016142.161963:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc2711746a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 434176->438271) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e714d expref: 6 pid: 7683 timeout: 509 lvb_type: 0 00010000:00010000:1.0:1734016142.161980:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016142.161982:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016142.161987:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711748d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7169 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.161996:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711748d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7169 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.162034:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711748d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7169 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016142.162049:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335417216:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016142.162104:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016142.166920:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335417216:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016142.166955:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016142.167026:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b23c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333968512:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5155us (5443us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016142.167041:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3225 00000100:00100000:2.0:1734016142.167295:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.168551:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333968640 00000100:00100000:1.0:1734016142.168562:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333968640 00000100:00100000:1.0:1734016142.168631:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11777 00000100:00100000:1.0:1734016142.168640:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247333968640:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.168665:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.168695:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27117494 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7170 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.168732:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711747f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->3424255) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7162 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.168740:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016142.168743:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016142.168745:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27117494 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7170 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.168783:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711747f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->3424255) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7162 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.168795:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711747f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->3424255) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7162 expref: 7 pid: 8216 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1734016142.168844:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335417344:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016142.168906:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016142.176948:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.177115:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333968768 00000100:00100000:2.0:1734016142.177132:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333968768 00010000:00010000:2.0:1734016142.177186:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711747f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->3424255) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7162 expref: 8 pid: 8216 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1734016142.177237:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3226 00000100:00100000:2.0:1734016142.177246:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333968768:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016142.177269:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016142.177294:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711747f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3416064->3424255) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7162 expref: 8 pid: 8216 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1734016142.177315:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711747f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3416064->3424255) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7162 expref: 8 pid: 8216 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1734016142.177348:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016142.177350:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016142.177357:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27117494 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7170 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.177367:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27117494 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7170 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.177411:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27117494 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7170 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.178148:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc2711747f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3416064->3424255) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7162 expref: 8 pid: 8216 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1734016142.178194:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335417344:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016142.178231:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27117494 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7170 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.178243:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016142.178317:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:10406:x1818247333968640:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9675us (11022us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016142.178329:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11777 00000100:00100000:2.0:1734016142.179326:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335417472:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016142.179413:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706a80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016142.187169:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016142.190407:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.190407:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335417472:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016142.190454:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016142.190502:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333968896 00000100:00100000:0.0:1734016142.190522:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333968896 00000100:00100000:2.0:1734016142.190561:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333968768:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 13314us (13630us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016142.190577:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3226 00002000:00010000:0.0:1734016142.190593:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:0.0:1734016142.190602:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719f100 with x1818247333968896 ext(4194304->18446744073709551615) 00002000:00010000:0.0:1734016142.190622:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008719f100. 00000100:00100000:0.0:1734016142.190646:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333969024 00000100:00100000:0.0:1734016142.190648:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333969024 00002000:00010000:0.0:1734016142.190659:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (2605274->18446744073709551615) 00002000:00100000:0.0:1734016142.190663:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719c000 with x1818247333969024 ext(2605274->18446744073709551615) 00002000:00010000:0.0:1734016142.190674:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719c000. 00000100:00100000:0.0:1734016142.190689:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8978 00000100:00100000:0.0:1734016142.190697:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333968896:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:3.0:1734016142.190736:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8979 00000100:00100000:3.0:1734016142.190742:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333969024:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016142.191059:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 2342912 -> 2605274 00002000:00010000:3.0:1734016142.191063:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016141 -> 1734016142 00002000:00010000:3.0:1734016142.191066:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016142 -> 1734016142 00002000:00010000:3.0:1734016142.191069:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016141 -> 1734016142 00002000:00010000:3.0:1734016142.191070:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 96 -> 96 00000100:00100000:3.0:1734016142.191098:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333969024:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 355us (707us total) trans 4294969544 rc 0/0 00000100:00100000:3.0:1734016142.191105:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8979 00002000:00010000:3.0:1734016142.191107:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (2605274->18446744073709551615) 00002000:00100000:3.0:1734016142.191111:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719c000 with x1818247333969024 ext(2605274->18446744073709551615) 00002000:00010000:3.0:1734016142.191115:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719c000. 00002000:00010000:0.0:1734016142.191123:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4298598 -> 4194304 00002000:00010000:0.0:1734016142.191127:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016142 -> 1734016142 00002000:00010000:0.0:1734016142.191129:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016142 -> 1734016142 00002000:00010000:0.0:1734016142.191132:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016142 -> 1734016142 00002000:00010000:0.0:1734016142.191133:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 200 -> 168 00000100:00100000:0.0:1734016142.191152:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333968896:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 455us (4003us total) trans 4294968079 rc 0/0 00000100:00100000:0.0:1734016142.191160:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8978 00002000:00010000:0.0:1734016142.191163:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:0.0:1734016142.191165:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719f100 with x1818247333968896 ext(4194304->18446744073709551615) 00002000:00010000:0.0:1734016142.191171:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008719f100. 00000100:00100000:0.0:1734016142.195147:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67a75f73-9674-4938-8c12-63813a36f078:3506:1818247335417600:0@lo:400:kworker.0 00000100:00100000:0.0:1734016142.195262:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1734016142.195293:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3504:1818247335417856:0@lo:400:kworker.0 00000100:00100000:0.0:1734016142.195309:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3506:1818247335418112:0@lo:400:kworker.0 00000100:00100000:0.0:1734016142.195337:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016142.195352:0:3506:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1734016142.195357:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016142.195358:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335417984:0@lo:400:kworker.0 00000100:00100000:3.0:1734016142.195372:0:3504:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1734016142.195376:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3504:1818247335417728:0@lo:400:kworker.0 00000100:00100000:0.0:1734016142.195384:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1734016142.195394:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1734016142.195407:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335418240:0@lo:400:kworker.0 00000100:00100000:3.0:1734016142.195424:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016142.195429:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335418112 00000100:00100000:0.0:1734016142.195438:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335418112 00000100:00100000:3.0:1734016142.195443:0:6478:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335417856 00000100:00100000:3.0:1734016142.195445:0:6478:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335417856 00000100:00100000:0.0:1734016142.195483:0:6480:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335417728 00000100:00100000:2.0:1734016142.195485:0:6474:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335417600 00000100:00100000:0.0:1734016142.195486:0:6480:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335417728 00000100:00100000:2.0:1734016142.195488:0:6474:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335417600 00000100:00100000:0.0:1734016142.195503:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1734016142.195510:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3506:x1818247335418112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016142.195556:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335417984 00000100:00100000:1.0:1734016142.195560:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335417984 00000100:00100000:0.0:1734016142.195578:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3506:x1818247335418112:12345-0@lo:400:kworker.0 Request processed in 68us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016142.195585:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1734016142.195604:0:6480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1734016142.195607:0:6480:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3504:x1818247335417728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1734016142.195633:0:6480:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3504:x1818247335417728:12345-0@lo:400:kworker.0 Request processed in 25us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016142.195637:0:6480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1734016142.197674:0:6478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1734016142.197686:0:6478:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3504:x1818247335417856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1734016142.197769:0:6478:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3504:x1818247335417856:12345-0@lo:400:kworker.0 Request processed in 86us (2411us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.197775:0:6478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1734016142.197854:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3504:1818247335417728:0@lo:400:kworker.0 00000100:00100000:3.0:1734016142.197865:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3504:1818247335417856:0@lo:400:kworker.0 00000100:00100000:3.0:1734016142.197901:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335418240 00000100:00100000:3.0:1734016142.197907:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335418240 00000100:00100000:3.0:1734016142.197943:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1734016142.197947:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335418240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1734016142.197980:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335418240:12345-0@lo:400:kworker.0 Request processed in 31us (2554us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.197986:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1734016142.198008:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335418240:0@lo:400:kworker.0 00000100:00100000:2.0:1734016142.198209:0:6474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1734016142.198216:0:6474:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a75f73-9674-4938-8c12-63813a36f078+18:3506:x1818247335417600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1734016142.198254:0:6474:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a75f73-9674-4938-8c12-63813a36f078+18:3506:x1818247335417600:12345-0@lo:400:kworker.0 Request processed in 39us (2995us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016142.198260:0:6474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1734016142.198830:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1734016142.198837:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335417984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016142.198878:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335417984:12345-0@lo:400:kworker.0 Request processed in 42us (3493us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016142.198883:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:0.0:1734016142.200296:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016112 00000100:00080000:0.0:1734016142.200310:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016112 00000100:00080000:0.0:1734016142.200314:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016112 00000100:00080000:0.0:1734016142.200319:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016112 00000100:00100000:0.0:1734016142.200587:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335417984:0@lo:400:kworker.0 00000100:00100000:0.0:1734016142.200611:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3506:1818247335418112:0@lo:400:kworker.0 00000100:00100000:0.0:1734016142.200627:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67a75f73-9674-4938-8c12-63813a36f078:3506:1818247335417600:0@lo:400:kworker.0 00000100:00100000:2.0:1734016142.201094:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016142.201627:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333969152 00000100:00100000:0.0:1734016142.201639:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333969152 00000100:00100000:0.0:1734016142.201763:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2358 00000100:00100000:0.0:1734016142.201774:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10406:x1818247333969152:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016142.202545:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016142.202586:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc2711749b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7177 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016142.202773:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc271174a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016142.202797:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc271174a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016142.202834:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc271174a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016142.202876:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 6799578 00000004:00200000:0.0:1734016142.202883:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016142.202914:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc271174a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016142.202947:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580900/0x5e3a3adc2711749b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7177 expref: 17 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016142.204664:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc271174a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7177 expref: 16 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016142.204679:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:0.0:1734016142.204681:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016142.204686:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7583180, rc 0) 00000100:00100000:0.0:1734016142.204794:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333969152:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3019us (3706us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016142.204819:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2358 00000100:00100000:0.0:1734016142.211144:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016142.211227:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.211918:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333969408 00000100:00100000:3.0:1734016142.211939:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333969408 00000100:00100000:1.0:1734016142.212232:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333969280 00000100:00100000:1.0:1734016142.212239:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333969280 00000100:00100000:1.0:1734016142.212284:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11778 00000100:00100000:1.0:1734016142.212299:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333969408:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.212344:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.212387:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271174a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7185 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016142.212492:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335418368:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016142.212632:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016142.212731:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11779 00000100:00100000:2.0:1734016142.212740:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333969280:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016142.212749:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016142.212766:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271174b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e717e expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016142.212822:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335418496:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016142.212849:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016142.215631:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335418496:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016142.215703:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271174b0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e717e expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016142.215727:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc271174b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e717e expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016142.215761:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016142.215876:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333969280:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3132us (4645us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016142.215891:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11779 00000100:00100000:1.0:1734016142.216253:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335418368:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016142.216290:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271174a9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7185 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.216304:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc271174a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7185 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.216342:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016142.216371:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333969408:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4076us (5248us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016142.216378:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11778 00000100:00100000:0.0:1734016142.224775:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016142.225171:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.225258:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333969536 00000100:00100000:1.0:1734016142.225271:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333969536 00000100:00100000:1.0:1734016142.225327:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333969664 00000100:00100000:1.0:1734016142.225329:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333969664 00000100:00100000:1.0:1734016142.225355:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11780 00000100:00100000:1.0:1734016142.225363:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333969536:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.225386:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.225411:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271174b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e718c expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016142.225490:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335418624:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016142.225588:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016142.225677:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11781 00000100:00100000:2.0:1734016142.225685:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333969664:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016142.225698:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016142.225713:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271174be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7193 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016142.225754:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335418752:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016142.225781:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016142.230593:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335418624:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016142.230651:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271174b7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e718c expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.230673:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc271174b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e718c expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.230702:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016142.230786:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333969536:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5421us (6028us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016142.230818:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11780 00000100:00100000:3.0:1734016142.230968:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335418752:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016142.231000:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271174be lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7193 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.231011:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271174be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7193 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.231021:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:3.0:1734016142.231045:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333969664:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5361us (5875us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016142.231052:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11781 00000100:00100000:0.0:1734016142.236637:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.236909:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333969792 00000100:00100000:2.0:1734016142.236927:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333969792 00000100:00100000:2.0:1734016142.237121:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2359 00000100:00100000:2.0:1734016142.237132:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+19:10406:x1818247333969792:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016142.237186:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016142.237219:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271174c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e719a expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.237360:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271174cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.237379:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271174cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.237393:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271174cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:2.0:1734016142.237428:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 6799578 00000004:00200000:2.0:1734016142.237434:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016142.237452:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271174cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.237475:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271174c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e719a expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.239775:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271174cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e719a expref: 20 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.239811:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016142.239815:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016142.239821:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016142.241263:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+20:10406:x1818247333969792:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4115us (4625us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016142.241279:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2359 00000100:00100000:0.0:1734016142.247470:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.247794:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333969920 00000100:00100000:3.0:1734016142.247865:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333969920 00000100:00100000:3.0:1734016142.247966:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11782 00000100:00100000:3.0:1734016142.247979:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:10406:x1818247333969920:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.248018:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.248056:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271174d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e71a1 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.248116:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711748d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7169 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.248125:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016142.248130:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016142.248134:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271174d3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71a1 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.248180:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711748d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7169 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.248195:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711748d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7169 expref: 7 pid: 8216 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1734016142.248210:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335418880:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016142.248299:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e300 going to sleep for 11 seconds 00000100:00100000:0.0:1734016142.257753:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.258419:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335418880:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016142.258472:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271174d3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71a1 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.258497:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016142.258607:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333969920:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10629us (11147us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.258620:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11782 00000100:00100000:3.0:1734016142.258916:0:3504:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335419008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1734016142.258979:0:3504:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1734016142.259029:0:7685:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335419008 00000100:00100000:3.0:1734016142.259038:0:7685:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335419008 00000100:00100000:3.0:1734016142.259083:0:7685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1734016142.259091:0:7685:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335419008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1734016142.259152:0:7685:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 980042304 pending 0 free 3923025920 avail 3691503616 00000100:00100000:3.0:1734016142.259187:0:7685:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3504:x1818247335419008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.259193:0:7685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1734016142.259219:0:3504:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3504:1818247335419008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1734016142.259521:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333970048 00000100:00100000:2.0:1734016142.259528:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333970048 00010000:00010000:2.0:1734016142.259559:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711748d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7169 expref: 8 pid: 8216 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1734016142.259585:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3227 00000100:00100000:2.0:1734016142.259589:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333970048:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016142.259603:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016142.259638:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711748d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7169 expref: 8 pid: 8216 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1734016142.259651:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711748d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7169 expref: 8 pid: 8216 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1734016142.259690:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711748d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7169 expref: 8 pid: 8216 timeout: 509 lvb_type: 0 00010000:00010000:2.0:1734016142.259733:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016142.259735:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016142.259743:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271174d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->307199) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71a1 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.259752:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271174d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->307199) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71a1 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.259785:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271174d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->307199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71a1 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016142.259795:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335419136:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016142.259869:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00000100:00100000:3.0:1734016142.268027:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335419136:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016142.268073:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016142.268191:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333970048:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 8598us (10458us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.268210:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3227 00000100:00100000:0.0:1734016142.269024:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.270067:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333970176 00000100:00100000:3.0:1734016142.270083:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333970176 00000100:00100000:3.0:1734016142.271831:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11783 00000100:00100000:3.0:1734016142.271852:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333970176:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016142.272338:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1734016142.272343:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016142 -> 1734016142 00002000:00010000:3.0:1734016142.272345:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016142 -> 1734016142 00002000:00010000:3.0:1734016142.272349:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016142 -> 1734016142 00002000:00010000:3.0:1734016142.272353:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 168 -> 168 00000100:00100000:3.0:1734016142.272607:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333970176:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 757us (3588us total) trans 4294968080 rc 0/0 00000100:00100000:3.0:1734016142.272622:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11783 00000100:00100000:0.0:1734016142.282697:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.283232:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333970304 00000100:00100000:3.0:1734016142.283252:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333970304 00000100:00100000:3.0:1734016142.283337:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11784 00000100:00100000:3.0:1734016142.283354:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333970304:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.283386:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.283416:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271174da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e71a8 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016142.283531:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335419264:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016142.283640:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016142.286359:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335419264:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016142.286421:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271174da lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71a8 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.286438:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271174da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71a8 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.286462:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016142.286706:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333970304:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3352us (7916us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016142.286720:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11784 00000100:00100000:0.0:1734016142.296084:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.296272:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333970432 00000100:00100000:3.0:1734016142.296290:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333970432 00000100:00100000:3.0:1734016142.296377:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11785 00000100:00100000:3.0:1734016142.296388:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333970432:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.296424:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.296468:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271174e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e71af expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016142.296584:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335419392:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016142.296698:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016142.302428:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335419392:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016142.302496:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271174e1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71af expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.302525:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271174e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71af expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.302553:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016142.306644:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247333970432:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10235us (10577us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016142.306665:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11785 00000100:00100000:0.0:1734016142.314708:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.315331:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333970688 00000100:00100000:2.0:1734016142.315345:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333970688 00000100:00100000:2.0:1734016142.315421:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2360 00000100:00100000:2.0:1734016142.315431:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247333970688:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016142.315521:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016142.315563:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7583180/0x5e3a3adc271174a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7177 expref: 16 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.315605:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016142.315611:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016142.315843:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271174e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.315858:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271174cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e719a expref: 19 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.315866:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271174e8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.315912:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271174cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e719a expref: 19 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.315928:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271174cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e719a expref: 19 pid: 13956 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1734016142.315946:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335419520:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016142.316065:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016142.319192:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335419520:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016142.319250:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271174e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016142.322378:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.325043:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333970816 00000100:00100000:3.0:1734016142.325075:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333970816 00010000:00010000:3.0:1734016142.325164:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271174cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e719a expref: 20 pid: 13956 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1734016142.325235:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3228 00000100:00100000:3.0:1734016142.325249:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+20:1982:x1818247333970816:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016142.325281:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016142.325291:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271174cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e719a expref: 20 pid: 13956 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1734016142.325307:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271174cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e719a expref: 20 pid: 13956 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1734016142.325343:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc271174cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e719a expref: 20 pid: 13956 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1734016142.326909:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016142.326922:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271174e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.326938:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271174e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.326948:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271174e8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.327048:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016142.327188:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271174e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016142.327197:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271174e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:0.0:1734016142.327366:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968833 00000004:00010000:0.0:1734016142.327464:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075a00700 reply state ffff88012cfa4000 transno 4294968834 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271174e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016142.327476:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016142.327706:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+19:1982:x1818247333970816:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 2452us (5341us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.327723:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3228 00000100:00100000:0.0:1734016142.328691:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:10406:x1818247333970688:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 13249us (13984us total) trans 4294968834 rc 0/0 00000100:00100000:0.0:1734016142.328706:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2360 00000020:00080000:0.0:1734016142.328717:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016142.332105:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271174e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.332140:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271174e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.332150:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271174e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.332159:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcfc0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016142.332165:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271174e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.332176:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271174e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.332214:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016142.332217:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016142.332223:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271174e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.332230:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc271174e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016142.333427:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.333579:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333970944 00000100:00100000:3.0:1734016142.333598:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333970944 00000100:00100000:3.0:1734016142.333686:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11786 00000100:00100000:3.0:1734016142.333697:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333970944:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.333736:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.333769:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271174ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e71b6 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.333876:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27117494 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7170 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.333891:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016142.333894:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016142.333898:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271174ef lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71b6 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.333949:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27117494 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7170 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.333961:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27117494 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7170 expref: 10 pid: 8216 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1734016142.333973:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335419648:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016142.334075:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016142.336071:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335419648:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016142.336133:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271174ef lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71b6 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.336162:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016142.336256:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247333970944:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2558us (2849us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.336275:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11786 00000100:00100000:0.0:1734016142.338920:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.339412:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333971072 00000100:00100000:3.0:1734016142.339431:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333971072 00010000:00010000:3.0:1734016142.339499:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27117494 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7170 expref: 11 pid: 8216 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1734016142.339580:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3229 00000100:00100000:3.0:1734016142.339592:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333971072:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016142.339622:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016142.339667:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27117494 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7170 expref: 11 pid: 8216 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1734016142.339685:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27117494 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7170 expref: 11 pid: 8216 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1734016142.339735:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e400/0x5e3a3adc27117494 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7170 expref: 11 pid: 8216 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1734016142.339781:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016142.339785:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016142.339797:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271174ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71b6 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.339840:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271174ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71b6 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.339898:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271174ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71b6 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016142.339916:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335419776:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016142.340008:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e300 going to sleep for 11 seconds 00000100:00100000:0.0:1734016142.342654:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.342972:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335419776:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016142.343006:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016142.343615:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333971072:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4020us (4820us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.343633:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3229 00000100:00100000:0.0:1734016142.343737:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.343768:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333971328 00000100:00100000:1.0:1734016142.343779:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333971328 00002000:00010000:1.0:1734016142.343853:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:1.0:1734016142.343858:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075a01500 with x1818247333971328 ext(0->18446744073709551615) 00002000:00010000:1.0:1734016142.343876:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075a01500. 00000100:00100000:1.0:1734016142.343902:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333971200 00000100:00100000:1.0:1734016142.343905:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333971200 00002000:00010000:1.0:1734016142.343920:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (1902126->18446744073709551615) 00000100:00100000:0.0:1734016142.343923:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8980 00002000:00100000:1.0:1734016142.343923:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075a01880 with x1818247333971200 ext(1902126->18446744073709551615) 00000100:00100000:0.0:1734016142.343934:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333971328:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016142.343934:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075a01880. 00000100:00100000:1.0:1734016142.343946:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8981 00000100:00100000:1.0:1734016142.343951:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333971200:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016142.347780:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 2605274 -> 0 00002000:00010000:0.0:1734016142.347791:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016142 -> 1734016142 00002000:00010000:0.0:1734016142.347794:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016142 -> 1734016142 00002000:00010000:0.0:1734016142.347796:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016142 -> 1734016142 00002000:00010000:0.0:1734016142.347798:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 96 -> 0 00000100:00100000:0.0:1734016142.347945:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333971328:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 4000us (5298us total) trans 4294969545 rc 0/0 00000100:00100000:0.0:1734016142.347963:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8980 00002000:00010000:0.0:1734016142.347975:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:0.0:1734016142.347980:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075a01500 with x1818247333971328 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016142.347990:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075a01500. 00002000:00010000:1.0:1734016142.349618:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 1902126 00002000:00010000:1.0:1734016142.349637:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016142 -> 1734016142 00002000:00010000:1.0:1734016142.349640:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016142 -> 1734016142 00002000:00010000:1.0:1734016142.349642:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016142 -> 1734016142 00002000:00010000:1.0:1734016142.349644:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 168 -> 136 00000100:00100000:1.0:1734016142.349761:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333971200:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 5796us (6012us total) trans 4294968081 rc 0/0 00000100:00100000:1.0:1734016142.349779:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8981 00002000:00010000:1.0:1734016142.349788:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (1902126->18446744073709551615) 00002000:00100000:1.0:1734016142.349793:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075a01880 with x1818247333971200 ext(1902126->18446744073709551615) 00002000:00010000:1.0:1734016142.349834:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075a01880. 00000100:00100000:0.0:1734016142.353854:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.354133:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333971456 00000100:00100000:2.0:1734016142.354146:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333971456 00000100:00100000:2.0:1734016142.354218:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2361 00000100:00100000:2.0:1734016142.354227:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+19:10406:x1818247333971456:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016142.354252:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016142.354282:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271174f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e71bd expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.354417:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271174fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.354436:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271174fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.354450:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271174fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:2.0:1734016142.354486:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 1902126 00000004:00200000:2.0:1734016142.354491:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016142.354518:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271174fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.354548:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271174f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71bd expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.354584:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271174fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71bd expref: 20 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.354595:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016142.354598:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016142.354603:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016142.354687:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+20:10406:x1818247333971456:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 460us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016142.354694:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2361 00000100:00100000:0.0:1734016142.357728:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016142.357865:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.358005:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333971712 00000100:00100000:3.0:1734016142.358005:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333971584 00000100:00100000:1.0:1734016142.358024:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333971712 00000100:00100000:3.0:1734016142.358024:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333971584 00000100:00100000:3.0:1734016142.358116:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11787 00000100:00100000:1.0:1734016142.358124:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11788 00000100:00100000:1.0:1734016142.358129:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333971712:12345-192.168.201.16@tcp:101:fsx.0 00000100:00100000:3.0:1734016142.358129:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333971584:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.358164:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.358164:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.358205:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27117504 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e71cb expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.358205:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc2711750b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e71c4 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016142.358302:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335420032:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016142.358303:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335419904:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016142.358543:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:3.0:1734016142.358543:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e300 going to sleep for 11 seconds 00000100:00100000:1.0:1734016142.360729:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335419904:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016142.360785:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27117504 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71cb expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.360830:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27117504 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71cb expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1734016142.360961:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335420032:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016142.360990:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc2711750b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71c4 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.360999:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc2711750b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71c4 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.361017:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016142.361084:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333971584:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2957us (3382us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016142.361096:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11787 00010000:00010000:1.0:1734016142.362144:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016142.362186:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333971712:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4056us (4320us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016142.362198:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11788 00000100:00100000:0.0:1734016142.367067:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016142.367784:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.367935:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333971968 00000100:00100000:1.0:1734016142.367950:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333971968 00000100:00100000:1.0:1734016142.368030:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333971840 00000100:00100000:1.0:1734016142.368032:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333971840 00000100:00100000:1.0:1734016142.368058:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11789 00000100:00100000:1.0:1734016142.368069:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333971968:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.368102:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.368131:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27117512 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e71d9 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016142.368217:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335420160:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016142.368311:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:3.0:1734016142.368415:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11790 00000100:00100000:3.0:1734016142.368422:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333971840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.368432:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.368450:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117519 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e71d2 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016142.368497:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335420288:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016142.368537:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e300 going to sleep for 11 seconds 00000100:00100000:1.0:1734016142.371137:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335420160:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016142.371221:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27117512 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71d9 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.371250:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c900/0x5e3a3adc27117512 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71d9 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1734016142.371468:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335420288:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016142.371505:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117519 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71d2 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.371527:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117519 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71d2 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.371546:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016142.371648:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333971840:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3221us (3861us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016142.371663:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11790 00010000:00010000:1.0:1734016142.372101:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016142.372148:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333971968:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4079us (5114us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016142.372158:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11789 00000100:00100000:0.0:1734016142.376050:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.376791:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333972096 00000100:00100000:1.0:1734016142.377043:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333972096 00000100:00100000:1.0:1734016142.377100:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11791 00000100:00100000:1.0:1734016142.377108:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333972096:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.377133:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.377159:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27117520 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e71e0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.377207:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271174d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->307199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71a1 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.377215:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016142.377218:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016142.377222:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27117520 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1888256->1900543] (req 1888256->1900543) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71e0 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.377265:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271174d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->307199) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71a1 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.377277:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271174d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->307199) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71a1 expref: 7 pid: 7682 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1734016142.377289:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335420416:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016142.377372:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016142.380110:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.380381:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333972224 00000100:00100000:3.0:1734016142.380397:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333972224 00010000:00010000:3.0:1734016142.380457:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271174d3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->307199) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71a1 expref: 8 pid: 7682 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1734016142.380498:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3230 00000100:00100000:3.0:1734016142.380517:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333972224:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016142.380536:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016142.380570:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271174d3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 303104->307199) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71a1 expref: 8 pid: 7682 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1734016142.380588:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271174d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 303104->307199) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71a1 expref: 8 pid: 7682 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1734016142.380633:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016142.380637:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016142.380653:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27117520 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->1900543) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71e0 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.380665:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27117520 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->1900543) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71e0 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.380728:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27117520 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->1900543) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71e0 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016142.380747:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335420544:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016142.380889:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e300 going to sleep for 11 seconds 00010000:00010000:1.0:1734016142.381077:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271174d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 303104->307199) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71a1 expref: 8 pid: 7682 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1734016142.381117:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335420416:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016142.381155:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27117520 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->1900543) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71e0 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.381168:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016142.381200:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333972096:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4092us (5167us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016142.381209:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11791 00000100:00100000:0.0:1734016142.389072:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.389296:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335420544:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016142.389353:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016142.389480:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333972224:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 8967us (9389us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.389517:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3230 00000100:00100000:1.0:1734016142.390087:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333972480 00000100:00100000:1.0:1734016142.390104:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333972480 00002000:00100000:1.0:1734016142.390198:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->1904639) req@ffff880075a03480 x1818247333972480/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:103/0 lens 488/0 e 0 to 0 dl 1734016153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016142.390214:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075a03480 with x1818247333972480 ext(0->1904639) 00002000:00010000:1.0:1734016142.390223:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075a03480 00000100:00100000:1.0:1734016142.390257:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8982 00000100:00100000:1.0:1734016142.390268:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333972480:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016142.416072:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333972480:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 25779us (27178us total) trans 0 rc 1904640/1904640 00000100:00100000:1.0:1734016142.416092:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8982 00002000:00100000:1.0:1734016142.416117:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->1904639) req@ffff880075a03480 x1818247333972480/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:103/0 lens 488/440 e 0 to 0 dl 1734016153 ref 1 fl Complete:/200/0 rc 1904640/1904640 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016142.416128:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075a03480 with x1818247333972480 ext(0->1904639) 00002000:00010000:1.0:1734016142.416138:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075a03480 00000100:00100000:0.0:1734016142.420489:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.421352:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333972608 00000100:00100000:2.0:1734016142.421365:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333972608 00000100:00100000:2.0:1734016142.421981:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2362 00000100:00100000:2.0:1734016142.421991:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:10406:x1818247333972608:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016142.422045:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016142.422085:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117527 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e71e7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.422259:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711752e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016142.422278:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711752e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016142.422293:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711752e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:2.0:1734016142.422323:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 1902126 00000004:00200000:2.0:1734016142.422328:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016142.422354:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711752e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016142.422382:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117527 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71e7 expref: 19 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.422423:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711752e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71e7 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.422434:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016142.422437:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016142.422442:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016142.422540:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:10406:x1818247333972608:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 549us (2076us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016142.422547:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2362 00000100:00100000:0.0:1734016142.426391:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.428153:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333972736 00000100:00100000:1.0:1734016142.428182:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333972736 00000100:00100000:1.0:1734016142.428284:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11792 00000100:00100000:1.0:1734016142.428295:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333972736:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.428330:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.428374:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc27117535 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e71ee expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.428409:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016142.428412:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016142.428425:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc27117535 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71ee expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.428451:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc27117535 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71ee expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.428471:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016142.428580:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333972736:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 287us (2211us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016142.428589:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11792 00000100:00100000:0.0:1734016142.431695:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.431887:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333972864 00000100:00100000:3.0:1734016142.431904:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333972864 00000100:00100000:3.0:1734016142.431995:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11793 00000100:00100000:3.0:1734016142.432010:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333972864:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.432049:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.432091:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711753c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e71f5 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016142.432205:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335420672:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016142.432318:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e300 going to sleep for 11 seconds 00000100:00100000:0.0:1734016142.435714:0:3506:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1734016142.435755:0:3506:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335420800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1734016142.435906:0:3506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1734016142.435981:0:7686:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335420800 00000100:00100000:0.0:1734016142.435999:0:7686:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335420800 00000100:00100000:0.0:1734016142.436102:0:7686:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1734016142.436112:0:7686:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335420800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1734016142.436175:0:7686:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 28672 granted 586875456 pending 0 free 3923582976 avail 3692027904 00000100:00100000:0.0:1734016142.436232:0:7686:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3506:x1818247335420800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016142.436242:0:7686:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1734016142.436303:0:3506:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3506:1818247335420800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1734016142.436929:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335420672:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016142.436996:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711753c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71f5 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016142.437024:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711753c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71f5 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016142.437065:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:0.0:1734016142.438093:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333972864:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6074us (6415us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016142.438107:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11793 00000100:00100000:0.0:1734016142.441190:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.441334:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333972992 00000100:00100000:2.0:1734016142.441355:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333972992 00000100:00100000:2.0:1734016142.441630:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11794 00000100:00100000:2.0:1734016142.441645:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333972992:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016142.441694:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016142.441735:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117543 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e71fc expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016142.441883:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335420928:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016142.442012:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016142.444688:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335420928:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016142.444765:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117543 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71fc expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.444791:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117543 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71fc expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.444856:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:3.0:1734016142.445630:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333972992:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3978us (4457us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016142.445649:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11794 00000100:00100000:0.0:1734016142.449639:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.450141:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333973120 00000100:00100000:3.0:1734016142.450156:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333973120 00000100:00100000:3.0:1734016142.450229:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11795 00000100:00100000:3.0:1734016142.450239:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333973120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.450274:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.450317:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711754a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7203 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.450364:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27117520 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->1900543) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71e0 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.450375:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc27117535 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71ee expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.450384:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016142.450387:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016142.450393:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711754a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [1396736->1400831] (req 1396736->1400831) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7203 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.450452:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc27117535 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71ee expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.450469:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc27117535 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71ee expref: 7 pid: 8216 timeout: 509 lvb_type: 1 00000100:00100000:3.0:1734016142.450482:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335421056:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016142.450582:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27117520 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->1900543) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71e0 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.450590:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27117520 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->1900543) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71e0 expref: 9 pid: 8216 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1734016142.450598:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335421184:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016142.450621:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016142.455371:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335421056:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016142.455397:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335421184:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016142.455453:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711754a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [1396736->1400831] (req 1396736->1400831) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7203 expref: 9 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.455478:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016142.455883:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247333973120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5642us (6265us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.455896:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11795 00000100:00100000:0.0:1734016142.456574:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.456665:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333973248 00000100:00100000:3.0:1734016142.456676:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333973248 00010000:00010000:3.0:1734016142.456712:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc27117535 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71ee expref: 8 pid: 8216 timeout: 509 lvb_type: 1 00000100:00100000:3.0:1734016142.458084:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3231 00000100:00100000:3.0:1734016142.458101:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075544e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333973248:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016142.458136:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016142.458195:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc27117535 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71ee expref: 8 pid: 8216 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1734016142.458218:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc27117535 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71ee expref: 8 pid: 8216 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1734016142.458268:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc27117535 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71ee expref: 8 pid: 8216 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1734016142.459365:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016142.459469:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075544e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333973248:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1369us (2892us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.459484:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3231 00000100:00100000:0.0:1734016142.461773:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.462654:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333973376 00000100:00100000:3.0:1734016142.462676:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333973376 00010000:00010000:3.0:1734016142.462765:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27117520 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71e0 expref: 9 pid: 8216 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1734016142.462868:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3232 00000100:00100000:3.0:1734016142.462882:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b23850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333973376:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016142.462915:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016142.462953:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27117520 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71e0 expref: 9 pid: 8216 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1734016142.462980:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27117520 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->1900543) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71e0 expref: 9 pid: 8216 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1734016142.463040:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc27117520 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->1900543) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71e0 expref: 9 pid: 8216 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1734016142.463082:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016142.463086:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016142.463101:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711754a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1400831) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7203 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.463122:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711754a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1400831) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7203 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.463201:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711754a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1400831) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7203 expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016142.463221:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335421312:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016142.463380:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016142.470640:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.470792:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333973504 00000100:00100000:2.0:1734016142.470864:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333973504 00000100:00100000:2.0:1734016142.470957:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11796 00000100:00100000:2.0:1734016142.470971:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333973504:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016142.471332:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 1902126 -> 1902126 00002000:00010000:2.0:1734016142.471335:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016142 -> 1734016142 00002000:00010000:2.0:1734016142.471337:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016142 -> 1734016142 00002000:00010000:2.0:1734016142.471339:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016142 -> 1734016142 00002000:00010000:2.0:1734016142.471341:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 136 -> 136 00000100:00100000:2.0:1734016142.471462:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333973504:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 494us (847us total) trans 4294968082 rc 0/0 00000100:00100000:2.0:1734016142.471472:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11796 00000100:00100000:3.0:1734016142.471889:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335421312:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016142.471915:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016142.471955:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b23850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247333973376:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9076us (10197us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.471966:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3232 00000100:00100000:0.0:1734016142.474725:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.475202:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333973632 00000100:00100000:1.0:1734016142.475219:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333973632 00000100:00100000:1.0:1734016142.475310:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11797 00000100:00100000:1.0:1734016142.475324:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333973632:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.475364:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.475398:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27117551 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e720a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016142.475494:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335421440:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016142.475611:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016142.478299:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335421440:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016142.478365:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27117551 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e720a expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.478384:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499c6c0/0x5e3a3adc27117551 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e720a expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.478420:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016142.478910:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333973632:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3585us (4201us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016142.478925:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11797 00000100:00100000:0.0:1734016142.481343:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.481797:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333973760 00000100:00100000:1.0:1734016142.481896:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333973760 00000100:00100000:1.0:1734016142.481984:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11798 00000100:00100000:1.0:1734016142.481997:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333973760:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.482038:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.482074:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27117558 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7211 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016142.482162:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335421568:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016142.482258:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016142.484247:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335421568:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016142.484305:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27117558 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7211 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.484324:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27117558 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7211 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.484359:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016142.484950:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333973760:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2952us (3629us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016142.484962:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11798 00000100:00100000:0.0:1734016142.487780:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.488420:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333973888 00000100:00100000:1.0:1734016142.488433:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333973888 00000100:00100000:1.0:1734016142.488500:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11799 00000100:00100000:1.0:1734016142.488518:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333973888:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.488546:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.488575:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc2711755f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7218 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016142.488644:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335421696:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016142.488724:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016142.495121:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335421696:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016142.495177:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc2711755f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7218 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.495195:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc2711755f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7218 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.495219:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016142.495305:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333973888:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6796us (7538us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016142.495321:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11799 00000100:00100000:2.0:1734016142.502978:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.503613:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333974144 00000100:00100000:1.0:1734016142.503633:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333974144 00002000:00100000:1.0:1734016142.503717:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->1904639) req@ffff880074939500 x1818247333974144/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:103/0 lens 488/0 e 0 to 0 dl 1734016153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016142.503732:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074939500 with x1818247333974144 ext(0->1904639) 00002000:00010000:1.0:1734016142.503741:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880074939500 00000100:00100000:0.0:1734016142.505232:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8983 00000100:00100000:0.0:1734016142.505254:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333974144:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016142.532723:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333974144:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 27447us (29738us total) trans 0 rc 1904640/1904640 00000100:00100000:2.0:1734016142.532747:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8983 00002000:00100000:2.0:1734016142.532766:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->1904639) req@ffff880074939500 x1818247333974144/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:103/0 lens 488/440 e 0 to 0 dl 1734016153 ref 1 fl Complete:/200/0 rc 1904640/1904640 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016142.532775:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880074939500 with x1818247333974144 ext(0->1904639) 00002000:00010000:2.0:1734016142.532783:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880074939500 00000100:00100000:0.0:1734016142.537586:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.537727:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333974272 00000100:00100000:1.0:1734016142.537743:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333974272 00000100:00100000:1.0:1734016142.537877:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11800 00000100:00100000:1.0:1734016142.537888:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333974272:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.537926:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.537965:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117566 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e721f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016142.538080:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335421824:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016142.538188:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016142.540292:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335421824:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016142.540366:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117566 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e721f expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.540388:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117566 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e721f expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.540412:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016142.540514:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247333974272:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2617us (2937us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016142.540526:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11800 00000100:00100000:0.0:1734016142.543309:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.543455:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333974400 00000100:00100000:1.0:1734016142.543472:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333974400 00000100:00100000:1.0:1734016142.543554:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11801 00000100:00100000:1.0:1734016142.543564:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333974400:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.543590:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.543621:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc2711756d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7226 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016142.543712:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335421952:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016142.543865:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016142.547418:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335421952:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016142.547479:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc2711756d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7226 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.547501:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ed00/0x5e3a3adc2711756d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7226 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.548003:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016142.548097:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333974400:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4532us (4808us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016142.548110:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11801 00000100:00100000:0.0:1734016142.552533:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.553311:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333974528 00000100:00100000:1.0:1734016142.553328:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333974528 00000100:00100000:1.0:1734016142.553404:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11802 00000100:00100000:1.0:1734016142.553415:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333974528:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.553452:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.553488:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117574 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e722d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016142.553604:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335422080:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016142.553719:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016142.557168:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335422080:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016142.557231:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117574 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e722d expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.557253:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117574 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e722d expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.557292:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016142.557375:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333974528:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3961us (4870us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016142.557389:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11802 00000100:00100000:0.0:1734016142.562383:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.562494:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333974656 00000100:00100000:2.0:1734016142.562516:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333974656 00002000:00100000:2.0:1734016142.562581:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (909312->917503) req@ffff880075546a00 x1818247333974656/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:103/0 lens 8680/0 e 0 to 0 dl 1734016153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016142.562593:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075546a00 with x1818247333974656 ext(909312->917503) 00002000:00010000:2.0:1734016142.562601:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075546a00 00000100:00100000:2.0:1734016142.562683:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8984 00000100:00100000:2.0:1734016142.562691:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333974656:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016142.563734:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333974656:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1036us (1362us total) trans 4294968083 rc 0/0 00000100:00100000:2.0:1734016142.563745:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8984 00002000:00100000:2.0:1734016142.563753:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (909312->917503) req@ffff880075546a00 x1818247333974656/t4294968083(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:103/0 lens 8680/448 e 0 to 0 dl 1734016153 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016142.563762:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075546a00 with x1818247333974656 ext(909312->917503) 00002000:00010000:2.0:1734016142.563766:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075546a00 00000100:00100000:0.0:1734016142.567067:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.567191:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333974784 00000100:00100000:2.0:1734016142.567205:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333974784 00000100:00100000:2.0:1734016142.567305:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2363 00000100:00100000:2.0:1734016142.567315:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+20:10406:x1818247333974784:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:2.0:1734016142.567957:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+20:10406:x1818247333974784:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 641us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016142.567966:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2363 00000100:00100000:0.0:1734016142.570285:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.570430:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333974912 00000100:00100000:1.0:1734016142.570446:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333974912 00000100:00100000:1.0:1734016142.570514:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11803 00000100:00100000:1.0:1734016142.570524:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247333974912:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016142.573022:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968083 is committed 00000001:00080000:2.0:1734016142.573103:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968081 is committed 00000100:00100000:1.0:1734016142.574410:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333974912:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 3873us (4125us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016142.574430:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11803 00000100:00100000:0.0:1734016142.577458:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.577676:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333975040 00000100:00100000:1.0:1734016142.577695:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333975040 00000100:00100000:1.0:1734016142.581914:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11804 00000100:00100000:1.0:1734016142.581953:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333975040:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.582013:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.582065:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc2711757b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7234 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016142.582197:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335422208:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016142.582366:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016142.590385:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335422208:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016142.590447:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc2711757b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7234 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.590466:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499e880/0x5e3a3adc2711757b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7234 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.590500:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016142.595151:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333975040:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 13188us (17695us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016142.595168:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11804 00000100:00100000:0.0:1734016142.597982:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.598612:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333975168 00000100:00100000:1.0:1734016142.598625:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333975168 00000100:00100000:1.0:1734016142.599020:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11805 00000100:00100000:1.0:1734016142.599032:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333975168:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.599059:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.599088:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117582 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e723b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016142.599161:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335422336:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016142.599250:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016142.605042:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335422336:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016142.605112:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117582 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e723b expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.605132:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117582 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e723b expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.605178:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016142.605280:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333975168:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6248us (7316us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016142.605292:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11805 00000100:00100000:0.0:1734016142.617176:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.617530:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333975296 00000100:00100000:1.0:1734016142.617547:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333975296 00000100:00100000:1.0:1734016142.618054:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11806 00000100:00100000:1.0:1734016142.618065:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333975296:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.618100:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.618129:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27117589 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7242 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016142.618217:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335422464:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016142.618315:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00002000:00010000:1.0:1734016142.622610:0:8216:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime: 1734016142 -> 1734016143 00002000:00010000:1.0:1734016142.622621:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016142 -> 1734016143 00002000:00010000:1.0:1734016142.622623:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016142 -> 1734016143 00002000:00010000:1.0:1734016142.622625:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks: 136 -> 152 00000100:00100000:1.0:1734016142.622660:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335422464:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016142.622710:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27117589 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7242 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.622728:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27117589 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7242 expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.622746:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016142.622847:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333975296:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4781us (5690us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016142.622859:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11806 00000100:00100000:0.0:1734016142.631585:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.633036:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333975424 00000100:00100000:1.0:1734016142.633065:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333975424 00000100:00100000:1.0:1734016142.633712:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11807 00000100:00100000:1.0:1734016142.633724:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:10406:x1818247333975424:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.633757:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.633791:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc27117590 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7249 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.634006:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711754a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1400831) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7203 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.634015:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016142.634017:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016142.634020:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc27117590 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [6045696->6049791] (req 6045696->6049791) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7249 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.634057:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711754a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1400831) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7203 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.634069:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711754a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1400831) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7203 expref: 6 pid: 7682 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1734016142.634082:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335422592:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016142.634180:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00010000:00010000:3.0:1734016142.636783:0:6468:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1734016142.647457:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.647733:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333975552 00000100:00100000:3.0:1734016142.647748:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333975552 00010000:00010000:3.0:1734016142.647833:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711754a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7203 expref: 7 pid: 7682 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1734016142.647872:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3233 00000100:00100000:3.0:1734016142.647879:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e774000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333975552:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016142.647897:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016142.647923:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711754a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7203 expref: 7 pid: 7682 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1734016142.647943:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711754a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->1400831) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7203 expref: 7 pid: 7682 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1734016142.647973:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016142.647976:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016142.647986:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc27117590 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6045696->6049791) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7249 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.647996:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc27117590 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6045696->6049791) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7249 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.648038:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc27117590 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6045696->6049791) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7249 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016142.648051:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335422720:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016142.648127:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00010000:00010000:1.0:1734016142.648831:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc2711754a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->1400831) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7203 expref: 7 pid: 7682 timeout: 509 lvb_type: 0 00000100:00100000:1.0:1734016142.648855:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335422592:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016142.648879:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc27117590 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6045696->6049791) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7249 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016142.648891:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016142.648935:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333975424:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 15212us (17373us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016142.648945:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11807 00000100:00100000:3.0:1734016142.651721:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335422720:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016142.651757:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016142.651865:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e774000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333975552:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3984us (4420us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.651877:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3233 00000100:00100000:2.0:1734016142.654007:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.655774:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333975680 00000100:00100000:1.0:1734016142.655792:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333975680 00000100:00100000:1.0:1734016142.655892:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11808 00000100:00100000:1.0:1734016142.655900:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333975680:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016142.656269:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 1902126 -> 6049254 00002000:00010000:1.0:1734016142.656273:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016143 -> 1734016142 00002000:00010000:1.0:1734016142.656276:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016143 -> 1734016142 00002000:00010000:1.0:1734016142.656278:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016143 -> 1734016142 00002000:00010000:1.0:1734016142.656280:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 152 -> 160 00000100:00100000:1.0:1734016142.656369:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333975680:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 468us (2371us total) trans 4294968084 rc 0/0 00000100:00100000:1.0:1734016142.656378:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11808 00000100:00100000:0.0:1734016142.660112:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016142.660550:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.661559:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333975936 00000100:00100000:3.0:1734016142.661577:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333975936 00000100:00100000:3.0:1734016142.662207:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333975808 00000100:00100000:3.0:1734016142.662212:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333975808 00000100:00100000:1.0:1734016142.662317:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11809 00000100:00100000:1.0:1734016142.662331:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333975936:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.662376:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.662420:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27117597 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7257 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016142.662546:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335422848:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016142.662680:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016142.664963:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11810 00000100:00100000:0.0:1734016142.664980:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333975808:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016142.665011:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016142.665041:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7581440/0x5e3a3adc2711759e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7250 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016142.665115:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e774a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335422976:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016142.665192:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00002000:00010000:2.0:1734016142.673416:0:7684:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime: 1734016142 -> 1734016143 00002000:00010000:2.0:1734016142.673435:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016142 -> 1734016143 00002000:00010000:2.0:1734016142.673437:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016142 -> 1734016143 00000100:00100000:2.0:1734016142.673479:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e774a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335422976:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016142.673551:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581440/0x5e3a3adc2711759e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7250 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016142.673572:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581440/0x5e3a3adc2711759e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7250 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016142.673617:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581440, rc 0) 00000100:00100000:2.0:1734016142.673714:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333975808:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8736us (13161us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016142.673729:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11810 00002000:00010000:1.0:1734016142.674352:0:8216:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016142 -> 1734016143 00002000:00010000:1.0:1734016142.674357:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016142 -> 1734016143 00002000:00010000:1.0:1734016142.674360:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016142 -> 1734016143 00000100:00100000:1.0:1734016142.674377:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335422848:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016142.674400:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27117597 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7257 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.674411:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27117597 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7257 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.674426:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016142.674448:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333975936:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12122us (14360us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016142.674455:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11809 00000100:00100000:0.0:1734016142.682999:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016142.683121:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.683392:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333976064 00000100:00100000:2.0:1734016142.683407:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333976064 00000100:00100000:2.0:1734016142.683476:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333976192 00000100:00100000:2.0:1734016142.683478:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333976192 00000100:00100000:2.0:1734016142.683513:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11811 00000100:00100000:2.0:1734016142.683522:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333976064:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016142.683548:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016142.683583:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271175a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e725e expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016142.683676:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335423104:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016142.683839:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11812 00000100:00100000:3.0:1734016142.683849:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333976192:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.683858:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.683872:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271175ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7265 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016142.683904:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335423232:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016142.684887:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706900 going to sleep for 11 seconds 00000100:00100000:3.0:1734016142.685038:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:2.0:1734016142.689874:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335423104:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016142.689947:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271175a5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e725e expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016142.689968:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271175a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e725e expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016142.690002:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016142.690076:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333976064:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6554us (7093us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016142.690088:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11811 00000100:00100000:3.0:1734016142.690637:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335423232:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016142.690676:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271175ac lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7265 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.690687:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271175ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7265 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.690705:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016142.690737:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333976192:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6889us (7615us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016142.690746:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11812 00000100:00100000:0.0:1734016142.696674:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.696871:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333976320 00000100:00100000:3.0:1734016142.696885:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333976320 00000100:00100000:3.0:1734016142.696948:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11813 00000100:00100000:3.0:1734016142.696957:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333976320:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016142.697441:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 6049254 -> 6049254 00002000:00010000:3.0:1734016142.697444:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016143 -> 1734016142 00002000:00010000:3.0:1734016142.697446:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016143 -> 1734016142 00002000:00010000:3.0:1734016142.697449:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016143 -> 1734016142 00002000:00010000:3.0:1734016142.697451:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 160 -> 152 00000100:00100000:3.0:1734016142.697525:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333976320:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 568us (872us total) trans 4294968085 rc 0/0 00000100:00100000:3.0:1734016142.697535:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11813 00000100:00100000:0.0:1734016142.706622:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.706825:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333976576 00000100:00100000:2.0:1734016142.706840:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333976576 00000100:00100000:2.0:1734016142.707081:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2364 00000100:00100000:2.0:1734016142.707092:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:10406:x1818247333976576:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016142.707172:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016142.707213:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc2711752e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71e7 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.707258:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016142.707265:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016142.707502:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271175b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.707525:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271174fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71bd expref: 19 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.707532:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271175b3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.707578:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271174fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71bd expref: 19 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.707594:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271174fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71bd expref: 19 pid: 13956 timeout: 509 lvb_type: 0 00000100:00100000:2.0:1734016142.707610:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335423360:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016142.707734:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016142.712521:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.713046:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007493a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335423360:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016142.713077:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271175b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:3.0:1734016142.713147:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333976704 00000100:00100000:3.0:1734016142.713154:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333976704 00010000:00010000:3.0:1734016142.713187:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271174fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71bd expref: 20 pid: 13956 timeout: 509 lvb_type: 0 00000100:00100000:3.0:1734016142.713214:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3234 00000100:00100000:3.0:1734016142.713221:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e775c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+20:1981:x1818247333976704:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016142.713236:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016142.713242:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271174fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71bd expref: 20 pid: 13956 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1734016142.713254:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271174fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71bd expref: 20 pid: 13956 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1734016142.713281:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc271174fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71bd expref: 20 pid: 13956 timeout: 509 lvb_type: 0 00010000:00010000:3.0:1734016142.714389:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016142.714399:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271175b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.714409:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271175b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.714423:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271175b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.714460:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016142.714523:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e775c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+19:1981:x1818247333976704:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1301us (2027us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.714532:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3234 00010000:00010000:2.0:1734016142.715033:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271175b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.715040:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271175b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:2.0:1734016142.715140:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968835 00000004:00010000:2.0:1734016142.715192:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012e775880 reply state ffff880071abc000 transno 4294968836 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271175b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016142.715199:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016142.715281:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:10406:x1818247333976576:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 8192us (8678us total) trans 4294968836 rc 0/0 00000100:00100000:2.0:1734016142.715288:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2364 00000020:00080000:2.0:1734016142.715292:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016142.723292:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016142.723360:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1734016142.723869:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271175b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.723891:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271175b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.723901:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271175b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.723914:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbd200 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016142.723926:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271175b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.723941:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271175b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.723978:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016142.723982:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016142.723988:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271175b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.723994:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc271175b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016142.724690:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333976832 00000100:00100000:1.0:1734016142.724707:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333976832 00002000:00010000:1.0:1734016142.724775:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (3472655->18446744073709551615) 00002000:00100000:1.0:1734016142.724783:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e775f80 with x1818247333976832 ext(3472655->18446744073709551615) 00002000:00010000:1.0:1734016142.724845:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e775f80. 00000100:00100000:1.0:1734016142.724885:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333976960 00000100:00100000:1.0:1734016142.724888:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333976960 00002000:00010000:1.0:1734016142.724902:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:1.0:1734016142.724905:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e776300 with x1818247333976960 ext(0->18446744073709551615) 00002000:00010000:1.0:1734016142.724914:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e776300. 00000100:00100000:1.0:1734016142.724936:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8985 00000100:00100000:1.0:1734016142.724947:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247333976832:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016142.725401:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 6049254 -> 3472655 00002000:00010000:1.0:1734016142.725405:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016142 -> 1734016143 00002000:00010000:1.0:1734016142.725408:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016142 -> 1734016142 00002000:00010000:1.0:1734016142.725410:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016142 -> 1734016143 00002000:00010000:1.0:1734016142.725415:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 152 -> 144 00000100:00100000:1.0:1734016142.725525:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333976832:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 579us (2253us total) trans 4294968086 rc 0/0 00000100:00100000:1.0:1734016142.725537:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8985 00002000:00010000:1.0:1734016142.725541:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (3472655->18446744073709551615) 00002000:00100000:1.0:1734016142.725544:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e775f80 with x1818247333976832 ext(3472655->18446744073709551615) 00002000:00010000:1.0:1734016142.725549:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e775f80. 00000100:00100000:1.0:1734016142.725572:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8986 00000100:00100000:1.0:1734016142.725576:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247333976960:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016142.725686:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1734016142.725689:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016143 -> 1734016143 00002000:00010000:1.0:1734016142.725691:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016143 -> 1734016142 00002000:00010000:1.0:1734016142.725694:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016143 -> 1734016143 00002000:00010000:1.0:1734016142.725695:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1734016142.725717:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333976960:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 140us (2358us total) trans 4294969546 rc 0/0 00000100:00100000:1.0:1734016142.725728:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8986 00002000:00010000:1.0:1734016142.725731:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:1.0:1734016142.725733:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e776300 with x1818247333976960 ext(0->18446744073709551615) 00002000:00010000:1.0:1734016142.725738:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e776300. 00000100:00100000:1.0:1734016142.735828:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.737606:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333977088 00000100:00100000:3.0:1734016142.737629:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333977088 00000100:00100000:3.0:1734016142.738394:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2365 00000100:00100000:3.0:1734016142.738407:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:10406:x1818247333977088:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.738450:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.738483:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271175ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e726c expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.738641:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271175c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.738662:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271175c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.738676:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271175c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:3.0:1734016142.738718:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 3472655 00000004:00200000:3.0:1734016142.738723:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016142.738745:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271175c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.738778:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc271175ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e726c expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.738845:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271175c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e726c expref: 20 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.738856:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016142.738859:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016142.738862:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016142.738958:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:10406:x1818247333977088:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 553us (3183us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.738968:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2365 00000100:00100000:0.0:1734016142.748470:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.748603:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333977344 00000100:00100000:3.0:1734016142.748621:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333977344 00000100:00100000:3.0:1734016142.748703:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2366 00000100:00100000:3.0:1734016142.748714:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+20:10406:x1818247333977344:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016142.748794:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016142.748854:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271175c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e726c expref: 20 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.748891:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016142.748897:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016142.749157:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc271175c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.749176:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc271175c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.749187:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc271175c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:3.0:1734016142.749232:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968837 00000004:00010000:3.0:1734016142.749254:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012e776680 reply state ffff880075e36000 transno 4294968838 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc271175c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:3.0:1734016142.749262:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016142.749367:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:10406:x1818247333977344:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 654us (1877us total) trans 4294968838 rc 0/0 00000100:00100000:3.0:1734016142.749374:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2366 00000020:00080000:3.0:1734016142.749384:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016142.754980:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc271175c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.755001:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc271175c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.755008:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc271175c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.755014:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df73c0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016142.755019:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc271175c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.755030:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc271175c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.755055:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016142.755058:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016142.755063:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc271175c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016142.755068:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc271175c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016142.755730:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016142.755793:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.758308:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333977600 00000100:00100000:1.0:1734016142.758339:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333977600 00002000:00010000:1.0:1734016142.758428:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:1.0:1734016142.758434:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e776a00 with x1818247333977600 ext(0->18446744073709551615) 00002000:00010000:1.0:1734016142.758456:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e776a00. 00000100:00100000:1.0:1734016142.758520:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333977472 00000100:00100000:1.0:1734016142.758525:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333977472 00002000:00010000:1.0:1734016142.758541:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (3827071->18446744073709551615) 00002000:00100000:1.0:1734016142.758545:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e776d80 with x1818247333977472 ext(3827071->18446744073709551615) 00002000:00010000:1.0:1734016142.758562:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e776d80. 00000100:00100000:1.0:1734016142.758606:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8987 00000100:00100000:1.0:1734016142.758619:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333977600:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016142.758926:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1734016142.758929:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016143 -> 1734016143 00002000:00010000:1.0:1734016142.758933:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016142 -> 1734016142 00002000:00010000:1.0:1734016142.758935:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016143 -> 1734016143 00002000:00010000:1.0:1734016142.758938:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1734016142.759056:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333977600:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 439us (3338us total) trans 4294969547 rc 0/0 00000100:00100000:1.0:1734016142.759065:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8987 00002000:00010000:1.0:1734016142.759069:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:1.0:1734016142.759072:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e776a00 with x1818247333977600 ext(0->18446744073709551615) 00002000:00010000:1.0:1734016142.759076:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e776a00. 00000100:00100000:1.0:1734016142.759100:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8988 00000100:00100000:1.0:1734016142.759105:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333977472:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016142.759313:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 3472655 -> 3827071 00002000:00010000:1.0:1734016142.759317:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016143 -> 1734016143 00002000:00010000:1.0:1734016142.759319:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016142 -> 1734016142 00002000:00010000:1.0:1734016142.759321:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016143 -> 1734016143 00002000:00010000:1.0:1734016142.759324:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 144 -> 144 00000100:00100000:1.0:1734016142.759341:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333977472:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 235us (3549us total) trans 4294968087 rc 0/0 00000100:00100000:1.0:1734016142.759347:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8988 00002000:00010000:1.0:1734016142.759350:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (3827071->18446744073709551615) 00002000:00100000:1.0:1734016142.759353:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e776d80 with x1818247333977472 ext(3827071->18446744073709551615) 00002000:00010000:1.0:1734016142.759357:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e776d80. 00000100:00100000:0.0:1734016142.768440:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.768674:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333977856 00000100:00100000:2.0:1734016142.768689:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333977856 00002000:00100000:2.0:1734016142.768759:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (3821568->3825663) req@ffff88012e777100 x1818247333977856/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:103/0 lens 488/0 e 0 to 0 dl 1734016153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016142.768772:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e777100 with x1818247333977856 ext(3821568->3825663) 00002000:00010000:2.0:1734016142.768782:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e777100 00000100:00100000:2.0:1734016142.768893:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8989 00000100:00100000:2.0:1734016142.768904:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e777100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333977856:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016142.769216:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e777100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333977856:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 312us (798us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016142.769225:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8989 00002000:00100000:2.0:1734016142.769232:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (3821568->3825663) req@ffff88012e777100 x1818247333977856/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:103/0 lens 488/4536 e 0 to 0 dl 1734016153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016142.769240:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e777100 with x1818247333977856 ext(3821568->3825663) 00002000:00010000:2.0:1734016142.769243:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e777100 00000100:00100000:0.0:1734016142.776056:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.776243:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333978112 00000100:00100000:3.0:1734016142.776262:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333978112 00002000:00100000:3.0:1734016142.776337:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (3825664->3829759) req@ffff88012e777480 x1818247333978112/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:103/0 lens 488/0 e 0 to 0 dl 1734016153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016142.776351:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e777480 with x1818247333978112 ext(3825664->3829759) 00002000:00010000:3.0:1734016142.776359:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e777480 00000100:00100000:3.0:1734016142.777680:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8990 00000100:00100000:3.0:1734016142.777699:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333978112:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016142.778573:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333978112:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 873us (2537us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016142.778583:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8990 00002000:00100000:3.0:1734016142.778593:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (3825664->3829759) req@ffff88012e777480 x1818247333978112/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:103/0 lens 488/4536 e 0 to 0 dl 1734016153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016142.778605:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e777480 with x1818247333978112 ext(3825664->3829759) 00002000:00010000:3.0:1734016142.778613:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e777480 00000100:00100000:0.0:1734016142.786214:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.786352:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333978240 00000100:00100000:3.0:1734016142.786367:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333978240 00002000:00100000:3.0:1734016142.786436:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (3821568->3827070) req@ffff88012e777800 x1818247333978240/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:103/0 lens 5992/0 e 0 to 0 dl 1734016153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016142.786449:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e777800 with x1818247333978240 ext(3821568->3827070) 00002000:00010000:3.0:1734016142.786456:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e777800 00000100:00100000:3.0:1734016142.786501:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8991 00000100:00100000:3.0:1734016142.786519:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333978240:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016142.787943:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247333978240:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1415us (1739us total) trans 4294968088 rc 0/0 00000100:00100000:3.0:1734016142.787958:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8991 00002000:00100000:3.0:1734016142.787971:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (3821568->3827070) req@ffff88012e777800 x1818247333978240/t4294968088(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:103/0 lens 5992/448 e 0 to 0 dl 1734016153 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016142.787979:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e777800 with x1818247333978240 ext(3821568->3827070) 00002000:00010000:3.0:1734016142.787985:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e777800 00000100:00100000:0.0:1734016142.791422:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.791683:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333978368 00000100:00100000:2.0:1734016142.791701:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333978368 00000100:00100000:2.0:1734016142.791858:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2367 00000100:00100000:2.0:1734016142.791870:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:10406:x1818247333978368:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:2.0:1734016142.792170:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:10406:x1818247333978368:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 300us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016142.792182:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2367 00000100:00100000:0.0:1734016142.800197:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.800316:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333978496 00000100:00100000:2.0:1734016142.800329:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333978496 00000100:00100000:2.0:1734016142.800680:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11814 00000100:00100000:2.0:1734016142.800694:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1983:x1818247333978496:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016142.807677:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968088 is committed 00000100:00100000:2.0:1734016142.807964:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1983:x1818247333978496:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 7261us (7778us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016142.807980:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11814 00000100:00100000:0.0:1734016142.812518:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.814490:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333978624 00000100:00100000:3.0:1734016142.814518:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333978624 00000100:00100000:3.0:1734016142.814618:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2368 00000100:00100000:3.0:1734016142.814629:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+19:10406:x1818247333978624:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.814660:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.814695:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271175cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7273 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.814889:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271175d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.814920:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271175d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.814940:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271175d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:3.0:1734016142.814983:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 3827071 00000004:00200000:3.0:1734016142.814988:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016142.815014:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271175d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.815045:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271175cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7273 expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.816741:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271175d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7273 expref: 20 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.816765:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016142.816770:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016142.816774:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016142.816917:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+20:10406:x1818247333978624:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2284us (4422us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.816932:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2368 00000100:00100000:0.0:1734016142.822079:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016142.822158:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.822270:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333978880 00000100:00100000:3.0:1734016142.822286:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333978880 00000100:00100000:3.0:1734016142.822366:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333978752 00000100:00100000:3.0:1734016142.822369:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333978752 00000100:00100000:3.0:1734016142.822411:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11815 00000100:00100000:3.0:1734016142.822421:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333978880:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.822458:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.822488:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271175dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7281 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016142.822606:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335423488:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016142.822702:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016142.822867:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11816 00000100:00100000:1.0:1734016142.822877:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333978752:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.822890:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.822908:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271175e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e727a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016142.822954:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335423616:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016142.822994:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00002000:00010000:1.0:1734016142.832460:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016142 -> 1734016143 00002000:00010000:1.0:1734016142.832472:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks: 144 -> 160 00000100:00100000:1.0:1734016142.832513:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335423616:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016142.832568:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271175e4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e727a expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.832591:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271175e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e727a expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.832623:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016142.832695:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333978752:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9818us (10534us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016142.832709:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11816 00002000:00010000:3.0:1734016142.834121:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016142 -> 1734016143 00000100:00100000:3.0:1734016142.834167:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335423488:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016142.834225:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271175dd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7281 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.834249:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271175dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7281 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.834277:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016142.834365:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333978880:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11942us (12300us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016142.834380:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11815 00000100:00100000:2.0:1734016142.843842:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.843926:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016142.844010:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333979008 00000100:00100000:1.0:1734016142.844031:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333979008 00000100:00100000:1.0:1734016142.844108:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333979136 00000100:00100000:1.0:1734016142.844112:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333979136 00000100:00100000:1.0:1734016142.844143:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11817 00000100:00100000:1.0:1734016142.844156:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333979008:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016142.844200:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016142.844232:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc271175eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7288 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016142.844337:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335423744:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016142.844448:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016142.844533:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11818 00000100:00100000:0.0:1734016142.844541:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333979136:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016142.844553:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016142.844568:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc271175f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e728f expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016142.844607:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335423872:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016142.844635:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016142.849680:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012d4aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335423872:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016142.849749:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc271175f2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e728f expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016142.849771:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582d00/0x5e3a3adc271175f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e728f expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1734016142.849987:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335423744:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016142.850013:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc271175eb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7288 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.850024:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d680/0x5e3a3adc271175eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7288 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016142.850039:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016142.850432:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333979008:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6275us (6629us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016142.850446:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11817 00010000:00010000:2.0:1734016142.850926:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582d00, rc 0) 00000100:00100000:2.0:1734016142.850960:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247333979136:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6420us (7033us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016142.850971:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11818 00000100:00100000:0.0:1734016142.862367:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.862548:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333979392 00000100:00100000:3.0:1734016142.862564:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333979392 00002000:00100000:3.0:1734016142.862643:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->3821567) req@ffff88012d4ace00 x1818247333979392/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:103/0 lens 488/0 e 0 to 0 dl 1734016153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016142.862657:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4ace00 with x1818247333979392 ext(0->3821567) 00002000:00010000:3.0:1734016142.862665:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d4ace00 00000100:00100000:3.0:1734016142.862723:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8992 00000100:00100000:3.0:1734016142.862737:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333979392:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016142.936428:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333979392:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 73673us (74059us total) trans 0 rc 3821568/3821568 00000100:00100000:3.0:1734016142.936449:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8992 00002000:00100000:3.0:1734016142.936476:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->3821567) req@ffff88012d4ace00 x1818247333979392/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:103/0 lens 488/440 e 0 to 0 dl 1734016153 ref 1 fl Complete:/200/0 rc 3821568/3821568 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016142.936488:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4ace00 with x1818247333979392 ext(0->3821567) 00002000:00010000:3.0:1734016142.936497:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d4ace00 00000100:00100000:1.0:1734016142.946775:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016142.947069:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333979520 00000100:00100000:3.0:1734016142.947087:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333979520 00000100:00100000:3.0:1734016142.947171:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2369 00000100:00100000:3.0:1734016142.947180:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:10406:x1818247333979520:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.947208:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.947233:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271175f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7296 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.947366:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117600 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.947386:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.947403:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:3.0:1734016142.947436:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 3827071 00000004:00200000:3.0:1734016142.947442:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016142.947461:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016142.947485:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271175f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7296 expref: 23 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.947532:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117600 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7296 expref: 22 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016142.947543:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016142.947546:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016142.947551:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016142.947617:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:10406:x1818247333979520:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 437us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016142.947625:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2369 00000100:00100000:0.0:1734016142.954519:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016142.954601:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.954647:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333979776 00000100:00100000:2.0:1734016142.954665:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333979776 00000100:00100000:2.0:1734016142.954737:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333979648 00000100:00100000:2.0:1734016142.954740:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333979648 00000100:00100000:2.0:1734016142.954767:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11819 00000100:00100000:2.0:1734016142.954778:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333979776:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016142.954858:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016142.954897:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117607 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e72a4 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016142.954999:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335424000:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016142.955103:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016142.955155:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11820 00000100:00100000:2.0:1734016142.955160:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333979648:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016142.955171:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016142.955184:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711760e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e729d expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016142.955218:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335424128:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016142.955242:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016142.964437:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335424128:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016142.964520:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711760e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e729d expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.964544:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc2711760e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e729d expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.964583:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:3.0:1734016142.964676:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333979648:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9512us (10073us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016142.964688:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11820 00000100:00100000:2.0:1734016142.966254:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335424000:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016142.966298:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117607 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72a4 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016142.966323:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117607 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72a4 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016142.973266:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016142.973415:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333979776:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 18621us (18910us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016142.973431:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11819 00000100:00100000:0.0:1734016142.978938:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016142.979094:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.979417:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333980032 00000100:00100000:2.0:1734016142.979437:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333980032 00000100:00100000:2.0:1734016142.979847:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333979904 00000100:00100000:2.0:1734016142.979851:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333979904 00000100:00100000:2.0:1734016142.979876:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11821 00000100:00100000:2.0:1734016142.979886:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333980032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016142.979924:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016142.979960:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117615 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e72b2 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016142.980064:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335424256:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016142.980222:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11822 00000100:00100000:3.0:1734016142.980229:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333979904:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016142.980240:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016142.980256:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc2711761c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e72ab expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016142.980300:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335424384:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016142.980479:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016142.980597:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016142.986061:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335424256:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016142.986122:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117615 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72b2 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016142.986147:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117615 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72b2 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1734016142.987155:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335424384:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016142.987194:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc2711761c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72ab expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.987216:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc2711761c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72ab expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016142.987252:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016142.987343:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1983:x1818247333979904:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7109us (8245us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016142.987357:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11822 00010000:00010000:2.0:1734016142.987515:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016142.987546:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333980032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7662us (8630us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016142.987554:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11821 00000100:00100000:0.0:1734016142.996383:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016142.996519:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333980288 00000100:00100000:2.0:1734016142.996536:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333980288 00000100:00100000:2.0:1734016142.997845:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2370 00000100:00100000:2.0:1734016142.997862:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+20:10406:x1818247333980288:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016142.999575:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016142.999655:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271175d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7273 expref: 20 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016142.999697:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016142.999704:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016143.000039:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117623 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016143.000059:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117600 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7296 expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.000068:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117623 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016143.000123:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117600 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7296 expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.000146:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117600 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7296 expref: 21 pid: 13956 timeout: 510 lvb_type: 0 00000100:00100000:2.0:1734016143.000164:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd2b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335424512:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016143.002829:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 10 seconds 00000100:00100000:0.0:1734016143.009315:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016143.009393:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333980416 00000100:00100000:0.0:1734016143.009406:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333980416 00010000:00010000:0.0:1734016143.009471:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117600 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7296 expref: 22 pid: 13956 timeout: 510 lvb_type: 0 00000100:00100000:3.0:1734016143.010144:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd2b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335424512:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016143.010177:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117623 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016143.018656:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3235 00000100:00100000:0.0:1734016143.018687:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:1981:x1818247333980416:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016143.018730:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016143.018744:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117600 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7296 expref: 22 pid: 13956 timeout: 510 lvb_type: 0 00010000:00010000:0.0:1734016143.018773:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117600 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7296 expref: 22 pid: 13956 timeout: 510 lvb_type: 0 00010000:00010000:0.0:1734016143.018828:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117600 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7296 expref: 22 pid: 13956 timeout: 510 lvb_type: 0 00010000:00010000:0.0:1734016143.018856:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:0.0:1734016143.018865:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117623 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016143.018876:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117623 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016143.018884:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117623 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016143.018931:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016143.018984:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117623 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016143.018994:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117623 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016143.019011:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:1981:x1818247333980416:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 335us (9721us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016143.019018:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3235 00000001:00080000:3.0:1734016143.019130:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968839 00000004:00010000:3.0:1734016143.019202:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012d4adc00 reply state ffff880071abb000 transno 4294968840 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117623 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:3.0:1734016143.019212:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016143.019309:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+22:10406:x1818247333980288:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 21452us (22950us total) trans 4294968840 rc 0/0 00000100:00100000:3.0:1734016143.019317:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2370 00000020:00080000:3.0:1734016143.019322:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016143.029291:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1734016143.029370:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117623 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016143.029389:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117623 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016143.029399:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117623 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016143.029405:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbf180 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016143.029411:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117623 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016143.029419:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117623 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016143.029445:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016143.029449:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016143.029454:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117623 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016143.029460:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117623 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:2.0:1734016143.029672:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333980544 00000100:00100000:2.0:1734016143.029685:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333980544 00000100:00100000:2.0:1734016143.030120:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11823 00000100:00100000:2.0:1734016143.030130:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:10406:x1818247333980544:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.030159:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.030188:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711762a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e72b9 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.030226:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc27117590 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6045696->6049791) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7249 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.030235:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016143.030237:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016143.030242:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711762a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72b9 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.030291:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc27117590 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6045696->6049791) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7249 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.030307:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc27117590 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6045696->6049791) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7249 expref: 5 pid: 8216 timeout: 510 lvb_type: 0 00000100:00100000:2.0:1734016143.030321:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd29180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335424640:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016143.030436:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016143.038486:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd29180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335424640:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016143.038560:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711762a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72b9 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.038596:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016143.038688:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333980544:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8556us (9411us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016143.038703:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11823 00000100:00100000:0.0:1734016143.043438:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.043508:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333980672 00000100:00100000:2.0:1734016143.043526:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333980672 00010000:00010000:2.0:1734016143.043593:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc27117590 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6045696->6049791) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7249 expref: 6 pid: 8216 timeout: 510 lvb_type: 0 00000100:00100000:2.0:1734016143.043657:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3236 00000100:00100000:2.0:1734016143.043668:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333980672:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016143.043695:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016143.043722:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc27117590 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6045696->6049791) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7249 expref: 6 pid: 8216 timeout: 510 lvb_type: 0 00010000:00010000:2.0:1734016143.043736:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc27117590 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6045696->6049791) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7249 expref: 6 pid: 8216 timeout: 510 lvb_type: 0 00010000:00010000:2.0:1734016143.043772:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc27117590 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6045696->6049791) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7249 expref: 6 pid: 8216 timeout: 510 lvb_type: 0 00010000:00010000:2.0:1734016143.043836:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016143.043840:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016143.043849:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711762a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72b9 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.043859:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711762a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72b9 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.043919:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711762a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72b9 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.043936:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd29180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335424768:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016143.044048:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016143.060155:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.060219:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd29180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335424768:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016143.060258:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016143.060336:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333980672:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 16669us (16913us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016143.060350:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3236 00000100:00100000:3.0:1734016143.062150:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333980800 00000100:00100000:3.0:1734016143.062168:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333980800 00000100:00100000:3.0:1734016143.062249:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11824 00000100:00100000:3.0:1734016143.062260:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:10406:x1818247333980800:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016143.062297:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016143.062335:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27117631 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e72c0 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.062383:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271174ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71b6 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.062397:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016143.062400:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016143.062405:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27117631 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72c0 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.062452:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271174ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71b6 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.062468:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271174ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71b6 expref: 10 pid: 7682 timeout: 510 lvb_type: 0 00000100:00100000:3.0:1734016143.062484:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335424896:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016143.062597:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016143.071327:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335424896:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016143.071407:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27117631 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72c0 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.071447:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016143.071826:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:10406:x1818247333980800:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9565us (11686us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016143.071846:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11824 00000100:00100000:1.0:1734016143.071989:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.072195:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333980928 00000100:00100000:2.0:1734016143.072209:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333980928 00010000:00010000:2.0:1734016143.072256:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271174ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71b6 expref: 11 pid: 7682 timeout: 510 lvb_type: 0 00000100:00100000:2.0:1734016143.072301:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3237 00000100:00100000:2.0:1734016143.072311:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333980928:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016143.072342:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016143.072383:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271174ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71b6 expref: 11 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:2.0:1734016143.072400:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271174ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71b6 expref: 11 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:2.0:1734016143.072453:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271174ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e71b6 expref: 11 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:2.0:1734016143.072505:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016143.072508:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016143.072519:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27117631 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72c0 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.072531:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27117631 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72c0 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.072592:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27117631 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72c0 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.072614:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd29180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335425024:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016143.072728:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016143.077781:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016143.077914:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016143.077953:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333981184 00000100:00100000:3.0:1734016143.077966:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333981184 00000100:00100000:2.0:1734016143.077995:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333981056 00000100:00100000:2.0:1734016143.078001:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333981056 00002000:00010000:2.0:1734016143.078028:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00010000:3.0:1734016143.078028:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (2473888->18446744073709551615) 00002000:00100000:2.0:1734016143.078034:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f4700 with x1818247333981056 ext(4194304->18446744073709551615) 00002000:00100000:3.0:1734016143.078034:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f6a00 with x1818247333981184 ext(2473888->18446744073709551615) 00002000:00010000:2.0:1734016143.078052:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800758f4700. 00002000:00010000:3.0:1734016143.078052:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758f6a00. 00000100:00100000:2.0:1734016143.078082:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8993 00000100:00100000:2.0:1734016143.078092:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333981056:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016143.078360:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 3827071 -> 4194304 00002000:00010000:2.0:1734016143.078363:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016143 -> 1734016143 00002000:00010000:2.0:1734016143.078366:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016143 -> 1734016143 00002000:00010000:2.0:1734016143.078368:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016143 -> 1734016143 00002000:00010000:2.0:1734016143.078369:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 160 -> 160 00000100:00100000:2.0:1734016143.078449:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333981056:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 356us (532us total) trans 4294968089 rc 0/0 00000100:00100000:0.0:1734016143.078451:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd29180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335425024:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016143.078456:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8993 00002000:00010000:2.0:1734016143.078459:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:2.0:1734016143.078461:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f4700 with x1818247333981056 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1734016143.078464:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800758f4700. 00010000:00010000:0.0:1734016143.078478:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016143.078482:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8994 00000100:00100000:2.0:1734016143.078485:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333981184:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:0.0:1734016143.078516:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333980928:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6208us (6530us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016143.078527:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3237 00002000:00010000:2.0:1734016143.078646:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 2473888 00002000:00010000:2.0:1734016143.078649:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016143 -> 1734016143 00002000:00010000:2.0:1734016143.078650:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016143 -> 1734016142 00002000:00010000:2.0:1734016143.078652:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016143 -> 1734016143 00002000:00010000:2.0:1734016143.078654:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1734016143.078677:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333981184:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 189us (913us total) trans 4294969548 rc 0/0 00000100:00100000:2.0:1734016143.078682:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8994 00002000:00010000:2.0:1734016143.078685:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (2473888->18446744073709551615) 00002000:00100000:2.0:1734016143.078687:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800758f6a00 with x1818247333981184 ext(2473888->18446744073709551615) 00002000:00010000:2.0:1734016143.078690:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800758f6a00. 00000100:00100000:0.0:1734016143.084546:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016143.084658:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333981312 00000100:00100000:3.0:1734016143.084676:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333981312 00000100:00100000:3.0:1734016143.084784:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2371 00000100:00100000:3.0:1734016143.084796:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+21:10406:x1818247333981312:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016143.084897:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016143.088694:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117638 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e72c7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.089000:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711763f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016143.089025:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711763f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016143.089049:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711763f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:3.0:1734016143.089091:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 6668192 00000004:00200000:3.0:1734016143.089097:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016143.089125:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711763f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016143.089164:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117638 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72c7 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.089236:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711763f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72c7 expref: 22 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.089247:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016143.089250:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016143.089255:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016143.089361:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:10406:x1818247333981312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4566us (4837us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016143.089372:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2371 00000100:00100000:0.0:1734016143.093371:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016143.093434:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016143.095925:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333981568 00000100:00100000:3.0:1734016143.095952:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333981568 00000100:00100000:3.0:1734016143.096032:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333981440 00000100:00100000:3.0:1734016143.096036:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333981440 00000100:00100000:3.0:1734016143.096077:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11825 00000100:00100000:2.0:1734016143.096088:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11826 00000100:00100000:3.0:1734016143.096089:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333981568:12345-192.168.201.16@tcp:101:fsx.0 00000100:00100000:2.0:1734016143.096094:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333981440:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.096119:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016143.096119:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.096156:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117646 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e72ce expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.096156:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711764d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e72d5 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.096232:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335425280:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016143.096232:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335425152:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016143.096320:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:3.0:1734016143.096528:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:2.0:1734016143.101471:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335425280:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016143.101533:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117646 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72ce expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.101551:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117646 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72ce expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.101569:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016143.101647:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333981440:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5550us (8211us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016143.101656:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11826 00002000:00010000:3.0:1734016143.101853:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016142 -> 1734016143 00000100:00100000:3.0:1734016143.101867:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335425152:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016143.101889:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711764d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72d5 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.101900:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc2711764d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72d5 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.101921:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016143.101944:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333981568:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5859us (8590us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016143.101955:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11825 00000100:00100000:0.0:1734016143.129321:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016143.129411:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016143.129561:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333981696 00000100:00100000:3.0:1734016143.129582:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333981696 00000100:00100000:3.0:1734016143.129688:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333981824 00000100:00100000:3.0:1734016143.129690:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333981824 00000100:00100000:3.0:1734016143.129722:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11827 00000100:00100000:3.0:1734016143.129733:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333981696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016143.129774:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016143.129866:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117654 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e72dc expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016143.129976:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335425408:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016143.130087:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:0.0:1734016143.130366:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11828 00000100:00100000:0.0:1734016143.130372:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333981824:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016143.130384:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016143.130398:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc2711765b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e72e3 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016143.130437:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335425536:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016143.130468:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016143.132476:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012d4ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335425536:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016143.132539:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc2711765b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72e3 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016143.132555:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7581f80/0x5e3a3adc2711765b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72e3 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016143.132579:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581f80, rc 0) 00000100:00100000:0.0:1734016143.132655:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333981824:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2281us (3242us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016143.132665:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11828 00000100:00100000:3.0:1734016143.133885:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335425408:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016143.133917:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117654 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72dc expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.133934:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117654 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72dc expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.133953:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016143.133995:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333981696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4264us (4708us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016143.134005:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11827 00000100:00100000:0.0:1734016143.136390:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.136481:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333981952 00000100:00100000:2.0:1734016143.136494:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333981952 00000100:00100000:2.0:1734016143.136567:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2372 00000100:00100000:2.0:1734016143.136580:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+21:10406:x1818247333981952:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.136621:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.136657:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117662 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e72ea expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.136862:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117669 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016143.136883:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016143.136899:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:2.0:1734016143.136936:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 6668192 00000004:00200000:2.0:1734016143.136940:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016143.136959:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016143.136987:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117662 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72ea expref: 23 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.137016:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117669 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72ea expref: 22 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.137025:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016143.137033:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016143.137037:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016143.137115:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+22:10406:x1818247333981952:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 539us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016143.137123:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2372 00000100:00100000:0.0:1734016143.141064:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016143.141162:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.141272:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333982208 00000100:00100000:2.0:1734016143.141293:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333982208 00000100:00100000:2.0:1734016143.141387:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333982080 00000100:00100000:2.0:1734016143.141390:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333982080 00000100:00100000:2.0:1734016143.141434:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11829 00000100:00100000:2.0:1734016143.141447:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333982208:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.141490:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.141535:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117670 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e72f8 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.141653:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335425664:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016143.141749:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016143.141769:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11830 00000100:00100000:2.0:1734016143.141773:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333982080:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.141783:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.141798:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117677 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e72f1 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.141867:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335425792:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016143.141886:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00002000:00010000:0.0:1734016143.144105:0:7682:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size: 4194304 -> 4788631 00000100:00100000:0.0:1734016143.144145:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335425792:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016143.144194:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117677 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72f1 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016143.144211:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117677 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72f1 expref: 6 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016143.144228:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:0.0:1734016143.144272:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333982080:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2496us (3109us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016143.144281:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11830 00002000:00010000:2.0:1734016143.144520:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:2.0:1734016143.144534:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335425664:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016143.144555:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117670 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72f8 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.144566:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117670 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72f8 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.144595:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016143.144620:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333982208:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3177us (3583us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016143.144626:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11829 00000100:00100000:0.0:1734016143.146906:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016143.147273:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016143.147633:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333982336 00000100:00100000:1.0:1734016143.147643:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333982336 00000100:00100000:1.0:1734016143.147693:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333982464 00000100:00100000:1.0:1734016143.147695:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333982464 00000100:00100000:1.0:1734016143.147714:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11831 00000100:00100000:1.0:1734016143.147722:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333982336:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016143.147744:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016143.147766:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc2711767e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e72ff expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016143.147850:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335425920:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016143.147936:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016143.149259:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11832 00000100:00100000:0.0:1734016143.149270:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333982464:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016143.149293:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016143.149310:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27117685 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7306 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016143.149394:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007583c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335426048:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016143.149449:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016143.150612:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335425920:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016143.150647:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc2711767e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72ff expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016143.150659:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc2711767e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72ff expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016143.150685:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016143.150723:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333982336:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3001us (3828us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016143.150730:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11831 00000100:00100000:0.0:1734016143.152066:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007583c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335426048:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016143.152105:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27117685 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7306 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016143.152120:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582f40/0x5e3a3adc27117685 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7306 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016143.153360:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582f40, rc 0) 00000100:00100000:0.0:1734016143.153479:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247333982464:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4204us (6199us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016143.153493:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11832 00000100:00100000:2.0:1734016143.161267:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.161317:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016143.161365:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333982592 00000100:00100000:1.0:1734016143.161381:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333982592 00000100:00100000:0.0:1734016143.161396:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333982720 00000100:00100000:0.0:1734016143.161401:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333982720 00000100:00100000:1.0:1734016143.161467:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11833 00000100:00100000:1.0:1734016143.161479:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333982592:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016143.161522:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016143.161564:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711768c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e730d expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016143.161694:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335426176:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016143.161695:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11834 00000100:00100000:0.0:1734016143.161701:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333982720:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016143.161713:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016143.161737:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27117693 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7314 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016143.161789:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007583c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335426304:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016143.161836:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:1.0:1734016143.161839:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016143.173319:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335426176:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016143.173395:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711768c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e730d expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016143.173421:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc2711768c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e730d expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016143.173453:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:0.0:1734016143.173529:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333982592:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12050us (12277us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016143.173545:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11833 00000100:00100000:2.0:1734016143.174483:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007583c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335426304:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016143.174528:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27117693 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7314 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.174539:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc27117693 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7314 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.174569:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:2.0:1734016143.174606:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333982720:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12904us (13287us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016143.174615:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11834 00000100:00100000:0.0:1734016143.186603:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016143.187312:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333982848 00000100:00100000:3.0:1734016143.187328:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333982848 00000100:00100000:3.0:1734016143.187396:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11835 00000100:00100000:3.0:1734016143.187405:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333982848:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016143.187442:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016143.187475:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc2711769a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e731b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016143.187590:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335426432:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016143.188030:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016143.190209:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016143.190438:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335426432:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016143.190525:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc2711769a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e731b expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.190552:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc2711769a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e731b expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1734016143.190727:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333982976 00000100:00100000:0.0:1734016143.190745:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333982976 00000100:00100000:0.0:1734016143.190847:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11836 00000100:00100000:0.0:1734016143.190860:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333982976:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016143.190901:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016143.190931:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc271176a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7322 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016143.191032:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007583c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335426560:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016143.191137:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00010000:00010000:3.0:1734016143.191685:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016143.191724:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333982848:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4318us (11961us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016143.191736:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11835 00000100:00100000:2.0:1734016143.195667:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007583c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335426560:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016143.195722:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc271176a1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7322 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.195739:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc271176a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7322 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.195775:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75818c0, rc 0) 00000100:00100000:2.0:1734016143.195877:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247333982976:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5017us (5685us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016143.195888:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11836 00000100:00100000:0.0:1734016143.200949:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.202029:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333983104 00000100:00100000:2.0:1734016143.202046:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333983104 00000100:00100000:2.0:1734016143.202154:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11837 00000100:00100000:2.0:1734016143.202167:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333983104:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.202207:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.202245:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271176a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7329 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.202368:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335426688:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016143.202505:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016143.205846:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335426688:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016143.205930:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271176a8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7329 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.205952:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271176a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7329 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.205983:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016143.206061:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333983104:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3896us (5131us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016143.206078:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11837 00000100:00100000:1.0:1734016143.207538:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016143.208945:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333983232 00000100:00100000:3.0:1734016143.208967:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333983232 00000100:00100000:3.0:1734016143.209062:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11838 00000100:00100000:3.0:1734016143.209074:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333983232:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016143.209108:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016143.209149:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271176af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7330 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016143.209241:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335426816:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016143.209345:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016143.212315:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335426816:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016143.212384:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271176af lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7330 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.212407:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271176af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7330 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.212448:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016143.212550:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247333983232:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3476us (5027us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016143.212566:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11838 00000100:00100000:0.0:1734016143.216950:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016143.217704:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016143.217841:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333983360 00000100:00100000:1.0:1734016143.217856:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333983360 00000100:00100000:1.0:1734016143.217916:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333983488 00000100:00100000:1.0:1734016143.217919:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333983488 00000100:00100000:1.0:1734016143.217947:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11839 00000100:00100000:1.0:1734016143.217956:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333983360:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016143.217993:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016143.218017:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc271176b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7337 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016143.218102:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335426944:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016143.218186:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92180 going to sleep for 11 seconds 00000100:00100000:0.0:1734016143.218258:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11840 00000100:00100000:0.0:1734016143.218264:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333983488:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016143.218273:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016143.218288:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc271176bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e733e expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016143.218324:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007583d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335427072:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016143.218352:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1734016143.223684:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335426944:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016143.223902:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc271176b6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7337 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016143.223923:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc271176b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7337 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016143.226734:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016143.226915:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247333983360:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8942us (9962us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016143.226931:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11839 00000100:00100000:2.0:1734016143.227579:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007583d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335427072:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016143.227637:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc271176bd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e733e expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.227659:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc271176bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e733e expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.227684:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75818c0, rc 0) 00000100:00100000:2.0:1734016143.227725:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247333983488:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9459us (10021us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016143.227734:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11840 00000100:00100000:2.0:1734016143.233723:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016143.233883:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333983744 00000100:00100000:3.0:1734016143.233907:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333983744 00000100:00100000:3.0:1734016143.234013:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2373 00000100:00100000:3.0:1734016143.234030:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+22:10406:x1818247333983744:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016143.234141:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016143.234199:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711763f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72c7 expref: 22 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.234263:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016143.234274:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016143.234610:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271176c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016143.234630:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117669 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72ea expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.234639:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271176c4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016143.234690:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117669 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72ea expref: 21 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.234707:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117669 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72ea expref: 21 pid: 13956 timeout: 510 lvb_type: 0 00000100:00100000:3.0:1734016143.234723:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335427200:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016143.234893:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016143.239040:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335427200:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016143.239101:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271176c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016143.239390:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.240505:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333983872 00000100:00100000:2.0:1734016143.240518:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333983872 00010000:00010000:2.0:1734016143.240566:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117669 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72ea expref: 22 pid: 13956 timeout: 510 lvb_type: 0 00000100:00100000:2.0:1734016143.240712:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3238 00000100:00100000:2.0:1734016143.240722:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+22:1982:x1818247333983872:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016143.240741:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016143.240749:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117669 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72ea expref: 22 pid: 13956 timeout: 510 lvb_type: 0 00010000:00010000:2.0:1734016143.240760:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117669 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72ea expref: 22 pid: 13956 timeout: 510 lvb_type: 0 00010000:00010000:2.0:1734016143.240789:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117669 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72ea expref: 22 pid: 13956 timeout: 510 lvb_type: 0 00010000:00010000:2.0:1734016143.240846:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016143.240852:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271176c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016143.240862:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271176c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016143.240872:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271176c4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016143.240900:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016143.240966:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+21:1982:x1818247333983872:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 244us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016143.240975:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3238 00010000:00010000:2.0:1734016143.241139:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271176c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016143.241148:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271176c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:2.0:1734016143.241302:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968841 00000004:00010000:2.0:1734016143.241368:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007bd29c00 reply state ffff88012e3b0000 transno 4294968842 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271176c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:2.0:1734016143.241377:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016143.243272:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:10406:x1818247333983744:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 9230us (9556us total) trans 4294968842 rc 0/0 00000100:00100000:2.0:1734016143.243288:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2373 00000020:00080000:2.0:1734016143.243300:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016143.247163:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271176c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016143.247201:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271176c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016143.247212:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271176c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016143.247221:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4240 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016143.247231:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271176c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016143.247243:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271176c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016143.247277:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016143.247281:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016143.247289:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271176c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016143.247295:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc271176c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016143.248336:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.248772:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333984000 00000100:00100000:2.0:1734016143.248787:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333984000 00000100:00100000:2.0:1734016143.248890:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11841 00000100:00100000:2.0:1734016143.248901:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:10406:x1818247333984000:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.248933:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.248967:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271176cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7345 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.249026:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711762a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72b9 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.249036:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016143.249039:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016143.249044:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271176cb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7345 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.249090:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711762a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72b9 expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.249108:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711762a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72b9 expref: 7 pid: 7682 timeout: 510 lvb_type: 0 00000100:00100000:2.0:1734016143.249125:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335427328:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016143.249757:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016143.253286:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335427328:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016143.253341:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271176cb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7345 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.253365:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016143.253435:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333984000:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4535us (5109us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016143.253446:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11841 00000100:00100000:2.0:1734016143.254950:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016143.255883:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333984128 00000100:00100000:0.0:1734016143.255907:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333984128 00002000:00100000:0.0:1734016143.256017:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (4784128->4788630) req@ffff88007bd2a680 x1818247333984128/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 4992/0 e 0 to 0 dl 1734016154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016143.256031:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd2a680 with x1818247333984128 ext(4784128->4788630) 00010000:00010000:0.0:1734016143.256047:0:7687:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711762a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72b9 expref: 8 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:0.0:1734016143.256070:0:7687:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711762a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72b9 expref: 8 pid: 7682 timeout: 510 lvb_type: 0 00002000:00010000:0.0:1734016143.256079:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007bd2a680 00000100:00100000:0.0:1734016143.256131:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 297 00000100:00100000:0.0:1734016143.256142:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333984128:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:0.0:1734016143.258534:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247333984128:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 2372us (3573us total) trans 4294968090 rc 0/0 00000100:00100000:0.0:1734016143.258556:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 297 00002000:00100000:0.0:1734016143.258583:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (4784128->4788630) req@ffff88007bd2a680 x1818247333984128/t4294968090(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 4992/448 e 0 to 0 dl 1734016154 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016143.258597:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd2a680 with x1818247333984128 ext(4784128->4788630) 00010000:00010000:0.0:1734016143.258616:0:7687:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711762a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72b9 expref: 10 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:0.0:1734016143.258648:0:7687:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711762a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72b9 expref: 10 pid: 7682 timeout: 510 lvb_type: 0 00002000:00010000:0.0:1734016143.258660:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007bd2a680 00000100:00100000:0.0:1734016143.262970:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016143.263120:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333984256 00000100:00100000:1.0:1734016143.263146:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333984256 00010000:00010000:1.0:1734016143.263228:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711762a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72b9 expref: 10 pid: 7682 timeout: 510 lvb_type: 0 00000100:00100000:1.0:1734016143.263396:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3239 00000100:00100000:1.0:1734016143.263411:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247333984256:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016143.263451:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1734016143.263502:0:6465:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 160 -> 176 00010000:00010000:1.0:1734016143.263511:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711762a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72b9 expref: 10 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:1.0:1734016143.263531:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711762a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72b9 expref: 10 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:1.0:1734016143.263573:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc2711762a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72b9 expref: 10 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:1.0:1734016143.263629:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016143.263634:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016143.263644:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271176cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7345 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016143.263657:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271176cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7345 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016143.263738:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271176cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7345 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016143.263758:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335427456:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016143.264773:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92180 going to sleep for 11 seconds 00000100:00100000:0.0:1734016143.269011:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.269275:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333984384 00000100:00100000:2.0:1734016143.269292:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333984384 00000100:00100000:2.0:1734016143.269372:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11842 00000100:00100000:2.0:1734016143.269385:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:10406:x1818247333984384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.269427:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.269461:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271176d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e734c expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.269522:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27117631 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72c0 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.269533:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016143.269535:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016143.269541:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271176d2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e734c expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.269599:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27117631 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72c0 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.269616:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27117631 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72c0 expref: 11 pid: 7682 timeout: 510 lvb_type: 0 00000100:00100000:2.0:1734016143.269633:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd29180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335427584:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016143.269741:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016143.270406:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335427456:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016143.270461:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016143.270525:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333984256:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7116us (7581us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016143.270538:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3239 00000100:00100000:2.0:1734016143.274473:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd29180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335427584:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016143.274533:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271176d2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e734c expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.274563:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016143.274622:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:10406:x1818247333984384:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5237us (5633us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016143.274633:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11842 00000100:00100000:0.0:1734016143.276117:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016143.277046:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333984512 00000100:00100000:1.0:1734016143.277059:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333984512 00010000:00010000:1.0:1734016143.277106:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27117631 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72c0 expref: 12 pid: 7682 timeout: 510 lvb_type: 0 00000100:00100000:1.0:1734016143.277152:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3240 00000100:00100000:1.0:1734016143.277161:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247333984512:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016143.277179:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016143.277204:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27117631 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72c0 expref: 12 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:1.0:1734016143.277222:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27117631 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72c0 expref: 12 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:1.0:1734016143.277251:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27117631 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e72c0 expref: 12 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:1.0:1734016143.277277:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016143.277279:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016143.277286:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271176d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e734c expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016143.277297:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271176d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e734c expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016143.277333:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271176d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e734c expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016143.277345:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335427712:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016143.277413:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92480 going to sleep for 11 seconds 00000100:00100000:1.0:1734016143.280453:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800758f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335427712:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016143.280502:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016143.280577:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333984512:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3414us (4474us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016143.280597:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3240 00000100:00100000:0.0:1734016143.281233:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016143.281317:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016143.282126:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333984768 00000100:00100000:1.0:1734016143.282143:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333984768 00002000:00010000:1.0:1734016143.282218:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:1.0:1734016143.282228:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007583e680 with x1818247333984768 ext(4194304->18446744073709551615) 00002000:00010000:1.0:1734016143.282250:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007583e680. 00000100:00100000:1.0:1734016143.282290:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333984640 00000100:00100000:1.0:1734016143.282293:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333984640 00002000:00010000:1.0:1734016143.282314:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (5357521->18446744073709551615) 00002000:00100000:1.0:1734016143.282319:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007583ea00 with x1818247333984640 ext(5357521->18446744073709551615) 00002000:00010000:1.0:1734016143.282335:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007583ea00. 00000100:00100000:1.0:1734016143.282381:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8995 00000100:00100000:1.0:1734016143.282392:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333984768:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:2.0:1734016143.282651:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8996 00000100:00100000:2.0:1734016143.282660:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333984640:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016143.283173:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4788631 -> 5357521 00002000:00010000:2.0:1734016143.283177:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016143 -> 1734016143 00002000:00010000:2.0:1734016143.283180:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016143 -> 1734016143 00002000:00010000:2.0:1734016143.283181:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016143 -> 1734016143 00002000:00010000:2.0:1734016143.283183:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 176 -> 176 00000100:00100000:2.0:1734016143.283282:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333984640:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 620us (1962us total) trans 4294968091 rc 0/0 00000100:00100000:2.0:1734016143.283291:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8996 00002000:00010000:2.0:1734016143.283294:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (5357521->18446744073709551615) 00002000:00100000:2.0:1734016143.283297:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007583ea00 with x1818247333984640 ext(5357521->18446744073709551615) 00002000:00010000:2.0:1734016143.283302:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007583ea00. 00002000:00010000:1.0:1734016143.284120:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 2473888 -> 4194304 00002000:00010000:1.0:1734016143.284124:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016143 -> 1734016143 00002000:00010000:1.0:1734016143.284127:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016143 -> 1734016142 00002000:00010000:1.0:1734016143.284130:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016143 -> 1734016143 00002000:00010000:1.0:1734016143.284132:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 1 -> 0 00000100:00100000:1.0:1734016143.284172:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247333984768:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1780us (2938us total) trans 4294969549 rc 0/0 00000100:00100000:1.0:1734016143.284178:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8995 00002000:00010000:1.0:1734016143.284181:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:1.0:1734016143.284184:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007583e680 with x1818247333984768 ext(4194304->18446744073709551615) 00002000:00010000:1.0:1734016143.284189:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007583e680. 00000100:00100000:0.0:1734016143.288556:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016143.288704:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333985024 00000100:00100000:1.0:1734016143.288724:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333985024 00002000:00100000:1.0:1734016143.289003:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (3829760->5357567) req@ffff88007583ed80 x1818247333985024/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:104/0 lens 504/0 e 0 to 0 dl 1734016154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016143.289023:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007583ed80 with x1818247333985024 ext(3829760->5357567) 00002000:00010000:1.0:1734016143.289031:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007583ed80 00000100:00100000:1.0:1734016143.289607:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8997 00000100:00100000:1.0:1734016143.289620:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333985024:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016143.296453:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247333985024:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 6806us (7897us total) trans 0 rc 368640/368640 00000100:00100000:1.0:1734016143.296475:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8997 00002000:00100000:1.0:1734016143.296511:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (3829760->5357567) req@ffff88007583ed80 x1818247333985024/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:104/0 lens 504/440 e 0 to 0 dl 1734016154 ref 1 fl Complete:/200/0 rc 368640/368640 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016143.296524:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007583ed80 with x1818247333985024 ext(3829760->5357567) 00002000:00010000:1.0:1734016143.296533:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007583ed80 00000100:00100000:0.0:1734016143.302504:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016143.302911:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333985152 00000100:00100000:1.0:1734016143.302923:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333985152 00002000:00100000:1.0:1734016143.302976:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (5353472->5357520) req@ffff88007583f100 x1818247333985152/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:104/0 lens 4544/0 e 0 to 0 dl 1734016154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016143.302986:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007583f100 with x1818247333985152 ext(5353472->5357520) 00002000:00010000:1.0:1734016143.302992:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007583f100 00000100:00100000:1.0:1734016143.303021:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8998 00000100:00100000:1.0:1734016143.303027:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333985152:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016143.304571:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247333985152:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1526us (2082us total) trans 4294968092 rc 0/0 00000100:00100000:1.0:1734016143.304596:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8998 00002000:00100000:1.0:1734016143.304617:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (5353472->5357520) req@ffff88007583f100 x1818247333985152/t4294968092(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:104/0 lens 4544/448 e 0 to 0 dl 1734016154 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016143.304627:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007583f100 with x1818247333985152 ext(5353472->5357520) 00002000:00010000:1.0:1734016143.304633:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007583f100 00000100:00100000:0.0:1734016143.308097:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.308309:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333985280 00000100:00100000:2.0:1734016143.308328:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333985280 00000100:00100000:2.0:1734016143.309615:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2374 00000100:00100000:2.0:1734016143.309628:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:10406:x1818247333985280:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:2.0:1734016143.309886:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:10406:x1818247333985280:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 259us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016143.309899:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2374 00000100:00100000:0.0:1734016143.313405:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.315612:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333985408 00000100:00100000:2.0:1734016143.315631:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333985408 00000100:00100000:2.0:1734016143.315726:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11843 00000100:00100000:2.0:1734016143.315735:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333985408:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016143.318321:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968092 is committed 00000001:00080000:2.0:1734016143.318348:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968090 is committed 00000100:00100000:0.0:1734016143.318981:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333985408:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 3063us (5411us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016143.318998:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11843 00000100:00100000:0.0:1734016143.322216:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016143.322342:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333985536 00000100:00100000:1.0:1734016143.322355:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333985536 00000100:00100000:1.0:1734016143.322409:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2375 00000100:00100000:1.0:1734016143.322418:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:10406:x1818247333985536:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016143.322454:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016143.322480:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc271176d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7353 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016143.322600:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271176e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016143.322617:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271176e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016143.322628:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271176e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:1.0:1734016143.322653:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 9551825 00000004:00200000:1.0:1734016143.322658:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016143.322678:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271176e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:1.0:1734016143.322701:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc271176d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7353 expref: 25 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016143.322720:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271176e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7353 expref: 24 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016143.322731:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016143.322734:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016143.322737:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016143.322793:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:10406:x1818247333985536:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 377us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016143.322822:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2375 00000100:00100000:1.0:1734016143.325152:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.325796:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333985664 00000100:00100000:2.0:1734016143.325899:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333985664 00000100:00100000:2.0:1734016143.326097:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2376 00000100:00100000:2.0:1734016143.326106:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+21:10406:x1818247333985664:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.326138:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.326168:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271176e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e735a expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.326297:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271176ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016143.326312:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271176ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016143.326325:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271176ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:2.0:1734016143.326356:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 9551825 00000004:00200000:2.0:1734016143.326360:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016143.326378:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271176ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016143.326407:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271176e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e735a expref: 23 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.326990:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271176ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e735a expref: 22 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.327001:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016143.327005:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016143.327008:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016143.329787:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+22:10406:x1818247333985664:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3654us (4625us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016143.329826:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2376 00000100:00100000:2.0:1734016143.338135:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.338201:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016143.338660:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333985920 00000100:00100000:0.0:1734016143.338684:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333985920 00000100:00100000:0.0:1734016143.338773:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333985792 00000100:00100000:0.0:1734016143.338776:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333985792 00000100:00100000:0.0:1734016143.338867:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11844 00000100:00100000:0.0:1734016143.338879:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333985920:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016143.338927:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016143.338972:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc271176f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7368 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016143.339088:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007583d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335427840:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016143.339254:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11845 00000100:00100000:3.0:1734016143.339262:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333985792:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016143.339275:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016143.339291:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271176fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7361 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016143.339330:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335427968:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016143.340568:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016143.343387:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00002000:00010000:3.0:1734016143.346578:0:7683:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks: 176 -> 184 00000100:00100000:3.0:1734016143.346635:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335427968:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016143.346715:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271176fc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7361 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.346739:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271176fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7361 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.346788:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016143.346907:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333985792:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7642us (8704us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016143.346920:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11845 00002000:00010000:2.0:1734016143.347225:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016142 -> 1734016143 00000100:00100000:2.0:1734016143.347254:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007583d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335427840:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016143.347286:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc271176f5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7368 expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.347297:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75818c0/0x5e3a3adc271176f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7368 expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.347328:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75818c0, rc 0) 00000100:00100000:2.0:1734016143.347366:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333985920:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8489us (9259us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016143.347372:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11844 00000100:00100000:0.0:1734016143.352325:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.352459:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333986048 00000100:00100000:2.0:1734016143.352475:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333986048 00000100:00100000:2.0:1734016143.352581:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11846 00000100:00100000:2.0:1734016143.352594:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333986048:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.352638:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.352674:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117703 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e736f expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.352795:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335428096:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016143.352974:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016143.354242:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016143.354508:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333986176 00000100:00100000:3.0:1734016143.354517:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333986176 00000100:00100000:3.0:1734016143.356652:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11847 00000100:00100000:3.0:1734016143.356668:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333986176:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016143.356695:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016143.356727:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711770a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7376 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016143.356824:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335428224:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016143.356953:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016143.362313:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335428096:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016143.362367:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117703 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e736f expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.362387:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117703 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e736f expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.363981:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016143.364114:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333986048:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11510us (11807us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016143.364130:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11846 00000100:00100000:3.0:1734016143.366345:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335428224:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016143.366420:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711770a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7376 expref: 12 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.366450:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc2711770a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7376 expref: 12 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.368880:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016143.369042:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247333986176:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12363us (14796us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016143.369058:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11847 00000100:00100000:0.0:1734016143.378339:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016143.378443:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.378702:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333986432 00000100:00100000:2.0:1734016143.378719:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333986432 00000100:00100000:2.0:1734016143.378778:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333986304 00000100:00100000:2.0:1734016143.378781:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333986304 00000100:00100000:2.0:1734016143.378855:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11848 00000100:00100000:2.0:1734016143.378867:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333986432:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.378897:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.378929:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27117711 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7384 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.379029:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bd29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335428352:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016143.379135:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016143.379152:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11849 00000100:00100000:2.0:1734016143.379158:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333986304:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.379169:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.379183:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117718 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e737d expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.379217:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335428480:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016143.379238:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016143.382847:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335428480:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016143.382914:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117718 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e737d expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.382936:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117718 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e737d expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.382958:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:3.0:1734016143.383042:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333986304:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3879us (4595us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016143.383057:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11849 00000100:00100000:2.0:1734016143.383187:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bd29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335428352:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016143.383215:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27117711 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7384 expref: 12 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.383224:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc27117711 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7384 expref: 12 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.383248:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016143.383268:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333986432:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4404us (4965us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016143.383273:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11848 00000100:00100000:1.0:1734016143.387294:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016143.387447:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.387609:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333986560 00000100:00100000:2.0:1734016143.387626:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333986560 00000100:00100000:2.0:1734016143.387691:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333986688 00000100:00100000:2.0:1734016143.387694:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333986688 00000100:00100000:2.0:1734016143.387714:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11850 00000100:00100000:2.0:1734016143.387726:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333986560:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.387758:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.387823:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711771f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e738b expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.387936:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335428608:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016143.388039:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016143.388069:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11851 00000100:00100000:2.0:1734016143.388074:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333986688:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.388084:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.388100:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117726 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7392 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.388128:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335428736:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016143.388150:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016143.391913:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335428608:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016143.391967:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711771f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e738b expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.391985:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711771f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e738b expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.391998:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016143.392082:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247333986560:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4355us (4815us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016143.392094:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11850 00000100:00100000:3.0:1734016143.392671:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335428736:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016143.392706:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117726 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7392 expref: 12 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.392720:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117726 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7392 expref: 12 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.392739:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:3.0:1734016143.392774:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333986688:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4699us (5326us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016143.392785:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11851 00000100:00100000:0.0:1734016143.399842:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016143.400255:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333986816 00000100:00100000:3.0:1734016143.400278:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333986816 00000100:00100000:3.0:1734016143.400366:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11852 00000100:00100000:3.0:1734016143.400380:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:10406:x1818247333986816:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016143.400422:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016143.400471:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711772d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7399 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.400539:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271176d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e734c expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.400551:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016143.400555:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016143.400559:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711772d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [1122304->1130495] (req 1122304->1130495) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7399 expref: 12 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.400607:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271176d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e734c expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.400624:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271176d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e734c expref: 11 pid: 7682 timeout: 510 lvb_type: 0 00000100:00100000:3.0:1734016143.400646:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335428864:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016143.400755:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:0.0:1734016143.405705:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016143.407311:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335428864:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016143.407371:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711772d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [1122304->1130495] (req 1122304->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7399 expref: 12 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.407403:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016143.407526:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:10406:x1818247333986816:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7148us (7738us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016143.407539:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11852 00000100:00100000:1.0:1734016143.409190:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333986944 00000100:00100000:1.0:1734016143.409214:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333986944 00010000:00010000:1.0:1734016143.409294:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271176d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e734c expref: 12 pid: 7682 timeout: 510 lvb_type: 0 00000100:00100000:1.0:1734016143.409356:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3241 00000100:00100000:1.0:1734016143.409373:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073af4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247333986944:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016143.409409:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016143.409461:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271176d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e734c expref: 12 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:1.0:1734016143.409479:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271176d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e734c expref: 12 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:1.0:1734016143.409526:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc271176d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e734c expref: 12 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:1.0:1734016143.411671:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016143.411676:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016143.411697:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711772d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1130495) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7399 expref: 11 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016143.411710:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711772d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1130495) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7399 expref: 11 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016143.411826:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711772d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7399 expref: 11 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016143.411845:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335428992:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016143.411968:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92480 going to sleep for 11 seconds 00000100:00100000:1.0:1734016143.418671:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016143.420530:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012d4ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335428992:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016143.420562:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016143.420632:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073af4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247333986944:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 11261us (14950us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016143.420650:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3241 00000100:00100000:2.0:1734016143.420953:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333987200 00000100:00100000:2.0:1734016143.420964:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333987200 00002000:00100000:2.0:1734016143.421028:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (1122304->1126399) req@ffff880073946680 x1818247333987200/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 488/0 e 0 to 0 dl 1734016154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016143.421038:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073946680 with x1818247333987200 ext(1122304->1126399) 00002000:00010000:2.0:1734016143.421044:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073946680 00000100:00100000:2.0:1734016143.421068:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 8999 00000100:00100000:2.0:1734016143.421076:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333987200:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016143.421316:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333987200:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 240us (2666us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016143.421323:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 8999 00002000:00100000:2.0:1734016143.421328:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (1122304->1126399) req@ffff880073946680 x1818247333987200/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 488/4536 e 0 to 0 dl 1734016154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016143.421336:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073946680 with x1818247333987200 ext(1122304->1126399) 00002000:00010000:2.0:1734016143.421339:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073946680 00000100:00100000:0.0:1734016143.424966:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.425140:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333987456 00000100:00100000:2.0:1734016143.425159:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333987456 00002000:00100000:2.0:1734016143.425234:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (1126400->1130495) req@ffff880073af4700 x1818247333987456/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 488/0 e 0 to 0 dl 1734016154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016143.425247:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073af4700 with x1818247333987456 ext(1126400->1130495) 00002000:00010000:2.0:1734016143.425254:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073af4700 00000100:00100000:2.0:1734016143.425412:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9000 00000100:00100000:2.0:1734016143.425425:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333987456:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016143.426125:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333987456:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 699us (1184us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016143.426134:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9000 00002000:00100000:2.0:1734016143.426141:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (1126400->1130495) req@ffff880073af4700 x1818247333987456/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 488/4536 e 0 to 0 dl 1734016154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016143.426149:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073af4700 with x1818247333987456 ext(1126400->1130495) 00002000:00010000:2.0:1734016143.426152:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073af4700 00000100:00100000:0.0:1734016143.428899:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016143.429097:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333987584 00000100:00100000:3.0:1734016143.429111:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333987584 00000100:00100000:3.0:1734016143.429196:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11853 00000100:00100000:3.0:1734016143.429208:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333987584:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016143.429244:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016143.429282:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117734 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e73a0 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016143.429379:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335429120:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016143.429478:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016143.431637:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335429120:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016143.431694:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117734 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73a0 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.431719:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117734 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73a0 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.431759:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016143.431893:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333987584:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2686us (3013us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016143.431907:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11853 00000100:00100000:0.0:1734016143.435791:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016143.436143:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333987712 00000100:00100000:3.0:1734016143.436159:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333987712 00000100:00100000:3.0:1734016143.436270:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11854 00000100:00100000:3.0:1734016143.436281:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333987712:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016143.436316:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016143.436338:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711773b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e73a7 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016143.436418:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335429248:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016143.437111:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016143.440167:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335429248:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016143.440220:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711773b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73a7 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.440242:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711773b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73a7 expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.440272:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016143.442698:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333987712:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6391us (6897us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016143.442721:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11854 00000100:00100000:0.0:1734016143.456421:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.456557:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333987968 00000100:00100000:2.0:1734016143.456572:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333987968 00002000:00100000:2.0:1734016143.456631:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->3829759) req@ffff880073af5180 x1818247333987968/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:104/0 lens 488/0 e 0 to 0 dl 1734016154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016143.456643:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073af5180 with x1818247333987968 ext(0->3829759) 00002000:00010000:2.0:1734016143.456651:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073af5180 00000100:00100000:2.0:1734016143.456680:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9001 00000100:00100000:2.0:1734016143.456688:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333987968:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016143.522214:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247333987968:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 65503us (65788us total) trans 0 rc 3829760/3829760 00000100:00100000:3.0:1734016143.522237:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9001 00002000:00100000:3.0:1734016143.522256:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->3829759) req@ffff880073af5180 x1818247333987968/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:104/0 lens 488/440 e 0 to 0 dl 1734016154 ref 1 fl Complete:/200/0 rc 3829760/3829760 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016143.522269:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073af5180 with x1818247333987968 ext(0->3829759) 00002000:00010000:3.0:1734016143.522277:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073af5180 00000100:00100000:0.0:1734016143.528507:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016143.528750:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333988096 00000100:00100000:3.0:1734016143.528763:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333988096 00000100:00100000:2.0:1734016143.530029:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11855 00000100:00100000:2.0:1734016143.530043:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333988096:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.530079:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.530119:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117742 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e73ae expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.530219:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335429376:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016143.530350:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00002000:00010000:2.0:1734016143.535038:0:7682:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime: 1734016143 -> 1734016144 00002000:00010000:2.0:1734016143.535057:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016143 -> 1734016144 00000100:00100000:2.0:1734016143.535110:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335429376:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016143.535197:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117742 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73ae expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.535225:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117742 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73ae expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.535261:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016143.535380:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1981:x1818247333988096:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5335us (6905us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016143.535399:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11855 00000100:00100000:0.0:1734016143.541099:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.541359:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333988224 00000100:00100000:2.0:1734016143.541375:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333988224 00000100:00100000:2.0:1734016143.541457:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11856 00000100:00100000:2.0:1734016143.541469:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333988224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.541506:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.541536:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117749 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e73b5 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.541620:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335429504:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016143.541709:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016143.544467:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335429504:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016143.544551:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117749 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73b5 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.544580:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117749 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73b5 expref: 7 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.544609:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016143.544711:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247333988224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3240us (3625us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016143.544729:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11856 00000100:00100000:0.0:1734016143.547588:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.547749:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333988352 00000100:00100000:2.0:1734016143.547771:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333988352 00000100:00100000:2.0:1734016143.547931:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11857 00000100:00100000:2.0:1734016143.547942:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+6:10406:x1818247333988352:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.547990:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.548037:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117750 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e73bc expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.548111:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271176cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7345 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.548122:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016143.548124:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016143.548130:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117750 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2244608->2248703] (req 2244608->2248703) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73bc expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.548183:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271176cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7345 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.548206:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271176cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7345 expref: 5 pid: 7682 timeout: 510 lvb_type: 0 00000100:00100000:2.0:1734016143.548223:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335429632:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016143.549286:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016143.554522:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016143.554685:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335429632:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016143.554747:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117750 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [2244608->2248703] (req 2244608->2248703) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73bc expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.554777:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:3.0:1734016143.555328:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247333988352:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7386us (7756us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016143.555341:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11857 00000100:00100000:3.0:1734016143.555411:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333988480 00000100:00100000:3.0:1734016143.555420:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333988480 00002000:00100000:3.0:1734016143.555498:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1069056->1081343) req@ffff880075545180 x1818247333988480/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:104/0 lens 12776/0 e 0 to 0 dl 1734016154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016143.555511:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075545180 with x1818247333988480 ext(1069056->1081343) 00010000:00010000:3.0:1734016143.555523:0:7687:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271176cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7345 expref: 6 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1734016143.555540:0:7687:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271176cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7345 expref: 6 pid: 7682 timeout: 510 lvb_type: 0 00002000:00010000:3.0:1734016143.555550:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880075545180 00000100:00100000:3.0:1734016143.556162:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 298 00000100:00100000:3.0:1734016143.556170:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333988480:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016143.557515:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333988480:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1337us (3002us total) trans 4294968093 rc 0/0 00000100:00100000:3.0:1734016143.557526:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 298 00002000:00100000:3.0:1734016143.557539:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1069056->1081343) req@ffff880075545180 x1818247333988480/t4294968093(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:104/0 lens 12776/448 e 0 to 0 dl 1734016154 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016143.557551:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075545180 with x1818247333988480 ext(1069056->1081343) 00010000:00010000:3.0:1734016143.557564:0:7687:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271176cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7345 expref: 8 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1734016143.557579:0:7687:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271176cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7345 expref: 8 pid: 7682 timeout: 510 lvb_type: 0 00002000:00010000:3.0:1734016143.557587:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880075545180 00000100:00100000:0.0:1734016143.569115:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.569651:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333988608 00000100:00100000:2.0:1734016143.569668:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333988608 00010000:00010000:2.0:1734016143.569734:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271176cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7345 expref: 8 pid: 7682 timeout: 510 lvb_type: 0 00000100:00100000:2.0:1734016143.569785:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3242 00000100:00100000:2.0:1734016143.569797:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247333988608:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016143.569860:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1734016143.569886:0:6465:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 184 -> 208 00010000:00010000:2.0:1734016143.569894:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271176cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7345 expref: 8 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:2.0:1734016143.569908:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271176cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7345 expref: 8 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:2.0:1734016143.569936:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc271176cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7345 expref: 8 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:2.0:1734016143.569960:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016143.569963:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016143.569972:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117750 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2244608->2248703) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73bc expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.569983:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117750 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2244608->2248703) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73bc expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.570027:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117750 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2244608->2248703) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73bc expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.570044:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335429760:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016143.570153:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016143.575766:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335429760:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016143.575869:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016143.575951:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247333988608:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6154us (6853us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016143.575969:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3242 00000100:00100000:0.0:1734016143.585706:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016143.585873:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333988864 00000100:00100000:3.0:1734016143.585888:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333988864 00002000:00100000:3.0:1734016143.585960:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1904640->4194303) req@ffff880073af6300 x1818247333988864/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 488/0 e 0 to 0 dl 1734016154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016143.585973:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073af6300 with x1818247333988864 ext(1904640->4194303) 00002000:00010000:3.0:1734016143.585982:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073af6300 00000100:00100000:3.0:1734016143.586025:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9002 00000100:00100000:3.0:1734016143.586034:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073af6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333988864:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016143.621198:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073af6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333988864:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 35132us (35480us total) trans 0 rc 2289664/2289664 00000100:00100000:2.0:1734016143.621220:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9002 00002000:00100000:2.0:1734016143.621243:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1904640->4194303) req@ffff880073af6300 x1818247333988864/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 488/440 e 0 to 0 dl 1734016154 ref 1 fl Complete:/200/0 rc 2289664/2289664 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016143.621256:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073af6300 with x1818247333988864 ext(1904640->4194303) 00002000:00010000:2.0:1734016143.621265:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073af6300 00000100:00100000:0.0:1734016143.627788:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016143.628691:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333989120 00000100:00100000:3.0:1734016143.628706:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333989120 00000100:00100000:3.0:1734016143.628827:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11858 00000100:00100000:3.0:1734016143.628840:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333989120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016143.628877:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016143.628914:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27117757 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e73ca expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016143.629026:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335429888:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016143.629153:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016143.629252:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016143.631617:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333988992 00000100:00100000:1.0:1734016143.631632:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333988992 00000100:00100000:1.0:1734016143.631925:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11859 00000100:00100000:1.0:1734016143.631934:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333988992:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016143.631965:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016143.631991:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711775e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e73c3 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016143.632072:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073944e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335430016:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016143.633460:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00002000:00010000:3.0:1734016143.635742:0:7682:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016143 -> 1734016144 00002000:00010000:3.0:1734016143.635756:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016143 -> 1734016144 00002000:00010000:3.0:1734016143.635758:0:7682:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:3.0:1734016143.635790:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335429888:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016143.636111:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27117757 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73ca expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.636137:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27117757 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73ca expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.636705:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016143.636863:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333989120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8023us (9089us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016143.636879:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11858 00000100:00100000:1.0:1734016143.638242:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073944e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335430016:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016143.638282:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711775e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73c3 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016143.638296:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711775e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73c3 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016143.638321:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016143.638365:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333988992:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6430us (9112us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016143.638375:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11859 00010000:00010000:2.0:1734016143.639506:0:8958:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1734016143.642536:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016143.643032:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333989248 00000100:00100000:1.0:1734016143.643045:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333989248 00000100:00100000:1.0:1734016143.643241:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11860 00000100:00100000:1.0:1734016143.643252:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333989248:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016143.643278:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016143.643307:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117765 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e73d1 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016143.643359:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117750 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2244608->2248703) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73bc expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016143.643368:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016143.643371:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016143.643375:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117765 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [4952064->4956159] (req 4952064->4956159) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73d1 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016143.643421:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117750 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2244608->2248703) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73bc expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016143.643438:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117750 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2244608->2248703) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73bc expref: 6 pid: 7682 timeout: 510 lvb_type: 0 00000100:00100000:1.0:1734016143.643452:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073944e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335430144:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016143.643925:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016143.648464:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016143.649164:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073944e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335430144:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016143.649221:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117765 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [4952064->4956159] (req 4952064->4956159) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73d1 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016143.649248:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016143.649335:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247333989248:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6082us (6811us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016143.649348:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11860 00000100:00100000:2.0:1734016143.650098:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333989376 00000100:00100000:2.0:1734016143.650110:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333989376 00002000:00100000:2.0:1734016143.650181:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (2244608->2248703) req@ffff880073af6d80 x1818247333989376/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 4584/0 e 0 to 0 dl 1734016154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016143.650194:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073af6d80 with x1818247333989376 ext(2244608->2248703) 00010000:00010000:2.0:1734016143.650205:0:7687:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117750 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2244608->2248703) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73bc expref: 7 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:2.0:1734016143.650224:0:7687:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117750 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2244608->2248703) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73bc expref: 7 pid: 7682 timeout: 510 lvb_type: 0 00002000:00010000:2.0:1734016143.650236:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880073af6d80 00000100:00100000:2.0:1734016143.650274:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 299 00000100:00100000:2.0:1734016143.650282:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333989376:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016143.653628:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333989376:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 3316us (5170us total) trans 4294968094 rc 0/0 00000100:00100000:2.0:1734016143.653654:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 299 00002000:00100000:2.0:1734016143.653677:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (2244608->2248703) req@ffff880073af6d80 x1818247333989376/t4294968094(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 4584/448 e 0 to 0 dl 1734016154 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016143.653691:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073af6d80 with x1818247333989376 ext(2244608->2248703) 00010000:00010000:2.0:1734016143.653708:0:7687:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117750 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2244608->2248703) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73bc expref: 9 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:2.0:1734016143.653740:0:7687:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117750 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2244608->2248703) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73bc expref: 9 pid: 7682 timeout: 510 lvb_type: 0 00002000:00010000:2.0:1734016143.653750:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880073af6d80 00000100:00100000:0.0:1734016143.666042:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.666281:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333989504 00000100:00100000:2.0:1734016143.666302:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333989504 00010000:00010000:2.0:1734016143.666379:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117750 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2244608->2248703) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73bc expref: 9 pid: 7682 timeout: 510 lvb_type: 0 00000100:00100000:2.0:1734016143.666506:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3243 00000100:00100000:2.0:1734016143.666519:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073af7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333989504:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016143.666551:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1734016143.666587:0:6465:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 208 -> 216 00010000:00010000:2.0:1734016143.666595:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117750 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2244608->2248703) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73bc expref: 9 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:2.0:1734016143.666612:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117750 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2244608->2248703) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73bc expref: 9 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:2.0:1734016143.666655:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117750 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2244608->2248703) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73bc expref: 9 pid: 7682 timeout: 510 lvb_type: 0 00010000:00010000:2.0:1734016143.669649:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016143.669667:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016143.669708:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117765 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->4956159) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73d1 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.669726:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117765 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->4956159) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73d1 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.669850:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117765 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->4956159) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73d1 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.669893:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335430272:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016143.670086:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016143.675634:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335430272:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016143.675768:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016143.675879:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073af7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333989504:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9360us (9860us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016143.675896:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3243 00000100:00100000:0.0:1734016143.677528:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016143.677946:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333989632 00000100:00100000:1.0:1734016143.677965:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333989632 00000100:00100000:1.0:1734016143.678058:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11861 00000100:00100000:1.0:1734016143.678071:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073af7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333989632:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016143.679074:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5357521 -> 5357521 00002000:00010000:1.0:1734016143.679083:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016144 -> 1734016144 00002000:00010000:1.0:1734016143.679085:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016143 -> 1734016143 00002000:00010000:1.0:1734016143.679088:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016144 -> 1734016143 00002000:00010000:1.0:1734016143.679090:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 216 -> 224 00000100:00100000:1.0:1734016143.679212:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073af7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333989632:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1141us (1721us total) trans 4294968095 rc 0/0 00000100:00100000:1.0:1734016143.679226:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11861 00000100:00100000:0.0:1734016143.686723:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016143.686849:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333989760 00000100:00100000:1.0:1734016143.686863:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333989760 00000100:00100000:1.0:1734016143.686942:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11862 00000100:00100000:1.0:1734016143.686950:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333989760:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016143.686976:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016143.687001:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711776c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e73d8 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016143.687077:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073944e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335430400:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016143.689322:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016143.696649:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073944e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335430400:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016143.696716:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711776c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73d8 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016143.696737:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc2711776c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73d8 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016143.696777:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016143.696887:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333989760:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9935us (10179us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016143.696899:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11862 00000100:00100000:2.0:1734016143.700866:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016143.701240:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333989888 00000100:00100000:1.0:1734016143.701256:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333989888 00000100:00100000:1.0:1734016143.701330:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11863 00000100:00100000:1.0:1734016143.701341:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333989888:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016143.701373:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016143.701404:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27117773 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e73df expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016143.701504:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073944e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335430528:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016143.703755:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016143.712354:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073944e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335430528:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016143.712438:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27117773 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73df expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016143.712460:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27117773 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73df expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016143.712500:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016143.713932:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333989888:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12581us (13075us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016143.713948:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11863 00000100:00100000:1.0:1734016143.720140:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.720306:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333990016 00000100:00100000:2.0:1734016143.720326:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333990016 00000100:00100000:2.0:1734016143.720442:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11864 00000100:00100000:2.0:1734016143.720462:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333990016:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.720509:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.720543:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711777a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e73e6 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.720631:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335430656:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016143.721921:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00002000:00010000:2.0:1734016143.724228:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016143 -> 1734016144 00000100:00100000:2.0:1734016143.724274:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335430656:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016143.724330:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711777a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73e6 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.724348:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711777a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73e6 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.724428:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016143.725105:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333990016:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4645us (4978us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016143.725125:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11864 00000100:00100000:0.0:1734016143.729282:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.729455:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333990144 00000100:00100000:2.0:1734016143.729475:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333990144 00000100:00100000:2.0:1734016143.729651:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11865 00000100:00100000:2.0:1734016143.729666:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333990144:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.729703:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.729743:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117781 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e73ed expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.729798:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117765 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->4956159) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73d1 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.729840:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016143.729843:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016143.729847:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117781 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73ed expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.729950:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117765 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->4956159) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73d1 expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.729964:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117765 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->4956159) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73d1 expref: 8 pid: 7684 timeout: 510 lvb_type: 0 00000100:00100000:2.0:1734016143.731377:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335430784:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016143.731497:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00000100:00100000:0.0:1734016143.736553:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016143.736652:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333990272 00000100:00100000:3.0:1734016143.736663:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333990272 00010000:00010000:3.0:1734016143.736728:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117765 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->4956159) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73d1 expref: 9 pid: 7684 timeout: 510 lvb_type: 0 00000100:00100000:3.0:1734016143.736786:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3244 00000100:00100000:3.0:1734016143.736795:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247333990272:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016143.736865:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016143.736898:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117765 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->4956159) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73d1 expref: 9 pid: 7684 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1734016143.736917:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117765 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->4956159) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73d1 expref: 9 pid: 7684 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1734016143.736964:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016143.736968:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016143.736980:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117781 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 872448->876543) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73ed expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.736994:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 872448->876543) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73ed expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.737045:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 872448->876543) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73ed expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016143.737060:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335430912:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016143.737182:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00010000:00010000:2.0:1734016143.737494:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117765 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->4956159) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73d1 expref: 9 pid: 7684 timeout: 510 lvb_type: 0 00000100:00100000:2.0:1734016143.738527:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335430784:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016143.738574:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 872448->876543) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73ed expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.738591:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016143.739552:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247333990144:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9881us (10280us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016143.739567:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11865 00000100:00100000:3.0:1734016143.741499:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335430912:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016143.741543:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016143.741632:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247333990272:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4836us (5101us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016143.741648:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3244 00000100:00100000:0.0:1734016143.762163:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016143.762254:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016143.762753:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333990528 00000100:00100000:1.0:1734016143.762771:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333990528 00002000:00100000:1.0:1734016143.762880:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (872448->876543) req@ffff880073b5c000 x1818247333990528/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 488/0 e 0 to 0 dl 1734016154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016143.762891:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b5c000 with x1818247333990528 ext(872448->876543) 00002000:00010000:1.0:1734016143.762898:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b5c000 00000100:00100000:1.0:1734016143.762946:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333990784 00000100:00100000:1.0:1734016143.762949:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333990784 00002000:00100000:1.0:1734016143.762966:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (0->4194303) req@ffff880073b5c380 x1818247333990784/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 504/0 e 0 to 0 dl 1734016154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016143.762974:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b5c380 with x1818247333990784 ext(0->4194303) 00002000:00010000:1.0:1734016143.762978:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b5c380 00000100:00100000:1.0:1734016143.763004:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9003 00000100:00100000:1.0:1734016143.763015:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333990528:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016143.763028:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9004 00000100:00100000:3.0:1734016143.763036:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333990784:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016143.763339:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247333990528:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 324us (1200us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016143.763349:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9003 00002000:00100000:1.0:1734016143.763357:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (872448->876543) req@ffff880073b5c000 x1818247333990528/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 488/4536 e 0 to 0 dl 1734016154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016143.763364:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b5c000 with x1818247333990528 ext(872448->876543) 00002000:00010000:1.0:1734016143.763367:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b5c000 00000100:00100000:0.0:1734016143.765745:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.765849:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333990912 00000100:00100000:2.0:1734016143.765865:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333990912 00002000:00100000:2.0:1734016143.765941:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (872448->876543) req@ffff880073b5c700 x1818247333990912/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 4584/0 e 0 to 0 dl 1734016154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016143.765955:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b5c700 with x1818247333990912 ext(872448->876543) 00002000:00010000:2.0:1734016143.765962:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b5c700 00000100:00100000:2.0:1734016143.765996:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9005 00000100:00100000:2.0:1734016143.766007:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247333990912:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016143.769107:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247333990912:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 3069us (3351us total) trans 4294968096 rc 0/0 00000100:00100000:2.0:1734016143.769134:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9005 00002000:00100000:2.0:1734016143.769166:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (872448->876543) req@ffff880073b5c700 x1818247333990912/t4294968096(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 4584/448 e 0 to 0 dl 1734016154 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016143.769180:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b5c700 with x1818247333990912 ext(872448->876543) 00002000:00010000:2.0:1734016143.769192:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b5c700 00000100:00100000:0.0:1734016143.772408:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.773735:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333991040 00000100:00100000:2.0:1734016143.773754:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333991040 00000100:00100000:2.0:1734016143.775299:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2377 00000100:00100000:2.0:1734016143.775321:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+22:10406:x1818247333991040:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:2.0:1734016143.775594:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+22:10406:x1818247333991040:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 278us (3209us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016143.775604:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2377 00000100:00100000:0.0:1734016143.777938:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.789357:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333991168 00000100:00100000:2.0:1734016143.789381:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333991168 00000100:00100000:2.0:1734016143.789505:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11866 00000100:00100000:2.0:1734016143.789516:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247333991168:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016143.798565:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968096 is committed 00000001:00080000:0.0:1734016143.798593:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968095 is committed 00000100:00100000:2.0:1734016143.799181:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247333991168:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 9655us (21260us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016143.799198:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11866 00000100:00100000:0.0:1734016143.803979:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.804405:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333991424 00000100:00100000:2.0:1734016143.804424:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333991424 00002000:00100000:2.0:1734016143.804509:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1105920->5357567) req@ffff880073b5d180 x1818247333991424/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 504/0 e 0 to 0 dl 1734016154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016143.804523:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b5d180 with x1818247333991424 ext(1105920->5357567) 00002000:00010000:2.0:1734016143.804530:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b5d180 00000100:00100000:2.0:1734016143.804573:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9006 00000100:00100000:2.0:1734016143.804582:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333991424:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016143.839512:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247333991424:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 34895us (35517us total) trans 0 rc 1167360/1167360 00000100:00100000:2.0:1734016143.839536:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9006 00002000:00100000:2.0:1734016143.839557:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1105920->5357567) req@ffff880073b5d180 x1818247333991424/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 504/440 e 0 to 0 dl 1734016154 ref 1 fl Complete:/200/0 rc 1167360/1167360 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016143.839572:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b5d180 with x1818247333991424 ext(1105920->5357567) 00002000:00010000:2.0:1734016143.839580:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b5d180 00000100:00100000:0.0:1734016143.858406:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.858859:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333991680 00000100:00100000:2.0:1734016143.858877:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333991680 00002000:00100000:2.0:1734016143.858957:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1110016->1114111) req@ffff880073b5d500 x1818247333991680/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 488/0 e 0 to 0 dl 1734016154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016143.858969:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b5d500 with x1818247333991680 ext(1110016->1114111) 00002000:00010000:2.0:1734016143.858977:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b5d500 00000100:00100000:2.0:1734016143.859006:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9007 00000100:00100000:2.0:1734016143.859013:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333991680:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016143.859231:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333991680:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 218us (851us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016143.859238:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9007 00002000:00100000:2.0:1734016143.859244:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1110016->1114111) req@ffff880073b5d500 x1818247333991680/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 488/4536 e 0 to 0 dl 1734016154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016143.859251:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b5d500 with x1818247333991680 ext(1110016->1114111) 00002000:00010000:2.0:1734016143.859254:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b5d500 00000100:00100000:3.0:1734016143.862545:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247333990784:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 99485us (100267us total) trans 0 rc 4186112/4186112 00000100:00100000:3.0:1734016143.862571:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9004 00002000:00100000:3.0:1734016143.862597:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (0->4194303) req@ffff880073b5c380 x1818247333990784/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:104/0 lens 504/440 e 0 to 0 dl 1734016154 ref 1 fl Complete:/200/0 rc 4186112/4186112 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016143.862610:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b5c380 with x1818247333990784 ext(0->4194303) 00002000:00010000:3.0:1734016143.862621:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b5c380 00000100:00100000:2.0:1734016143.863142:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016143.863430:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333991936 00000100:00100000:0.0:1734016143.863445:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333991936 00000100:00100000:0.0:1734016143.863578:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2378 00000100:00100000:0.0:1734016143.863588:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+22:10406:x1818247333991936:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016143.863690:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016143.863745:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271176ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e735a expref: 22 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016143.864747:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:0.0:1734016143.864755:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016143.865176:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117788 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016143.865200:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271176e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7353 expref: 23 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.865213:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117788 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016143.865262:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271176e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7353 expref: 23 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.865282:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271176e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7353 expref: 23 pid: 13956 timeout: 510 lvb_type: 0 00000100:00100000:2.0:1734016143.865296:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335431040:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016143.866703:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016143.881884:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335431040:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016143.881928:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117788 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016143.882025:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016143.883069:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333992064 00000100:00100000:3.0:1734016143.883083:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333992064 00010000:00010000:3.0:1734016143.883129:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271176e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7353 expref: 24 pid: 13956 timeout: 510 lvb_type: 0 00000100:00100000:3.0:1734016143.883971:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3245 00000100:00100000:3.0:1734016143.883981:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:1981:x1818247333992064:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016143.884006:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016143.884017:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271176e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7353 expref: 24 pid: 13956 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1734016143.884033:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271176e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7353 expref: 24 pid: 13956 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1734016143.884068:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc271176e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7353 expref: 24 pid: 13956 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1734016143.884110:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016143.884116:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117788 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016143.884128:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016143.884138:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117788 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016143.885857:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117788 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016143.885878:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117788 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:2.0:1734016143.886060:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968843 00000004:00010000:2.0:1734016143.886151:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075545c00 reply state ffff880075209000 transno 4294968844 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117788 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016143.886162:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016143.886367:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+24:10406:x1818247333991936:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 22774us (23221us total) trans 4294968844 rc 0/0 00000100:00100000:2.0:1734016143.886379:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2378 00010000:00010000:3.0:1734016143.886668:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016143.886719:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:1981:x1818247333992064:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 2735us (4693us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016143.886730:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3245 00000020:00080000:2.0:1734016143.888240:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016143.888959:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016143.889029:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1734016143.889159:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016143.889175:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117788 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016143.889184:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117788 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016143.889191:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbf180 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016143.889208:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117788 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016143.889219:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117788 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016143.889251:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016143.889256:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016143.889263:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117788 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016143.889270:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117788 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016143.889434:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333992192 00000100:00100000:1.0:1734016143.889451:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333992192 00002000:00010000:1.0:1734016143.889528:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00000100:00100000:2.0:1734016143.889530:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333992320 00002000:00100000:1.0:1734016143.889535:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b5dc00 with x1818247333992192 ext(4194304->18446744073709551615) 00000100:00100000:2.0:1734016143.889535:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333992320 00002000:00010000:1.0:1734016143.889556:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b5dc00. 00002000:00010000:2.0:1734016143.889559:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (2800218->18446744073709551615) 00002000:00100000:2.0:1734016143.889564:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b5df80 with x1818247333992320 ext(2800218->18446744073709551615) 00002000:00010000:2.0:1734016143.889579:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b5df80. 00000100:00100000:1.0:1734016143.889598:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9008 00000100:00100000:1.0:1734016143.889610:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247333992192:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:2.0:1734016143.889615:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9009 00000100:00100000:2.0:1734016143.889621:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247333992320:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016143.891175:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 4194304 -> 2800218 00002000:00010000:2.0:1734016143.891185:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016144 -> 1734016144 00002000:00010000:2.0:1734016143.891187:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016143 -> 1734016142 00002000:00010000:2.0:1734016143.891190:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016144 -> 1734016144 00002000:00010000:2.0:1734016143.891193:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 1 -> 0 00000100:00100000:2.0:1734016143.891288:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333992320:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1660us (2253us total) trans 4294969550 rc 0/0 00002000:00010000:1.0:1734016143.891301:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5357521 -> 4194304 00000100:00100000:2.0:1734016143.891303:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9009 00002000:00010000:1.0:1734016143.891306:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016144 -> 1734016144 00002000:00010000:1.0:1734016143.891308:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016143 -> 1734016143 00002000:00010000:2.0:1734016143.891310:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (2800218->18446744073709551615) 00002000:00010000:1.0:1734016143.891312:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016144 -> 1734016144 00002000:00010000:1.0:1734016143.891314:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 224 -> 200 00002000:00100000:2.0:1734016143.891316:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b5df80 with x1818247333992320 ext(2800218->18446744073709551615) 00002000:00010000:2.0:1734016143.891325:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b5df80. 00000100:00100000:1.0:1734016143.891345:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333992192:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1736us (2400us total) trans 4294968097 rc 0/0 00000100:00100000:1.0:1734016143.891353:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9008 00002000:00010000:1.0:1734016143.891356:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:1.0:1734016143.891359:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b5dc00 with x1818247333992192 ext(4194304->18446744073709551615) 00002000:00010000:1.0:1734016143.891365:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b5dc00. 00000100:00100000:0.0:1734016143.896253:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.898341:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333992448 00000100:00100000:2.0:1734016143.898367:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333992448 00000100:00100000:0.0:1734016143.900026:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2379 00000100:00100000:0.0:1734016143.900046:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:10406:x1818247333992448:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016143.900162:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016143.900204:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc2711778f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e73f4 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016143.900352:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27117796 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016143.900371:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27117796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016143.900383:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27117796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:1.0:1734016143.900414:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 6994522 00000004:00200000:1.0:1734016143.900418:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016143.900439:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27117796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016143.900467:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc2711778f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73f4 expref: 25 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016143.900496:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27117796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73f4 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016143.900511:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016143.900514:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016143.900518:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016143.900603:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:10406:x1818247333992448:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 563us (4365us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016143.900611:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2379 00000100:00100000:0.0:1734016143.903113:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016143.903194:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.904093:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333992704 00000100:00100000:2.0:1734016143.904118:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333992704 00000100:00100000:2.0:1734016143.904197:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333992576 00000100:00100000:2.0:1734016143.904203:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333992576 00000100:00100000:2.0:1734016143.904232:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11867 00000100:00100000:3.0:1734016143.904244:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11868 00000100:00100000:2.0:1734016143.904246:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333992704:12345-192.168.201.16@tcp:101:fsx.0 00000100:00100000:3.0:1734016143.904255:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333992576:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.904285:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016143.904285:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.904321:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271177a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7402 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.904321:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc2711779d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e73fb expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.904428:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335431168:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016143.904428:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335431296:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016143.904560:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:3.0:1734016143.906758:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016143.917392:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335431296:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016143.917481:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc2711779d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73fb expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016143.917510:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc2711779d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73fb expref: 6 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016143.917569:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:0.0:1734016143.917700:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333992576:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 13441us (14501us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016143.917715:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11868 00002000:00010000:2.0:1734016143.917925:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016142 -> 1734016143 00002000:00010000:2.0:1734016143.917933:0:7684:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:2.0:1734016143.917955:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335431168:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016143.917987:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271177a4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7402 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.917998:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc271177a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7402 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.918019:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016143.918048:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333992704:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 13806us (14957us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016143.918055:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11867 00000100:00100000:0.0:1734016143.927533:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016143.927631:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.927751:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333992960 00000100:00100000:2.0:1734016143.927776:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333992960 00000100:00100000:2.0:1734016143.927902:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333992832 00000100:00100000:2.0:1734016143.927906:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333992832 00000100:00100000:2.0:1734016143.927965:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11869 00000100:00100000:2.0:1734016143.927978:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333992960:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.928031:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1734016143.928037:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11870 00000100:00100000:3.0:1734016143.928048:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333992832:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016143.928063:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.928076:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc271177ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7410 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.928088:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271177b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7409 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.928204:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335431424:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016143.928204:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335431552:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016143.929064:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016143.929413:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016143.931243:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335431552:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016143.931296:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271177b2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7409 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.931317:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271177b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7409 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.931351:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016143.931435:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333992832:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3383us (3799us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016143.931449:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11870 00000100:00100000:2.0:1734016143.942764:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335431424:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016143.942849:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc271177ab lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7410 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.942868:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc271177ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7410 expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.942905:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016143.943013:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333992960:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 15037us (15507us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016143.943026:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11869 00000100:00100000:0.0:1734016143.951663:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016143.951768:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.952000:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333993216 00000100:00100000:2.0:1734016143.952019:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333993216 00000100:00100000:2.0:1734016143.952097:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333993088 00000100:00100000:2.0:1734016143.952100:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333993088 00000100:00100000:2.0:1734016143.952128:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11871 00000100:00100000:2.0:1734016143.952140:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333993216:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.952179:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.952218:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271177b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e741e expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.952323:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335431680:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016143.952426:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016143.952478:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11872 00000100:00100000:3.0:1734016143.952495:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333993088:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016143.952508:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016143.952525:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc271177c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7417 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016143.952568:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335431808:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016143.952613:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016143.962420:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335431680:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016143.962421:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335431808:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016143.962502:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271177b9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e741e expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.962502:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc271177c0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7417 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.962523:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc271177b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e741e expref: 12 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.962523:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc271177c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7417 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.962610:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00010000:00010000:3.0:1734016143.962613:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016143.962691:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333993088:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10191us (10918us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016143.962705:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11872 00000100:00100000:2.0:1734016143.968187:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333993216:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 16009us (16509us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016143.968212:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11871 00000100:00100000:0.0:1734016143.981514:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.984683:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333993344 00000100:00100000:2.0:1734016143.984720:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333993344 00000100:00100000:1.0:1734016143.984748:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.986023:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333993472 00000100:00100000:2.0:1734016143.986036:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333993472 00000100:00100000:2.0:1734016143.986089:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11873 00000100:00100000:2.0:1734016143.986104:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333993344:12345-192.168.201.16@tcp:101:fsx.0 00000100:00100000:3.0:1734016143.986139:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11874 00000100:00100000:3.0:1734016143.986148:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1983:x1818247333993472:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016143.986151:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016143.986165:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016143.986190:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271177c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7425 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016143.986201:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271177ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e742c expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016143.986282:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335432064:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016143.986296:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335431936:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016143.986476:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e780 going to sleep for 11 seconds 00000100:00100000:2.0:1734016143.986571:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016143.992905:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335431936:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016143.992977:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271177ce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e742c expref: 12 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016143.993001:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc271177ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e742c expref: 12 pid: 7683 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1734016143.993014:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335432064:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016143.993026:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00010000:00010000:2.0:1734016143.993042:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271177c7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7425 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.993054:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271177c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7425 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016143.993070:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:3.0:1734016143.993085:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1983:x1818247333993472:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6935us (8345us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016143.993093:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1983:x1818247333993344:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6994us (11643us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016143.993096:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11874 00000100:00100000:2.0:1734016143.993100:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11873 00000100:00100000:0.0:1734016143.995718:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016143.995953:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333993728 00000100:00100000:2.0:1734016143.995976:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333993728 00000100:00100000:2.0:1734016143.996095:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2380 00000100:00100000:2.0:1734016143.996109:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+23:10406:x1818247333993728:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016143.996647:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271177d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016143.996678:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27117796 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73f4 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.996689:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271177d5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016143.996766:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27117796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73f4 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016143.996788:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27117796 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73f4 expref: 23 pid: 6479 timeout: 511 lvb_type: 0 00000100:00100000:2.0:1734016143.996851:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335432192:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016143.999391:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706900 going to sleep for 11 seconds 00000100:00100000:2.0:1734016144.002429:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335432192:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016144.002496:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271177d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016144.002560:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.003857:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333993856 00000100:00100000:3.0:1734016144.004173:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333993856 00010000:00010000:3.0:1734016144.004301:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27117796 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73f4 expref: 24 pid: 6479 timeout: 511 lvb_type: 0 00000100:00080000:0.0:1734016144.004387:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016114 00000100:00100000:3.0:1734016144.004718:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3246 00000100:00100000:3.0:1734016144.004732:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:1982:x1818247333993856:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016144.004770:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016144.004781:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27117796 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73f4 expref: 24 pid: 6479 timeout: 511 lvb_type: 0 00010000:00010000:3.0:1734016144.004846:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27117796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73f4 expref: 24 pid: 6479 timeout: 511 lvb_type: 0 00010000:00010000:3.0:1734016144.004891:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d440/0x5e3a3adc27117796 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73f4 expref: 24 pid: 6479 timeout: 511 lvb_type: 0 00010000:00010000:3.0:1734016144.004925:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016144.004933:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271177d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016144.004950:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271177d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016144.004960:0:6465:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271177d5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016144.005663:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016144.005833:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:1982:x1818247333993856:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1100us (3270us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016144.005849:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3246 00010000:00010000:2.0:1734016144.006634:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271177d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016144.006646:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271177d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:2.0:1734016144.008619:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968845 00000004:00010000:2.0:1734016144.008828:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880073b5fb80 reply state ffff880075576000 transno 4294968846 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271177d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016144.008847:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016144.010615:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+26:10406:x1818247333993728:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 14473us (14888us total) trans 4294968846 rc 0/0 00000100:00100000:3.0:1734016144.010633:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2380 00000020:00080000:3.0:1734016144.010648:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016144.017493:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.017562:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.017632:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333993984 00000100:00100000:0.0:1734016144.017645:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333993984 00002000:00010000:0.0:1734016144.017705:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (2805133->18446744073709551615) 00002000:00100000:0.0:1734016144.017710:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b5d880 with x1818247333993984 ext(2805133->18446744073709551615) 00002000:00010000:0.0:1734016144.017732:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b5d880. 00000100:00100000:0.0:1734016144.017783:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333994112 00000100:00100000:0.0:1734016144.017785:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333994112 00002000:00010000:0.0:1734016144.017826:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:0.0:1734016144.017829:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b5ce00 with x1818247333994112 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016144.017839:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b5ce00. 00000100:00100000:0.0:1734016144.017862:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9010 00000100:00100000:0.0:1734016144.017873:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333993984:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016144.019680:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 2805133 00002000:00010000:0.0:1734016144.019693:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016144 -> 1734016144 00002000:00010000:0.0:1734016144.019697:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016143 -> 1734016143 00002000:00010000:0.0:1734016144.019699:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016144 -> 1734016144 00002000:00010000:0.0:1734016144.019703:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 200 -> 184 00000100:00100000:0.0:1734016144.019859:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333993984:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1981us (2390us total) trans 4294968098 rc 0/0 00000100:00100000:0.0:1734016144.019872:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9010 00002000:00010000:0.0:1734016144.019885:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (2805133->18446744073709551615) 00002000:00100000:0.0:1734016144.019891:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b5d880 with x1818247333993984 ext(2805133->18446744073709551615) 00002000:00010000:0.0:1734016144.019899:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b5d880. 00000100:00100000:0.0:1734016144.019956:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9011 00000100:00100000:0.0:1734016144.019972:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333994112:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016144.023165:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 2800218 -> 0 00002000:00010000:0.0:1734016144.023182:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016144 -> 1734016144 00002000:00010000:0.0:1734016144.023186:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016143 -> 1734016142 00002000:00010000:0.0:1734016144.023188:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016144 -> 1734016144 00002000:00010000:0.0:1734016144.023191:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 1 -> 0 00000100:00100000:0.0:1734016144.023318:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333994112:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 3336us (5740us total) trans 4294969551 rc 0/0 00000100:00100000:0.0:1734016144.023335:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9011 00002000:00010000:0.0:1734016144.023346:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:0.0:1734016144.023350:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b5ce00 with x1818247333994112 ext(0->18446744073709551615) 00002000:00010000:0.0:1734016144.023359:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b5ce00. 00000100:00080000:0.0:1734016144.023438:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016114 00000100:00080000:0.0:1734016144.023445:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016114 00010000:00010000:2.0:1734016144.023696:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271177d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016144.023712:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271177d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016144.023722:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271177d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016144.023730:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbe1c0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016144.023737:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271177d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016144.023747:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271177d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016144.023769:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016144.023773:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016144.023778:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271177d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016144.023785:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc271177d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:0.0:1734016144.041610:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.043820:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333994240 00000100:00100000:3.0:1734016144.043850:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333994240 00000100:00100000:3.0:1734016144.043972:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2381 00000100:00100000:3.0:1734016144.043986:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+23:10406:x1818247333994240:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016144.044034:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016144.044073:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271177dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7433 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016144.044225:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271177e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016144.044250:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271177e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016144.044268:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271177e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:3.0:1734016144.044300:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 2805133 00000004:00200000:3.0:1734016144.044305:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016144.044330:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271177e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016144.044362:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc271177dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7433 expref: 25 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016144.044399:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271177e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7433 expref: 24 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016144.044412:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016144.044415:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016144.044420:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016144.049314:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:10406:x1818247333994240:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5290us (7694us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016144.049343:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2381 00000100:00100000:1.0:1734016144.053036:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.053131:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.053317:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333994368 00000100:00100000:2.0:1734016144.053333:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333994368 00000100:00100000:2.0:1734016144.053402:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333994496 00000100:00100000:2.0:1734016144.053404:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333994496 00000100:00100000:2.0:1734016144.053431:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11875 00000100:00100000:2.0:1734016144.053442:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333994368:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016144.053478:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016144.053517:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271177ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e743a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016144.053614:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335432320:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016144.053718:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016144.054001:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11876 00000100:00100000:3.0:1734016144.054011:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333994496:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016144.054024:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016144.054043:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271177f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7441 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016144.054094:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335432448:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016144.054134:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e300 going to sleep for 11 seconds 00000100:00080000:1.0:1734016144.054220:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016114 00000100:00080000:1.0:1734016144.054226:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016114 00002000:00010000:3.0:1734016144.064246:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016142 -> 1734016143 00000100:00100000:3.0:1734016144.064295:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335432448:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016144.064353:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271177f1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7441 expref: 12 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.064373:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc271177f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7441 expref: 12 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.064401:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016144.064491:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247333994496:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10469us (11347us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016144.064504:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11876 00000100:00100000:2.0:1734016144.065303:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335432320:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016144.065346:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271177ea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e743a expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.065361:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271177ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e743a expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.065390:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016144.065422:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247333994368:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11983us (12412us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016144.065433:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11875 00000100:00100000:3.0:1734016144.072342:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.072771:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.073237:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333994624 00000100:00100000:2.0:1734016144.073254:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333994624 00000100:00100000:2.0:1734016144.073315:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333994752 00000100:00100000:2.0:1734016144.073318:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333994752 00000100:00100000:2.0:1734016144.073342:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11877 00000100:00100000:2.0:1734016144.073354:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333994624:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016144.073393:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016144.073423:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271177f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7448 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016144.073513:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335432576:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016144.073685:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11878 00000100:00100000:3.0:1734016144.073693:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333994752:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016144.073707:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016144.073724:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271177ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e744f expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016144.073760:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335432704:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016144.074396:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016144.074472:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e300 going to sleep for 11 seconds 00000100:00100000:2.0:1734016144.077918:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335432576:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016144.078009:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271177f8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7448 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.078034:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271177f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7448 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.078069:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016144.078836:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247333994624:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5476us (6504us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016144.078851:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11877 00000100:00100000:0.0:1734016144.082311:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335432704:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016144.082378:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271177ff lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e744f expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016144.082399:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271177ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e744f expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016144.083583:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:1.0:1734016144.083978:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247333994752:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10271us (11194us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016144.083996:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11878 00000100:00100000:0.0:1734016144.089470:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.089661:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333995008 00000100:00100000:2.0:1734016144.089681:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333995008 00000100:00100000:2.0:1734016144.089790:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2382 00000100:00100000:2.0:1734016144.089849:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+24:10406:x1818247333995008:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016144.089985:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016144.090051:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc271177e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7433 expref: 24 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.090110:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016144.090117:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016144.090491:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117806 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016144.090513:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117806 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016144.090526:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117806 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:2.0:1734016144.090593:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968847 00000004:00010000:2.0:1734016144.090618:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88007bd29f80 reply state ffff880075575000 transno 4294968848 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117806 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016144.090626:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016144.090773:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+26:10406:x1818247333995008:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 972us (1327us total) trans 4294968848 rc 0/0 00000100:00100000:2.0:1734016144.090780:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2382 00000020:00080000:2.0:1734016144.090787:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016144.096285:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:3.0:1734016144.096885:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117806 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016144.096907:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117806 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016144.096916:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117806 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016144.096924:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc900 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016144.096932:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117806 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016144.096942:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117806 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016144.096975:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016144.096979:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016144.096985:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117806 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016144.096992:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117806 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:1.0:1734016144.097124:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333995136 00000100:00100000:1.0:1734016144.097142:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333995136 00000100:00100000:1.0:1734016144.097551:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11879 00000100:00100000:1.0:1734016144.097569:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:10406:x1818247333995136:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016144.097607:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016144.097654:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc2711780d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7456 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.097723:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117781 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 872448->876543) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73ed expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.097735:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016144.097742:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016144.097747:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc2711780d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7456 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.097955:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117781 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 872448->876543) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73ed expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.097972:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 872448->876543) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73ed expref: 8 pid: 7684 timeout: 511 lvb_type: 0 00000100:00100000:1.0:1734016144.097992:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073945c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335432832:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016144.098170:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92d80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016144.103362:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073945c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335432832:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016144.103434:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc2711780d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7456 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016144.103476:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016144.104040:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247333995136:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6471us (7778us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016144.104057:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11879 00000100:00100000:0.0:1734016144.105194:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.105506:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333995264 00000100:00100000:3.0:1734016144.105526:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333995264 00010000:00010000:3.0:1734016144.105587:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 872448->876543) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73ed expref: 9 pid: 7684 timeout: 511 lvb_type: 0 00000100:00100000:3.0:1734016144.106169:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3247 00000100:00100000:3.0:1734016144.106183:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333995264:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016144.106219:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016144.106264:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 872448->876543) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73ed expref: 9 pid: 7684 timeout: 511 lvb_type: 0 00010000:00010000:3.0:1734016144.106280:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117781 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 872448->876543) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73ed expref: 9 pid: 7684 timeout: 511 lvb_type: 0 00010000:00010000:3.0:1734016144.106330:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117781 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 872448->876543) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e73ed expref: 9 pid: 7684 timeout: 511 lvb_type: 0 00010000:00010000:3.0:1734016144.106372:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016144.106376:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016144.106386:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc2711780d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7456 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016144.106400:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc2711780d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7456 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016144.106459:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc2711780d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7456 expref: 5 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016144.106477:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335432960:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016144.106597:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016144.111926:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335432960:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016144.111977:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016144.112615:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333995264:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6430us (7427us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016144.112633:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3247 00000100:00100000:0.0:1734016144.113083:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.113569:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333995392 00000100:00100000:1.0:1734016144.113584:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333995392 00000100:00100000:1.0:1734016144.113643:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11880 00000100:00100000:1.0:1734016144.113654:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:10406:x1818247333995392:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016144.113699:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016144.113740:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27117814 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e745d expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.113791:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711772d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7399 expref: 13 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.113831:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016144.113835:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016144.113839:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27117814 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e745d expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.113896:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711772d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1130495) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7399 expref: 13 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.113911:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711772d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1130495) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7399 expref: 13 pid: 7683 timeout: 511 lvb_type: 0 00000100:00100000:1.0:1734016144.113925:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073946300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335433088:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016144.114002:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92300 going to sleep for 11 seconds 00000100:00100000:1.0:1734016144.118261:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073946300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335433088:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016144.118319:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27117814 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e745d expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.118354:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016144.118422:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:10406:x1818247333995392:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4769us (5340us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016144.118438:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11880 00000100:00100000:0.0:1734016144.119798:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.120291:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333995520 00000100:00100000:3.0:1734016144.120305:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333995520 00010000:00010000:3.0:1734016144.120358:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711772d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7399 expref: 14 pid: 7683 timeout: 511 lvb_type: 0 00000100:00100000:3.0:1734016144.120413:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3248 00000100:00100000:3.0:1734016144.120423:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e774000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247333995520:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016144.120445:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016144.120475:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711772d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7399 expref: 14 pid: 7683 timeout: 511 lvb_type: 0 00010000:00010000:3.0:1734016144.120502:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711772d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->1130495) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7399 expref: 14 pid: 7683 timeout: 511 lvb_type: 0 00010000:00010000:3.0:1734016144.120541:0:6465:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711772d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->1130495) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7399 expref: 14 pid: 7683 timeout: 511 lvb_type: 0 00010000:00010000:3.0:1734016144.120567:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016144.120572:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016144.120581:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27117814 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e745d expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016144.120592:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27117814 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e745d expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016144.120640:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27117814 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e745d expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016144.120662:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335433216:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016144.120741:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016144.130005:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6465:1818247335433216:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016144.130051:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016144.130161:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e774000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333995520:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9736us (10374us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016144.130184:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3248 00000100:00100000:0.0:1734016144.131422:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.131505:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.131692:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333995776 00000100:00100000:3.0:1734016144.131712:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333995776 00002000:00010000:3.0:1734016144.131779:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (2728624->18446744073709551615) 00002000:00100000:3.0:1734016144.131784:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e775c00 with x1818247333995776 ext(2728624->18446744073709551615) 00002000:00010000:3.0:1734016144.131850:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e775c00. 00000100:00100000:3.0:1734016144.131898:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333995648 00000100:00100000:3.0:1734016144.131901:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333995648 00002000:00010000:3.0:1734016144.131916:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:3.0:1734016144.131919:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e774700 with x1818247333995648 ext(4194304->18446744073709551615) 00002000:00010000:3.0:1734016144.131932:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e774700. 00000100:00100000:3.0:1734016144.131952:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9012 00000100:00100000:3.0:1734016144.131962:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247333995776:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016144.132375:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 2728624 00002000:00010000:3.0:1734016144.132379:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016144 -> 1734016144 00002000:00010000:3.0:1734016144.132382:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016143 -> 1734016142 00002000:00010000:3.0:1734016144.132384:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016144 -> 1734016144 00002000:00010000:3.0:1734016144.132386:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1734016144.132461:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1981:x1818247333995776:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 500us (1049us total) trans 4294969552 rc 0/0 00000100:00100000:3.0:1734016144.132471:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9012 00002000:00010000:3.0:1734016144.132475:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (2728624->18446744073709551615) 00002000:00100000:3.0:1734016144.132478:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e775c00 with x1818247333995776 ext(2728624->18446744073709551615) 00002000:00010000:3.0:1734016144.132494:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e775c00. 00000100:00100000:3.0:1734016144.132515:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9013 00000100:00100000:3.0:1734016144.132522:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333995648:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016144.132641:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 2805133 -> 4194304 00002000:00010000:3.0:1734016144.132645:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016144 -> 1734016144 00002000:00010000:3.0:1734016144.132647:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016143 -> 1734016143 00002000:00010000:3.0:1734016144.132650:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016144 -> 1734016144 00002000:00010000:3.0:1734016144.132651:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 184 -> 184 00000100:00100000:3.0:1734016144.132671:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333995648:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 150us (1167us total) trans 4294968099 rc 0/0 00000100:00100000:3.0:1734016144.132676:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9013 00002000:00010000:3.0:1734016144.132678:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:3.0:1734016144.132681:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e774700 with x1818247333995648 ext(4194304->18446744073709551615) 00002000:00010000:3.0:1734016144.132684:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e774700. 00000100:00100000:0.0:1734016144.136124:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.138152:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333995904 00000100:00100000:1.0:1734016144.138174:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333995904 00000100:00100000:1.0:1734016144.141716:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2383 00000100:00100000:1.0:1734016144.141737:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+25:10406:x1818247333995904:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016144.142207:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016144.142253:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc2711781b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7464 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.142444:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27117822 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016144.142469:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27117822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016144.142493:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27117822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:1.0:1734016144.142531:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 6922928 00000004:00200000:1.0:1734016144.142536:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016144.142564:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27117822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016144.142597:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499e400/0x5e3a3adc2711781b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7464 expref: 27 pid: 6479 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1734016144.142944:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016114 00010000:00010000:1.0:1734016144.143011:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27117822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7464 expref: 26 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.143022:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016144.143025:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016144.143030:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016144.144489:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+26:10406:x1818247333995904:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2734us (8370us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016144.144503:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2383 00000100:00100000:0.0:1734016144.153945:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.154028:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.154150:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333996160 00000100:00100000:1.0:1734016144.154166:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333996160 00000100:00100000:1.0:1734016144.154248:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333996032 00000100:00100000:1.0:1734016144.154250:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333996032 00000100:00100000:1.0:1734016144.154278:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11881 00000100:00100000:1.0:1734016144.154289:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333996160:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016144.154331:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016144.154365:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27117829 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7472 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016144.154764:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11882 00000100:00100000:2.0:1734016144.154771:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333996032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016144.154785:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016144.154856:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117830 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e746b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016144.154910:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335433472:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016144.155031:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016144.156004:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073946300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335433344:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016144.156064:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92300 going to sleep for 11 seconds 00000100:00100000:2.0:1734016144.159445:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335433472:192.168.201.16@tcp:106: 00002000:00010000:1.0:1734016144.159494:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016142 -> 1734016143 00000100:00100000:1.0:1734016144.159515:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073946300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335433344:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016144.159521:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117830 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e746b expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.159542:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117830 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e746b expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.159543:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27117829 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7472 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.159553:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27117829 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7472 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.159571:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00010000:00010000:2.0:1734016144.160273:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:1.0:1734016144.160320:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333996160:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6028us (6387us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016144.160335:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11881 00000100:00100000:2.0:1734016144.160421:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333996032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5648us (6391us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016144.160428:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11882 00000100:00100000:0.0:1734016144.164628:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.164980:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.165086:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333996416 00000100:00100000:1.0:1734016144.165102:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333996416 00000100:00100000:1.0:1734016144.165162:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333996288 00000100:00100000:1.0:1734016144.165164:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333996288 00000100:00100000:1.0:1734016144.165188:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11883 00000100:00100000:1.0:1734016144.165199:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333996416:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016144.165228:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016144.165260:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27117837 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7480 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016144.165335:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073946300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335433600:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016144.165413:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016144.165615:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11884 00000100:00100000:3.0:1734016144.165621:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333996288:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016144.165632:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016144.165645:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc2711783e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7479 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016144.165682:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335433728:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016144.165706:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016144.168092:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073946300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335433600:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016144.168154:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27117837 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7480 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.168174:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27117837 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7480 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.168204:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016144.168255:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333996416:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3057us (3647us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016144.168266:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11883 00000100:00100000:3.0:1734016144.168589:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335433728:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016144.168617:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc2711783e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7479 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.168627:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc2711783e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7479 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.168641:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016144.168674:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333996288:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3052us (3694us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016144.168680:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11884 00000100:00100000:0.0:1734016144.173866:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.173938:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.174040:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333996672 00000100:00100000:1.0:1734016144.174057:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333996672 00000100:00100000:1.0:1734016144.174103:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333996544 00000100:00100000:1.0:1734016144.174105:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333996544 00000100:00100000:1.0:1734016144.174142:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11885 00000100:00100000:1.0:1734016144.174155:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333996672:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016144.174186:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016144.174213:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27117845 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e748e expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016144.174297:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073946300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335433856:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016144.174392:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016144.174475:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11886 00000100:00100000:3.0:1734016144.174490:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333996544:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016144.174500:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016144.174515:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711784c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7487 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016144.174555:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335433984:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016144.174585:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016144.177275:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073946300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335433856:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016144.177348:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27117845 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e748e expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.177378:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27117845 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e748e expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.177413:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016144.177509:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333996672:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3353us (3656us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016144.177524:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11885 00000100:00100000:3.0:1734016144.177676:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335433984:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016144.177703:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711784c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7487 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.177714:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc2711784c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7487 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.178413:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016144.178448:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333996544:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3955us (4507us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016144.178454:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11886 00000100:00100000:0.0:1734016144.182425:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.182729:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333996800 00000100:00100000:3.0:1734016144.182745:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333996800 00000100:00100000:3.0:1734016144.182880:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11887 00000100:00100000:3.0:1734016144.182894:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007493b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247333996800:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016144.182935:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016144.182968:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117853 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7495 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016144.183024:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc2711780d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7456 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016144.183036:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016144.183039:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016144.183045:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117853 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7495 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016144.183103:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc2711780d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7456 expref: 6 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016144.183129:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc2711780d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7456 expref: 6 pid: 7682 timeout: 511 lvb_type: 0 00000100:00100000:3.0:1734016144.183146:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335434112:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016144.183256:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:2.0:1734016144.189958:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.190665:0:6465:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333996928 00000100:00100000:0.0:1734016144.190681:0:6465:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333996928 00010000:00010000:0.0:1734016144.190738:0:6465:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc2711780d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7456 expref: 7 pid: 7682 timeout: 511 lvb_type: 0 00000100:00100000:0.0:1734016144.190843:0:6465:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3249 00000100:00100000:0.0:1734016144.190855:0:6465:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075545880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247333996928:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016144.190879:0:6465:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016144.190921:0:6465:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc2711780d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7456 expref: 7 pid: 7682 timeout: 511 lvb_type: 0 00010000:00010000:0.0:1734016144.190946:0:6465:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc2711780d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7456 expref: 7 pid: 7682 timeout: 511 lvb_type: 0 00010000:00010000:0.0:1734016144.191001:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016144.191004:0:6465:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016144.191018:0:6465:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117853 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 704512->708607) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7495 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016144.191031:0:6465:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117853 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 704512->708607) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7495 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016144.191107:0:6465:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117853 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 704512->708607) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7495 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016144.191130:0:6465:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880074938700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335434240:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016144.191249:0:6465:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00010000:00010000:3.0:1734016144.191570:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc2711780d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7456 expref: 7 pid: 7682 timeout: 511 lvb_type: 0 00000100:00100000:3.0:1734016144.191595:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335434112:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016144.191650:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117853 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 704512->708607) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7495 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016144.191664:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016144.191717:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007493b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247333996800:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8824us (9317us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016144.191727:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11887 00000100:00100000:2.0:1734016144.197945:0:6465:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880074938700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6465:1818247335434240:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016144.197997:0:6465:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016144.198135:0:6465:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075545880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247333996928:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7276us (8196us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016144.198159:0:6465:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3249 00000100:00100000:3.0:1734016144.198983:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.199233:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333997184 00000100:00100000:0.0:1734016144.199251:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333997184 00002000:00100000:0.0:1734016144.199340:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (704512->708607) req@ffff8801369f1880 x1818247333997184/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:105/0 lens 488/0 e 0 to 0 dl 1734016155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016144.199355:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1880 with x1818247333997184 ext(704512->708607) 00002000:00010000:0.0:1734016144.199363:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801369f1880 00000100:00100000:0.0:1734016144.199405:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9014 00000100:00100000:0.0:1734016144.199414:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333997184:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016144.201624:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333997184:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 2176us (2609us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016144.201651:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9014 00002000:00100000:0.0:1734016144.201682:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (704512->708607) req@ffff8801369f1880 x1818247333997184/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:105/0 lens 488/4536 e 0 to 0 dl 1734016155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016144.201698:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8801369f1880 with x1818247333997184 ext(704512->708607) 00002000:00010000:0.0:1734016144.201708:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801369f1880 00000100:00100000:0.0:1734016144.211036:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.211377:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333997312 00000100:00100000:1.0:1734016144.211399:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333997312 00000100:00100000:1.0:1734016144.211606:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2384 00000100:00100000:1.0:1734016144.211621:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880074938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+25:10406:x1818247333997312:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016144.211687:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016144.211735:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711785a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e749c expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.212099:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27117861 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016144.212125:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27117861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016144.212144:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27117861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:1.0:1734016144.212182:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 6922928 00000004:00200000:1.0:1734016144.212187:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016144.212211:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27117861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016144.212242:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499dd40/0x5e3a3adc2711785a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e749c expref: 27 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.212340:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27117861 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e749c expref: 26 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.212350:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016144.212354:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016144.212357:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016144.212614:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880074938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+26:10406:x1818247333997312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 996us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016144.212622:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2384 00000100:00100000:0.0:1734016144.223511:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.227118:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333997440 00000100:00100000:2.0:1734016144.227142:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333997440 00000100:00100000:2.0:1734016144.227247:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11888 00000100:00100000:2.0:1734016144.227262:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247333997440:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016144.227301:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016144.227339:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117868 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e74a3 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.227375:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016144.227378:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016144.227390:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117868 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74a3 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.227412:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117868 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74a3 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.227428:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016144.227518:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333997440:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 262us (4048us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016144.227525:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11888 00000100:00100000:0.0:1734016144.234908:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.235072:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333997568 00000100:00100000:1.0:1734016144.235087:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333997568 00000100:00100000:1.0:1734016144.235179:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11889 00000100:00100000:1.0:1734016144.235189:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333997568:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016144.235227:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016144.235263:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc2711786f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e74aa expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.235328:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117853 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 704512->708607) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7495 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.235340:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117868 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74a3 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.235347:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016144.235350:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016144.235356:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc2711786f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [6123520->6127615] (req 6123520->6127615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74aa expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.235418:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117868 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74a3 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.235436:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117868 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74a3 expref: 8 pid: 8216 timeout: 511 lvb_type: 1 00000100:00100000:1.0:1734016144.235453:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073946300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335434368:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016144.235605:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117853 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 704512->708607) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7495 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.235616:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117853 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 704512->708607) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7495 expref: 8 pid: 8216 timeout: 511 lvb_type: 0 00000100:00100000:1.0:1734016144.235626:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073945c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335434496:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016144.235660:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92300 going to sleep for 11 seconds 00000100:00100000:0.0:1734016144.241720:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.241838:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.241952:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333997696 00000100:00100000:0.0:1734016144.241972:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333997696 00010000:00010000:0.0:1734016144.242076:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117868 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74a3 expref: 9 pid: 8216 timeout: 511 lvb_type: 1 00000100:00100000:0.0:1734016144.242166:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333997824 00000100:00100000:0.0:1734016144.242170:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333997824 00010000:00010000:0.0:1734016144.242184:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117853 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 704512->708607) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7495 expref: 9 pid: 8216 timeout: 511 lvb_type: 0 00000100:00100000:0.0:1734016144.242213:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3250 00000100:00100000:0.0:1734016144.242226:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333997696:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016144.242263:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016144.242308:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117868 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74a3 expref: 9 pid: 8216 timeout: 511 lvb_type: 1 00010000:00010000:0.0:1734016144.242339:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117868 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74a3 expref: 9 pid: 8216 timeout: 511 lvb_type: 1 00010000:00010000:0.0:1734016144.242401:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016144.242499:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247333997696:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 275us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016144.242509:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3250 00000100:00100000:0.0:1734016144.242536:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3251 00000100:00100000:0.0:1734016144.242540:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247333997824:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016144.242549:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016144.242557:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117853 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 704512->708607) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7495 expref: 9 pid: 8216 timeout: 511 lvb_type: 0 00010000:00010000:0.0:1734016144.242569:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117853 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 704512->708607) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7495 expref: 9 pid: 8216 timeout: 511 lvb_type: 0 00010000:00010000:0.0:1734016144.242585:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016144.242587:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016144.242596:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc2711786f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 6123520->6127615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74aa expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016144.242608:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc2711786f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 6123520->6127615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74aa expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016144.242666:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc2711786f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 6123520->6127615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74aa expref: 8 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016144.242689:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b73bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335434624:192.168.201.16@tcp:105: 00000100:00100000:0.0:1734016144.242767:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00010000:00010000:1.0:1734016144.245271:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117868 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74a3 expref: 8 pid: 8216 timeout: 511 lvb_type: 1 00000100:00100000:1.0:1734016144.245328:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073946300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335434368:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016144.245350:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117853 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 704512->708607) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7495 expref: 9 pid: 8216 timeout: 511 lvb_type: 0 00000100:00100000:1.0:1734016144.245362:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073945c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335434496:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016144.245402:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc2711786f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6123520->6127615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74aa expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.245423:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016144.245536:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247333997568:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10348us (10650us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016144.245549:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11889 00000100:00100000:1.0:1734016144.252967:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b73bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335434624:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016144.253018:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016144.253125:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333997824:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 10580us (11283us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016144.253140:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3251 00000100:00100000:0.0:1734016144.256069:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.256231:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333997952 00000100:00100000:1.0:1734016144.256252:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333997952 00000100:00100000:1.0:1734016144.256364:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11890 00000100:00100000:1.0:1734016144.256377:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247333997952:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016144.256888:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 6127477 00002000:00010000:1.0:1734016144.256892:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016144 -> 1734016144 00002000:00010000:1.0:1734016144.256895:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016143 -> 1734016143 00002000:00010000:1.0:1734016144.256897:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016144 -> 1734016144 00002000:00010000:1.0:1734016144.256899:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 184 -> 192 00000100:00100000:1.0:1734016144.258219:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247333997952:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1826us (2164us total) trans 4294968100 rc 0/0 00000100:00100000:1.0:1734016144.258241:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11890 00000100:00100000:0.0:1734016144.263165:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.263791:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.264005:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333998080 00000100:00100000:2.0:1734016144.264023:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333998080 00000100:00100000:2.0:1734016144.264099:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333998208 00000100:00100000:2.0:1734016144.264102:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333998208 00000100:00100000:2.0:1734016144.264147:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11891 00000100:00100000:2.0:1734016144.264159:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333998080:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016144.264195:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016144.264234:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117876 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e74b1 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016144.264367:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335434752:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016144.264493:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016144.264574:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11892 00000100:00100000:0.0:1734016144.264580:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333998208:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016144.264592:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016144.264609:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc2711787d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e74b8 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016144.264646:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b738a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335434880:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016144.264672:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016144.268218:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b738a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335434880:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016144.268305:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc2711787d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74b8 expref: 14 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.268328:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc2711787d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74b8 expref: 14 pid: 7683 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1734016144.268523:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335434752:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016144.268559:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117876 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74b1 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.268571:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117876 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74b1 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.268931:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00010000:00010000:2.0:1734016144.269600:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:1.0:1734016144.270672:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333998208:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6071us (6860us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016144.270690:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11892 00000100:00100000:2.0:1734016144.271638:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333998080:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7474us (8482us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016144.271650:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11891 00000100:00100000:0.0:1734016144.282291:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.285386:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.285759:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333998336 00000100:00100000:1.0:1734016144.285778:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333998336 00000100:00100000:1.0:1734016144.285906:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333998464 00000100:00100000:1.0:1734016144.285909:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333998464 00000100:00100000:1.0:1734016144.285945:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11893 00000100:00100000:1.0:1734016144.285957:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333998336:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016144.285999:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016144.286034:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc27117884 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e74bf expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016144.286144:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073945c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335435008:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016144.286252:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016144.287596:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11894 00000100:00100000:3.0:1734016144.287609:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333998464:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016144.287633:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016144.287657:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711788b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e74c6 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016144.287711:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335435136:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016144.287778:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016144.294612:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335435136:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016144.294684:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711788b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74c6 expref: 14 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.294708:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc2711788b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74c6 expref: 14 pid: 7684 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1734016144.295359:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073945c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335435008:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016144.295389:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc27117884 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74bf expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.295400:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc27117884 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74bf expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.295430:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016144.295516:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333998336:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9561us (13243us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016144.295530:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11893 00010000:00010000:3.0:1734016144.295754:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016144.295781:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333998464:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8174us (10418us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016144.295788:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11894 00000100:00100000:0.0:1734016144.302239:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.302408:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.303567:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333998592 00000100:00100000:1.0:1734016144.303585:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333998592 00000100:00100000:1.0:1734016144.304229:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333998720 00000100:00100000:1.0:1734016144.304234:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333998720 00000100:00100000:3.0:1734016144.304287:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11895 00000100:00100000:3.0:1734016144.304301:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333998592:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016144.304342:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016144.304371:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27117892 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e74cd expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016144.304463:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335435264:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016144.304568:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016144.305073:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11896 00000100:00100000:1.0:1734016144.305080:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333998720:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016144.305090:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016144.305102:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27117899 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e74d4 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016144.305153:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073945c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335435392:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016144.305189:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016144.309778:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335435264:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016144.309916:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27117892 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74cd expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.309948:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27117892 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74cd expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.309996:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016144.310108:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333998592:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5805us (8307us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016144.310128:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11895 00000100:00100000:1.0:1734016144.310313:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073945c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335435392:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016144.310349:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27117899 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74d4 expref: 14 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.310363:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27117899 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74d4 expref: 14 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.310392:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016144.310427:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333998720:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5347us (8019us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016144.310436:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11896 00000100:00100000:0.0:1734016144.324576:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.324657:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.325310:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333998848 00000100:00100000:3.0:1734016144.325322:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333998848 00000100:00100000:3.0:1734016144.325388:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333998976 00000100:00100000:3.0:1734016144.325390:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333998976 00000100:00100000:3.0:1734016144.325412:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11897 00000100:00100000:3.0:1734016144.325422:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333998848:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016144.325451:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016144.325493:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271178a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e74db expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016144.325592:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335435520:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016144.325693:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016144.325793:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11898 00000100:00100000:1.0:1734016144.325860:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333998976:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016144.325875:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016144.325894:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc271178a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e74e2 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016144.325937:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073945c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335435648:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016144.325976:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016144.332245:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335435520:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016144.332317:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271178a0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74db expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.332341:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271178a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74db expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.332394:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:1.0:1734016144.332518:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073945c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335435648:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016144.332548:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc271178a7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74e2 expref: 14 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.332559:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc271178a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74e2 expref: 14 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.332577:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016144.332664:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333998976:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6860us (8003us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016144.332679:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11898 00000100:00100000:3.0:1734016144.336797:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333998848:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11348us (12214us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016144.336839:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11897 00000100:00100000:0.0:1734016144.343985:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.344195:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333999104 00000100:00100000:3.0:1734016144.344223:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333999104 00000100:00100000:3.0:1734016144.344330:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11899 00000100:00100000:3.0:1734016144.344349:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1982:x1818247333999104:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016144.344953:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 2728624 -> 2728624 00002000:00010000:3.0:1734016144.344958:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016144 -> 1734016144 00002000:00010000:3.0:1734016144.344961:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016143 -> 1734016142 00002000:00010000:3.0:1734016144.344964:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016144 -> 1734016144 00002000:00010000:3.0:1734016144.344967:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 16 00000100:00100000:3.0:1734016144.345062:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1982:x1818247333999104:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 718us (1111us total) trans 4294969553 rc 0/0 00000100:00100000:3.0:1734016144.345071:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11899 00000100:00100000:0.0:1734016144.355026:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.355098:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.355214:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333999232 00000100:00100000:3.0:1734016144.355229:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333999232 00000100:00100000:3.0:1734016144.355282:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333999360 00000100:00100000:3.0:1734016144.355284:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333999360 00000100:00100000:3.0:1734016144.355439:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11900 00000100:00100000:3.0:1734016144.355453:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333999232:12345-192.168.201.16@tcp:101:fsx.0 00000100:00100000:0.0:1734016144.355692:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11901 00000100:00100000:0.0:1734016144.355698:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333999360:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016144.355724:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016144.355757:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271178ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e74f0 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016144.355893:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335435776:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016144.355985:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1734016144.356451:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016144.356472:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271178b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e74e9 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016144.356524:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335435904:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016144.356572:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00002000:00010000:1.0:1734016144.361224:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016142 -> 1734016143 00000100:00100000:1.0:1734016144.361288:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335435776:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016144.361352:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271178ae lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74f0 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.361382:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582400/0x5e3a3adc271178ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74f0 expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.361418:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:1.0:1734016144.361529:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247333999360:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5828us (6427us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016144.361546:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11901 00000100:00100000:3.0:1734016144.369886:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335435904:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016144.369958:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271178b5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74e9 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.369982:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc271178b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74e9 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.370013:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016144.373421:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247333999232:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 17931us (18373us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016144.373447:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11900 00000100:00100000:0.0:1734016144.379640:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.379711:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.379838:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333999616 00000100:00100000:3.0:1734016144.379857:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333999616 00000100:00100000:3.0:1734016144.379919:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333999488 00000100:00100000:3.0:1734016144.379920:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333999488 00000100:00100000:3.0:1734016144.379953:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11902 00000100:00100000:3.0:1734016144.379964:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333999616:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016144.379989:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016144.380016:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271178bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e74fe expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016144.380106:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335436032:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016144.380212:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016144.380288:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11903 00000100:00100000:1.0:1734016144.380295:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333999488:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016144.380306:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016144.380322:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271178c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e74f7 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016144.380364:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073945c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335436160:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016144.380407:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016144.385615:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335436032:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016144.385687:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271178bc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74fe expref: 14 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.385710:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271178bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74fe expref: 14 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.385735:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016144.385856:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247333999616:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5893us (6236us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016144.385871:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11902 00000100:00100000:1.0:1734016144.386745:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073945c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335436160:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016144.386791:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271178c3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74f7 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.386844:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc271178c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74f7 expref: 9 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.386863:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016144.386905:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247333999488:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6610us (7194us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016144.386913:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11903 00000100:00100000:2.0:1734016144.397738:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.398554:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.399744:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333999872 00000100:00100000:3.0:1734016144.399761:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333999872 00000100:00100000:3.0:1734016144.399843:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247333999744 00000100:00100000:3.0:1734016144.399846:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247333999744 00000100:00100000:3.0:1734016144.399886:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11904 00000100:00100000:3.0:1734016144.399896:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247333999872:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016144.399919:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016144.399945:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271178ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e750c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016144.400014:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335436288:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016144.400094:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:0.0:1734016144.400314:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11905 00000100:00100000:0.0:1734016144.400320:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333999744:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016144.400329:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016144.400342:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7582400/0x5e3a3adc271178d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7505 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016144.400376:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335436416:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016144.400405:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016144.409874:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335436416:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016144.409956:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7582400/0x5e3a3adc271178d1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7505 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016144.409987:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7582400/0x5e3a3adc271178d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7505 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1734016144.410150:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335436288:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016144.410187:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271178ca lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e750c expref: 14 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.410197:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc271178ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e750c expref: 14 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.410225:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016144.410303:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247333999872:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10407us (12586us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016144.410315:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11904 00010000:00010000:0.0:1734016144.417206:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582400, rc 0) 00000100:00100000:0.0:1734016144.417429:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247333999744:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 17093us (18861us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016144.417451:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11905 00000100:00100000:0.0:1734016144.429880:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.432602:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.432985:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334000000 00000100:00100000:2.0:1734016144.433000:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334000000 00000100:00100000:2.0:1734016144.433105:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11906 00000100:00100000:2.0:1734016144.433119:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247334000000:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016144.433157:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016144.433181:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc271178d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7513 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016144.433282:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075546680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335436544:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016144.433383:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016144.434565:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334000128 00000100:00100000:3.0:1734016144.434573:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334000128 00000100:00100000:3.0:1734016144.434633:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11907 00000100:00100000:3.0:1734016144.434642:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247334000128:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016144.434661:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016144.434685:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271178df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e751a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016144.434741:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335436672:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016144.434833:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:2.0:1734016144.436729:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075546680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335436544:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016144.436775:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc271178d8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7513 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.436791:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc271178d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7513 expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.436857:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016144.437336:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247334000000:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4217us (7475us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016144.437348:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11906 00000100:00100000:3.0:1734016144.453564:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335436672:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016144.453647:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271178df lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e751a expref: 14 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.453669:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc271178df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e751a expref: 14 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.457076:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016144.457258:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247334000128:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 22603us (24660us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016144.457281:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11907 00000100:00100000:1.0:1734016144.463259:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.463375:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.463494:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334000256 00000100:00100000:3.0:1734016144.463513:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334000256 00000100:00100000:3.0:1734016144.463606:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334000384 00000100:00100000:3.0:1734016144.463609:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334000384 00000100:00100000:3.0:1734016144.463661:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11908 00000100:00100000:3.0:1734016144.463677:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247334000256:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016144.463717:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016144.463762:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc271178e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7521 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016144.463929:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335436800:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016144.464043:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016144.464065:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11909 00000100:00100000:3.0:1734016144.464070:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247334000384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016144.464082:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016144.464099:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271178ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7528 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016144.464142:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335436928:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016144.464165:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e300 going to sleep for 11 seconds 00000100:00100000:3.0:1734016144.469522:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335436800:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016144.469589:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc271178e6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7521 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.469615:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc271178e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7521 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.469650:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016144.469737:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247334000256:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6064us (6514us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016144.469750:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11908 00000100:00100000:3.0:1734016144.471636:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335436928:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016144.471690:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271178ed lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7528 expref: 14 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.471707:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc271178ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7528 expref: 14 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.471721:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016144.471875:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247334000384:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7801us (8497us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016144.471887:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11909 00000100:00100000:1.0:1734016144.479529:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.479882:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.479984:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334000640 00000100:00100000:2.0:1734016144.480003:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334000640 00000100:00100000:2.0:1734016144.480065:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334000512 00000100:00100000:2.0:1734016144.480067:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334000512 00000100:00100000:2.0:1734016144.480094:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11910 00000100:00100000:2.0:1734016144.480104:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247334000640:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016144.480136:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016144.480169:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271178f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7536 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016144.480259:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075546680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335437056:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016144.480355:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016144.480572:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11911 00000100:00100000:2.0:1734016144.480578:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247334000512:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016144.480593:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016144.480611:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271178fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e752f expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016144.480646:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335437184:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016144.484445:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016144.487997:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075546680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335437056:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016144.488061:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271178f4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7536 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.488078:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271178f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7536 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.488106:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016144.488188:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247334000640:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8081us (8675us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016144.488204:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11910 00000100:00100000:2.0:1734016144.490174:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335437184:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016144.490266:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271178fb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e752f expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.490294:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc271178fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e752f expref: 9 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.490318:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016144.491849:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247334000512:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11252us (11948us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016144.491867:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11911 00000100:00100000:0.0:1734016144.499632:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.501626:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334000768 00000100:00100000:2.0:1734016144.501655:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334000768 00000100:00100000:2.0:1734016144.501892:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11912 00000100:00100000:2.0:1734016144.501910:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247334000768:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016144.501959:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016144.502004:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117902 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e753d expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.502061:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc2711786f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6123520->6127615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74aa expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.502071:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016144.502075:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016144.502081:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117902 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [4001792->4014079] (req 4001792->4014079) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e753d expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.502145:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc2711786f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6123520->6127615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74aa expref: 7 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.502165:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc2711786f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6123520->6127615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74aa expref: 7 pid: 7682 timeout: 511 lvb_type: 0 00000100:00100000:2.0:1734016144.502182:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335437312:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016144.502332:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016144.508252:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335437312:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016144.508309:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117902 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [4001792->4014079] (req 4001792->4014079) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e753d expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016144.508342:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:3.0:1734016144.508490:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247334000768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6584us (8874us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016144.508507:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11912 00000100:00100000:0.0:1734016144.511241:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.511730:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334000896 00000100:00100000:2.0:1734016144.511743:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334000896 00010000:00010000:2.0:1734016144.511852:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc2711786f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 6123520->6127615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74aa expref: 8 pid: 7682 timeout: 511 lvb_type: 0 00000100:00100000:2.0:1734016144.511892:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3252 00000100:00100000:2.0:1734016144.511900:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247334000896:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016144.511919:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016144.511944:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc2711786f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6123520->6127615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74aa expref: 8 pid: 7682 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1734016144.511959:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc2711786f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6123520->6127615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74aa expref: 8 pid: 7682 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1734016144.511996:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc2711786f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 6123520->6127615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e74aa expref: 8 pid: 7682 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1734016144.512016:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016144.512018:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016144.512028:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117902 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4014079) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e753d expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.512038:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117902 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4014079) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e753d expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.512086:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117902 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4014079) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e753d expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016144.512105:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075546680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335437440:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016144.512172:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016144.521176:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075546680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335437440:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016144.521216:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016144.521290:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247334000896:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9388us (10071us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016144.521306:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3252 00000100:00100000:0.0:1734016144.522717:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.522861:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334001024 00000100:00100000:3.0:1734016144.522874:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334001024 00000100:00100000:3.0:1734016144.522928:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11913 00000100:00100000:3.0:1734016144.522937:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247334001024:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016144.523295:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 6127477 -> 6127477 00002000:00010000:3.0:1734016144.523299:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016144 -> 1734016144 00002000:00010000:3.0:1734016144.523302:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016143 -> 1734016143 00002000:00010000:3.0:1734016144.523304:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016144 -> 1734016144 00002000:00010000:3.0:1734016144.523306:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 192 -> 192 00000100:00100000:3.0:1734016144.523418:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247334001024:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 481us (713us total) trans 4294968101 rc 0/0 00000100:00100000:3.0:1734016144.523426:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11913 00000100:00100000:0.0:1734016144.525964:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.526091:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334001152 00000100:00100000:2.0:1734016144.526104:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334001152 00000100:00100000:2.0:1734016144.526154:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11914 00000100:00100000:2.0:1734016144.526161:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247334001152:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016144.526183:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016144.526204:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117909 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7544 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016144.526275:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075546680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335437568:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016144.526682:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016144.528957:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075546680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335437568:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016144.529025:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117909 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7544 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.529047:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117909 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7544 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.529076:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016144.529308:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247334001152:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3142us (3349us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016144.529324:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11914 00000100:00100000:0.0:1734016144.536612:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.536710:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334001280 00000100:00100000:2.0:1734016144.536720:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334001280 00000100:00100000:2.0:1734016144.538010:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11915 00000100:00100000:2.0:1734016144.538027:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247334001280:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016144.538053:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016144.538088:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117910 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e754b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016144.538168:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075546680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335437696:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016144.539929:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016144.546786:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075546680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335437696:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016144.546906:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117910 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e754b expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.546935:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117910 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e754b expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.546958:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016144.551548:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1983:x1818247334001280:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 13490us (14915us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016144.551575:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11915 00000100:00100000:0.0:1734016144.564008:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.565714:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334001408 00000100:00100000:2.0:1734016144.565732:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334001408 00000100:00100000:2.0:1734016144.565881:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11916 00000100:00100000:2.0:1734016144.565890:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247334001408:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016144.565920:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016144.565948:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117917 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7552 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016144.566044:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075546680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335437824:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016144.566158:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00002000:00010000:2.0:1734016144.568196:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016143 -> 1734016144 00000100:00100000:2.0:1734016144.568232:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075546680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335437824:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016144.568281:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117917 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7552 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.568302:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117917 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7552 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.568336:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016144.568405:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247334001408:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2513us (4412us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016144.568415:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11916 00000100:00100000:0.0:1734016144.570377:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.570486:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334001536 00000100:00100000:2.0:1734016144.570502:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334001536 00000100:00100000:2.0:1734016144.570586:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11917 00000100:00100000:2.0:1734016144.570598:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247334001536:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016144.570624:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016144.570658:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711791e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7559 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.570704:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117902 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4014079) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e753d expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.570713:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016144.570716:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016144.570721:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711791e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7559 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.570764:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117902 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4014079) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e753d expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.570779:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117902 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4014079) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e753d expref: 9 pid: 7683 timeout: 511 lvb_type: 0 00000100:00100000:2.0:1734016144.570795:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075546680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335437952:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016144.570917:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016144.572965:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.573115:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334001664 00000100:00100000:3.0:1734016144.573127:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334001664 00010000:00010000:3.0:1734016144.573164:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117902 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4014079) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e753d expref: 10 pid: 7683 timeout: 511 lvb_type: 0 00000100:00100000:3.0:1734016144.573209:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3253 00000100:00100000:3.0:1734016144.573217:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247334001664:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016144.573231:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016144.573252:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117902 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4001792->4014079) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e753d expref: 10 pid: 7683 timeout: 511 lvb_type: 0 00010000:00010000:3.0:1734016144.573268:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117902 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4001792->4014079) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e753d expref: 10 pid: 7683 timeout: 511 lvb_type: 0 00010000:00010000:3.0:1734016144.573297:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016144.573300:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016144.573308:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711791e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 565248->569343) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7559 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016144.573316:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711791e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 565248->569343) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7559 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016144.573348:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711791e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 565248->569343) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7559 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016144.573358:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335438080:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016144.573685:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e300 going to sleep for 11 seconds 00010000:00010000:2.0:1734016144.574266:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117902 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4001792->4014079) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e753d expref: 10 pid: 7683 timeout: 511 lvb_type: 0 00000100:00100000:2.0:1734016144.574286:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075546680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335437952:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016144.574316:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711791e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 565248->569343) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7559 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.574327:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016144.577395:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247334001536:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6762us (6998us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016144.577422:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11917 00000100:00100000:3.0:1734016144.580125:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7698:1818247335438080:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016144.580165:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016144.587755:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247334001664:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 14479us (14743us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016144.587791:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3253 00000100:00100000:0.0:1734016144.589739:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.589783:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334002048 00000100:00100000:0.0:1734016144.589795:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334002048 00002000:00100000:0.0:1734016144.589884:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->2732031) req@ffff880073b9ce00 x1818247334002048/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:105/0 lens 488/0 e 0 to 0 dl 1734016155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016144.589894:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9ce00 with x1818247334002048 ext(0->2732031) 00002000:00010000:0.0:1734016144.589900:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9ce00 00000100:00100000:0.0:1734016144.589943:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9015 00000100:00100000:0.0:1734016144.589952:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1982:x1818247334002048:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016144.596000:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.596356:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334002176 00000100:00100000:3.0:1734016144.596371:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334002176 00002000:00100000:3.0:1734016144.596425:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (565248->569343) req@ffff880075fc6d80 x1818247334002176/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:105/0 lens 488/0 e 0 to 0 dl 1734016155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016144.596442:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc6d80 with x1818247334002176 ext(565248->569343) 00002000:00010000:3.0:1734016144.596449:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075fc6d80 00000100:00100000:3.0:1734016144.596487:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9016 00000100:00100000:3.0:1734016144.596495:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247334002176:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016144.596759:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247334002176:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 264us (783us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016144.596768:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9016 00002000:00100000:3.0:1734016144.596774:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (565248->569343) req@ffff880075fc6d80 x1818247334002176/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:105/0 lens 488/4536 e 0 to 0 dl 1734016155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016144.596782:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075fc6d80 with x1818247334002176 ext(565248->569343) 00002000:00010000:3.0:1734016144.596785:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075fc6d80 00000100:00100000:2.0:1734016144.618498:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.622337:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334002432 00000100:00100000:1.0:1734016144.622361:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334002432 00002000:00100000:1.0:1734016144.622430:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (569344->573439) req@ffff880075546680 x1818247334002432/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:105/0 lens 488/0 e 0 to 0 dl 1734016155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016144.622443:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075546680 with x1818247334002432 ext(569344->573439) 00002000:00010000:1.0:1734016144.622449:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075546680 00000100:00100000:1.0:1734016144.622508:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9017 00000100:00100000:1.0:1734016144.622514:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247334002432:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016144.622775:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247334002432:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 259us (4290us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016144.622784:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9017 00002000:00100000:1.0:1734016144.622791:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (569344->573439) req@ffff880075546680 x1818247334002432/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:105/0 lens 488/4536 e 0 to 0 dl 1734016155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016144.622841:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075546680 with x1818247334002432 ext(569344->573439) 00002000:00010000:1.0:1734016144.622844:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075546680 00010000:00010000:2.0:1734016144.643636:0:6469:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1734016144.655746:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1982:x1818247334002048:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 65772us (65995us total) trans 0 rc 2732032/2732032 00000100:00100000:1.0:1734016144.655772:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9015 00002000:00100000:1.0:1734016144.655796:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->2732031) req@ffff880073b9ce00 x1818247334002048/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:105/0 lens 488/440 e 0 to 0 dl 1734016155 ref 1 fl Complete:/200/0 rc 2732032/2732032 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016144.655829:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9ce00 with x1818247334002048 ext(0->2732031) 00002000:00010000:1.0:1734016144.655838:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9ce00 00000100:00100000:0.0:1734016144.659144:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.659215:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.659377:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334002560 00000100:00100000:2.0:1734016144.659399:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334002560 00000100:00100000:2.0:1734016144.659498:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334002688 00000100:00100000:2.0:1734016144.659502:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334002688 00000100:00100000:2.0:1734016144.659559:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11918 00000100:00100000:2.0:1734016144.659573:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247334002560:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016144.659620:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016144.659671:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117925 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7560 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.659720:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016144.659723:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016144.659741:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117925 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7560 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.659772:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117925 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7560 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.659793:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016144.659934:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247334002560:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 364us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016144.659942:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11918 00000100:00100000:2.0:1734016144.659973:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11919 00000100:00100000:2.0:1734016144.659979:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247334002688:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016144.659993:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016144.660014:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711792c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7567 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016144.660095:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335438208:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016144.660171:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00002000:00010000:2.0:1734016144.665363:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016143 -> 1734016145 00000100:00100000:2.0:1734016144.665418:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335438208:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016144.665485:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711792c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7567 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.665504:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc2711792c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7567 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.666082:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016144.666695:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247334002688:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6705us (7466us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016144.666710:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11919 00000100:00100000:0.0:1734016144.670193:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.670562:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334002816 00000100:00100000:2.0:1734016144.670580:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334002816 00000100:00100000:2.0:1734016144.670675:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11920 00000100:00100000:2.0:1734016144.670689:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247334002816:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016144.670728:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016144.670761:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117933 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e756e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016144.671214:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335438336:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016144.671408:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016144.673718:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335438336:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016144.673792:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117933 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e756e expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.673852:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117933 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e756e expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016144.673875:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016144.673971:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247334002816:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3284us (3792us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016144.673985:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11920 00000100:00100000:0.0:1734016144.680245:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.680439:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334002944 00000100:00100000:2.0:1734016144.680458:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334002944 00000100:00100000:2.0:1734016144.680722:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11921 00000100:00100000:2.0:1734016144.680738:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:10406:x1818247334002944:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016144.680779:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016144.680847:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711793a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7575 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.680917:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27117814 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e745d expref: 13 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.680931:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016144.680935:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016144.680940:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711793a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [2400256->2408447] (req 2400256->2408447) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7575 expref: 14 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.680999:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27117814 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e745d expref: 13 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.681015:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27117814 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e745d expref: 13 pid: 7682 timeout: 511 lvb_type: 0 00000100:00100000:2.0:1734016144.681032:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335438464:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016144.681154:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016144.688697:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335438464:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016144.688764:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711793a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [2400256->2408447] (req 2400256->2408447) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7575 expref: 14 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.688795:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016144.688934:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+14:10406:x1818247334002944:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8199us (8714us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016144.688948:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11921 00000100:00100000:0.0:1734016144.693326:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.693507:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334003072 00000100:00100000:3.0:1734016144.693522:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334003072 00010000:00010000:3.0:1734016144.693590:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27117814 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e745d expref: 14 pid: 7682 timeout: 511 lvb_type: 0 00000100:00100000:3.0:1734016144.693643:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3254 00000100:00100000:3.0:1734016144.693653:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1982:x1818247334003072:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016144.693680:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016144.693713:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27117814 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e745d expref: 14 pid: 7682 timeout: 511 lvb_type: 0 00010000:00010000:3.0:1734016144.693734:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27117814 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e745d expref: 14 pid: 7682 timeout: 511 lvb_type: 0 00010000:00010000:3.0:1734016144.693773:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27117814 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e745d expref: 14 pid: 7682 timeout: 511 lvb_type: 0 00010000:00010000:3.0:1734016144.693997:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016144.694000:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016144.694009:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711793a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->2408447) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7575 expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016144.694019:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711793a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->2408447) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7575 expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016144.694077:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711793a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->2408447) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7575 expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016144.694094:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335438592:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016144.694195:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016144.705431:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335438592:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016144.705508:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016144.705608:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:1982:x1818247334003072:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 11952us (12301us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016144.705632:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3254 00000100:00100000:0.0:1734016144.718962:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.720188:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334003328 00000100:00100000:1.0:1734016144.720208:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334003328 00002000:00100000:1.0:1734016144.720301:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->2732031) req@ffff8800849b4000 x1818247334003328/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:105/0 lens 488/0 e 0 to 0 dl 1734016155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016144.720316:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b4000 with x1818247334003328 ext(0->2732031) 00002000:00010000:1.0:1734016144.720328:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b4000 00000100:00100000:1.0:1734016144.720386:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9018 00000100:00100000:1.0:1734016144.720396:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1983:x1818247334003328:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016144.729115:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.730384:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334003584 00000100:00100000:3.0:1734016144.730403:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334003584 00002000:00100000:3.0:1734016144.730485:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff8800849b7b80 x1818247334003584/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:105/0 lens 488/0 e 0 to 0 dl 1734016155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016144.730503:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b7b80 with x1818247334003584 ext(0->4194303) 00002000:00010000:3.0:1734016144.730510:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800849b7b80 00000100:00100000:3.0:1734016144.730564:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9019 00000100:00100000:3.0:1734016144.730571:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247334003584:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016144.789077:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1983:x1818247334003328:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 68649us (70098us total) trans 0 rc 2732032/2732032 00000100:00100000:1.0:1734016144.789106:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9018 00002000:00100000:1.0:1734016144.789131:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->2732031) req@ffff8800849b4000 x1818247334003328/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:105/0 lens 488/440 e 0 to 0 dl 1734016155 ref 1 fl Complete:/200/0 rc 2732032/2732032 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016144.789145:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b4000 with x1818247334003328 ext(0->2732031) 00002000:00010000:1.0:1734016144.789156:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b4000 00000100:00100000:0.0:1734016144.826663:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.830715:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334003712 00000100:00100000:2.0:1734016144.830750:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334003712 00000100:00100000:2.0:1734016144.831434:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11922 00000100:00100000:2.0:1734016144.831451:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+13:10406:x1818247334003712:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016144.831504:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016144.831545:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117941 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e757c expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.831604:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711793a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->2408447) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7575 expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.831618:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016144.831621:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016144.831628:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117941 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [2961408->2969599] (req 2961408->2969599) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e757c expref: 14 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.831700:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711793a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->2408447) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7575 expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.831722:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711793a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->2408447) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7575 expref: 13 pid: 8216 timeout: 511 lvb_type: 0 00000100:00100000:2.0:1734016144.831740:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335438720:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016144.834214:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016144.863163:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.863217:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334003840 00000100:00100000:1.0:1734016144.863233:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334003840 00010000:00010000:1.0:1734016144.863290:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711793a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7575 expref: 14 pid: 8216 timeout: 511 lvb_type: 0 00000100:00100000:1.0:1734016144.863338:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3255 00000100:00100000:1.0:1734016144.863347:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247334003840:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016144.863376:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016144.863417:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711793a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2400256->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7575 expref: 14 pid: 8216 timeout: 511 lvb_type: 0 00010000:00010000:1.0:1734016144.863434:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711793a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2400256->2408447) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7575 expref: 14 pid: 8216 timeout: 511 lvb_type: 0 00010000:00010000:1.0:1734016144.863487:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016144.863491:0:7698:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016144.863502:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117941 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2961408->2969599) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e757c expref: 14 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.863519:0:7698:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117941 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2961408->2969599) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e757c expref: 14 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.863580:0:7698:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117941 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2961408->2969599) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e757c expref: 14 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016144.863593:0:7698:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335438848:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016144.863680:0:7698:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92c00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016144.864169:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247334003584:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 133590us (135063us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016144.864183:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9019 00002000:00100000:1.0:1734016144.864198:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff8800849b7b80 x1818247334003584/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:105/0 lens 488/440 e 0 to 0 dl 1734016155 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016144.864210:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b7b80 with x1818247334003584 ext(0->4194303) 00002000:00010000:1.0:1734016144.864215:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800849b7b80 00010000:00010000:3.0:1734016144.864883:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc2711793a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2400256->2408447) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7575 expref: 14 pid: 8216 timeout: 511 lvb_type: 0 00000100:00100000:3.0:1734016144.864916:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335438720:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016144.864951:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117941 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2961408->2969599) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e757c expref: 14 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016144.864967:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:3.0:1734016144.865012:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:10406:x1818247334003712:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 33565us (38367us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016144.865021:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11922 00000100:00100000:1.0:1734016144.871754:0:7698:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7698:1818247335438848:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016144.871786:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016144.871940:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247334003840:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 8592us (8799us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016144.871954:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3255 00000100:00100000:0.0:1734016144.874780:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.874964:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334004096 00000100:00100000:1.0:1734016144.874980:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334004096 00002000:00100000:1.0:1734016144.875060:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (2961408->2965503) req@ffff8800849b5500 x1818247334004096/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:105/0 lens 488/0 e 0 to 0 dl 1734016155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016144.875080:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b5500 with x1818247334004096 ext(2961408->2965503) 00002000:00010000:1.0:1734016144.875086:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b5500 00000100:00100000:1.0:1734016144.875297:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9020 00000100:00100000:1.0:1734016144.875307:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1982:x1818247334004096:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016144.875605:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1982:x1818247334004096:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 298us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016144.875614:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9020 00002000:00100000:1.0:1734016144.875621:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (2961408->2965503) req@ffff8800849b5500 x1818247334004096/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:105/0 lens 488/440 e 0 to 0 dl 1734016155 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016144.875628:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800849b5500 with x1818247334004096 ext(2961408->2965503) 00002000:00010000:1.0:1734016144.875631:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800849b5500 00000100:00100000:1.0:1734016144.881625:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.881743:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334004352 00000100:00100000:2.0:1734016144.881762:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334004352 00002000:00100000:2.0:1734016144.881866:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2965504->2969599) req@ffff88007345ed80 x1818247334004352/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:105/0 lens 488/0 e 0 to 0 dl 1734016155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016144.881881:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345ed80 with x1818247334004352 ext(2965504->2969599) 00002000:00010000:2.0:1734016144.881891:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345ed80 00000100:00100000:2.0:1734016144.881935:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9021 00000100:00100000:2.0:1734016144.881948:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1981:x1818247334004352:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016144.882292:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1981:x1818247334004352:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 347us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016144.882303:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9021 00002000:00100000:2.0:1734016144.882308:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2965504->2969599) req@ffff88007345ed80 x1818247334004352/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:105/0 lens 488/440 e 0 to 0 dl 1734016155 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016144.882315:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007345ed80 with x1818247334004352 ext(2965504->2969599) 00002000:00010000:2.0:1734016144.882318:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007345ed80 00000100:00100000:0.0:1734016144.886060:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.886229:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334004480 00000100:00100000:3.0:1734016144.886252:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334004480 00000100:00100000:3.0:1734016144.887106:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11923 00000100:00100000:3.0:1734016144.887120:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247334004480:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016144.887160:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016144.887196:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27117948 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7583 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016144.887301:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335438976:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016144.887417:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398ef00 going to sleep for 11 seconds 00002000:00010000:3.0:1734016144.892270:0:8216:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size: 2728624 -> 2967646 00002000:00010000:3.0:1734016144.892286:0:8216:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016144 -> 1734016145 00002000:00010000:3.0:1734016144.892290:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016144 -> 1734016145 00000100:00100000:3.0:1734016144.892333:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335438976:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016144.892395:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27117948 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7583 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.892414:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27117948 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7583 expref: 14 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016144.892687:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016144.893327:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247334004480:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6203us (7529us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016144.893339:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11923 00000100:00100000:0.0:1734016144.896287:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016144.896652:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334004608 00000100:00100000:3.0:1734016144.896673:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334004608 00000100:00100000:1.0:1734016144.896925:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11924 00000100:00100000:1.0:1734016144.896941:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247334004608:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016144.896981:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016144.897019:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711794f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e758a expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016144.897135:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335439104:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016144.897681:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92c00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016144.900373:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335439104:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016144.900458:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711794f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e758a expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.900500:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc2711794f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e758a expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.900540:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016144.900654:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247334004608:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3711us (4385us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016144.900675:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11924 00000100:00100000:0.0:1734016144.904963:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.905086:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334004864 00000100:00100000:1.0:1734016144.905105:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334004864 00000100:00100000:1.0:1734016144.905318:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2385 00000100:00100000:1.0:1734016144.905330:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+26:10406:x1818247334004864:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016144.905429:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016144.905478:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499d200/0x5e3a3adc27117822 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7464 expref: 26 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.905516:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016144.905521:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016144.905780:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27117956 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016144.905826:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27117861 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e749c expref: 25 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.905834:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27117956 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016144.906332:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27117861 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e749c expref: 25 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.906348:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27117861 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e749c expref: 25 pid: 6479 timeout: 512 lvb_type: 0 00000100:00100000:1.0:1734016144.906363:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335439232:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016144.906715:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92a80 going to sleep for 11 seconds 00000100:00100000:1.0:1734016144.909901:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335439232:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016144.909942:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27117956 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016144.910334:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.910667:0:7698:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334004992 00000100:00100000:1.0:1734016144.910677:0:7698:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334004992 00010000:00010000:1.0:1734016144.910725:0:7698:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27117861 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e749c expref: 26 pid: 6479 timeout: 512 lvb_type: 0 00000100:00100000:1.0:1734016144.910784:0:7698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3256 00000100:00100000:1.0:1734016144.910794:0:7698:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800849b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+26:1981:x1818247334004992:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016144.910843:0:7698:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016144.910851:0:7698:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27117861 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e749c expref: 26 pid: 6479 timeout: 512 lvb_type: 0 00010000:00010000:1.0:1734016144.910865:0:7698:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27117861 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e749c expref: 26 pid: 6479 timeout: 512 lvb_type: 0 00010000:00010000:1.0:1734016144.910899:0:7698:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499db00/0x5e3a3adc27117861 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e749c expref: 26 pid: 6479 timeout: 512 lvb_type: 0 00010000:00010000:1.0:1734016144.911632:0:7698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016144.911643:0:7698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27117956 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016144.911658:0:7698:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27117956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016144.911669:0:7698:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27117956 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016144.911750:0:7698:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016144.911892:0:7698:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+25:1981:x1818247334004992:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1094us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016144.911904:0:7698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3256 00010000:00010000:2.0:1734016144.912868:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27117956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016144.912886:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27117956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:2.0:1734016144.913110:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968849 00000004:00010000:2.0:1734016144.913213:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800849b6a00 reply state ffff88007484c000 transno 4294968850 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27117956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:2.0:1734016144.913226:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016144.913361:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800849b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+28:10406:x1818247334004864:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 8032us (8421us total) trans 4294968850 rc 0/0 00000100:00100000:2.0:1734016144.913372:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2385 00000020:00080000:2.0:1734016144.913380:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016144.918687:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.918938:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334005120 00000100:00100000:1.0:1734016144.918956:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334005120 00010000:00010000:2.0:1734016144.919128:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27117956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016144.919144:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27117956 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016144.919153:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27117956 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016144.919161:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499ef40 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016144.919167:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27117956 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016144.919177:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27117956 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016144.919202:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016144.919206:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016144.919211:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27117956 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016144.919216:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499ef40/0x5e3a3adc27117956 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:1.0:1734016144.919488:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11925 00000100:00100000:1.0:1734016144.919502:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:10406:x1818247334005120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016144.919547:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016144.919578:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc2711795d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7591 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.919630:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711791e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 565248->569343) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7559 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.919642:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117925 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7560 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.919649:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016144.919652:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016144.919658:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc2711795d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7591 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.919718:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117925 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7560 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016144.919733:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117925 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7560 expref: 11 pid: 8216 timeout: 512 lvb_type: 1 00000100:00100000:1.0:1734016144.919749:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335439360:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016144.919915:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711791e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 565248->569343) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7559 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.919927:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711791e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 565248->569343) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7559 expref: 7 pid: 8216 timeout: 512 lvb_type: 0 00000100:00100000:1.0:1734016144.919938:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335439488:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016144.919963:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92a80 going to sleep for 11 seconds 00000100:00100000:1.0:1734016144.928476:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335439360:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016144.928494:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335439488:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016144.928542:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc2711795d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7591 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.928567:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016144.928633:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:10406:x1818247334005120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9134us (9976us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016144.928648:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11925 00000100:00100000:0.0:1734016144.929973:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.930026:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.930182:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334005376 00000100:00100000:2.0:1734016144.930194:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334005376 00010000:00010000:2.0:1734016144.930246:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711791e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 565248->569343) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7559 expref: 8 pid: 8216 timeout: 512 lvb_type: 0 00000100:00100000:2.0:1734016144.930296:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334005248 00000100:00100000:2.0:1734016144.930299:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334005248 00010000:00010000:2.0:1734016144.930312:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117925 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7560 expref: 11 pid: 8216 timeout: 512 lvb_type: 1 00000100:00100000:2.0:1734016144.930330:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3257 00000100:00100000:2.0:1734016144.930338:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247334005376:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016144.930358:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016144.930393:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711791e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 565248->569343) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7559 expref: 8 pid: 8216 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016144.930406:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711791e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 565248->569343) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7559 expref: 8 pid: 8216 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016144.930440:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc2711791e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 565248->569343) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7559 expref: 8 pid: 8216 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016144.930463:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016144.930510:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247334005376:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 172us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016144.930517:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3257 00000100:00100000:2.0:1734016144.930533:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3258 00000100:00100000:2.0:1734016144.930538:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247334005248:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016144.930546:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016144.930556:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117925 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7560 expref: 11 pid: 8216 timeout: 512 lvb_type: 1 00010000:00010000:2.0:1734016144.930568:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117925 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7560 expref: 11 pid: 8216 timeout: 512 lvb_type: 1 00010000:00010000:2.0:1734016144.930580:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117925 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7560 expref: 11 pid: 8216 timeout: 512 lvb_type: 1 00010000:00010000:2.0:1734016144.930590:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016144.930593:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016144.930599:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc2711795d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7591 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.930612:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc2711795d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7591 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.930652:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc2711795d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7591 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016144.930666:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335439616:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016144.930715:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016144.941619:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335439616:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016144.941679:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016144.941771:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247334005248:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 11228us (11740us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016144.941792:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3258 00000100:00100000:0.0:1734016144.942231:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.942482:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334005504 00000100:00100000:1.0:1734016144.942492:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334005504 00000100:00100000:1.0:1734016144.942553:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11926 00000100:00100000:1.0:1734016144.942560:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:10406:x1818247334005504:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016144.942586:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016144.942617:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117964 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7598 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.942653:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117941 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2961408->2969599) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e757c expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.942662:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016144.942665:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016144.942669:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117964 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7598 expref: 14 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.942712:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117941 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2961408->2969599) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e757c expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.942727:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117941 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2961408->2969599) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e757c expref: 13 pid: 8216 timeout: 512 lvb_type: 0 00000100:00100000:1.0:1734016144.942739:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335439744:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016144.943201:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92a80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016144.949790:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.949897:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334005632 00000100:00100000:0.0:1734016144.949912:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334005632 00002000:00100000:0.0:1734016144.949983:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (2961408->2967645) req@ffff8800750c0e00 x1818247334005632/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:105/0 lens 6728/0 e 0 to 0 dl 1734016155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016144.949998:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0e00 with x1818247334005632 ext(2961408->2967645) 00010000:00010000:0.0:1734016144.950014:0:7688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117941 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2961408->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e757c expref: 14 pid: 8216 timeout: 512 lvb_type: 0 00010000:00010000:0.0:1734016144.950031:0:7688:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117941 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2961408->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e757c expref: 14 pid: 8216 timeout: 512 lvb_type: 0 00002000:00010000:0.0:1734016144.950038:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800750c0e00 00000100:00100000:0.0:1734016144.950083:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 300 00000100:00100000:0.0:1734016144.950092:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1982:x1818247334005632:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:1.0:1734016144.951001:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335439744:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016144.951038:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117964 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7598 expref: 14 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016144.951056:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016144.951136:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:10406:x1818247334005504:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8576us (8907us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016144.951148:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11926 00000100:00100000:1.0:1734016144.953677:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247334005632:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 3563us (3880us total) trans 4294969554 rc 0/0 00000100:00100000:1.0:1734016144.953700:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 300 00002000:00100000:1.0:1734016144.953724:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (2961408->2967645) req@ffff8800750c0e00 x1818247334005632/t4294969554(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:105/0 lens 6728/448 e 0 to 0 dl 1734016155 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016144.953739:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0e00 with x1818247334005632 ext(2961408->2967645) 00010000:00010000:1.0:1734016144.953757:0:7688:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117941 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2961408->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e757c expref: 16 pid: 8216 timeout: 512 lvb_type: 0 00010000:00010000:1.0:1734016144.953785:0:7688:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117941 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2961408->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e757c expref: 16 pid: 8216 timeout: 512 lvb_type: 0 00002000:00010000:1.0:1734016144.953796:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800750c0e00 00000100:00100000:0.0:1734016144.957311:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.957534:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334005760 00000100:00100000:2.0:1734016144.957556:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334005760 00010000:00010000:2.0:1734016144.957641:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117941 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2961408->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e757c expref: 16 pid: 8216 timeout: 512 lvb_type: 0 00000100:00100000:2.0:1734016144.957716:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3259 00000100:00100000:2.0:1734016144.957732:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1981:x1818247334005760:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016144.957768:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1734016144.957859:0:6466:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 16 -> 32 00010000:00010000:2.0:1734016144.957870:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117941 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2961408->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e757c expref: 16 pid: 8216 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016144.957897:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117941 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2961408->2969599) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e757c expref: 16 pid: 8216 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016144.957948:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117941 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2961408->2969599) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e757c expref: 16 pid: 8216 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016144.958630:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016144.958634:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016144.958647:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117964 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7598 expref: 13 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.958660:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117964 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7598 expref: 13 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.958711:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117964 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7598 expref: 13 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016144.958728:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335439872:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016144.959648:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016144.965327:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.965417:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.965742:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335439872:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016144.965785:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016144.965940:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1981:x1818247334005760:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 8209us (8657us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016144.965963:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3259 00000100:00100000:3.0:1734016144.966380:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334006016 00000100:00100000:3.0:1734016144.966393:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334006016 00002000:00010000:3.0:1734016144.966457:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4150025->18446744073709551615) 00002000:00100000:3.0:1734016144.966463:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0700 with x1818247334006016 ext(4150025->18446744073709551615) 00002000:00010000:3.0:1734016144.966493:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c0700. 00000100:00100000:3.0:1734016144.966518:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334005888 00000100:00100000:3.0:1734016144.966521:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334005888 00002000:00010000:3.0:1734016144.966536:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:3.0:1734016144.966539:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbd500 with x1818247334005888 ext(4194304->18446744073709551615) 00002000:00010000:3.0:1734016144.966551:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073bbd500. 00000100:00100000:3.0:1734016144.966577:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9022 00000100:00100000:3.0:1734016144.966586:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247334006016:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016144.966999:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 2967646 -> 4150025 00002000:00010000:3.0:1734016144.967004:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016145 -> 1734016145 00002000:00010000:3.0:1734016144.967007:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016145 -> 1734016145 00002000:00010000:3.0:1734016144.967010:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016145 -> 1734016145 00002000:00010000:3.0:1734016144.967014:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:3.0:1734016144.967064:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+15:1981:x1818247334006016:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 477us (1766us total) trans 4294969555 rc 0/0 00000100:00100000:3.0:1734016144.967074:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9022 00002000:00010000:3.0:1734016144.967077:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4150025->18446744073709551615) 00002000:00100000:3.0:1734016144.967081:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c0700 with x1818247334006016 ext(4150025->18446744073709551615) 00002000:00010000:3.0:1734016144.967085:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c0700. 00000100:00100000:3.0:1734016144.967106:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9023 00000100:00100000:3.0:1734016144.967111:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247334005888:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016144.967329:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 6127477 -> 4194304 00002000:00010000:3.0:1734016144.967332:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016144 -> 1734016145 00002000:00010000:3.0:1734016144.967334:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016144 -> 1734016143 00002000:00010000:3.0:1734016144.967337:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016144 -> 1734016145 00002000:00010000:3.0:1734016144.967339:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 192 -> 184 00000100:00100000:3.0:1734016144.967359:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247334005888:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 246us (1941us total) trans 4294968102 rc 0/0 00000100:00100000:3.0:1734016144.967364:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9023 00002000:00010000:3.0:1734016144.967366:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:3.0:1734016144.967369:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbd500 with x1818247334005888 ext(4194304->18446744073709551615) 00002000:00010000:3.0:1734016144.967374:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073bbd500. 00000100:00100000:0.0:1734016144.971455:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.972238:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334006144 00000100:00100000:2.0:1734016144.972258:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334006144 00000100:00100000:2.0:1734016144.972364:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2386 00000100:00100000:2.0:1734016144.972376:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+27:10406:x1818247334006144:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016144.972429:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016144.972476:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711796b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e759f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.972635:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117972 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016144.972657:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016144.972673:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:2.0:1734016144.972707:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 8344329 00000004:00200000:2.0:1734016144.972713:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016144.972738:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016144.972769:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc2711796b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e759f expref: 29 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.972837:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117972 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e759f expref: 28 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016144.972847:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016144.972850:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016144.972855:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016144.972964:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+28:10406:x1818247334006144:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 588us (1535us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016144.972973:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2386 00000100:00100000:0.0:1734016144.980177:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016144.980268:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016144.980438:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334006528 00000100:00100000:1.0:1734016144.980455:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334006528 00002000:00100000:1.0:1734016144.980557:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (2732032->4153343) req@ffff880073bbc000 x1818247334006528/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:105/0 lens 488/0 e 0 to 0 dl 1734016155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016144.980573:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbc000 with x1818247334006528 ext(2732032->4153343) 00002000:00010000:1.0:1734016144.980583:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbc000 00000100:00100000:1.0:1734016144.980610:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334006656 00000100:00100000:1.0:1734016144.980613:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334006656 00002000:00100000:1.0:1734016144.980630:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (1040384->1044479) req@ffff880073bbed80 x1818247334006656/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:105/0 lens 488/0 e 0 to 0 dl 1734016155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016144.980639:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbed80 with x1818247334006656 ext(1040384->1044479) 00002000:00010000:1.0:1734016144.980644:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073bbed80 00000100:00100000:1.0:1734016144.980754:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9024 00000100:00100000:1.0:1734016144.980765:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+15:1981:x1818247334006528:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016144.983794:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9025 00000100:00100000:0.0:1734016144.983845:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247334006656:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016144.984365:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247334006656:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 528us (4092us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016144.984376:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9025 00002000:00100000:0.0:1734016144.984400:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (1040384->1044479) req@ffff880073bbed80 x1818247334006656/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:105/0 lens 488/4536 e 0 to 0 dl 1734016155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016144.984414:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbed80 with x1818247334006656 ext(1040384->1044479) 00002000:00010000:0.0:1734016144.984426:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073bbed80 00000100:00100000:0.0:1734016144.988398:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016144.989172:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334006912 00000100:00100000:2.0:1734016144.989190:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334006912 00002000:00100000:2.0:1734016144.989258:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1044480->1048575) req@ffff880073bbfb80 x1818247334006912/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:105/0 lens 488/0 e 0 to 0 dl 1734016155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016144.989273:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbfb80 with x1818247334006912 ext(1044480->1048575) 00002000:00010000:2.0:1734016144.989283:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073bbfb80 00000100:00100000:2.0:1734016144.989972:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9026 00000100:00100000:2.0:1734016144.989987:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247334006912:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016144.990281:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247334006912:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 295us (1906us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016144.990293:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9026 00002000:00100000:2.0:1734016144.990302:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1044480->1048575) req@ffff880073bbfb80 x1818247334006912/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:105/0 lens 488/4536 e 0 to 0 dl 1734016155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016144.990312:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbfb80 with x1818247334006912 ext(1044480->1048575) 00002000:00010000:2.0:1734016144.990315:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073bbfb80 00000100:00100000:0.0:1734016145.009698:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016145.012208:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334007040 00000100:00100000:1.0:1734016145.012233:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334007040 00000100:00100000:1.0:1734016145.012341:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11927 00000100:00100000:1.0:1734016145.012354:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247334007040:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016145.012852:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1734016145.012857:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016145 -> 1734016145 00002000:00010000:1.0:1734016145.012860:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016143 -> 1734016143 00002000:00010000:1.0:1734016145.012862:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016145 -> 1734016145 00002000:00010000:1.0:1734016145.012864:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 184 -> 200 00000100:00100000:1.0:1734016145.012971:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247334007040:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 619us (3294us total) trans 4294968103 rc 0/0 00000100:00100000:1.0:1734016145.012978:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11927 00000100:00100000:0.0:1734016145.015387:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.015538:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334007168 00000100:00100000:3.0:1734016145.015552:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334007168 00000100:00100000:3.0:1734016145.015622:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2387 00000100:00100000:3.0:1734016145.015631:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+25:10406:x1818247334007168:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016145.015673:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016145.015713:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117979 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e75a6 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.015954:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117980 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016145.015975:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016145.015990:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:3.0:1734016145.016026:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 8344329 00000004:00200000:3.0:1734016145.016031:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016145.016055:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016145.016079:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117979 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75a6 expref: 27 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.016111:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75a6 expref: 26 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.016122:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016145.016125:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016145.016130:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016145.016190:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+26:10406:x1818247334007168:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 559us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016145.016198:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2387 00000100:00100000:0.0:1734016145.028922:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.029981:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+15:1981:x1818247334006528:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 49211us (49823us total) trans 0 rc 1421312/1421312 00000100:00100000:2.0:1734016145.029995:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9024 00002000:00100000:2.0:1734016145.030011:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (2732032->4153343) req@ffff880073bbc000 x1818247334006528/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:105/0 lens 488/440 e 0 to 0 dl 1734016155 ref 1 fl Complete:/200/0 rc 1421312/1421312 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016145.030022:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073bbc000 with x1818247334006528 ext(2732032->4153343) 00002000:00010000:2.0:1734016145.030030:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073bbc000 00000100:00100000:3.0:1734016145.030223:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334007296 00000100:00100000:3.0:1734016145.030237:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334007296 00000100:00100000:3.0:1734016145.030290:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11928 00000100:00100000:3.0:1734016145.030298:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334007296:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016145.030327:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016145.030359:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27117987 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e75ad expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016145.030456:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335440000:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016145.030521:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016145.030931:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.033966:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334007424 00000100:00100000:3.0:1734016145.034002:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334007424 00000100:00100000:3.0:1734016145.034150:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11929 00000100:00100000:3.0:1734016145.034166:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1981:x1818247334007424:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016145.034213:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016145.034267:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711798e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e75b4 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016145.034405:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335440128:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016145.034587:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:2.0:1734016145.038348:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335440128:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016145.038422:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711798e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75b4 expref: 16 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.038447:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc2711798e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75b4 expref: 16 pid: 7682 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1734016145.038897:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016143 -> 1734016145 00000100:00100000:3.0:1734016145.038913:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335440000:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016145.038937:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27117987 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75ad expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.038949:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27117987 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75ad expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.039110:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:2.0:1734016145.039180:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1981:x1818247334007424:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5018us (8248us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016145.039193:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11929 00010000:00010000:3.0:1734016145.039504:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016145.039537:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334007296:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9240us (10639us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016145.039544:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11928 00000100:00100000:0.0:1734016145.044120:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016145.044202:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.044396:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334007552 00000100:00100000:3.0:1734016145.044414:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334007552 00000100:00100000:3.0:1734016145.044494:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334007680 00000100:00100000:3.0:1734016145.044496:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334007680 00000100:00100000:3.0:1734016145.044528:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11930 00000100:00100000:3.0:1734016145.044537:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334007552:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016145.044567:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016145.044598:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117995 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e75bb expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016145.044701:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335440256:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016145.044869:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016145.045068:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11931 00000100:00100000:3.0:1734016145.045072:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247334007680:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016145.045084:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016145.045100:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711799c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e75c2 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016145.045139:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335440384:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016145.045180:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:2.0:1734016145.050993:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335440384:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016145.051076:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711799c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75c2 expref: 16 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.051102:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc2711799c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75c2 expref: 16 pid: 7684 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1734016145.052327:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335440256:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016145.052372:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117995 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75bb expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.052388:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117995 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75bb expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.052562:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:2.0:1734016145.052702:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247334007680:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7624us (8495us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016145.052719:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11931 00010000:00010000:3.0:1734016145.053454:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016145.053499:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334007552:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8964us (9401us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016145.053506:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11930 00000100:00100000:0.0:1734016145.057585:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.057750:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334007936 00000100:00100000:2.0:1734016145.057772:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334007936 00002000:00100000:2.0:1734016145.058171:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (3842048->3846143) req@ffff8800755b5880 x1818247334007936/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 488/0 e 0 to 0 dl 1734016156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016145.058197:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5880 with x1818247334007936 ext(3842048->3846143) 00002000:00010000:2.0:1734016145.058207:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800755b5880 00000100:00100000:0.0:1734016145.058368:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9027 00000100:00100000:0.0:1734016145.058385:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247334007936:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016145.058780:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247334007936:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 398us (1213us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016145.058793:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9027 00002000:00100000:0.0:1734016145.058832:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (3842048->3846143) req@ffff8800755b5880 x1818247334007936/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 488/4536 e 0 to 0 dl 1734016156 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016145.058840:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b5880 with x1818247334007936 ext(3842048->3846143) 00002000:00010000:0.0:1734016145.058843:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800755b5880 00000100:00100000:0.0:1734016145.062932:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.064420:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334008064 00000100:00100000:3.0:1734016145.064439:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334008064 00000100:00100000:3.0:1734016145.064549:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11932 00000100:00100000:3.0:1734016145.064559:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334008064:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016145.064602:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016145.064643:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271179a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e75c9 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016145.064746:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335440512:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016145.064944:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1734016145.065504:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.065551:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334008192 00000100:00100000:2.0:1734016145.065559:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334008192 00000100:00100000:2.0:1734016145.065611:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11933 00000100:00100000:2.0:1734016145.065621:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247334008192:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.065638:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.065659:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271179aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e75d0 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016145.065700:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335440640:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016145.065736:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016145.069362:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335440640:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016145.069363:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335440512:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016145.069417:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271179aa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75d0 expref: 16 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.069417:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271179a3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75c9 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.069436:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbf180/0x5e3a3adc271179aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75d0 expref: 16 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.069436:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc271179a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75c9 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.069476:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00010000:00010000:3.0:1734016145.069505:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016145.069611:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334008064:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5051us (6694us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016145.069624:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11932 00000100:00100000:2.0:1734016145.069726:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247334008192:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4106us (4223us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016145.069732:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11933 00000100:00100000:3.0:1734016145.076316:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.076383:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.076532:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334008448 00000100:00100000:2.0:1734016145.076552:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334008448 00000100:00100000:2.0:1734016145.076642:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334008320 00000100:00100000:2.0:1734016145.076645:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334008320 00000100:00100000:2.0:1734016145.076679:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11934 00000100:00100000:2.0:1734016145.076691:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1981:x1818247334008448:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.076723:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.076756:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc271179b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e75de expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016145.076879:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335440768:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016145.076983:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016145.077058:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11935 00000100:00100000:1.0:1734016145.077068:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334008320:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016145.077079:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016145.077097:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499e880/0x5e3a3adc271179b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e75d7 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016145.077147:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335440896:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016145.077185:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92a80 going to sleep for 11 seconds 00000100:00100000:1.0:1734016145.080676:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335440896:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016145.080753:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499e880/0x5e3a3adc271179b8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75d7 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016145.080778:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499e880/0x5e3a3adc271179b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75d7 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016145.080844:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016145.080941:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334008320:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3871us (4555us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016145.080956:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11935 00000100:00100000:2.0:1734016145.081111:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335440768:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016145.081140:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc271179b1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75de expref: 16 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.081151:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc271179b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75de expref: 16 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.081174:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016145.081201:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1981:x1818247334008448:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4513us (4912us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016145.081207:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11934 00000100:00100000:0.0:1734016145.084667:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.084762:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334008704 00000100:00100000:2.0:1734016145.084777:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334008704 00000100:00100000:2.0:1734016145.084869:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2388 00000100:00100000:2.0:1734016145.084879:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+28:10406:x1818247334008704:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016145.084958:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016145.084997:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117972 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e759f expref: 28 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.085017:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016145.085023:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016145.085222:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271179bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.085238:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117980 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75a6 expref: 25 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.085244:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271179bf lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.085284:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75a6 expref: 25 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.085296:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117980 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75a6 expref: 25 pid: 13956 timeout: 512 lvb_type: 0 00000100:00100000:2.0:1734016145.085311:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335441024:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016145.085377:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016145.088118:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.088354:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335441024:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016145.088404:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271179bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:3.0:1734016145.088587:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334008832 00000100:00100000:3.0:1734016145.088602:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334008832 00010000:00010000:3.0:1734016145.088664:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117980 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75a6 expref: 26 pid: 13956 timeout: 512 lvb_type: 0 00000100:00100000:3.0:1734016145.088709:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3260 00000100:00100000:3.0:1734016145.088721:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+26:1981:x1818247334008832:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016145.088745:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016145.088754:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117980 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75a6 expref: 26 pid: 13956 timeout: 512 lvb_type: 0 00010000:00010000:3.0:1734016145.088765:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75a6 expref: 26 pid: 13956 timeout: 512 lvb_type: 0 00010000:00010000:3.0:1734016145.088847:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117980 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75a6 expref: 26 pid: 13956 timeout: 512 lvb_type: 0 00010000:00010000:3.0:1734016145.088897:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016145.088902:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271179bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016145.088917:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271179bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016145.088928:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271179bf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016145.088958:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016145.089036:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+25:1981:x1818247334008832:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 318us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016145.089048:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3260 00010000:00010000:2.0:1734016145.089896:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271179bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.089911:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271179bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:2.0:1734016145.090064:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968851 00000004:00010000:2.0:1734016145.090130:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff8800755b6a00 reply state ffff880075573000 transno 4294968852 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271179bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:2.0:1734016145.090138:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016145.090240:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+30:10406:x1818247334008704:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 5360us (5586us total) trans 4294968852 rc 0/0 00000100:00100000:2.0:1734016145.090248:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2388 00000020:00080000:2.0:1734016145.090253:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016145.096084:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1734016145.096620:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271179bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.096638:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271179bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.096647:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271179bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.096655:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbcb40 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016145.096662:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271179bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.096674:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271179bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.096706:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016145.096709:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016145.096716:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271179bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.096726:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc271179bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:3.0:1734016145.096858:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334009088 00000100:00100000:3.0:1734016145.096876:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334009088 00002000:00010000:3.0:1734016145.096933:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (2168867->18446744073709551615) 00002000:00100000:3.0:1734016145.096940:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4380 with x1818247334009088 ext(2168867->18446744073709551615) 00002000:00010000:3.0:1734016145.096957:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4380. 00000100:00100000:3.0:1734016145.096983:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9028 00000100:00100000:3.0:1734016145.096991:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+15:1982:x1818247334009088:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016145.099100:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 4150025 -> 2168867 00002000:00010000:3.0:1734016145.099113:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016145 -> 1734016145 00002000:00010000:3.0:1734016145.099116:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016145 -> 1734016145 00002000:00010000:3.0:1734016145.099118:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016145 -> 1734016145 00002000:00010000:3.0:1734016145.099121:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 32 -> 16 00000100:00100000:3.0:1734016145.099249:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+16:1982:x1818247334009088:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 2245us (3175us total) trans 4294969556 rc 0/0 00000100:00100000:3.0:1734016145.099268:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9028 00002000:00010000:3.0:1734016145.099277:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (2168867->18446744073709551615) 00002000:00100000:3.0:1734016145.099282:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4380 with x1818247334009088 ext(2168867->18446744073709551615) 00002000:00010000:3.0:1734016145.099290:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800755b4380. 00000100:00100000:0.0:1734016145.100391:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.100631:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334008960 00000100:00100000:2.0:1734016145.100649:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334008960 00002000:00010000:2.0:1734016145.100718:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:2.0:1734016145.100724:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4700 with x1818247334008960 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1734016145.100746:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800755b4700. 00000100:00100000:2.0:1734016145.100794:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9029 00000100:00100000:2.0:1734016145.100828:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247334008960:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016145.101072:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1734016145.101077:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016145 -> 1734016145 00002000:00010000:2.0:1734016145.101079:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016145 -> 1734016143 00002000:00010000:2.0:1734016145.101081:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016145 -> 1734016145 00002000:00010000:2.0:1734016145.101084:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 200 -> 200 00000100:00100000:2.0:1734016145.101158:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247334008960:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 333us (774us total) trans 4294968104 rc 0/0 00000100:00100000:2.0:1734016145.101167:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9029 00002000:00010000:2.0:1734016145.101171:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:2.0:1734016145.101173:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800755b4700 with x1818247334008960 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1734016145.101180:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800755b4700. 00000100:00100000:0.0:1734016145.105513:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.105847:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334009216 00000100:00100000:2.0:1734016145.105865:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334009216 00000100:00100000:2.0:1734016145.105956:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2389 00000100:00100000:2.0:1734016145.105969:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+29:10406:x1818247334009216:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.106019:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.106055:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271179c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e75e5 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.106232:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271179cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.106255:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271179cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.106275:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271179cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:2.0:1734016145.106311:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 6363171 00000004:00200000:2.0:1734016145.106316:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016145.106334:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271179cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.106361:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc271179c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75e5 expref: 31 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.106388:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271179cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75e5 expref: 30 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.106401:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016145.106404:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016145.106408:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016145.106509:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+30:10406:x1818247334009216:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 541us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016145.106517:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2389 00000100:00100000:0.0:1734016145.110775:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.112759:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334009344 00000100:00100000:2.0:1734016145.112793:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334009344 00000100:00100000:3.0:1734016145.113094:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2390 00000100:00100000:3.0:1734016145.113108:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+25:10406:x1818247334009344:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016145.113144:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016145.113172:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271179d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e75ec expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.113348:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271179db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016145.113374:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271179db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016145.113393:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271179db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:3.0:1734016145.113433:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 6363171 00000004:00200000:3.0:1734016145.113439:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016145.113476:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271179db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016145.113513:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc271179d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75ec expref: 27 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.113542:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271179db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75ec expref: 26 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.113552:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016145.113556:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016145.113560:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016145.113667:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+26:10406:x1818247334009344:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 561us (2918us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016145.113675:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2390 00000100:00100000:0.0:1734016145.117285:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016145.117595:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.117954:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334009600 00000100:00100000:2.0:1734016145.117973:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334009600 00000100:00100000:2.0:1734016145.118061:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334009472 00000100:00100000:2.0:1734016145.118065:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334009472 00000100:00100000:2.0:1734016145.118095:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11936 00000100:00100000:2.0:1734016145.118106:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247334009600:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.118139:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.118177:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271179e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e75fa expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016145.118289:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335441152:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016145.118439:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11937 00000100:00100000:0.0:1734016145.118445:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334009472:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016145.118455:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016145.118478:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7581200/0x5e3a3adc271179e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e75f3 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016145.118519:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335441280:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016145.120011:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00000100:00100000:0.0:1734016145.120869:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f9c0 going to sleep for 11 seconds 00002000:00010000:1.0:1734016145.123863:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016143 -> 1734016145 00000100:00100000:1.0:1734016145.123907:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335441280:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016145.123963:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581200/0x5e3a3adc271179e9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75f3 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016145.123984:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581200/0x5e3a3adc271179e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75f3 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016145.124011:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581200, rc 0) 00000100:00100000:1.0:1734016145.124094:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334009472:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5646us (6495us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016145.124109:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11937 00000100:00100000:2.0:1734016145.124483:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335441152:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016145.124517:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271179e2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75fa expref: 16 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.124529:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc271179e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75fa expref: 16 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.124545:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016145.124576:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247334009600:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6472us (7315us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016145.124583:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11936 00000100:00100000:0.0:1734016145.127253:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016145.127742:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.128356:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334009856 00000100:00100000:2.0:1734016145.128376:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334009856 00000100:00100000:1.0:1734016145.128522:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334009728 00000100:00100000:1.0:1734016145.128527:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334009728 00000100:00100000:1.0:1734016145.128579:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11938 00000100:00100000:1.0:1734016145.128588:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247334009728:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016145.128619:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016145.128653:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499e880/0x5e3a3adc271179f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7601 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016145.128738:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335441408:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016145.128927:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11939 00000100:00100000:3.0:1734016145.128933:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1983:x1818247334009856:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016145.128944:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016145.128957:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271179f7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7608 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016145.128988:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335441536:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016145.129398:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92a80 going to sleep for 11 seconds 00000100:00100000:3.0:1734016145.129462:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016145.132304:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335441408:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016145.132349:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499e880/0x5e3a3adc271179f0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7601 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016145.132365:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499e880/0x5e3a3adc271179f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7601 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016145.132386:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e880, rc 0) 00000100:00100000:1.0:1734016145.132442:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247334009728:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3854us (4699us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016145.132452:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11938 00000100:00100000:3.0:1734016145.132560:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335441536:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016145.132586:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271179f7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7608 expref: 16 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.132595:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc271179f7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7608 expref: 16 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.132627:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016145.132650:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1983:x1818247334009856:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3716us (5418us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016145.132656:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11939 00000100:00100000:0.0:1734016145.145555:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.147869:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334010112 00000100:00100000:3.0:1734016145.147892:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334010112 00002000:00100000:2.0:1734016145.148560:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff880073ad7480 x1818247334010112/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 520/0 e 0 to 0 dl 1734016156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016145.148576:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad7480 with x1818247334010112 ext(0->4194303) 00002000:00010000:2.0:1734016145.148585:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073ad7480 00000100:00100000:2.0:1734016145.148639:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9030 00000100:00100000:2.0:1734016145.148651:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247334010112:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016145.215923:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1984:x1818247334010112:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 67236us (70345us total) trans 0 rc 4182016/4182016 00000100:00100000:3.0:1734016145.215947:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9030 00002000:00100000:3.0:1734016145.215976:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff880073ad7480 x1818247334010112/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 520/440 e 0 to 0 dl 1734016156 ref 1 fl Complete:/200/0 rc 4182016/4182016 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016145.215988:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad7480 with x1818247334010112 ext(0->4194303) 00002000:00010000:3.0:1734016145.215998:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073ad7480 00000100:00100000:0.0:1734016145.225062:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016145.225892:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.226499:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334010368 00000100:00100000:3.0:1734016145.226516:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334010368 00002000:00100000:3.0:1734016145.226593:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (0->2170879) req@ffff880073ad5f80 x1818247334010368/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 488/0 e 0 to 0 dl 1734016156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016145.226608:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5f80 with x1818247334010368 ext(0->2170879) 00002000:00010000:3.0:1734016145.226616:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5f80 00000100:00100000:3.0:1734016145.226656:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9031 00000100:00100000:3.0:1734016145.226666:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+16:1982:x1818247334010368:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016145.226798:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016145.226866:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334010496 00000100:00100000:1.0:1734016145.226877:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334010496 00000100:00100000:1.0:1734016145.226928:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334010624 00000100:00100000:1.0:1734016145.226932:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334010624 00000100:00100000:2.0:1734016145.226935:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11940 00000100:00100000:2.0:1734016145.226943:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334010496:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.226958:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1734016145.226961:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11941 00000100:00100000:1.0:1734016145.226971:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247334010624:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016145.226987:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.226991:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc271179fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e760f expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016145.227011:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27117a05 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7616 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016145.227067:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335441664:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016145.227071:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335441792:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016145.227302:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016145.227304:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92a80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016145.237166:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335441664:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016145.237238:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc271179fe lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e760f expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.237260:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc271179fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e760f expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.237301:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016145.237386:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334010496:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10440us (11492us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016145.237399:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11940 00000100:00100000:1.0:1734016145.237991:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335441792:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016145.238052:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27117a05 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7616 expref: 16 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016145.238069:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499ef40/0x5e3a3adc27117a05 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7616 expref: 16 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016145.238106:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ef40, rc 0) 00000100:00100000:1.0:1734016145.238180:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247334010624:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11209us (11381us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016145.238189:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11941 00000100:00100000:2.0:1734016145.246586:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.247532:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+16:1982:x1818247334010368:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 20861us (22485us total) trans 0 rc 2170880/2170880 00000100:00100000:3.0:1734016145.247554:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9031 00002000:00100000:3.0:1734016145.247570:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (0->2170879) req@ffff880073ad5f80 x1818247334010368/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 488/440 e 0 to 0 dl 1734016156 ref 1 fl Complete:/200/0 rc 2170880/2170880 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016145.247582:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073ad5f80 with x1818247334010368 ext(0->2170879) 00002000:00010000:3.0:1734016145.247590:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073ad5f80 00000100:00100000:2.0:1734016145.247829:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016145.248695:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334010880 00000100:00100000:1.0:1734016145.248707:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334010880 00000100:00100000:1.0:1734016145.248751:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334010752 00000100:00100000:1.0:1734016145.248753:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334010752 00000100:00100000:1.0:1734016145.248771:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11942 00000100:00100000:1.0:1734016145.248779:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247334010880:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016145.248820:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016145.248843:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27117a0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7624 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016145.248919:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335441920:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016145.248992:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92a80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016145.249078:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11943 00000100:00100000:0.0:1734016145.249086:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334010752:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016145.249094:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016145.249106:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7581200/0x5e3a3adc27117a13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e761d expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016145.249135:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073791500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335442048:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016145.249159:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016145.252752:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335441920:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016145.252829:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27117a0c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7624 expref: 16 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016145.252846:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27117a0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7624 expref: 16 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016145.252863:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:2.0:1734016145.253119:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073791500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335442048:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016145.253144:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581200/0x5e3a3adc27117a13 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e761d expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.253153:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581200/0x5e3a3adc27117a13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e761d expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.253166:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581200, rc 0) 00000100:00100000:2.0:1734016145.253221:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334010752:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4134us (5392us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016145.253230:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11943 00000100:00100000:1.0:1734016145.253362:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247334010880:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4584us (6799us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016145.253368:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11942 00000100:00100000:0.0:1734016145.259300:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016145.259540:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334011136 00000100:00100000:1.0:1734016145.259553:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334011136 00000100:00100000:1.0:1734016145.260731:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11944 00000100:00100000:1.0:1734016145.260744:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1983:x1818247334011136:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016145.260778:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016145.260823:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27117a1a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7632 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016145.260917:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335442176:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016145.261031:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92a80 going to sleep for 11 seconds 00000100:00100000:0.0:1734016145.261314:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.261553:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334011008 00000100:00100000:2.0:1734016145.261560:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334011008 00000100:00100000:2.0:1734016145.261602:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11945 00000100:00100000:2.0:1734016145.261607:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247334011008:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.261616:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.261628:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a21 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e762b expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016145.261660:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335442304:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016145.261686:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016145.265258:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335442176:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016145.265258:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335442304:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016145.265311:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27117a1a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7632 expref: 16 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.265311:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a21 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e762b expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016145.265332:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499db00/0x5e3a3adc27117a1a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7632 expref: 16 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.265332:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a21 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e762b expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.265363:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00010000:00010000:1.0:1734016145.265364:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016145.265433:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1983:x1818247334011136:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4686us (6148us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016145.265444:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11944 00000100:00100000:2.0:1734016145.266857:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247334011008:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5233us (5528us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016145.266873:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11945 00000100:00100000:0.0:1734016145.271443:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.271538:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334011264 00000100:00100000:2.0:1734016145.271551:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334011264 00000100:00100000:2.0:1734016145.271617:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11946 00000100:00100000:2.0:1734016145.271626:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247334011264:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.271648:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.271667:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7639 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016145.271737:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335442432:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016145.271868:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00000100:00100000:0.0:1734016145.272316:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.273022:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334011392 00000100:00100000:2.0:1734016145.273036:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334011392 00000100:00100000:2.0:1734016145.273117:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11947 00000100:00100000:2.0:1734016145.273125:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247334011392:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.273159:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.273192:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117a2f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7640 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016145.274161:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335442560:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016145.274237:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:3.0:1734016145.274285:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335442432:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016145.274319:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a28 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7639 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.274331:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7639 expref: 8 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.274361:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:3.0:1734016145.274394:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247334011264:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2769us (2967us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016145.274403:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11946 00000100:00100000:2.0:1734016145.276511:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335442560:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016145.276558:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117a2f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7640 expref: 16 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.276576:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117a2f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7640 expref: 16 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.276607:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016145.276694:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247334011392:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3568us (4377us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016145.276705:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11947 00000100:00100000:0.0:1734016145.282300:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.282579:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334011648 00000100:00100000:2.0:1734016145.282596:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334011648 00000100:00100000:2.0:1734016145.282687:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2391 00000100:00100000:2.0:1734016145.282697:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+26:10406:x1818247334011648:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016145.282790:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016145.282887:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc271179db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75ec expref: 26 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.282916:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016145.282922:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016145.283160:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.283181:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271179cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75e5 expref: 29 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.283190:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a36 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.283229:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271179cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75e5 expref: 29 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.283244:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271179cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75e5 expref: 29 pid: 6479 timeout: 512 lvb_type: 0 00000100:00100000:2.0:1734016145.283263:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335442688:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016145.283375:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016145.289252:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335442688:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016145.289290:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016145.289336:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.289380:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334011776 00000100:00100000:2.0:1734016145.289386:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334011776 00010000:00010000:2.0:1734016145.289417:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271179cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75e5 expref: 30 pid: 6479 timeout: 512 lvb_type: 0 00000100:00100000:2.0:1734016145.289474:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3261 00000100:00100000:2.0:1734016145.289482:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+30:1981:x1818247334011776:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016145.289497:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016145.289504:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271179cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75e5 expref: 30 pid: 6479 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016145.289514:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271179cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75e5 expref: 30 pid: 6479 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016145.289535:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc271179cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e75e5 expref: 30 pid: 6479 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016145.289547:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016145.289551:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.289559:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.289566:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a36 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.289592:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016145.289648:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+29:1981:x1818247334011776:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 167us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016145.289654:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3261 00010000:00010000:0.0:1734016145.289781:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016145.289788:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:0.0:1734016145.289931:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968853 00000004:00010000:0.0:1734016145.289980:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880073790000 reply state ffff880075572000 transno 4294968854 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016145.289989:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016145.290072:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+28:10406:x1818247334011648:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 7375us (7789us total) trans 4294968854 rc 0/0 00000100:00100000:0.0:1734016145.290208:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2391 00000020:00080000:0.0:1734016145.290215:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016145.293049:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.293076:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.293085:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.293093:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbdf80 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016145.293099:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016145.293104:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1734016145.293108:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.293132:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016145.293135:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016145.293140:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.293146:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117a36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:3.0:1734016145.293224:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334011904 00000100:00100000:3.0:1734016145.293242:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334011904 00000100:00100000:3.0:1734016145.293332:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11948 00000100:00100000:3.0:1734016145.293345:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247334011904:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016145.293380:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016145.293405:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117a3d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7647 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.293456:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc2711795d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7591 expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.293476:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016145.293478:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016145.293481:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117a3d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7647 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.293527:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc2711795d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7591 expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.293539:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc2711795d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7591 expref: 12 pid: 7682 timeout: 512 lvb_type: 0 00000100:00100000:3.0:1734016145.293555:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335442816:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016145.293662:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016145.296424:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335442816:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016145.296476:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117a3d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7647 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016145.296614:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.296708:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334012032 00000100:00100000:2.0:1734016145.296718:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334012032 00002000:00100000:2.0:1734016145.296762:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (1040384->3846143) req@ffff880073790380 x1818247334012032/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 504/0 e 0 to 0 dl 1734016156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016145.296772:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790380 with x1818247334012032 ext(1040384->3846143) 00010000:00010000:2.0:1734016145.296780:0:13914:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc2711795d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7591 expref: 13 pid: 7682 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016145.296792:0:13914:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc2711795d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7591 expref: 13 pid: 7682 timeout: 512 lvb_type: 0 00002000:00010000:2.0:1734016145.296817:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880073790380 00000100:00100000:2.0:1734016145.296844:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 301 00000100:00100000:2.0:1734016145.296852:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247334012032:12345-192.168.201.16@tcp:4:fsx.0 00010000:00010000:3.0:1734016145.300335:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016145.300449:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247334011904:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7094us (7340us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016145.300505:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11948 00000100:00100000:3.0:1734016145.306822:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+15:1982:x1818247334012032:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 9926us (10166us total) trans 4294968105 rc 0/0 00000100:00100000:3.0:1734016145.306840:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 301 00002000:00100000:3.0:1734016145.306862:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (1040384->3846143) req@ffff880073790380 x1818247334012032/t4294968105(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 504/448 e 0 to 0 dl 1734016156 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016145.306872:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073790380 with x1818247334012032 ext(1040384->3846143) 00010000:00010000:3.0:1734016145.306886:0:13914:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc2711795d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7591 expref: 15 pid: 7682 timeout: 512 lvb_type: 0 00010000:00010000:3.0:1734016145.306907:0:13914:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc2711795d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7591 expref: 15 pid: 7682 timeout: 512 lvb_type: 0 00002000:00010000:3.0:1734016145.306913:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880073790380 00000100:00100000:0.0:1734016145.318012:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.318098:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334012160 00000100:00100000:2.0:1734016145.318110:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334012160 00010000:00010000:2.0:1734016145.318165:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc2711795d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7591 expref: 15 pid: 7682 timeout: 512 lvb_type: 0 00000100:00100000:2.0:1734016145.318229:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3262 00000100:00100000:2.0:1734016145.318241:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+15:1982:x1818247334012160:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016145.318268:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1734016145.318292:0:9876:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 200 -> 224 00010000:00010000:2.0:1734016145.318299:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc2711795d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7591 expref: 15 pid: 7682 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016145.318312:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc2711795d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7591 expref: 15 pid: 7682 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016145.318343:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc2711795d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7591 expref: 15 pid: 7682 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016145.318377:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016145.318381:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016145.318390:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117a3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7647 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.318399:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117a3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7647 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.318439:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117a3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7647 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016145.318453:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335442944:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016145.327057:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:0.0:1734016145.332330:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.332509:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335442944:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016145.332543:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016145.332614:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247334012160:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 14373us (14616us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016145.332631:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3262 00000100:00100000:3.0:1734016145.333031:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334012288 00000100:00100000:3.0:1734016145.333045:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334012288 00000100:00100000:3.0:1734016145.333125:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11949 00000100:00100000:3.0:1734016145.333133:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10406:x1818247334012288:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016145.333165:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016145.333198:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117a44 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e764e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.333251:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117964 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7598 expref: 15 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.333259:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016145.333262:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016145.333266:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117a44 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e764e expref: 16 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.333319:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117964 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7598 expref: 15 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.333338:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117964 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7598 expref: 15 pid: 7682 timeout: 512 lvb_type: 0 00000100:00100000:3.0:1734016145.333358:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335443072:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016145.333416:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016145.350789:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335443072:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016145.350952:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117a44 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e764e expref: 16 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.350985:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016145.351128:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247334012288:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 17993us (18817us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016145.351139:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11949 00000100:00100000:0.0:1734016145.372796:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.373174:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334012416 00000100:00100000:2.0:1734016145.373187:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334012416 00010000:00010000:2.0:1734016145.373238:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117964 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7598 expref: 16 pid: 7682 timeout: 512 lvb_type: 0 00000100:00100000:2.0:1734016145.373371:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3263 00000100:00100000:2.0:1734016145.373380:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+16:1981:x1818247334012416:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016145.373399:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016145.373426:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117964 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7598 expref: 16 pid: 7682 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016145.373438:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117964 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7598 expref: 16 pid: 7682 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016145.373477:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f840/0x5e3a3adc27117964 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7598 expref: 16 pid: 7682 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016145.373503:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016145.373505:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016145.373512:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117a44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e764e expref: 15 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.373528:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117a44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e764e expref: 15 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.373574:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117a44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e764e expref: 15 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016145.373588:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335443200:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016145.373665:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016145.378117:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335443200:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016145.378152:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016145.378226:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+15:1981:x1818247334012416:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4844us (5450us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016145.378240:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3263 00000100:00100000:0.0:1734016145.383981:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016145.384053:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.384148:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334012544 00000100:00100000:3.0:1734016145.384160:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334012544 00002000:00010000:3.0:1734016145.384208:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:3.0:1734016145.384213:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075874700 with x1818247334012544 ext(4194304->18446744073709551615) 00002000:00010000:3.0:1734016145.384227:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075874700. 00000100:00100000:3.0:1734016145.384252:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334012672 00000100:00100000:3.0:1734016145.384254:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334012672 00002000:00010000:3.0:1734016145.384264:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (3916196->18446744073709551615) 00002000:00100000:3.0:1734016145.384267:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075876d80 with x1818247334012672 ext(3916196->18446744073709551615) 00002000:00010000:3.0:1734016145.384273:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075876d80. 00000100:00100000:3.0:1734016145.384287:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9032 00000100:00100000:3.0:1734016145.384293:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247334012544:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016145.384485:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1734016145.384489:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016145 -> 1734016145 00002000:00010000:3.0:1734016145.384490:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016145 -> 1734016145 00002000:00010000:3.0:1734016145.384492:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016145 -> 1734016145 00002000:00010000:3.0:1734016145.384495:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 224 -> 224 00000100:00100000:3.0:1734016145.384550:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247334012544:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 256us (586us total) trans 4294968106 rc 0/0 00000100:00100000:3.0:1734016145.384556:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9032 00002000:00010000:3.0:1734016145.384560:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:3.0:1734016145.384562:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075874700 with x1818247334012544 ext(4194304->18446744073709551615) 00002000:00010000:3.0:1734016145.384565:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075874700. 00000100:00100000:3.0:1734016145.384583:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9033 00000100:00100000:3.0:1734016145.384587:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1981:x1818247334012672:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016145.384769:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 2168867 -> 3916196 00002000:00010000:3.0:1734016145.384772:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016145 -> 1734016145 00002000:00010000:3.0:1734016145.384774:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016145 -> 1734016145 00002000:00010000:3.0:1734016145.384776:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016145 -> 1734016145 00002000:00010000:3.0:1734016145.384779:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:3.0:1734016145.384797:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1981:x1818247334012672:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 209us (743us total) trans 4294969557 rc 0/0 00000100:00100000:3.0:1734016145.384846:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9033 00002000:00010000:3.0:1734016145.384848:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (3916196->18446744073709551615) 00002000:00100000:3.0:1734016145.384851:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075876d80 with x1818247334012672 ext(3916196->18446744073709551615) 00002000:00010000:3.0:1734016145.384857:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075876d80. 00000100:00100000:0.0:1734016145.394924:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.395056:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334012928 00000100:00100000:2.0:1734016145.395071:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334012928 00002000:00100000:2.0:1734016145.395144:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2732032->3919871) req@ffff880075875c00 x1818247334012928/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:106/0 lens 488/0 e 0 to 0 dl 1734016156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016145.395156:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075875c00 with x1818247334012928 ext(2732032->3919871) 00002000:00010000:2.0:1734016145.395161:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075875c00 00000100:00100000:2.0:1734016145.395193:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9034 00000100:00100000:2.0:1734016145.395201:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1981:x1818247334012928:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016145.458356:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1981:x1818247334012928:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 63136us (63424us total) trans 0 rc 1187840/1187840 00000100:00100000:2.0:1734016145.458378:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9034 00002000:00100000:2.0:1734016145.458397:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (2732032->3919871) req@ffff880075875c00 x1818247334012928/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:106/0 lens 488/440 e 0 to 0 dl 1734016156 ref 1 fl Complete:/200/0 rc 1187840/1187840 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016145.458409:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075875c00 with x1818247334012928 ext(2732032->3919871) 00002000:00010000:2.0:1734016145.458417:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075875c00 00000100:00100000:0.0:1734016145.462703:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.464101:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334013056 00000100:00100000:2.0:1734016145.464111:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334013056 00002000:00100000:2.0:1734016145.464161:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (3911680->3916195) req@ffff880075877480 x1818247334013056/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:106/0 lens 5008/0 e 0 to 0 dl 1734016156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016145.464172:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075877480 with x1818247334013056 ext(3911680->3916195) 00002000:00010000:2.0:1734016145.464178:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075877480 00000100:00100000:2.0:1734016145.465143:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9035 00000100:00100000:2.0:1734016145.465152:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1982:x1818247334013056:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016145.466334:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:1982:x1818247334013056:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1177us (3637us total) trans 4294969558 rc 0/0 00000100:00100000:2.0:1734016145.466345:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9035 00002000:00100000:2.0:1734016145.466357:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (3911680->3916195) req@ffff880075877480 x1818247334013056/t4294969558(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:106/0 lens 5008/448 e 0 to 0 dl 1734016156 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016145.466365:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075877480 with x1818247334013056 ext(3911680->3916195) 00002000:00010000:2.0:1734016145.466373:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075877480 00000100:00100000:0.0:1734016145.476112:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.476319:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334013184 00000100:00100000:2.0:1734016145.476334:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334013184 00000100:00100000:3.0:1734016145.477576:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2392 00000100:00100000:3.0:1734016145.477594:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:10406:x1818247334013184:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:3.0:1734016145.477777:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:10406:x1818247334013184:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 185us (1683us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016145.477785:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2392 00000100:00100000:0.0:1734016145.481667:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.489352:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334013312 00000100:00100000:3.0:1734016145.489376:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334013312 00000100:00100000:3.0:1734016145.489477:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11950 00000100:00100000:3.0:1734016145.489486:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:1983:x1818247334013312:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:0.0:1734016145.491475:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969558 is committed 00000001:00080000:0.0:1734016145.491523:0:8951:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0001: transno 4294969556 is committed 00000100:00100000:3.0:1734016145.491895:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1983:x1818247334013312:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2398us (10249us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016145.491909:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11950 00000100:00100000:0.0:1734016145.500338:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.500554:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334013440 00000100:00100000:2.0:1734016145.500569:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334013440 00000100:00100000:2.0:1734016145.500661:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2393 00000100:00100000:2.0:1734016145.500674:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:10406:x1818247334013440:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.500720:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.500758:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117a4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7655 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.501003:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117a52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.501029:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.501045:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:2.0:1734016145.501083:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 8110500 00000004:00200000:2.0:1734016145.501089:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016145.501111:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016145.501140:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117a4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7655 expref: 29 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.501183:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117a52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7655 expref: 28 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.501192:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016145.501194:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016145.501199:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016145.501262:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+28:10406:x1818247334013440:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 592us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016145.501272:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2393 00000100:00100000:0.0:1734016145.513988:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016145.514059:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.514151:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334013696 00000100:00100000:3.0:1734016145.514160:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334013696 00000100:00100000:3.0:1734016145.514208:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334013568 00000100:00100000:3.0:1734016145.514209:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334013568 00000100:00100000:3.0:1734016145.514228:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11951 00000100:00100000:3.0:1734016145.514236:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247334013696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016145.514268:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016145.514295:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27117a59 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7663 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016145.514366:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335443328:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016145.514425:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:2.0:1734016145.514886:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11952 00000100:00100000:2.0:1734016145.514892:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247334013568:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.514901:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.514914:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117a60 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e765c expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016145.514941:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335443456:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016145.514966:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00002000:00010000:3.0:1734016145.522010:0:8216:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016145 -> 1734016146 00002000:00010000:3.0:1734016145.522024:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016145 -> 1734016146 00002000:00010000:3.0:1734016145.522026:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016145 -> 1734016146 00002000:00010000:3.0:1734016145.522028:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 16 -> 32 00000100:00100000:3.0:1734016145.522063:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335443328:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016145.522113:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27117a59 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7663 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.522130:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27117a59 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7663 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.522149:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016145.522214:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247334013696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7977us (8243us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016145.522224:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11951 00002000:00010000:2.0:1734016145.522427:0:7684:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime: 1734016145 -> 1734016146 00002000:00010000:2.0:1734016145.522430:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016145 -> 1734016146 00002000:00010000:2.0:1734016145.522432:0:7684:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016145 -> 1734016146 00000100:00100000:2.0:1734016145.522445:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335443456:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016145.522472:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117a60 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e765c expref: 15 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.522482:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117a60 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e765c expref: 15 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.522494:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016145.522522:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247334013568:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7630us (8463us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016145.522528:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11952 00000100:00100000:0.0:1734016145.527541:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.527664:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334013824 00000100:00100000:2.0:1734016145.527676:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334013824 00000100:00100000:2.0:1734016145.527746:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11953 00000100:00100000:2.0:1734016145.527754:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247334013824:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.527779:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.527837:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117a67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e766a expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.527877:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117a44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e764e expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.527883:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016145.527886:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016145.527889:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117a67 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e766a expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.527924:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117a44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e764e expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.527936:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117a44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e764e expref: 6 pid: 8216 timeout: 512 lvb_type: 0 00000100:00100000:2.0:1734016145.527950:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335443584:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016145.528027:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016145.535427:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335443584:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016145.535520:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117a67 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e766a expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.535566:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016145.535671:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247334013824:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7914us (8144us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016145.535688:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11953 00000100:00100000:0.0:1734016145.538187:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.538308:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334013952 00000100:00100000:2.0:1734016145.538328:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334013952 00010000:00010000:2.0:1734016145.538393:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117a44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e764e expref: 7 pid: 8216 timeout: 512 lvb_type: 0 00000100:00100000:2.0:1734016145.538451:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3264 00000100:00100000:2.0:1734016145.538469:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247334013952:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016145.538494:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016145.538529:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117a44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e764e expref: 7 pid: 8216 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016145.538543:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117a44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e764e expref: 7 pid: 8216 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016145.538587:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117a44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e764e expref: 7 pid: 8216 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016145.540395:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016145.540404:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016145.540421:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117a67 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->917503) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e766a expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.540440:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117a67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->917503) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e766a expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.540511:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117a67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->917503) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e766a expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016145.540527:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335443712:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016145.540622:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016145.558135:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335443712:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016145.558179:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016145.558241:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247334013952:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 19772us (20072us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016145.558256:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3264 00000100:00100000:0.0:1734016145.564012:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.565974:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334014208 00000100:00100000:2.0:1734016145.566003:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334014208 00002000:00100000:2.0:1734016145.566088:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (913408->3919871) req@ffff88012b15df80 x1818247334014208/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 504/0 e 0 to 0 dl 1734016156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016145.566100:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15df80 with x1818247334014208 ext(913408->3919871) 00002000:00010000:2.0:1734016145.566111:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15df80 00000100:00100000:2.0:1734016145.566172:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9036 00000100:00100000:2.0:1734016145.566184:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247334014208:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016145.604969:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247334014208:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 38773us (40960us total) trans 0 rc 1753088/1753088 00000100:00100000:3.0:1734016145.604987:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9036 00002000:00100000:3.0:1734016145.605008:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (913408->3919871) req@ffff88012b15df80 x1818247334014208/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 504/440 e 0 to 0 dl 1734016156 ref 1 fl Complete:/200/0 rc 1753088/1753088 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016145.605019:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15df80 with x1818247334014208 ext(913408->3919871) 00002000:00010000:3.0:1734016145.605029:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15df80 00000100:00100000:0.0:1734016145.617105:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.617311:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334014464 00000100:00100000:3.0:1734016145.617327:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334014464 00002000:00100000:3.0:1734016145.617393:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (917504->921599) req@ffff88012b15c380 x1818247334014464/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 488/0 e 0 to 0 dl 1734016156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016145.617411:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15c380 with x1818247334014464 ext(917504->921599) 00002000:00010000:3.0:1734016145.617418:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15c380 00000100:00100000:3.0:1734016145.619848:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9037 00000100:00100000:3.0:1734016145.619871:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247334014464:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016145.620165:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247334014464:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 300us (3078us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016145.620172:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9037 00002000:00100000:3.0:1734016145.620182:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (917504->921599) req@ffff88012b15c380 x1818247334014464/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 488/4536 e 0 to 0 dl 1734016156 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016145.620192:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15c380 with x1818247334014464 ext(917504->921599) 00002000:00010000:3.0:1734016145.620200:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15c380 00000100:00100000:0.0:1734016145.627374:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.630348:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334014592 00000100:00100000:3.0:1734016145.630370:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334014592 00000100:00100000:3.0:1734016145.630468:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2394 00000100:00100000:3.0:1734016145.630476:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+29:10406:x1818247334014592:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016145.630502:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016145.630527:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117a6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7671 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.630638:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117a75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016145.630653:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016145.630666:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:3.0:1734016145.630699:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 8110500 00000004:00200000:3.0:1734016145.630706:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016145.630727:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016145.630757:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117a6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7671 expref: 31 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.630789:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117a75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7671 expref: 30 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.630797:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016145.630815:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016145.630819:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016145.632961:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+30:10406:x1818247334014592:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2465us (5585us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016145.632978:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2394 00010000:00010000:3.0:1734016145.644841:0:8957:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1734016145.646539:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.646776:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334014720 00000100:00100000:2.0:1734016145.646788:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334014720 00000100:00100000:2.0:1734016145.646988:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11954 00000100:00100000:2.0:1734016145.646999:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247334014720:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.647019:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.647039:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117a7c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7678 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016145.647097:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335443840:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016145.647513:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016145.650952:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335443840:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016145.651008:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117a7c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7678 expref: 15 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.651029:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117a7c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7678 expref: 15 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.651068:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016145.651133:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247334014720:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4135us (4602us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016145.651143:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11954 00000100:00100000:0.0:1734016145.655314:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.655404:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334014848 00000100:00100000:2.0:1734016145.655417:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334014848 00000100:00100000:2.0:1734016145.655476:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11955 00000100:00100000:2.0:1734016145.655485:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1984:x1818247334014848:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.655515:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.655539:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117a83 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e767f expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016145.655625:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335443968:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016145.655710:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016145.657932:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335443968:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016145.657984:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117a83 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e767f expref: 15 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.658000:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117a83 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e767f expref: 15 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.658034:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016145.658096:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1984:x1818247334014848:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2611us (2794us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016145.658107:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11955 00000100:00100000:0.0:1734016145.660777:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.661533:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334015104 00000100:00100000:3.0:1734016145.661554:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334015104 00002000:00100000:3.0:1734016145.661659:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (3547136->3551231) req@ffff88012b15c000 x1818247334015104/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:106/0 lens 488/0 e 0 to 0 dl 1734016156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016145.661676:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15c000 with x1818247334015104 ext(3547136->3551231) 00002000:00010000:3.0:1734016145.661686:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b15c000 00000100:00100000:1.0:1734016145.661998:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9038 00000100:00100000:1.0:1734016145.662010:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247334015104:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016145.662718:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247334015104:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 708us (1961us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016145.662727:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9038 00002000:00100000:1.0:1734016145.662734:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (3547136->3551231) req@ffff88012b15c000 x1818247334015104/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:106/0 lens 488/4536 e 0 to 0 dl 1734016156 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016145.662743:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15c000 with x1818247334015104 ext(3547136->3551231) 00002000:00010000:1.0:1734016145.662746:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b15c000 00000100:00100000:0.0:1734016145.667448:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.667614:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334015232 00000100:00100000:2.0:1734016145.667630:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334015232 00000100:00100000:2.0:1734016145.668336:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11956 00000100:00100000:2.0:1734016145.668350:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247334015232:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.668400:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.668436:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117a8a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7686 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016145.668529:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335444096:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016145.668640:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016145.671928:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335444096:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016145.671977:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117a8a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7686 expref: 15 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.671995:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117a8a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7686 expref: 15 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.672027:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016145.672090:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247334015232:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3741us (4660us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016145.672100:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11956 00000100:00100000:0.0:1734016145.674603:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.674852:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334015360 00000100:00100000:2.0:1734016145.674865:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334015360 00000100:00100000:2.0:1734016145.677312:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11957 00000100:00100000:2.0:1734016145.677335:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1983:x1818247334015360:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.677367:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.677396:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117a91 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e768d expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016145.677480:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335444224:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016145.677578:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016145.680210:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335444224:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016145.680255:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117a91 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e768d expref: 15 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.680278:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117a91 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e768d expref: 15 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.680297:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016145.680367:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1983:x1818247334015360:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3036us (5782us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016145.680378:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11957 00000100:00100000:0.0:1734016145.685493:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.686309:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334015488 00000100:00100000:2.0:1734016145.686332:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334015488 00000100:00100000:2.0:1734016145.689600:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11958 00000100:00100000:2.0:1734016145.689626:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247334015488:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.689666:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.689708:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117a98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7694 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016145.689845:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335444352:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016145.689979:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016145.694692:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335444352:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016145.694778:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117a98 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7694 expref: 15 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.694835:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117a98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7694 expref: 15 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.694927:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016145.695703:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247334015488:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6076us (10245us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016145.695721:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11958 00000100:00100000:0.0:1734016145.701336:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.701519:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334015616 00000100:00100000:2.0:1734016145.701534:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334015616 00000100:00100000:2.0:1734016145.701610:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11959 00000100:00100000:2.0:1734016145.701618:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:10406:x1818247334015616:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.701648:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.701680:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117a9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e769b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.701723:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117a3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7647 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.701731:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016145.701734:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016145.701739:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117a9f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e769b expref: 15 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.701783:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117a3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7647 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.701797:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117a3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7647 expref: 8 pid: 8216 timeout: 512 lvb_type: 0 00000100:00100000:2.0:1734016145.702276:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335444480:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016145.702723:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016145.706425:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335444480:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016145.706487:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117a9f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e769b expref: 15 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.706515:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016145.706577:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+15:10406:x1818247334015616:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4958us (5257us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016145.706592:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11959 00000100:00100000:0.0:1734016145.707088:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.707420:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334015744 00000100:00100000:2.0:1734016145.707426:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334015744 00002000:00100000:2.0:1734016145.707478:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (3547136->3551231) req@ffff88012b15fb80 x1818247334015744/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:106/0 lens 4584/0 e 0 to 0 dl 1734016156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016145.707489:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15fb80 with x1818247334015744 ext(3547136->3551231) 00010000:00010000:2.0:1734016145.707499:0:7687:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117a3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7647 expref: 9 pid: 8216 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016145.707514:0:7687:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117a3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7647 expref: 9 pid: 8216 timeout: 512 lvb_type: 0 00002000:00010000:2.0:1734016145.707522:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b15fb80 00000100:00100000:2.0:1734016145.707568:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 302 00000100:00100000:2.0:1734016145.707577:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247334015744:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:2.0:1734016145.719422:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247334015744:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 11830us (12319us total) trans 4294968107 rc 0/0 00000100:00100000:2.0:1734016145.719440:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 302 00002000:00100000:2.0:1734016145.719466:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (3547136->3551231) req@ffff88012b15fb80 x1818247334015744/t4294968107(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:106/0 lens 4584/448 e 0 to 0 dl 1734016156 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016145.719479:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15fb80 with x1818247334015744 ext(3547136->3551231) 00010000:00010000:2.0:1734016145.719496:0:7687:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117a3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7647 expref: 11 pid: 8216 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016145.719517:0:7687:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117a3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7647 expref: 11 pid: 8216 timeout: 512 lvb_type: 0 00002000:00010000:2.0:1734016145.719524:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b15fb80 00000100:00100000:0.0:1734016145.726680:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.726882:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334015872 00000100:00100000:2.0:1734016145.726904:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334015872 00010000:00010000:2.0:1734016145.726981:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117a3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7647 expref: 11 pid: 8216 timeout: 512 lvb_type: 0 00000100:00100000:2.0:1734016145.727062:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3265 00000100:00100000:2.0:1734016145.727077:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247334015872:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016145.727105:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1734016145.727141:0:9876:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 224 -> 232 00010000:00010000:2.0:1734016145.727148:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117a3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7647 expref: 11 pid: 8216 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016145.727167:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117a3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7647 expref: 11 pid: 8216 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016145.727217:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117a3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7647 expref: 11 pid: 8216 timeout: 512 lvb_type: 0 00010000:00010000:2.0:1734016145.727266:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016145.727269:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016145.727282:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117a9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 569344->573439) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e769b expref: 14 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.727294:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117a9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 569344->573439) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e769b expref: 14 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.727361:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117a9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 569344->573439) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e769b expref: 14 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016145.727381:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335444608:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016145.727525:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016145.731549:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335444608:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016145.731598:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016145.731690:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247334015872:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4610us (5029us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016145.731710:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3265 00000100:00100000:0.0:1734016145.734419:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.735301:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334016128 00000100:00100000:2.0:1734016145.735316:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334016128 00002000:00100000:3.0:1734016145.735495:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (569344->573439) req@ffff880075e52300 x1818247334016128/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 488/0 e 0 to 0 dl 1734016156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016145.735510:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e52300 with x1818247334016128 ext(569344->573439) 00002000:00010000:3.0:1734016145.735521:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075e52300 00000100:00100000:3.0:1734016145.735556:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9039 00000100:00100000:3.0:1734016145.735568:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+15:1981:x1818247334016128:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016145.736098:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+15:1981:x1818247334016128:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 531us (1696us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016145.736107:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9039 00002000:00100000:3.0:1734016145.736115:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (569344->573439) req@ffff880075e52300 x1818247334016128/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 488/4536 e 0 to 0 dl 1734016156 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016145.736122:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e52300 with x1818247334016128 ext(569344->573439) 00002000:00010000:3.0:1734016145.736126:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075e52300 00000100:00100000:0.0:1734016145.743328:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016145.743484:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.743614:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334016384 00000100:00100000:2.0:1734016145.743633:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334016384 00000100:00100000:2.0:1734016145.743687:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334016256 00000100:00100000:2.0:1734016145.743691:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334016256 00000100:00100000:2.0:1734016145.743731:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11960 00000100:00100000:2.0:1734016145.743743:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247334016384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.743772:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.743796:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aa6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e76a9 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.743863:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016145.743866:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016145.743876:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76a9 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.743893:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76a9 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.743910:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016145.743973:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247334016384:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 234us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016145.743980:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11960 00000100:00100000:2.0:1734016145.744180:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11961 00000100:00100000:2.0:1734016145.744185:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247334016256:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.744192:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.744204:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117aad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e76a2 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.744217:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016145.744219:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016145.744222:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117aad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76a2 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.744235:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117aad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76a2 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.744242:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016145.744257:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247334016256:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 72us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016145.744262:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11961 00000100:00100000:0.0:1734016145.749278:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.749421:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334016640 00000100:00100000:3.0:1734016145.749436:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334016640 00002000:00100000:3.0:1734016145.749507:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1589248->1593343) req@ffff880075e50380 x1818247334016640/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:106/0 lens 488/0 e 0 to 0 dl 1734016156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016145.749519:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50380 with x1818247334016640 ext(1589248->1593343) 00002000:00010000:3.0:1734016145.749530:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075e50380 00000100:00100000:3.0:1734016145.749572:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9040 00000100:00100000:3.0:1734016145.749584:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247334016640:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016145.751657:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247334016640:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 2064us (2378us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016145.751672:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9040 00002000:00100000:3.0:1734016145.751688:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1589248->1593343) req@ffff880075e50380 x1818247334016640/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:106/0 lens 488/4536 e 0 to 0 dl 1734016156 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016145.751698:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50380 with x1818247334016640 ext(1589248->1593343) 00002000:00010000:3.0:1734016145.751706:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075e50380 00000100:00100000:0.0:1734016145.754863:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.755154:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334016896 00000100:00100000:3.0:1734016145.755168:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334016896 00002000:00100000:3.0:1734016145.755227:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1593344->1597439) req@ffff880075e51f80 x1818247334016896/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:106/0 lens 488/0 e 0 to 0 dl 1734016156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016145.755237:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e51f80 with x1818247334016896 ext(1593344->1597439) 00002000:00010000:3.0:1734016145.755245:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075e51f80 00000100:00100000:3.0:1734016145.755282:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9041 00000100:00100000:3.0:1734016145.755291:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247334016896:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016145.755558:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247334016896:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 268us (765us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016145.755567:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9041 00002000:00100000:3.0:1734016145.755572:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (1593344->1597439) req@ffff880075e51f80 x1818247334016896/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:106/0 lens 488/4536 e 0 to 0 dl 1734016156 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016145.755579:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e51f80 with x1818247334016896 ext(1593344->1597439) 00002000:00010000:3.0:1734016145.755581:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075e51f80 00000100:00100000:0.0:1734016145.759520:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.760650:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334017024 00000100:00100000:2.0:1734016145.760665:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334017024 00000100:00100000:2.0:1734016145.760763:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11962 00000100:00100000:2.0:1734016145.760773:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247334017024:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.760827:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.760856:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117ab4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e76b0 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.760900:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117a67 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->917503) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e766a expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.760908:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aa6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76a9 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.760917:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016145.760919:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016145.760923:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117ab4 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76b0 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.760974:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76a9 expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.760990:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aa6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76a9 expref: 8 pid: 7684 timeout: 512 lvb_type: 1 00000100:00100000:2.0:1734016145.761004:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335444736:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016145.761102:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117a67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->917503) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e766a expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.761110:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117a67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->917503) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e766a expref: 7 pid: 7684 timeout: 512 lvb_type: 0 00000100:00100000:2.0:1734016145.761118:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335444864:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016145.761139:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016145.766959:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335444736:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016145.766982:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335444864:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016145.767037:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117ab4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76b0 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.767067:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016145.767163:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247334017024:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6390us (7663us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016145.767184:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11962 00000100:00100000:0.0:1734016145.769670:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.771196:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334017152 00000100:00100000:2.0:1734016145.771213:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334017152 00010000:00010000:2.0:1734016145.771285:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aa6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76a9 expref: 8 pid: 7684 timeout: 512 lvb_type: 1 00000100:00100000:2.0:1734016145.771348:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3266 00000100:00100000:2.0:1734016145.771358:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247334017152:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016145.771394:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016145.771432:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aa6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76a9 expref: 8 pid: 7684 timeout: 512 lvb_type: 1 00010000:00010000:2.0:1734016145.771445:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76a9 expref: 8 pid: 7684 timeout: 512 lvb_type: 1 00010000:00010000:2.0:1734016145.771484:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aa6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76a9 expref: 8 pid: 7684 timeout: 512 lvb_type: 1 00010000:00010000:2.0:1734016145.771525:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016145.771628:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334017152:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 269us (1972us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016145.771638:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3266 00000100:00100000:3.0:1734016145.772194:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.772220:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334017280 00000100:00100000:3.0:1734016145.772224:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334017280 00010000:00010000:3.0:1734016145.772245:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117a67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->917503) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e766a expref: 8 pid: 7684 timeout: 512 lvb_type: 0 00000100:00100000:3.0:1734016145.772264:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3267 00000100:00100000:3.0:1734016145.772270:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247334017280:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016145.772282:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016145.772294:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117a67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->917503) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e766a expref: 8 pid: 7684 timeout: 512 lvb_type: 0 00010000:00010000:3.0:1734016145.772306:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117a67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->917503) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e766a expref: 8 pid: 7684 timeout: 512 lvb_type: 0 00010000:00010000:3.0:1734016145.772324:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117a67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->917503) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e766a expref: 8 pid: 7684 timeout: 512 lvb_type: 0 00010000:00010000:3.0:1734016145.772786:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016145.772789:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016145.772822:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117ab4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 253952->258047) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76b0 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.772832:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117ab4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 253952->258047) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76b0 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.772881:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117ab4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 253952->258047) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76b0 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016145.772898:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335444992:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016145.772957:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a398e840 going to sleep for 11 seconds 00000100:00100000:3.0:1734016145.786086:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335444992:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016145.786136:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016145.786211:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247334017280:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 13937us (14339us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016145.786228:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3267 00000100:00100000:1.0:1734016145.786559:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.786839:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334017408 00000100:00100000:3.0:1734016145.786852:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334017408 00000100:00100000:3.0:1734016145.787297:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11963 00000100:00100000:3.0:1734016145.787305:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334017408:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016145.787680:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 3916196 -> 3916196 00002000:00010000:3.0:1734016145.787684:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016146 -> 1734016146 00002000:00010000:3.0:1734016145.787687:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016146 -> 1734016145 00002000:00010000:3.0:1734016145.787690:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016146 -> 1734016146 00002000:00010000:3.0:1734016145.787692:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:3.0:1734016145.787742:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247334017408:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 438us (1185us total) trans 4294969559 rc 0/0 00000100:00100000:3.0:1734016145.787749:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11963 00000100:00100000:0.0:1734016145.792022:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.792265:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334017536 00000100:00100000:2.0:1734016145.792286:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334017536 00000100:00100000:2.0:1734016145.792372:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11964 00000100:00100000:2.0:1734016145.792383:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247334017536:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.792426:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.792471:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117abb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e76b7 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016145.792595:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335445120:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016145.792715:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00002000:00010000:3.0:1734016145.800712:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016145 -> 1734016146 00000100:00100000:3.0:1734016145.800780:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335445120:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016145.800871:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117abb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76b7 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.800896:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117abb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76b7 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.800926:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:3.0:1734016145.801025:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247334017536:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8642us (9022us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016145.801040:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11964 00000100:00100000:0.0:1734016145.805990:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.807146:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334017664 00000100:00100000:3.0:1734016145.807166:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334017664 00000100:00100000:3.0:1734016145.807235:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11965 00000100:00100000:3.0:1734016145.807245:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247334017664:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016145.807280:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016145.807314:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27117ac2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e76be expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016145.807406:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335445248:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016145.808405:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016145.813943:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335445248:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016145.814002:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27117ac2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76be expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.814020:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4900/0x5e3a3adc27117ac2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76be expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.814042:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016145.814126:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247334017664:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6880us (8154us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016145.814140:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11965 00000100:00100000:0.0:1734016145.821039:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.821375:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334017792 00000100:00100000:3.0:1734016145.821393:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334017792 00000100:00100000:3.0:1734016145.822094:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11966 00000100:00100000:3.0:1734016145.822110:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247334017792:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016145.822142:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016145.822175:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27117ac9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e76c5 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016145.822282:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335445376:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016145.825920:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016145.827441:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335445376:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016145.827498:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27117ac9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76c5 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.827517:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27117ac9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76c5 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.827530:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016145.827589:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247334017792:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5484us (6576us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016145.827599:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11966 00000100:00100000:0.0:1734016145.831233:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.831499:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334018048 00000100:00100000:2.0:1734016145.831512:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334018048 00002000:00100000:2.0:1734016145.831576:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (2600960->2605055) req@ffff880075e53100 x1818247334018048/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 488/0 e 0 to 0 dl 1734016156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016145.831587:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e53100 with x1818247334018048 ext(2600960->2605055) 00002000:00010000:2.0:1734016145.831594:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075e53100 00000100:00100000:2.0:1734016145.831634:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9042 00000100:00100000:2.0:1734016145.831642:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+15:1983:x1818247334018048:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016145.831936:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+15:1983:x1818247334018048:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 294us (715us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016145.831945:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9042 00002000:00100000:2.0:1734016145.831950:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (2600960->2605055) req@ffff880075e53100 x1818247334018048/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 488/4536 e 0 to 0 dl 1734016156 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016145.831957:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e53100 with x1818247334018048 ext(2600960->2605055) 00002000:00010000:2.0:1734016145.831961:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075e53100 00000100:00100000:0.0:1734016145.840287:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.840541:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334018176 00000100:00100000:3.0:1734016145.840561:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334018176 00000100:00100000:3.0:1734016145.840640:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11967 00000100:00100000:3.0:1734016145.840651:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247334018176:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016145.840688:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016145.840726:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117ad0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e76cc expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016145.840880:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335445504:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016145.840993:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016145.846154:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335445504:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016145.846207:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117ad0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76cc expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.846224:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117ad0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76cc expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.846844:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016145.846981:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247334018176:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6330us (6710us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016145.846993:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11967 00000100:00100000:0.0:1734016145.854776:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.857023:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334018304 00000100:00100000:3.0:1734016145.857049:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334018304 00000100:00100000:3.0:1734016145.857154:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11968 00000100:00100000:3.0:1734016145.857165:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247334018304:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016145.857194:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016145.857229:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27117ad7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e76d3 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016145.857324:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335445632:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016145.857438:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016145.862358:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335445632:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016145.862432:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27117ad7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76d3 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.862461:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7180/0x5e3a3adc27117ad7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76d3 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016145.862505:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016145.862598:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247334018304:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5431us (7843us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016145.862611:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11968 00000100:00100000:0.0:1734016145.874385:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.875640:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334018432 00000100:00100000:3.0:1734016145.875655:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334018432 00000100:00100000:2.0:1734016145.875813:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11969 00000100:00100000:2.0:1734016145.875827:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247334018432:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.875851:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.875877:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117ade lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e76da expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016145.875968:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335445760:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016145.876064:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016145.879271:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335445760:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016145.879325:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117ade lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76da expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.879348:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117ade lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76da expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016145.879929:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016145.880001:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1983:x1818247334018432:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4175us (5665us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016145.880010:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11969 00000100:00100000:0.0:1734016145.884155:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.884266:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334018560 00000100:00100000:2.0:1734016145.884278:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334018560 00000100:00100000:2.0:1734016145.884344:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11970 00000100:00100000:2.0:1734016145.884353:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:10406:x1818247334018560:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016145.884390:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016145.884419:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117ae5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e76e1 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.884476:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117ab4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 253952->258047) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76b0 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.884488:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016145.884490:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016145.884494:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117ae5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [1761280->1769471] (req 1761280->1769471) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e1 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.884538:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117ab4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 253952->258047) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76b0 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.884551:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117ab4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 253952->258047) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76b0 expref: 7 pid: 7683 timeout: 513 lvb_type: 0 00000100:00100000:2.0:1734016145.884566:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335445888:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016145.884672:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016145.893218:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016145.893365:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334018688 00000100:00100000:3.0:1734016145.893379:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334018688 00010000:00010000:3.0:1734016145.893428:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117ab4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 253952->258047) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76b0 expref: 8 pid: 7683 timeout: 513 lvb_type: 0 00000100:00100000:3.0:1734016145.893473:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3268 00000100:00100000:3.0:1734016145.893479:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247334018688:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016145.893498:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016145.893529:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117ab4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 253952->258047) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76b0 expref: 8 pid: 7683 timeout: 513 lvb_type: 0 00010000:00010000:3.0:1734016145.893543:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117ab4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 253952->258047) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76b0 expref: 8 pid: 7683 timeout: 513 lvb_type: 0 00010000:00010000:3.0:1734016145.893582:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016145.893585:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016145.893595:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->1769471) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e1 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.893606:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117ae5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->1769471) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e1 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016145.893646:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117ae5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->1769471) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e1 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016145.893661:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335446016:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016145.893746:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00010000:00010000:2.0:1734016145.895404:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117ab4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 253952->258047) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76b0 expref: 8 pid: 7683 timeout: 513 lvb_type: 0 00000100:00100000:2.0:1734016145.895457:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335445888:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016145.895495:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117ae5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->1769471) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e1 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016145.895511:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016145.895574:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247334018560:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11223us (11435us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016145.895585:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11970 00000100:00100000:3.0:1734016145.900619:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335446016:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016145.900670:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016145.900947:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247334018688:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7464us (7743us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016145.900964:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3268 00000100:00100000:0.0:1734016145.928541:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016145.928631:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016145.928793:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334018944 00000100:00100000:2.0:1734016145.928905:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334018944 00002000:00100000:2.0:1734016145.928997:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->3919871) req@ffff88012b73aa00 x1818247334018944/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 488/0 e 0 to 0 dl 1734016156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016145.929011:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b73aa00 with x1818247334018944 ext(0->3919871) 00002000:00010000:2.0:1734016145.929019:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b73aa00 00000100:00100000:2.0:1734016145.929059:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334019200 00000100:00100000:2.0:1734016145.929062:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334019200 00002000:00100000:2.0:1734016145.929076:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff88012b739f80 x1818247334019200/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 520/0 e 0 to 0 dl 1734016156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016145.929082:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b739f80 with x1818247334019200 ext(0->4194303) 00002000:00010000:2.0:1734016145.929085:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b739f80 00000100:00100000:2.0:1734016145.929100:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9043 00000100:00100000:2.0:1734016145.929107:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247334018944:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016145.930302:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9044 00000100:00100000:0.0:1734016145.930316:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+15:1983:x1818247334019200:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016146.017853:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+15:1983:x1818247334019200:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 87518us (89200us total) trans 0 rc 4186112/4186112 00000100:00100000:1.0:1734016146.017874:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9044 00002000:00100000:1.0:1734016146.017895:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff88012b739f80 x1818247334019200/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 520/440 e 0 to 0 dl 1734016156 ref 1 fl Complete:/200/0 rc 4186112/4186112 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016146.017908:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b739f80 with x1818247334019200 ext(0->4194303) 00002000:00010000:1.0:1734016146.017916:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b739f80 00000100:00100000:3.0:1734016146.058020:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247334018944:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 128886us (129483us total) trans 0 rc 3919872/3919872 00000100:00100000:3.0:1734016146.058046:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9043 00002000:00100000:3.0:1734016146.058074:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->3919871) req@ffff88012b73aa00 x1818247334018944/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:106/0 lens 488/440 e 0 to 0 dl 1734016156 ref 1 fl Complete:/200/0 rc 3919872/3919872 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016146.058088:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b73aa00 with x1818247334018944 ext(0->3919871) 00002000:00010000:3.0:1734016146.058098:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b73aa00 00000100:00100000:0.0:1734016146.065790:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.066620:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334019328 00000100:00100000:2.0:1734016146.066639:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334019328 00000100:00100000:2.0:1734016146.066740:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11971 00000100:00100000:2.0:1734016146.066753:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247334019328:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016146.066780:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016146.066832:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e76e8 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.066871:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016146.066875:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016146.066886:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e8 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016146.066907:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e8 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016146.066927:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00080000:3.0:1734016146.067769:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016116 00000100:00100000:2.0:1734016146.069106:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247334019328:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2340us (3315us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016146.069124:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11971 00000100:00100000:0.0:1734016146.076021:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016146.076331:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334019584 00000100:00100000:3.0:1734016146.076350:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334019584 00000100:00100000:3.0:1734016146.076484:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2395 00000100:00100000:3.0:1734016146.076495:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+30:10406:x1818247334019584:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016146.076706:0:13956:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016146.076770:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117a75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7671 expref: 30 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.076867:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016146.076876:0:13956:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016146.077209:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117af3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016146.077232:0:13956:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117a52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7655 expref: 27 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.077242:0:13956:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117af3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016146.077293:0:13956:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117a52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7655 expref: 27 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.077312:0:13956:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117a52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7655 expref: 27 pid: 6479 timeout: 513 lvb_type: 0 00000100:00100000:3.0:1734016146.077329:0:13956:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335446144:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016146.077471:0:13956:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781780 going to sleep for 11 seconds 00000100:00080000:0.0:1734016146.077560:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016116 00000100:00100000:0.0:1734016146.082160:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.082439:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334019712 00000100:00100000:2.0:1734016146.082462:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334019712 00010000:00010000:2.0:1734016146.082937:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117a52 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7655 expref: 28 pid: 6479 timeout: 513 lvb_type: 0 00000100:00100000:3.0:1734016146.083277:0:13956:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13956:1818247335446144:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016146.083324:0:13956:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117af3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00080000:0.0:1734016146.083533:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016116 00000100:00100000:2.0:1734016146.083591:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3269 00000100:00100000:2.0:1734016146.083602:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+28:1981:x1818247334019712:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016146.083629:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016146.083640:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117a52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7655 expref: 28 pid: 6479 timeout: 513 lvb_type: 0 00010000:00010000:2.0:1734016146.083657:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117a52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7655 expref: 28 pid: 6479 timeout: 513 lvb_type: 0 00010000:00010000:2.0:1734016146.083697:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117a52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7655 expref: 28 pid: 6479 timeout: 513 lvb_type: 0 00010000:00010000:2.0:1734016146.083732:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016146.083740:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117af3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016146.083755:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117af3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016146.083768:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117af3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016146.083853:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016146.084177:0:13956:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117af3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:3.0:1734016146.084186:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117af3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000001:00080000:3.0:1734016146.084402:0:13956:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968855 00000100:00100000:2.0:1734016146.084613:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+27:1981:x1818247334019712:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1006us (2472us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016146.084626:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3269 00000004:00010000:3.0:1734016146.085360:0:13956:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012b739500 reply state ffff880075d63000 transno 4294968856 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117af3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000100:00100000:3.0:1734016146.085372:0:13956:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016146.085548:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+32:10406:x1818247334019584:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 9053us (9540us total) trans 4294968856 rc 0/0 00000100:00100000:3.0:1734016146.085558:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2395 00000020:00080000:3.0:1734016146.085563:0:13956:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1734016146.092875:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117af3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016146.092936:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117af3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016146.092945:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117af3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016146.092953:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df7cc0 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016146.092960:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117af3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016146.092969:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117af3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016146.092995:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016146.092998:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016146.093003:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117af3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00010000:00010000:2.0:1734016146.093011:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117af3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13956 initiator: MDT0 00000100:00100000:2.0:1734016146.095187:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016146.095626:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334019840 00000100:00100000:0.0:1734016146.095640:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334019840 00000100:00080000:2.0:1734016146.095829:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016116 00000100:00100000:0.0:1734016146.096150:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11972 00000100:00100000:0.0:1734016146.096160:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+15:10406:x1818247334019840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016146.096185:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016146.096213:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7581200/0x5e3a3adc27117afa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e76ef expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016146.096253:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117a9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 569344->573439) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e769b expref: 16 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016146.096262:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117aad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76a2 expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016146.096270:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016146.096273:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1734016146.096277:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7581200/0x5e3a3adc27117afa lrc: 5/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76ef expref: 16 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016146.096317:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117aad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76a2 expref: 10 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016146.096330:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117aad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76a2 expref: 10 pid: 7684 timeout: 513 lvb_type: 1 00000100:00100000:0.0:1734016146.096350:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b739180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335446272:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016146.096444:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117a9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 569344->573439) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e769b expref: 16 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016146.096461:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117a9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 569344->573439) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e769b expref: 16 pid: 7684 timeout: 513 lvb_type: 0 00000100:00100000:0.0:1734016146.096470:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b739c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335446400:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016146.096489:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1734016146.105880:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016146.112568:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334019968 00000100:00100000:3.0:1734016146.112595:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334019968 00010000:00010000:3.0:1734016146.112722:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117aad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76a2 expref: 11 pid: 7684 timeout: 513 lvb_type: 1 00000100:00100000:3.0:1734016146.112780:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3270 00000100:00100000:3.0:1734016146.112789:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075547480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247334019968:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016146.112865:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016146.112894:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117aad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76a2 expref: 11 pid: 7684 timeout: 513 lvb_type: 1 00010000:00010000:3.0:1734016146.112909:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117aad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76a2 expref: 11 pid: 7684 timeout: 513 lvb_type: 1 00010000:00010000:3.0:1734016146.112951:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016146.113036:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075547480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247334019968:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 247us (7182us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016146.113044:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3270 00010000:00010000:0.0:1734016146.114091:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117aad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76a2 expref: 10 pid: 7684 timeout: 513 lvb_type: 1 00000100:00100000:0.0:1734016146.114133:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b739180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335446272:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016146.114150:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b739c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335446400:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016146.114187:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581200/0x5e3a3adc27117afa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76ef expref: 16 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016146.114203:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581200, rc 0) 00000100:00100000:0.0:1734016146.114248:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+16:10406:x1818247334019840:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 18090us (19244us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016146.114256:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11972 00000100:00080000:2.0:1734016146.114353:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016116 00000100:00100000:0.0:1734016146.115744:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016146.115916:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334020096 00000100:00100000:1.0:1734016146.115931:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334020096 00010000:00010000:1.0:1734016146.115983:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117a9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 569344->573439) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e769b expref: 16 pid: 7684 timeout: 513 lvb_type: 0 00000100:00100000:1.0:1734016146.116041:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3271 00000100:00100000:1.0:1734016146.116053:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+16:1983:x1818247334020096:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016146.116078:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016146.116117:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117a9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 569344->573439) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e769b expref: 16 pid: 7684 timeout: 513 lvb_type: 0 00010000:00010000:1.0:1734016146.116137:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117a9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 569344->573439) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e769b expref: 16 pid: 7684 timeout: 513 lvb_type: 0 00010000:00010000:1.0:1734016146.116175:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117a9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 569344->573439) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e769b expref: 16 pid: 7684 timeout: 513 lvb_type: 0 00010000:00010000:1.0:1734016146.116209:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016146.116212:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016146.116220:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581200/0x5e3a3adc27117afa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76ef expref: 15 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016146.116240:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7581200/0x5e3a3adc27117afa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76ef expref: 15 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016146.116291:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7581200/0x5e3a3adc27117afa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76ef expref: 15 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016146.116307:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b49c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335446528:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016146.116395:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92900 going to sleep for 11 seconds 00000100:00100000:2.0:1734016146.123011:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b49c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335446528:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016146.123048:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016146.123121:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+15:1983:x1818247334020096:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7070us (7383us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016146.123137:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3271 00000100:00100000:0.0:1734016146.125624:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016146.125778:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016146.125877:0:6475:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334020352 00000100:00100000:0.0:1734016146.125895:0:6475:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334020352 00000100:00100000:0.0:1734016146.126001:0:6475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 336 00000100:00100000:2.0:1734016146.126240:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334020224 00000100:00100000:2.0:1734016146.126246:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334020224 00000100:00100000:2.0:1734016146.126292:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11973 00000100:00100000:2.0:1734016146.126300:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247334020224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016146.126333:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016146.126367:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b01 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e76f6 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.126410:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117ae5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->1769471) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e1 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.126419:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e8 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016146.126428:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016146.126432:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016146.126436:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b01 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76f6 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.126493:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e8 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016146.126506:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e8 expref: 7 pid: 8216 timeout: 513 lvb_type: 1 00000100:00100000:2.0:1734016146.126521:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335446656:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016146.126624:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->1769471) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e1 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.126631:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117ae5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->1769471) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e1 expref: 9 pid: 8216 timeout: 513 lvb_type: 0 00000100:00100000:2.0:1734016146.126639:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335446784:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016146.126660:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00080000:3.0:1734016146.126836:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016116 00000100:00080000:3.0:1734016146.126845:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016116 00000100:00100000:0.0:1734016146.127671:0:6475:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99867e87-1bc2-4e49-bd45-a757ae2fdd76+12:1981:x1818247334020352:12345-192.168.201.16@tcp:400:kworker.0 00000100:00100000:0.0:1734016146.127753:0:6475:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99867e87-1bc2-4e49-bd45-a757ae2fdd76+12:1981:x1818247334020352:12345-192.168.201.16@tcp:400:kworker.0 Request processed in 91us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016146.127762:0:6475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 336 00000100:00100000:2.0:1734016146.134242:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335446656:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016146.134262:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335446784:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016146.134316:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b01 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76f6 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.134353:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016146.134441:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247334020224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8141us (8840us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016146.134469:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11973 00000100:00100000:0.0:1734016146.139572:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.139743:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334020480 00000100:00100000:2.0:1734016146.139766:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334020480 00010000:00010000:2.0:1734016146.140112:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e8 expref: 8 pid: 8216 timeout: 513 lvb_type: 1 00000100:00100000:2.0:1734016146.140540:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3272 00000100:00100000:2.0:1734016146.140552:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b739880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247334020480:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016146.140586:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016146.140634:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e8 expref: 8 pid: 8216 timeout: 513 lvb_type: 1 00010000:00010000:2.0:1734016146.140648:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e8 expref: 8 pid: 8216 timeout: 513 lvb_type: 1 00010000:00010000:2.0:1734016146.140686:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117aec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e8 expref: 8 pid: 8216 timeout: 513 lvb_type: 1 00010000:00010000:2.0:1734016146.140738:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016146.141254:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b739880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247334020480:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 696us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016146.141267:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3272 00000100:00100000:0.0:1734016146.156618:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.156753:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334020608 00000100:00100000:2.0:1734016146.156772:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334020608 00010000:00010000:2.0:1734016146.156916:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117ae5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e1 expref: 9 pid: 8216 timeout: 513 lvb_type: 0 00000100:00100000:2.0:1734016146.156980:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3273 00000100:00100000:2.0:1734016146.156990:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247334020608:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016146.157021:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016146.157061:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117ae5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e1 expref: 9 pid: 8216 timeout: 513 lvb_type: 0 00010000:00010000:2.0:1734016146.157080:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->1769471) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e1 expref: 9 pid: 8216 timeout: 513 lvb_type: 0 00010000:00010000:2.0:1734016146.157129:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117ae5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->1769471) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76e1 expref: 9 pid: 8216 timeout: 513 lvb_type: 0 00010000:00010000:2.0:1734016146.157185:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016146.157188:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016146.158315:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76f6 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.158335:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76f6 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.158624:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76f6 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016146.158648:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335446912:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016146.159008:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016146.167204:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016146.167292:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016146.169200:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335446912:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016146.169256:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016146.169377:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247334020608:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 12385us (12782us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016146.169397:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3273 00000100:00100000:1.0:1734016146.169575:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334020864 00000100:00100000:1.0:1734016146.169591:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334020864 00002000:00010000:1.0:1734016146.169649:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:1.0:1734016146.169656:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b738700 with x1818247334020864 ext(4194304->18446744073709551615) 00002000:00010000:1.0:1734016146.169671:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b738700. 00000100:00100000:1.0:1734016146.169711:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334020736 00000100:00100000:1.0:1734016146.169716:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334020736 00002000:00010000:1.0:1734016146.169734:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (5033455->18446744073709551615) 00002000:00100000:1.0:1734016146.169736:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b738a80 with x1818247334020736 ext(5033455->18446744073709551615) 00002000:00010000:1.0:1734016146.169746:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b738a80. 00000100:00100000:1.0:1734016146.169785:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9045 00000100:00100000:1.0:1734016146.169793:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247334020864:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016146.170190:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 3916196 -> 4194304 00002000:00010000:1.0:1734016146.170194:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016146 -> 1734016146 00002000:00010000:1.0:1734016146.170196:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016146 -> 1734016145 00002000:00010000:1.0:1734016146.170200:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016146 -> 1734016146 00002000:00010000:1.0:1734016146.170202:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:1.0:1734016146.170231:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247334020864:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 439us (3057us total) trans 4294969560 rc 0/0 00000100:00100000:1.0:1734016146.170239:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9045 00002000:00010000:1.0:1734016146.170242:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:1.0:1734016146.170244:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b738700 with x1818247334020864 ext(4194304->18446744073709551615) 00002000:00010000:1.0:1734016146.170249:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b738700. 00000100:00100000:1.0:1734016146.170263:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9046 00000100:00100000:1.0:1734016146.170268:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+15:1982:x1818247334020736:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016146.170536:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 5033455 00002000:00010000:1.0:1734016146.170539:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016146 -> 1734016146 00002000:00010000:1.0:1734016146.170541:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016146 -> 1734016145 00002000:00010000:1.0:1734016146.170544:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016146 -> 1734016146 00002000:00010000:1.0:1734016146.170546:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 232 -> 232 00000100:00100000:1.0:1734016146.170568:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+16:1982:x1818247334020736:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 299us (3276us total) trans 4294968108 rc 0/0 00000100:00100000:1.0:1734016146.170576:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9046 00002000:00010000:1.0:1734016146.170578:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (5033455->18446744073709551615) 00002000:00100000:1.0:1734016146.170580:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b738a80 with x1818247334020736 ext(5033455->18446744073709551615) 00002000:00010000:1.0:1734016146.170585:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b738a80. 00000100:00100000:0.0:1734016146.177014:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016146.178234:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334021120 00000100:00100000:3.0:1734016146.178263:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334021120 00002000:00100000:3.0:1734016146.178373:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (5025792->5029887) req@ffff88012b73bb80 x1818247334021120/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:107/0 lens 488/0 e 0 to 0 dl 1734016157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016146.178389:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b73bb80 with x1818247334021120 ext(5025792->5029887) 00002000:00010000:3.0:1734016146.178398:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b73bb80 00000100:00100000:3.0:1734016146.178466:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9047 00000100:00100000:3.0:1734016146.178478:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+16:1983:x1818247334021120:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016146.178875:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+16:1983:x1818247334021120:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 397us (1871us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1734016146.178885:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9047 00002000:00100000:3.0:1734016146.178893:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (5025792->5029887) req@ffff88012b73bb80 x1818247334021120/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:107/0 lens 488/4536 e 0 to 0 dl 1734016157 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016146.178908:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b73bb80 with x1818247334021120 ext(5025792->5029887) 00002000:00010000:3.0:1734016146.178911:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b73bb80 00000100:00100000:1.0:1734016146.181560:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016146.183330:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334021376 00000100:00100000:3.0:1734016146.183351:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334021376 00002000:00100000:3.0:1734016146.183429:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (3919872->4194303) req@ffff880073b48700 x1818247334021376/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:107/0 lens 488/0 e 0 to 0 dl 1734016157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016146.183443:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48700 with x1818247334021376 ext(3919872->4194303) 00002000:00010000:3.0:1734016146.183462:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b48700 00000100:00100000:3.0:1734016146.183508:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9048 00000100:00100000:3.0:1734016146.183519:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247334021376:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016146.185013:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016146.185114:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334021632 00000100:00100000:1.0:1734016146.185125:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334021632 00002000:00100000:1.0:1734016146.185177:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (4194304->5033983) req@ffff880073947800 x1818247334021632/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:107/0 lens 504/0 e 0 to 0 dl 1734016157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016146.185194:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073947800 with x1818247334021632 ext(4194304->5033983) 00002000:00010000:1.0:1734016146.185199:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073947800 00000100:00100000:1.0:1734016146.185224:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9049 00000100:00100000:1.0:1734016146.185233:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+16:1983:x1818247334021632:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016146.201140:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+16:1983:x1818247334021632:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 15877us (16108us total) trans 0 rc 835584/835584 00000100:00100000:1.0:1734016146.201166:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9049 00002000:00100000:1.0:1734016146.201191:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (4194304->5033983) req@ffff880073947800 x1818247334021632/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:107/0 lens 504/440 e 0 to 0 dl 1734016157 ref 1 fl Complete:/200/0 rc 835584/835584 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016146.201206:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073947800 with x1818247334021632 ext(4194304->5033983) 00002000:00010000:1.0:1734016146.201216:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073947800 00000100:00100000:3.0:1734016146.201483:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1983:x1818247334021376:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 17963us (19943us total) trans 0 rc 274432/274432 00000100:00100000:3.0:1734016146.201491:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9048 00002000:00100000:3.0:1734016146.201497:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (3919872->4194303) req@ffff880073b48700 x1818247334021376/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:107/0 lens 488/440 e 0 to 0 dl 1734016157 ref 1 fl Complete:/200/0 rc 274432/274432 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016146.201504:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48700 with x1818247334021376 ext(3919872->4194303) 00002000:00010000:3.0:1734016146.201510:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b48700 00000100:00100000:0.0:1734016146.210290:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016146.210455:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334021760 00000100:00100000:3.0:1734016146.210469:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334021760 00002000:00100000:3.0:1734016146.210534:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (5025792->5033454) req@ffff880073947100 x1818247334021760/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:107/0 lens 8152/0 e 0 to 0 dl 1734016157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016146.210549:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073947100 with x1818247334021760 ext(5025792->5033454) 00002000:00010000:3.0:1734016146.210556:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073947100 00000100:00100000:3.0:1734016146.210607:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9050 00000100:00100000:3.0:1734016146.210617:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+16:1982:x1818247334021760:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016146.212744:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247334021760:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 2092us (2438us total) trans 4294968109 rc 0/0 00000100:00100000:3.0:1734016146.212773:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9050 00002000:00100000:3.0:1734016146.212795:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (5025792->5033454) req@ffff880073947100 x1818247334021760/t4294968109(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:107/0 lens 8152/448 e 0 to 0 dl 1734016157 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016146.212859:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073947100 with x1818247334021760 ext(5025792->5033454) 00002000:00010000:3.0:1734016146.212869:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073947100 00000100:00100000:0.0:1734016146.217796:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016146.218152:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334021888 00000100:00100000:3.0:1734016146.218174:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334021888 00000100:00100000:3.0:1734016146.218290:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2396 00000100:00100000:3.0:1734016146.218304:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+31:10406:x1818247334021888:12345-192.168.201.16@tcp:44:fsx.0 00000100:00100000:3.0:1734016146.218551:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c598caf-7141-4c19-8566-0b7731516db9+31:10406:x1818247334021888:12345-192.168.201.16@tcp:44:fsx.0 Request processed in 247us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016146.218560:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2396 00000100:00100000:0.0:1734016146.223526:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.224058:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334022016 00000100:00100000:2.0:1734016146.224075:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334022016 00000100:00100000:2.0:1734016146.224717:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11974 00000100:00100000:2.0:1734016146.224728:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+18:1981:x1818247334022016:12345-192.168.201.16@tcp:16:fsx.0 00000001:00080000:2.0:1734016146.227066:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968109 is committed 00000001:00080000:2.0:1734016146.227106:0:7680:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-OST0000: transno 4294968107 is committed 00000100:00100000:0.0:1734016146.227653:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247334022016:12345-192.168.201.16@tcp:16:fsx.0 Request processed in 2914us (4141us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016146.227670:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11974 00000100:00100000:1.0:1734016146.232893:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016146.233145:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334022144 00000100:00100000:3.0:1734016146.233165:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334022144 00000100:00100000:3.0:1734016146.233837:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2397 00000100:00100000:3.0:1734016146.233850:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+31:10406:x1818247334022144:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016146.233891:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016146.233924:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117b08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e76fd expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.234102:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27117b0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016146.234127:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27117b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016146.234145:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27117b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:3.0:1734016146.234187:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 9227759 00000004:00200000:3.0:1734016146.234196:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016146.234224:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27117b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016146.234262:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117b08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76fd expref: 33 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.234316:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27117b0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76fd expref: 32 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.234330:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016146.234333:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016146.234338:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016146.235380:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+32:10406:x1818247334022144:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1525us (2497us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016146.235396:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2397 00000100:00100000:0.0:1734016146.238606:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.238861:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334022272 00000100:00100000:2.0:1734016146.238878:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334022272 00000100:00100000:2.0:1734016146.239039:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11975 00000100:00100000:2.0:1734016146.239053:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:10406:x1818247334022272:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016146.239100:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016146.239143:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117b16 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7704 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.239710:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581200/0x5e3a3adc27117afa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76ef expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.239724:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016146.239727:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016146.239733:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117b16 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [487424->495615] (req 487424->495615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7704 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.239793:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7581200/0x5e3a3adc27117afa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76ef expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.239900:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581200/0x5e3a3adc27117afa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76ef expref: 6 pid: 8216 timeout: 513 lvb_type: 0 00000100:00100000:2.0:1734016146.239916:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335447040:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016146.240376:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016146.245155:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335447040:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016146.245236:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117b16 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [487424->495615] (req 487424->495615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7704 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.245271:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016146.245385:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247334022272:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6332us (6802us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016146.245400:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11975 00000100:00100000:0.0:1734016146.246697:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016146.248753:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334022400 00000100:00100000:3.0:1734016146.248773:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334022400 00010000:00010000:3.0:1734016146.248852:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7581200/0x5e3a3adc27117afa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76ef expref: 7 pid: 8216 timeout: 513 lvb_type: 0 00000100:00100000:3.0:1734016146.248892:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3274 00000100:00100000:3.0:1734016146.248900:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247334022400:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016146.248921:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1734016146.248944:0:9876:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016145 -> 1734016146 00002000:00010000:3.0:1734016146.248948:0:9876:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 232 -> 248 00010000:00010000:3.0:1734016146.248952:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a7581200/0x5e3a3adc27117afa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76ef expref: 7 pid: 8216 timeout: 513 lvb_type: 0 00010000:00010000:3.0:1734016146.248963:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a7581200/0x5e3a3adc27117afa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76ef expref: 7 pid: 8216 timeout: 513 lvb_type: 0 00010000:00010000:3.0:1734016146.248990:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581200/0x5e3a3adc27117afa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76ef expref: 7 pid: 8216 timeout: 513 lvb_type: 0 00010000:00010000:3.0:1734016146.249655:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016146.249657:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016146.249664:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117b16 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->495615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7704 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.249672:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117b16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->495615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7704 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.249706:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117b16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->495615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7704 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016146.249716:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335447168:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016146.250115:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781540 going to sleep for 11 seconds 00000100:00100000:3.0:1734016146.254953:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335447168:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016146.255013:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016146.255105:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+6:1982:x1818247334022400:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6203us (8423us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016146.255127:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3274 00000100:00100000:1.0:1734016146.266795:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016146.267109:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334022656 00000100:00100000:3.0:1734016146.267134:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334022656 00002000:00100000:3.0:1734016146.267241:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff880073b48a80 x1818247334022656/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:107/0 lens 488/0 e 0 to 0 dl 1734016157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016146.267255:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48a80 with x1818247334022656 ext(0->4194303) 00002000:00010000:3.0:1734016146.267268:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b48a80 00000100:00100000:1.0:1734016146.272843:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9051 00000100:00100000:1.0:1734016146.272873:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247334022656:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016146.337358:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247334022656:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 64477us (70587us total) trans 0 rc 4194304/4194304 00000100:00100000:2.0:1734016146.337374:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9051 00002000:00100000:2.0:1734016146.337395:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff880073b48a80 x1818247334022656/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:107/0 lens 488/440 e 0 to 0 dl 1734016157 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016146.337406:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b48a80 with x1818247334022656 ext(0->4194303) 00002000:00010000:2.0:1734016146.337428:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b48a80 00000100:00100000:0.0:1734016146.347095:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.347787:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334022784 00000100:00100000:2.0:1734016146.347882:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334022784 00000100:00100000:1.0:1734016146.353352:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11976 00000100:00100000:1.0:1734016146.353378:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+6:1984:x1818247334022784:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016146.353424:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016146.353475:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27117b1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e770b expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016146.353526:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016146.353529:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016146.353540:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27117b1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e770b expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016146.353558:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27117b1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e770b expref: 7 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016146.353571:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f840, rc 0) 00000100:00100000:1.0:1734016146.353670:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247334022784:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 297us (6597us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016146.353677:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11976 00000100:00100000:0.0:1734016146.361438:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.361654:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334022912 00000100:00100000:2.0:1734016146.361664:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334022912 00000100:00100000:2.0:1734016146.361724:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11977 00000100:00100000:2.0:1734016146.361733:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247334022912:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016146.361757:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016146.361783:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117b24 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7712 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.361855:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76f6 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.361864:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016146.361866:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016146.361870:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117b24 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [4014080->4026367] (req 4014080->4026367) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7712 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.361905:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76f6 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.361921:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76f6 expref: 8 pid: 8216 timeout: 513 lvb_type: 0 00000100:00100000:2.0:1734016146.361933:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335447296:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016146.362000:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016146.370071:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335447296:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016146.370149:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117b24 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [4014080->4026367] (req 4014080->4026367) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7712 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.370183:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016146.372347:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247334022912:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10587us (10894us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016146.372363:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11977 00000100:00100000:0.0:1734016146.374988:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016146.375209:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334023040 00000100:00100000:3.0:1734016146.375233:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334023040 00010000:00010000:3.0:1734016146.375340:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76f6 expref: 9 pid: 8216 timeout: 513 lvb_type: 0 00000100:00100000:3.0:1734016146.375424:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3275 00000100:00100000:3.0:1734016146.375440:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247334023040:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016146.375482:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016146.375524:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76f6 expref: 9 pid: 8216 timeout: 513 lvb_type: 0 00010000:00010000:3.0:1734016146.375560:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76f6 expref: 9 pid: 8216 timeout: 513 lvb_type: 0 00010000:00010000:3.0:1734016146.376601:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76f6 expref: 9 pid: 8216 timeout: 513 lvb_type: 0 00010000:00010000:3.0:1734016146.376665:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016146.376670:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016146.376686:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117b24 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4026367) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7712 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.376698:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117b24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4026367) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7712 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.376772:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117b24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4026367) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7712 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016146.376796:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335447424:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016146.379612:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073781240 going to sleep for 11 seconds 00000100:00100000:3.0:1734016146.390502:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335447424:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016146.390571:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016146.390666:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247334023040:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 15229us (15707us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016146.390691:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3275 00000100:00100000:0.0:1734016146.402916:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.403105:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334023296 00000100:00100000:2.0:1734016146.403118:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334023296 00002000:00100000:2.0:1734016146.403194:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (0->4194303) req@ffff88008719d180 x1818247334023296/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:107/0 lens 488/0 e 0 to 0 dl 1734016157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016146.403209:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719d180 with x1818247334023296 ext(0->4194303) 00002000:00010000:2.0:1734016146.403219:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719d180 00000100:00100000:2.0:1734016146.403263:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9052 00000100:00100000:2.0:1734016146.403271:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247334023296:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016146.485294:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247334023296:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 81999us (82376us total) trans 0 rc 4194304/4194304 00000100:00100000:3.0:1734016146.485314:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9052 00002000:00100000:3.0:1734016146.485332:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (0->4194303) req@ffff88008719d180 x1818247334023296/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:107/0 lens 488/440 e 0 to 0 dl 1734016157 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016146.485344:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719d180 with x1818247334023296 ext(0->4194303) 00002000:00010000:3.0:1734016146.485355:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719d180 00000100:00100000:0.0:1734016146.493214:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016146.493291:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016146.493639:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334023552 00000100:00100000:3.0:1734016146.493656:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334023552 00002000:00100000:3.0:1734016146.493722:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (4194304->5033983) req@ffff88008719ed80 x1818247334023552/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:107/0 lens 488/0 e 0 to 0 dl 1734016157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016146.493734:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719ed80 with x1818247334023552 ext(4194304->5033983) 00002000:00010000:3.0:1734016146.493741:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008719ed80 00000100:00100000:3.0:1734016146.493787:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9053 00000100:00100000:3.0:1734016146.493796:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247334023552:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016146.494957:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334023680 00000100:00100000:2.0:1734016146.494971:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334023680 00000100:00100000:2.0:1734016146.495023:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11978 00000100:00100000:2.0:1734016146.495030:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247334023680:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016146.495047:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016146.495075:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7719 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.495109:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016146.495113:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016146.495124:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7719 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016146.495145:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7719 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016146.495160:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016146.495240:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+9:1984:x1818247334023680:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 208us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016146.495251:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11978 00000100:00100000:3.0:1734016146.530225:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1984:x1818247334023552:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 36392us (36989us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1734016146.530248:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9053 00002000:00100000:3.0:1734016146.530273:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (4194304->5033983) req@ffff88008719ed80 x1818247334023552/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:107/0 lens 488/440 e 0 to 0 dl 1734016157 ref 1 fl Complete:/200/0 rc 839680/839680 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016146.530290:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719ed80 with x1818247334023552 ext(4194304->5033983) 00002000:00010000:3.0:1734016146.530300:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008719ed80 00000100:00100000:0.0:1734016146.540481:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016146.542352:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334024064 00000100:00100000:3.0:1734016146.542371:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334024064 00002000:00100000:3.0:1734016146.542458:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->4194303) req@ffff88008719e300 x1818247334024064/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:107/0 lens 488/0 e 0 to 0 dl 1734016157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016146.542469:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719e300 with x1818247334024064 ext(0->4194303) 00002000:00010000:3.0:1734016146.542475:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719e300 00000100:00100000:3.0:1734016146.542534:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9054 00000100:00100000:3.0:1734016146.542544:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247334024064:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016146.547088:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016146.547310:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334024192 00000100:00100000:1.0:1734016146.547325:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334024192 00002000:00100000:1.0:1734016146.547392:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff88008719c700 x1818247334024192/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:107/0 lens 488/0 e 0 to 0 dl 1734016157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016146.547406:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719c700 with x1818247334024192 ext(0->4194303) 00002000:00010000:1.0:1734016146.547414:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008719c700 00000100:00100000:1.0:1734016146.547447:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9055 00000100:00100000:1.0:1734016146.547453:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247334024192:12345-192.168.201.16@tcp:3:fsx.0 00000001:00080000:0.0:1734016146.594202:0:6461:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968856 is committed 00000001:00080000:0.0:1734016146.594227:0:6461:0:(tgt_lastrcvd.c:952:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968854 is committed 00010000:00010000:0.0:1734016146.657159:0:6468:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1734016146.662107:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+7:1981:x1818247334024192:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 114632us (115022us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016146.662154:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9055 00002000:00100000:1.0:1734016146.662177:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff88008719c700 x1818247334024192/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:107/0 lens 488/440 e 0 to 0 dl 1734016157 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016146.662189:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719c700 with x1818247334024192 ext(0->4194303) 00002000:00010000:1.0:1734016146.662196:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008719c700 00000100:00100000:0.0:1734016146.690694:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247334024064:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 147235us (149351us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1734016146.690720:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9054 00002000:00100000:0.0:1734016146.690748:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->4194303) req@ffff88008719e300 x1818247334024064/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:107/0 lens 488/440 e 0 to 0 dl 1734016157 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016146.690761:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719e300 with x1818247334024064 ext(0->4194303) 00002000:00010000:0.0:1734016146.690771:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008719e300 00000100:00100000:0.0:1734016146.701328:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016146.704033:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.704406:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334024448 00000100:00100000:2.0:1734016146.704426:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334024448 00002000:00100000:2.0:1734016146.704509:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (4194304->5033983) req@ffff88008719c380 x1818247334024448/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:107/0 lens 488/0 e 0 to 0 dl 1734016157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016146.704524:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719c380 with x1818247334024448 ext(4194304->5033983) 00002000:00010000:2.0:1734016146.704532:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008719c380 00000100:00100000:2.0:1734016146.704563:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9056 00000100:00100000:2.0:1734016146.704573:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+7:1984:x1818247334024448:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016146.705611:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334024576 00000100:00100000:1.0:1734016146.705620:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334024576 00000100:00100000:1.0:1734016146.705673:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11979 00000100:00100000:1.0:1734016146.705681:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247334024576:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016146.705696:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016146.705721:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27117b32 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7720 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016146.705763:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117b16 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->495615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7704 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016146.705771:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27117b1d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e770b expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016146.705777:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016146.705781:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016146.705786:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27117b32 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [3678208->3686399] (req 3678208->3686399) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7720 expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016146.705845:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27117b1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e770b expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016146.705858:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27117b1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e770b expref: 10 pid: 7683 timeout: 513 lvb_type: 1 00000100:00100000:1.0:1734016146.705872:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335447552:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016146.705935:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117b16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->495615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7704 expref: 5 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016146.705947:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117b16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->495615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7704 expref: 5 pid: 8216 timeout: 513 lvb_type: 0 00000100:00100000:1.0:1734016146.705956:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335447680:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016146.705975:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016146.724467:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335447552:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016146.724488:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335447680:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016146.724530:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27117b32 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [3678208->3686399] (req 3678208->3686399) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7720 expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016146.724554:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499ed00, rc 0) 00000100:00100000:1.0:1734016146.724636:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:10406:x1818247334024576:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 18956us (23325us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016146.724647:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11979 00000100:00100000:2.0:1734016146.730762:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247334024448:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 26178us (26738us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1734016146.730776:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9056 00002000:00100000:2.0:1734016146.730787:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (4194304->5033983) req@ffff88008719c380 x1818247334024448/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:107/0 lens 488/440 e 0 to 0 dl 1734016157 ref 1 fl Complete:/200/0 rc 839680/839680 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016146.730795:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88008719c380 with x1818247334024448 ext(4194304->5033983) 00010000:00010000:2.0:1734016146.730831:0:7689:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27117b1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e770b expref: 8 pid: 7683 timeout: 513 lvb_type: 1 00010000:00010000:2.0:1734016146.730842:0:7689:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27117b1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e770b expref: 8 pid: 7683 timeout: 513 lvb_type: 1 00002000:00010000:2.0:1734016146.730850:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008719c380 00000100:00100000:0.0:1734016146.740607:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016146.740724:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334024704 00000100:00100000:3.0:1734016146.740734:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334024704 00010000:00010000:3.0:1734016146.740766:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117b16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->495615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7704 expref: 6 pid: 8216 timeout: 513 lvb_type: 0 00000100:00100000:3.0:1734016146.741277:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3276 00000100:00100000:3.0:1734016146.741286:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247334024704:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016146.741309:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016146.741333:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117b16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 487424->495615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7704 expref: 6 pid: 8216 timeout: 513 lvb_type: 0 00010000:00010000:3.0:1734016146.741348:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117b16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 487424->495615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7704 expref: 6 pid: 8216 timeout: 513 lvb_type: 0 00010000:00010000:3.0:1734016146.741377:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117b16 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 487424->495615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7704 expref: 6 pid: 8216 timeout: 513 lvb_type: 0 00010000:00010000:3.0:1734016146.741433:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016146.741519:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247334024704:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 233us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016146.741528:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3276 00000100:00100000:0.0:1734016146.745270:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016146.745375:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334024832 00000100:00100000:1.0:1734016146.745392:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334024832 00010000:00010000:1.0:1734016146.745463:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27117b1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e770b expref: 8 pid: 7683 timeout: 513 lvb_type: 1 00000100:00100000:1.0:1734016146.745579:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3277 00000100:00100000:1.0:1734016146.745589:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247334024832:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016146.745620:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016146.745657:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27117b1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e770b expref: 8 pid: 7683 timeout: 513 lvb_type: 1 00010000:00010000:1.0:1734016146.745675:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27117b1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e770b expref: 8 pid: 7683 timeout: 513 lvb_type: 1 00010000:00010000:1.0:1734016146.745710:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499f840/0x5e3a3adc27117b1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e770b expref: 8 pid: 7683 timeout: 513 lvb_type: 1 00010000:00010000:1.0:1734016146.745762:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016146.745765:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016146.745775:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27117b32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3686399) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7720 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016146.745789:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27117b32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3686399) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7720 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016146.745890:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27117b32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3686399) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7720 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016146.745908:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335447808:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016146.746006:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016146.752132:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.752309:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335447808:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016146.752336:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016146.752386:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+7:1982:x1818247334024832:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6799us (7137us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016146.752400:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3277 00000100:00100000:0.0:1734016146.753567:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334024960 00000100:00100000:0.0:1734016146.753580:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334024960 00000100:00100000:0.0:1734016146.753704:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11980 00000100:00100000:0.0:1734016146.753715:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247334024960:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016146.756495:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5033455 -> 5033455 00002000:00010000:0.0:1734016146.756503:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016146 -> 1734016146 00002000:00010000:0.0:1734016146.756505:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016146 -> 1734016146 00002000:00010000:0.0:1734016146.756508:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016146 -> 1734016146 00002000:00010000:0.0:1734016146.756510:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 248 -> 264 00000100:00100000:0.0:1734016146.756594:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247334024960:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 2876us (4474us total) trans 4294968110 rc 0/0 00000100:00100000:0.0:1734016146.756604:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11980 00000100:00100000:0.0:1734016146.759962:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016146.760098:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334025088 00000100:00100000:3.0:1734016146.760114:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334025088 00000100:00100000:0.0:1734016146.760310:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2398 00000100:00100000:0.0:1734016146.760321:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:10406:x1818247334025088:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016146.760349:0:13956:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016146.760380:0:13956:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27117b39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7727 expref: -99 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016146.760527:0:13956:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117b40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016146.760548:0:13956:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016146.760561:0:13956:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00000004:00200000:0.0:1734016146.760593:0:13956:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 9227759 00000004:00200000:0.0:1734016146.760601:0:13956:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1734016146.760621:0:13956:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13956 initiator: MDT0 00010000:00010000:0.0:1734016146.760648:0:13956:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7581680/0x5e3a3adc27117b39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7727 expref: 16 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016146.760690:0:13956:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117b40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7727 expref: 15 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016146.760698:0:13956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:0.0:1734016146.760703:0:13956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1734016146.760707:0:13956:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:0.0:1734016146.760766:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10406:x1818247334025088:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 447us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016146.760774:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2398 00000100:00100000:0.0:1734016146.765733:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.765821:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334025216 00000100:00100000:2.0:1734016146.765835:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334025216 00000100:00100000:2.0:1734016146.765935:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11981 00000100:00100000:2.0:1734016146.765946:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247334025216:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016146.765985:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016146.766197:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117b47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e772e expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016146.766289:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335447936:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016146.766500:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00002000:00010000:2.0:1734016146.773642:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016146 -> 1734016147 00002000:00010000:2.0:1734016146.773664:0:7683:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016146 -> 1734016147 00000100:00100000:2.0:1734016146.773711:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335447936:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016146.773778:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117b47 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e772e expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016146.773863:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117b47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e772e expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016146.773906:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016146.773990:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247334025216:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8044us (8276us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016146.774004:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11981 00000100:00100000:0.0:1734016146.787914:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.794945:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334025344 00000100:00100000:2.0:1734016146.794963:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334025344 00000100:00100000:2.0:1734016146.795069:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11982 00000100:00100000:2.0:1734016146.795080:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247334025344:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016146.795114:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016146.795159:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117b4e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7735 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016146.795260:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335448064:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016146.795380:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016146.802225:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335448064:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016146.802295:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117b4e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7735 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016146.802318:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117b4e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7735 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016146.802362:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016146.802448:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247334025344:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7369us (14544us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016146.802458:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11982 00000100:00100000:0.0:1734016146.815627:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.817379:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334025472 00000100:00100000:2.0:1734016146.817396:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334025472 00000100:00100000:2.0:1734016146.817492:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11983 00000100:00100000:2.0:1734016146.817510:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247334025472:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016146.817544:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016146.817576:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117b55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e773c expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016146.817669:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335448192:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016146.817781:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016146.823381:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335448192:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016146.823451:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117b55 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e773c expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016146.823471:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117b55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e773c expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016146.823507:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016146.823576:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1984:x1818247334025472:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6071us (7971us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016146.823588:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11983 00000100:00100000:0.0:1734016146.833182:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.836938:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334025600 00000100:00100000:2.0:1734016146.836967:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334025600 00000100:00100000:2.0:1734016146.837095:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11984 00000100:00100000:2.0:1734016146.837106:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247334025600:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016146.837139:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016146.837171:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117b5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7743 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016146.837266:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335448320:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016146.837364:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016146.842694:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335448320:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016146.842732:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117b5c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7743 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016146.842746:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117b5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7743 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016146.842774:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016146.842849:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1981:x1818247334025600:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5744us (9679us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016146.842860:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11984 00000100:00100000:0.0:1734016146.857041:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016146.860172:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334025856 00000100:00100000:3.0:1734016146.860189:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334025856 00000100:00100000:3.0:1734016146.860266:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2399 00000100:00100000:3.0:1734016146.860273:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+18:10406:x1818247334025856:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:3.0:1734016146.860327:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016146.860352:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5440/0x5e3a3adc27117b0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e76fd expref: 18 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.861656:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016146.861666:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1734016146.861932:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117b63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016146.861955:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117b40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7727 expref: 14 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.861962:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117b63 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016146.862015:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117b40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7727 expref: 14 pid: 13956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.862027:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117b40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7727 expref: 14 pid: 13956 timeout: 513 lvb_type: 0 00000100:00100000:3.0:1734016146.862046:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335448448:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016146.862140:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d780 going to sleep for 11 seconds 00000100:00100000:0.0:1734016146.864936:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.865134:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334025984 00000100:00100000:2.0:1734016146.865145:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334025984 00010000:00010000:2.0:1734016146.865187:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117b40 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7727 expref: 15 pid: 13956 timeout: 513 lvb_type: 0 00000100:00100000:2.0:1734016146.865226:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3278 00000100:00100000:2.0:1734016146.865232:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247334025984:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016146.865251:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016146.865258:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117b40 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7727 expref: 15 pid: 13956 timeout: 513 lvb_type: 0 00010000:00010000:2.0:1734016146.865270:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117b40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7727 expref: 15 pid: 13956 timeout: 513 lvb_type: 0 00010000:00010000:2.0:1734016146.865298:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016146.865304:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117b63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016146.865315:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016146.865322:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117b63 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016146.865349:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016146.865394:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247334025984:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 161us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016146.865401:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3278 00010000:00010000:3.0:1734016146.867207:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117b40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7727 expref: 14 pid: 13956 timeout: 513 lvb_type: 0 00000100:00100000:3.0:1734016146.867250:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335448448:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016146.867288:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016146.867305:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016146.867310:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:3.0:1734016146.867474:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968857 00000004:00010000:3.0:1734016146.867544:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075a02d80 reply state ffff880075d65000 transno 4294968858 ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:3.0:1734016146.867554:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016146.869842:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+20:10406:x1818247334025856:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 9545us (12798us total) trans 4294968858 rc 0/0 00000100:00100000:3.0:1734016146.869858:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2399 00000020:00080000:3.0:1734016146.869870:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016146.883542:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1734016146.884048:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016146.884061:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117b63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016146.884069:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117b63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016146.884076:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4240 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016146.884081:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117b63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016146.884088:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117b63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016146.884111:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016146.884114:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016146.884119:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117b63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016146.884123:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117b63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:3.0:1734016146.888219:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334026112 00000100:00100000:3.0:1734016146.888242:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334026112 00000100:00100000:3.0:1734016146.888346:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11985 00000100:00100000:3.0:1734016146.888356:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247334026112:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016146.888387:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016146.888421:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27117b6a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e774a expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.888468:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117b24 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4014080->4026367) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7712 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.888476:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b2b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7719 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016146.888487:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016146.888489:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016146.888492:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27117b6a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e774a expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.888532:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7719 expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016146.888546:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7719 expref: 10 pid: 8216 timeout: 514 lvb_type: 1 00000100:00100000:3.0:1734016146.888562:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335448576:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016146.889465:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117b24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4014080->4026367) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7712 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.889476:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117b24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4014080->4026367) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7712 expref: 7 pid: 8216 timeout: 514 lvb_type: 0 00000100:00100000:3.0:1734016146.889485:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335448704:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016146.889515:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d600 going to sleep for 11 seconds 00000100:00100000:3.0:1734016146.899373:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335448576:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016146.909001:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335448704:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016146.909090:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27117b6a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e774a expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.909131:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016146.914293:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:10406:x1818247334026112:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 25922us (30762us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016146.914308:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11985 00000100:00100000:0.0:1734016146.921783:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.922127:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334026240 00000100:00100000:2.0:1734016146.922139:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334026240 00010000:00010000:2.0:1734016146.922194:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7719 expref: 10 pid: 8216 timeout: 514 lvb_type: 1 00000100:00100000:2.0:1734016146.922233:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3279 00000100:00100000:2.0:1734016146.922241:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247334026240:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016146.922265:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016146.922292:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7719 expref: 10 pid: 8216 timeout: 514 lvb_type: 1 00010000:00010000:2.0:1734016146.922306:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7719 expref: 10 pid: 8216 timeout: 514 lvb_type: 1 00010000:00010000:2.0:1734016146.922338:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117b2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7719 expref: 10 pid: 8216 timeout: 514 lvb_type: 1 00010000:00010000:2.0:1734016146.922383:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016146.922450:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247334026240:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 208us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016146.922457:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3279 00000100:00100000:0.0:1734016146.931355:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.931735:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334026368 00000100:00100000:2.0:1734016146.931750:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334026368 00010000:00010000:2.0:1734016146.931841:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117b24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4026367) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7712 expref: 8 pid: 8216 timeout: 514 lvb_type: 0 00000100:00100000:2.0:1734016146.931874:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3280 00000100:00100000:2.0:1734016146.931880:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247334026368:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016146.931899:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016146.931924:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117b24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4014080->4026367) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7712 expref: 8 pid: 8216 timeout: 514 lvb_type: 0 00010000:00010000:2.0:1734016146.931938:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117b24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4014080->4026367) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7712 expref: 8 pid: 8216 timeout: 514 lvb_type: 0 00010000:00010000:2.0:1734016146.931962:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117b24 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4014080->4026367) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7712 expref: 8 pid: 8216 timeout: 514 lvb_type: 0 00010000:00010000:2.0:1734016146.932132:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016146.932136:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016146.932144:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27117b6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e774a expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.932155:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27117b6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e774a expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016146.932194:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27117b6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e774a expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016146.932210:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335448832:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016146.932890:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016146.938166:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335448832:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016146.938221:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016146.938308:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247334026368:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6423us (6963us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016146.938326:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3280 00000100:00100000:0.0:1734016146.940503:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016146.940582:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016146.940992:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334026624 00000100:00100000:1.0:1734016146.941009:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334026624 00002000:00010000:1.0:1734016146.941090:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (1802609->18446744073709551615) 00002000:00100000:1.0:1734016146.941096:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ac380 with x1818247334026624 ext(1802609->18446744073709551615) 00002000:00010000:1.0:1734016146.941118:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ac380. 00000100:00100000:1.0:1734016146.941152:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334026496 00000100:00100000:1.0:1734016146.941156:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334026496 00002000:00010000:1.0:1734016146.941169:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:1.0:1734016146.941172:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ac000 with x1818247334026496 ext(4194304->18446744073709551615) 00002000:00010000:1.0:1734016146.941183:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800749ac000. 00000100:00100000:1.0:1734016146.941207:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9057 00000100:00100000:1.0:1734016146.941217:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247334026624:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:2.0:1734016146.944004:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9058 00000100:00100000:2.0:1734016146.944030:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1982:x1818247334026496:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:1.0:1734016146.950209:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 4194304 -> 1802609 00002000:00010000:1.0:1734016146.950223:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016146 -> 1734016147 00002000:00010000:1.0:1734016146.950226:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016145 -> 1734016145 00002000:00010000:1.0:1734016146.950228:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016146 -> 1734016147 00002000:00010000:1.0:1734016146.950230:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 32 -> 16 00000100:00100000:1.0:1734016146.950345:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247334026624:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 9119us (9847us total) trans 4294969561 rc 0/0 00000100:00100000:1.0:1734016146.950360:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9057 00002000:00010000:1.0:1734016146.950370:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (1802609->18446744073709551615) 00002000:00100000:1.0:1734016146.950374:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ac380 with x1818247334026624 ext(1802609->18446744073709551615) 00002000:00010000:1.0:1734016146.950384:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800749ac380. 00002000:00010000:3.0:1734016146.959787:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5033455 -> 4194304 00002000:00010000:3.0:1734016146.959847:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016146 -> 1734016147 00002000:00010000:3.0:1734016146.959850:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016147 -> 1734016146 00002000:00010000:3.0:1734016146.959852:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016147 -> 1734016147 00002000:00010000:3.0:1734016146.959855:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 264 -> 248 00000100:00100000:3.0:1734016146.959971:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247334026496:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 15940us (19379us total) trans 4294968111 rc 0/0 00000100:00100000:3.0:1734016146.959987:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9058 00002000:00010000:3.0:1734016146.960000:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:3.0:1734016146.960005:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ac000 with x1818247334026496 ext(4194304->18446744073709551615) 00002000:00010000:3.0:1734016146.960015:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800749ac000. 00000100:00100000:0.0:1734016146.966016:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016146.966238:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334026752 00000100:00100000:3.0:1734016146.966252:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334026752 00000100:00100000:3.0:1734016146.966323:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2400 00000100:00100000:3.0:1734016146.966335:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:10406:x1818247334026752:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016146.966372:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016146.966409:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117b71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7751 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.966654:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117b78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016146.966676:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016146.966688:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:3.0:1734016146.966725:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 5996913 00000004:00200000:3.0:1734016146.966730:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016146.966755:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016146.966784:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117b71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7751 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.966848:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117b78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7751 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016146.966858:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016146.966862:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016146.966866:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016146.966933:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10406:x1818247334026752:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 601us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016146.966941:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2400 00000100:00100000:0.0:1734016146.970946:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016146.971017:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.972209:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334027008 00000100:00100000:2.0:1734016146.972222:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334027008 00000100:00100000:2.0:1734016146.972656:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334026880 00000100:00100000:2.0:1734016146.972659:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334026880 00000100:00100000:3.0:1734016146.972701:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11986 00000100:00100000:3.0:1734016146.972708:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334027008:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016146.972726:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016146.972748:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117b7f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e775f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016146.972827:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335448960:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016146.973096:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11987 00000100:00100000:2.0:1734016146.973101:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247334026880:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016146.973109:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016146.973118:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117b86 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7758 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016146.973146:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335449088:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016146.974075:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016146.974170:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00002000:00010000:3.0:1734016146.982427:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016145 -> 1734016146 00000100:00100000:3.0:1734016146.982488:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335448960:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016146.982542:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117b7f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e775f expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016146.982561:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117b7f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e775f expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016146.982615:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016146.982703:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334027008:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9993us (11777us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016146.982715:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11986 00000100:00100000:2.0:1734016146.984645:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335449088:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016146.984711:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117b86 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7758 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016146.984733:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117b86 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7758 expref: 6 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016146.984785:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016146.984906:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247334026880:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11800us (13885us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016146.984917:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11987 00000100:00100000:0.0:1734016146.989123:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016146.989223:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016146.989346:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334027264 00000100:00100000:2.0:1734016146.989364:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334027264 00000100:00100000:2.0:1734016146.989419:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334027136 00000100:00100000:2.0:1734016146.989421:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334027136 00000100:00100000:2.0:1734016146.990354:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11988 00000100:00100000:2.0:1734016146.990370:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334027264:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016146.990414:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016146.990462:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117b8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e776d expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016146.990564:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335449216:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016146.990659:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016146.992532:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11989 00000100:00100000:0.0:1734016146.992551:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247334027136:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016146.992577:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016146.992605:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27117b94 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7766 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016146.992676:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800749ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335449344:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016146.992753:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f900 going to sleep for 11 seconds 00000100:00100000:2.0:1734016146.995730:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335449216:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016146.995790:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117b8d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e776d expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016146.995844:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117b8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e776d expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016146.995880:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016146.995959:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334027264:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5589us (6861us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016146.995973:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11988 00000100:00100000:1.0:1734016146.999365:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800749ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335449344:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016146.999409:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27117b94 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7766 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016146.999424:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27117b94 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7766 expref: 6 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016146.999463:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581b00, rc 0) 00000100:00100000:1.0:1734016146.999529:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:1982:x1818247334027136:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6983us (10303us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016146.999539:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11989 00000100:00100000:0.0:1734016147.007254:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016147.007345:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334027392 00000100:00100000:1.0:1734016147.007357:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334027392 00000100:00100000:1.0:1734016147.007430:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11990 00000100:00100000:1.0:1734016147.007449:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+5:10406:x1818247334027392:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016147.007475:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016147.007504:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27117b9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7774 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016147.007542:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27117b32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3686399) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7720 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016147.007548:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016147.007550:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016147.007553:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27117b9b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [94208->106495] (req 94208->106495) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7774 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016147.007591:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27117b32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3686399) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7720 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016147.007602:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27117b32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3686399) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7720 expref: 8 pid: 7683 timeout: 514 lvb_type: 0 00000100:00100000:1.0:1734016147.007612:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335449472:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016147.007687:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c926c0 going to sleep for 11 seconds 00000100:00100000:0.0:1734016147.014657:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016147.014795:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335449472:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016147.014867:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27117b9b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [94208->106495] (req 94208->106495) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7774 expref: 6 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016147.014893:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499db00, rc 0) 00000100:00100000:1.0:1734016147.014964:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247334027392:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7516us (7722us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016147.014976:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11990 00000100:00100000:2.0:1734016147.015101:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334027520 00000100:00100000:2.0:1734016147.015112:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334027520 00010000:00010000:2.0:1734016147.015150:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27117b32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3686399) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7720 expref: 9 pid: 7683 timeout: 514 lvb_type: 0 00000100:00100000:2.0:1734016147.015202:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3281 00000100:00100000:2.0:1734016147.015211:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1981:x1818247334027520:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016147.015231:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016147.015259:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27117b32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3678208->3686399) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7720 expref: 9 pid: 7683 timeout: 514 lvb_type: 0 00010000:00010000:2.0:1734016147.015272:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27117b32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3678208->3686399) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7720 expref: 9 pid: 7683 timeout: 514 lvb_type: 0 00010000:00010000:2.0:1734016147.015314:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499ed00/0x5e3a3adc27117b32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3678208->3686399) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7720 expref: 9 pid: 7683 timeout: 514 lvb_type: 0 00010000:00010000:2.0:1734016147.015348:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016147.015350:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016147.015359:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27117b9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->106495) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7774 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.015369:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27117b9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->106495) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7774 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.015423:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27117b9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->106495) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7774 expref: 5 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016147.015448:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335449600:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016147.015503:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016147.027954:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335449600:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016147.028010:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016147.028103:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247334027520:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 12889us (13461us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016147.028122:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3281 00000100:00100000:0.0:1734016147.028523:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.028883:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334027776 00000100:00100000:3.0:1734016147.028899:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334027776 00002000:00100000:3.0:1734016147.028970:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff8800756ec700 x1818247334027776/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:108/0 lens 488/0 e 0 to 0 dl 1734016158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016147.028982:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ec700 with x1818247334027776 ext(0->4194303) 00002000:00010000:3.0:1734016147.028989:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756ec700 00000100:00100000:3.0:1734016147.029015:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9059 00000100:00100000:3.0:1734016147.029021:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247334027776:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016147.132174:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247334027776:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 103124us (103624us total) trans 0 rc 4194304/4194304 00000100:00100000:3.0:1734016147.132202:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9059 00002000:00100000:3.0:1734016147.132231:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff8800756ec700 x1818247334027776/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:108/0 lens 488/440 e 0 to 0 dl 1734016158 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016147.132243:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800756ec700 with x1818247334027776 ext(0->4194303) 00002000:00010000:3.0:1734016147.132252:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800756ec700 00000100:00100000:0.0:1734016147.141022:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016147.142389:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334027904 00000100:00100000:1.0:1734016147.142426:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334027904 00000100:00100000:1.0:1734016147.145172:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11991 00000100:00100000:1.0:1734016147.145200:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247334027904:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016147.145238:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016147.145284:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27117ba2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e777b expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016147.145401:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335449728:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016147.145562:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c926c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016147.153604:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335449728:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016147.153675:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27117ba2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e777b expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016147.153700:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d200/0x5e3a3adc27117ba2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e777b expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016147.156058:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d200, rc 0) 00000100:00100000:1.0:1734016147.156276:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247334027904:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11064us (15257us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016147.156296:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11991 00000100:00100000:0.0:1734016147.160071:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016147.167765:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334028032 00000100:00100000:1.0:1734016147.167796:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334028032 00000100:00100000:2.0:1734016147.168102:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11992 00000100:00100000:2.0:1734016147.168131:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247334028032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016147.168182:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016147.168227:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117ba9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7782 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016147.168328:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335449856:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016147.168499:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00000100:00100000:2.0:1734016147.181898:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335449856:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016147.182015:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117ba9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7782 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.182050:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117ba9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7782 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.182107:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016147.182220:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247334028032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 14092us (22166us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016147.182238:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11992 00000100:00100000:0.0:1734016147.198961:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.199564:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334028160 00000100:00100000:2.0:1734016147.199588:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334028160 00000100:00100000:2.0:1734016147.199685:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11993 00000100:00100000:2.0:1734016147.199699:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334028160:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016147.199739:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016147.199775:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117bb0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7789 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016147.199935:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335449984:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016147.200078:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00000100:00100000:2.0:1734016147.204296:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335449984:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016147.204401:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117bb0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7789 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.204441:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117bb0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7789 expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.204490:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016147.204602:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334028160:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4903us (5678us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016147.204622:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11993 00000100:00100000:1.0:1734016147.205114:0:3505:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335450496:0@lo:400:kworker.0 00000100:00100000:1.0:1734016147.205215:0:3505:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016147.205247:0:3505:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1734016147.205253:0:3505:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67a75f73-9674-4938-8c12-63813a36f078:3505:1818247335450112:0@lo:400:kworker.0 00000100:00100000:1.0:1734016147.205285:0:3505:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016147.205297:0:3505:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3505:1818247335450624:0@lo:400:kworker.0 00000100:00100000:1.0:1734016147.205324:0:3505:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016147.205350:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3503:1818247335450240:0@lo:400:kworker.0 00000100:00100000:1.0:1734016147.205372:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016147.205385:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007345ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335450752:0@lo:400:kworker.0 00000100:00100000:1.0:1734016147.205404:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016147.205412:0:3503:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1734016147.205416:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3503:1818247335450368:0@lo:400:kworker.0 00000100:00100000:1.0:1734016147.205447:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1734016147.205472:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335450624 00000100:00100000:1.0:1734016147.205482:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335450624 00000100:00100000:1.0:1734016147.205538:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335450240 00000100:00100000:1.0:1734016147.205540:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335450240 00000100:00100000:1.0:1734016147.205554:0:13956:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335450368 00000100:00100000:1.0:1734016147.205556:0:13956:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335450368 00000100:00100000:1.0:1734016147.205570:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1734016147.205579:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3505:x1818247335450624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016147.205640:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3505:x1818247335450624:12345-0@lo:400:kworker.0 Request processed in 62us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016147.205646:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1734016147.205661:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1734016147.205665:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3503:x1818247335450240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016147.205688:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3503:x1818247335450240:12345-0@lo:400:kworker.0 Request processed in 23us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016147.205693:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1734016147.205703:0:13956:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1734016147.205706:0:13956:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3503:x1818247335450368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016147.205725:0:13956:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3503:x1818247335450368:12345-0@lo:400:kworker.0 Request processed in 18us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016147.205730:0:13956:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1734016147.205762:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3503:1818247335450368:0@lo:400:kworker.0 00000100:00100000:1.0:1734016147.205771:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3503:1818247335450240:0@lo:400:kworker.0 00000100:00100000:1.0:1734016147.205839:0:3505:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3505:1818247335450624:0@lo:400:kworker.0 00000100:00100000:1.0:1734016147.205856:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335450496 00000100:00100000:1.0:1734016147.205859:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335450496 00000100:00100000:1.0:1734016147.205885:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1734016147.205889:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335450496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016147.205909:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335450752 00000100:00100000:1.0:1734016147.205911:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335450752 00000100:00100000:1.0:1734016147.205935:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1734016147.205939:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335450752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016147.205969:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335450752:12345-0@lo:400:kworker.0 Request processed in 29us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016147.205975:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1734016147.206001:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007345ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335450752:0@lo:400:kworker.0 00000100:00100000:1.0:1734016147.206030:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335450496:12345-0@lo:400:kworker.0 Request processed in 140us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016147.206034:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1734016147.206048:0:3505:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335450496:0@lo:400:kworker.0 00000100:00100000:1.0:1734016147.206094:0:6475:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335450112 00000100:00100000:1.0:1734016147.206097:0:6475:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335450112 00000100:00100000:1.0:1734016147.206125:0:6475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1734016147.206129:0:6475:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a75f73-9674-4938-8c12-63813a36f078+18:3505:x1818247335450112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1734016147.206157:0:6475:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a75f73-9674-4938-8c12-63813a36f078+18:3505:x1818247335450112:12345-0@lo:400:kworker.0 Request processed in 28us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016147.206163:0:6475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1734016147.206192:0:3505:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67a75f73-9674-4938-8c12-63813a36f078:3505:1818247335450112:0@lo:400:kworker.0 00000100:00080000:1.0:1734016147.206215:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1734016117 00000100:00080000:1.0:1734016147.206220:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016117 00000100:00080000:1.0:1734016147.206222:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016117 00000100:00080000:1.0:1734016147.206224:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016117 00000100:00100000:0.0:1734016147.212106:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.213165:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334028288 00000100:00100000:3.0:1734016147.213194:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334028288 00000100:00100000:3.0:1734016147.213309:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11994 00000100:00100000:3.0:1734016147.213320:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247334028288:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016147.213365:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016147.213414:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117bb7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7790 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.213495:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27117b9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->106495) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7774 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.213509:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016147.213513:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016147.213518:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117bb7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [5550080->5558271] (req 5550080->5558271) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7790 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.213572:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27117b9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->106495) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7774 expref: 7 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.213591:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27117b9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->106495) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7774 expref: 7 pid: 7684 timeout: 514 lvb_type: 0 00000100:00100000:3.0:1734016147.213612:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335450880:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016147.213748:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d600 going to sleep for 11 seconds 00000100:00100000:0.0:1734016147.226914:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335450880:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016147.226997:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117bb7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [5550080->5558271] (req 5550080->5558271) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7790 expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016147.227037:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:0.0:1734016147.227152:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247334028288:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 13828us (15060us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016147.227167:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11994 00000100:00100000:0.0:1734016147.239628:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.242229:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334028416 00000100:00100000:2.0:1734016147.242264:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334028416 00010000:00010000:2.0:1734016147.242378:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27117b9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->106495) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7774 expref: 7 pid: 7684 timeout: 514 lvb_type: 0 00000100:00100000:2.0:1734016147.244079:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3282 00000100:00100000:2.0:1734016147.244099:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334028416:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016147.244137:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016147.244186:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27117b9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 94208->106495) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7774 expref: 7 pid: 7684 timeout: 514 lvb_type: 0 00010000:00010000:2.0:1734016147.244207:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27117b9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 94208->106495) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7774 expref: 7 pid: 7684 timeout: 514 lvb_type: 0 00010000:00010000:2.0:1734016147.244250:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499db00/0x5e3a3adc27117b9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 94208->106495) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7774 expref: 7 pid: 7684 timeout: 514 lvb_type: 0 00010000:00010000:2.0:1734016147.244312:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016147.244316:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016147.244324:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117bb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5550080->5558271) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7790 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.244334:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117bb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5550080->5558271) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7790 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.244400:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117bb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5550080->5558271) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7790 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016147.244418:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335451008:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016147.246278:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00000100:00100000:2.0:1734016147.257202:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335451008:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016147.257267:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016147.257377:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247334028416:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 13277us (17779us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016147.257402:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3282 00000100:00100000:3.0:1734016147.258615:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.258761:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334028544 00000100:00100000:3.0:1734016147.258779:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334028544 00000100:00100000:3.0:1734016147.258896:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11995 00000100:00100000:3.0:1734016147.258909:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247334028544:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016147.259474:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 5556270 00002000:00010000:3.0:1734016147.259479:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016147 -> 1734016147 00002000:00010000:3.0:1734016147.259483:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016146 -> 1734016146 00002000:00010000:3.0:1734016147.259485:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016147 -> 1734016147 00002000:00010000:3.0:1734016147.259489:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 248 -> 264 00000100:00100000:3.0:1734016147.259570:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247334028544:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 663us (964us total) trans 4294968112 rc 0/0 00000100:00100000:3.0:1734016147.259581:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11995 00000100:00100000:1.0:1734016147.271140:0:3503:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1734016147.271194:0:3503:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335451136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1734016147.271364:0:3503:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1734016147.271846:0:7685:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335451136 00000100:00100000:3.0:1734016147.271863:0:7685:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335451136 00000100:00100000:3.0:1734016147.271951:0:7685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1734016147.271964:0:7685:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335451136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1734016147.272038:0:7685:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 980009536 pending 0 free 3923066880 avail 3691544576 00000100:00100000:3.0:1734016147.273476:0:7685:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3503:x1818247335451136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1500us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016147.273496:0:7685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1734016147.273734:0:3503:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3503:1818247335451136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1734016147.280674:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.280876:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334028672 00000100:00100000:3.0:1734016147.280894:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334028672 00000100:00100000:3.0:1734016147.282317:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2401 00000100:00100000:3.0:1734016147.282342:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+19:10406:x1818247334028672:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016147.282415:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016147.282467:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27117bbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7797 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.282659:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117bc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016147.282688:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016147.282707:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:3.0:1734016147.282757:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 5996913 00000004:00200000:3.0:1734016147.282765:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016147.282796:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016147.282851:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27117bbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7797 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.287927:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7797 expref: 20 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.287960:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016147.287964:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016147.287970:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016147.288169:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+20:10406:x1818247334028672:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5829us (7510us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016147.288187:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2401 00000100:00100000:0.0:1734016147.294547:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.295243:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334028800 00000100:00100000:3.0:1734016147.295259:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334028800 00000100:00100000:3.0:1734016147.295339:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11996 00000100:00100000:3.0:1734016147.295356:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247334028800:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016147.295393:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016147.295418:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117bcc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e779e expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016147.295519:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335451264:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016147.296995:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00002000:00010000:3.0:1734016147.300845:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016146 -> 1734016147 00000100:00100000:3.0:1734016147.300908:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335451264:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016147.300968:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117bcc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e779e expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016147.300987:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117bcc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e779e expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016147.301015:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016147.301111:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1981:x1818247334028800:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5759us (6585us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016147.301123:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11996 00000100:00100000:0.0:1734016147.307664:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.309626:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334028928 00000100:00100000:3.0:1734016147.309649:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334028928 00000100:00100000:3.0:1734016147.309735:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11997 00000100:00100000:3.0:1734016147.309746:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247334028928:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016147.309778:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016147.309854:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117bd3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e77a5 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016147.309934:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335451392:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016147.310048:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016147.321019:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335451392:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016147.321100:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117bd3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77a5 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016147.321124:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117bd3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77a5 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016147.323969:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016147.324163:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1984:x1818247334028928:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 14402us (16502us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016147.324179:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11997 00000100:00100000:1.0:1734016147.330257:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.330389:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334029056 00000100:00100000:3.0:1734016147.330406:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334029056 00000100:00100000:3.0:1734016147.330491:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11998 00000100:00100000:3.0:1734016147.330499:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247334029056:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016147.330531:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016147.330554:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27117bda lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e77ac expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016147.330644:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335451520:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016147.330762:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016147.342307:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335451520:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016147.342385:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27117bda lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77ac expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016147.342410:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5440/0x5e3a3adc27117bda lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77ac expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016147.342451:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016147.342535:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247334029056:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12032us (12299us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016147.342548:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11998 00000100:00100000:0.0:1734016147.351235:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.351364:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334029184 00000100:00100000:3.0:1734016147.351382:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334029184 00000100:00100000:3.0:1734016147.351561:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 11999 00000100:00100000:3.0:1734016147.351571:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247334029184:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016147.351592:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016147.351615:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117be1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e77b3 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016147.351687:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335451648:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016147.354904:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016147.369271:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335451648:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016147.369352:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117be1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77b3 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016147.369380:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4240/0x5e3a3adc27117be1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77b3 expref: 9 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016147.369419:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016147.369516:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:1983:x1818247334029184:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 17943us (20567us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016147.369530:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 11999 00000100:00100000:0.0:1734016147.372554:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.372673:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334029440 00000100:00100000:3.0:1734016147.372685:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334029440 00000100:00100000:3.0:1734016147.372759:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2402 00000100:00100000:3.0:1734016147.372769:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+20:10406:x1818247334029440:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016147.373206:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016147.373245:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117bc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7797 expref: 20 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.373281:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016147.373287:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016147.373541:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117be8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016147.373557:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117b78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7751 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.373565:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117be8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016147.373606:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117b78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7751 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.373648:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117b78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7751 expref: 14 pid: 6479 timeout: 514 lvb_type: 0 00000100:00100000:2.0:1734016147.373662:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335451776:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016147.373752:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016147.381899:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.382467:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334029568 00000100:00100000:3.0:1734016147.382481:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334029568 00010000:00010000:3.0:1734016147.382533:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117b78 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7751 expref: 15 pid: 6479 timeout: 514 lvb_type: 0 00000100:00100000:3.0:1734016147.382588:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3283 00000100:00100000:3.0:1734016147.382599:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:1982:x1818247334029568:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016147.382621:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016147.382628:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117b78 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7751 expref: 15 pid: 6479 timeout: 514 lvb_type: 0 00010000:00010000:3.0:1734016147.382643:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117b78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7751 expref: 15 pid: 6479 timeout: 514 lvb_type: 0 00010000:00010000:3.0:1734016147.382680:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016147.382686:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117be8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016147.382696:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117be8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016147.382704:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117be8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016147.382728:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016147.382930:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117b78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7751 expref: 15 pid: 6479 timeout: 514 lvb_type: 0 00000100:00100000:2.0:1734016147.382958:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335451776:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016147.382988:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117be8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016147.382997:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117be8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016147.383002:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117be8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:3.0:1734016147.383250:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:1982:x1818247334029568:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 651us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016147.383258:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3283 00000001:00080000:2.0:1734016147.383450:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968859 00000004:00010000:2.0:1734016147.383509:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff88012e607b80 reply state ffff880075a93000 transno 4294968860 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117be8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:2.0:1734016147.383516:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016147.383606:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+22:10406:x1818247334029440:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 10838us (11073us total) trans 4294968860 rc 0/0 00000100:00100000:2.0:1734016147.383613:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2402 00000020:00080000:2.0:1734016147.383619:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016147.387747:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:2.0:1734016147.387895:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117be8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016147.387909:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117be8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016147.387917:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117be8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016147.387925:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc480 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016147.387931:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117be8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016147.387941:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117be8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016147.387971:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016147.387974:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016147.387979:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117be8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016147.387983:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117be8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:3.0:1734016147.388994:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334029696 00000100:00100000:3.0:1734016147.389012:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334029696 00000100:00100000:3.0:1734016147.389081:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12000 00000100:00100000:3.0:1734016147.389092:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+8:10406:x1818247334029696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016147.389120:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016147.389144:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117bef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e77ba expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.389182:0:7684:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117bb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5550080->5558271) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7790 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.389191:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016147.389194:0:7684:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016147.389198:0:7684:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117bef lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77ba expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.389245:0:7684:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117bb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5550080->5558271) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7790 expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.389259:0:7684:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117bb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5550080->5558271) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7790 expref: 6 pid: 7683 timeout: 514 lvb_type: 0 00000100:00100000:3.0:1734016147.389272:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335451904:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016147.391899:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016147.396869:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.396968:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334029824 00000100:00100000:3.0:1734016147.396980:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334029824 00000100:00100000:2.0:1734016147.397026:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335451904:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016147.397032:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117bb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5550080->5558271) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7790 expref: 7 pid: 7683 timeout: 514 lvb_type: 0 00010000:00010000:2.0:1734016147.397070:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117bef lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77ba expref: 9 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016147.397083:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3284 00000100:00100000:3.0:1734016147.397092:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247334029824:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016147.397097:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00010000:00010000:3.0:1734016147.397118:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016147.397150:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117bb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5550080->5558271) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7790 expref: 7 pid: 7683 timeout: 514 lvb_type: 0 00010000:00010000:3.0:1734016147.397167:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117bb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5550080->5558271) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7790 expref: 7 pid: 7683 timeout: 514 lvb_type: 0 00000100:00100000:2.0:1734016147.397172:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+9:10406:x1818247334029696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8080us (9443us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016147.397181:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12000 00010000:00010000:3.0:1734016147.397203:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117bb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5550080->5558271) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7790 expref: 7 pid: 7683 timeout: 514 lvb_type: 0 00010000:00010000:3.0:1734016147.397231:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016147.397234:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016147.397249:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117bef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77ba expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.397260:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117bef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77ba expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.397299:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117bef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77ba expref: 8 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016147.397316:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335452032:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016147.397367:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016147.402926:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016147.403011:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.403044:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334030080 00000100:00100000:2.0:1734016147.403062:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334030080 00002000:00010000:2.0:1734016147.403154:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (3383879->18446744073709551615) 00000100:00100000:1.0:1734016147.403157:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334029952 00000100:00100000:1.0:1734016147.403163:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334029952 00002000:00100000:2.0:1734016147.403163:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3c700 with x1818247334030080 ext(3383879->18446744073709551615) 00002000:00010000:2.0:1734016147.403182:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3c700. 00002000:00010000:1.0:1734016147.403184:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:1.0:1734016147.403189:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cc380 with x1818247334029952 ext(4194304->18446744073709551615) 00002000:00010000:1.0:1734016147.403201:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a78cc380. 00000100:00100000:2.0:1734016147.403239:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9060 00000100:00100000:2.0:1734016147.403254:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247334030080:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:3.0:1734016147.403528:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335452032:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016147.403576:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016147.403661:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247334029824:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6566us (6867us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016147.403675:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3284 00002000:00010000:2.0:1734016147.403728:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 1802609 -> 3383879 00002000:00010000:2.0:1734016147.403732:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016147 -> 1734016147 00002000:00010000:2.0:1734016147.403734:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016146 -> 1734016145 00002000:00010000:2.0:1734016147.403739:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016147 -> 1734016147 00002000:00010000:2.0:1734016147.403741:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:2.0:1734016147.403772:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247334030080:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 523us (869us total) trans 4294969562 rc 0/0 00000100:00100000:1.0:1734016147.403775:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9061 00000100:00100000:2.0:1734016147.403780:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9060 00000100:00100000:1.0:1734016147.403781:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+9:1982:x1818247334029952:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016147.403783:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (3383879->18446744073709551615) 00002000:00100000:2.0:1734016147.403785:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007bd3c700 with x1818247334030080 ext(3383879->18446744073709551615) 00002000:00010000:2.0:1734016147.403789:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007bd3c700. 00002000:00010000:1.0:1734016147.404053:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5556270 -> 4194304 00002000:00010000:1.0:1734016147.404057:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016147 -> 1734016147 00002000:00010000:1.0:1734016147.404059:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016147 -> 1734016146 00002000:00010000:1.0:1734016147.404062:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016147 -> 1734016147 00002000:00010000:1.0:1734016147.404064:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 264 -> 248 00000100:00100000:1.0:1734016147.404094:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247334029952:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 312us (1082us total) trans 4294968113 rc 0/0 00000100:00100000:1.0:1734016147.404101:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9061 00002000:00010000:1.0:1734016147.404104:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:1.0:1734016147.404107:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a78cc380 with x1818247334029952 ext(4194304->18446744073709551615) 00002000:00010000:1.0:1734016147.404111:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a78cc380. 00000100:00100000:0.0:1734016147.406935:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.407121:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334030208 00000100:00100000:2.0:1734016147.407137:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334030208 00000100:00100000:2.0:1734016147.407233:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2403 00000100:00100000:2.0:1734016147.407243:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+14:10406:x1818247334030208:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016147.407288:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016147.407321:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117bf6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e77c1 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.407451:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117bfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016147.407466:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016147.407475:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:2.0:1734016147.407504:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 7578183 00000004:00200000:2.0:1734016147.407509:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016147.407533:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016147.407562:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117bf6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77c1 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.407587:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117bfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77c1 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.407596:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016147.407599:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016147.407604:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016147.407669:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10406:x1818247334030208:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 427us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016147.407676:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2403 00000100:00100000:0.0:1734016147.432108:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016147.432211:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.432360:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334030464 00000100:00100000:2.0:1734016147.432395:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334030464 00000100:00100000:2.0:1734016147.432521:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334030336 00000100:00100000:2.0:1734016147.432524:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334030336 00000100:00100000:2.0:1734016147.432563:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12001 00000100:00100000:2.0:1734016147.432580:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334030464:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016147.432624:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016147.432667:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117c04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e77cf expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016147.432871:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335452160:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016147.433013:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00000100:00100000:0.0:1734016147.436992:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12002 00000100:00100000:0.0:1734016147.437031:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247334030336:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016147.437084:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016147.437141:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27117c0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e77c8 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016147.437276:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335452288:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016147.437410:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f000 going to sleep for 11 seconds 00000100:00100000:0.0:1734016147.445635:0:3505:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335452416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1734016147.445743:0:3505:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1734016147.446045:0:7685:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247335452416 00000100:00100000:3.0:1734016147.446057:0:7685:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247335452416 00000100:00100000:3.0:1734016147.446110:0:7685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1734016147.446120:0:7685:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335452416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1734016147.446173:0:7685:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 28672 granted 620499520 pending 0 free 3923550208 avail 3692027904 00000100:00100000:3.0:1734016147.446231:0:7685:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3505:x1818247335452416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016147.446242:0:7685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1734016147.446335:0:3505:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3505:1818247335452416:0@lo:13:osp-pre-0-0.0 00002000:00010000:2.0:1734016147.450385:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016145 -> 1734016147 00000100:00100000:2.0:1734016147.450436:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335452160:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016147.450490:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117c04 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77cf expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.450506:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117c04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77cf expref: 8 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.450528:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016147.450588:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334030464:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 18012us (18512us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016147.450599:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12001 00002000:00010000:1.0:1734016147.450838:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016146 -> 1734016147 00000100:00100000:1.0:1734016147.450853:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335452288:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016147.450877:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27117c0b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77c8 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016147.450892:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27117c0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77c8 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016147.451402:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:1.0:1734016147.451448:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1982:x1818247334030336:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 14429us (19236us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016147.451454:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12002 00000100:00100000:0.0:1734016147.465047:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016147.465273:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.469583:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334030592 00000100:00100000:2.0:1734016147.469604:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334030592 00000100:00100000:2.0:1734016147.469683:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334030720 00000100:00100000:2.0:1734016147.469687:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334030720 00000100:00100000:2.0:1734016147.469723:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12003 00000100:00100000:2.0:1734016147.469734:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247334030592:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016147.469763:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016147.469791:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117c12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e77d6 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016147.469891:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335452544:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016147.469989:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00000100:00100000:0.0:1734016147.470073:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12004 00000100:00100000:0.0:1734016147.470079:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247334030720:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016147.470090:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016147.470103:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27117c19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e77dd expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016147.470134:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335452672:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016147.470157:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016147.476330:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335452672:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016147.476412:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27117c19 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77dd expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016147.476445:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27117c19 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77dd expref: 8 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016147.476487:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:1.0:1734016147.476569:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247334030720:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6487us (11293us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016147.476585:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12004 00000100:00100000:2.0:1734016147.476945:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335452544:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016147.476983:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117c12 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77d6 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.477003:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117c12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77d6 expref: 7 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.477606:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016147.477651:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:1981:x1818247334030592:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7918us (12625us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016147.477657:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12003 00000100:00100000:2.0:1734016147.490673:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016147.490744:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334030848 00000100:00100000:0.0:1734016147.490755:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334030848 00000100:00100000:0.0:1734016147.490824:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12005 00000100:00100000:0.0:1734016147.490835:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247334030848:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:0.0:1734016147.491088:0:7684:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1734016147.491092:0:7684:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016147 -> 1734016147 00002000:00010000:0.0:1734016147.491094:0:7684:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016147 -> 1734016146 00002000:00010000:0.0:1734016147.491097:0:7684:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016147 -> 1734016147 00002000:00010000:0.0:1734016147.491099:0:7684:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 248 -> 248 00000100:00100000:0.0:1734016147.491208:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247334030848:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 375us (551us total) trans 4294968114 rc 0/0 00000100:00100000:0.0:1734016147.491216:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12005 00000100:00100000:2.0:1734016147.493965:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016147.494055:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334030976 00000100:00100000:1.0:1734016147.494073:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334030976 00000100:00100000:1.0:1734016147.494148:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2404 00000100:00100000:1.0:1734016147.494156:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+21:10406:x1818247334030976:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016147.494187:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016147.494206:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117c20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e77e4 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016147.494331:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27117c27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016147.494348:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27117c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016147.494364:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27117c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:1.0:1734016147.494396:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 7578183 00000004:00200000:1.0:1734016147.494400:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016147.494417:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27117c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016147.494448:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499f3c0/0x5e3a3adc27117c20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77e4 expref: 23 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016147.494475:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27117c27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77e4 expref: 22 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016147.494482:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016147.494485:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1734016147.494488:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016147.494539:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+22:10406:x1818247334030976:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 384us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016147.494545:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2404 00000100:00100000:2.0:1734016147.497215:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016147.497275:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334031232 00000100:00100000:0.0:1734016147.497287:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334031232 00000100:00100000:0.0:1734016147.497575:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2405 00000100:00100000:0.0:1734016147.497585:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+15:10406:x1818247334031232:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:0.0:1734016147.497657:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016147.497691:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117bfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77c1 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016147.498107:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:0.0:1734016147.498115:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016147.498382:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27117c2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016147.498398:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27117c27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77e4 expref: 21 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016147.498406:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27117c2e lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016147.498456:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27117c27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77e4 expref: 21 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016147.498474:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27117c27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77e4 expref: 21 pid: 7704 timeout: 514 lvb_type: 0 00000100:00100000:0.0:1734016147.498491:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800750c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335452800:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016147.498585:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f540 going to sleep for 11 seconds 00000100:00100000:0.0:1734016147.509794:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800750c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335452800:192.168.201.16@tcp:104: 00010000:00010000:0.0:1734016147.509876:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27117c2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:2.0:1734016147.510003:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016147.510073:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334031360 00000100:00100000:0.0:1734016147.510082:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334031360 00010000:00010000:0.0:1734016147.510135:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27117c27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77e4 expref: 22 pid: 7704 timeout: 514 lvb_type: 0 00000100:00100000:0.0:1734016147.510185:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3285 00000100:00100000:0.0:1734016147.510195:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075547100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+22:1982:x1818247334031360:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1734016147.510223:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1734016147.510231:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27117c27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77e4 expref: 22 pid: 7704 timeout: 514 lvb_type: 0 00010000:00010000:0.0:1734016147.510246:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27117c27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77e4 expref: 22 pid: 7704 timeout: 514 lvb_type: 0 00010000:00010000:0.0:1734016147.510283:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c900/0x5e3a3adc27117c27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77e4 expref: 22 pid: 7704 timeout: 514 lvb_type: 0 00010000:00010000:0.0:1734016147.510313:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:0.0:1734016147.510317:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27117c2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016147.510332:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27117c2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016147.510341:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27117c2e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016147.510366:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016147.510461:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075547100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+21:1982:x1818247334031360:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 264us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016147.510474:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3285 00010000:00010000:0.0:1734016147.510506:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27117c2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:0.0:1734016147.510512:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27117c2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:0.0:1734016147.510694:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968861 00000004:00010000:0.0:1734016147.510775:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075546300 reply state ffff88007520f000 transno 4294968862 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27117c2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016147.510785:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1734016147.510912:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:10406:x1818247334031232:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 13329us (13709us total) trans 4294968862 rc 0/0 00000100:00100000:0.0:1734016147.510921:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2405 00000020:00080000:0.0:1734016147.510925:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1734016147.515686:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27117c2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016147.515708:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27117c2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016147.515717:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27117c2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016147.515722:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff8800a7582640 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016147.515729:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27117c2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016147.515737:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27117c2e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016147.515770:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016147.515774:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016147.515778:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27117c2e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016147.515783:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7582640/0x5e3a3adc27117c2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00000100:00100000:2.0:1734016147.518680:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016147.518861:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334031488 00000100:00100000:1.0:1734016147.518873:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334031488 00000100:00100000:1.0:1734016147.518939:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12006 00000100:00100000:1.0:1734016147.518951:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+6:10406:x1818247334031488:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016147.518991:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016147.519033:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117c35 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e77eb expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016147.519079:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117bef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77ba expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016147.519087:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016147.519089:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016147.519093:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117c35 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77eb expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016147.519140:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117bef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77ba expref: 10 pid: 7684 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016147.519154:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117bef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77ba expref: 10 pid: 7684 timeout: 514 lvb_type: 0 00000100:00100000:1.0:1734016147.519168:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335452928:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016147.519266:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00000100:00100000:1.0:1734016147.522522:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335452928:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016147.522580:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117c35 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77eb expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016147.522611:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016147.522707:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247334031488:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3755us (4036us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016147.522723:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12006 00000100:00100000:0.0:1734016147.530335:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016147.530549:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334031616 00000100:00100000:1.0:1734016147.530560:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334031616 00010000:00010000:1.0:1734016147.530611:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117bef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77ba expref: 11 pid: 7684 timeout: 514 lvb_type: 0 00000100:00100000:1.0:1734016147.530673:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3286 00000100:00100000:1.0:1734016147.530685:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247334031616:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016147.530712:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016147.530746:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117bef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77ba expref: 11 pid: 7684 timeout: 514 lvb_type: 0 00010000:00010000:1.0:1734016147.530763:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117bef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77ba expref: 11 pid: 7684 timeout: 514 lvb_type: 0 00010000:00010000:1.0:1734016147.530797:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117bef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77ba expref: 11 pid: 7684 timeout: 514 lvb_type: 0 00010000:00010000:1.0:1734016147.535211:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016147.535226:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016147.535248:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117c35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77eb expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016147.535265:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117c35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77eb expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016147.535352:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117c35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77eb expref: 6 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016147.535368:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335453056:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016147.535503:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016147.558669:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016147.559310:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335453056:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016147.559335:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016147.559391:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1981:x1818247334031616:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 28707us (29073us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016147.559402:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3286 00000100:00100000:2.0:1734016147.559617:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334031744 00000100:00100000:2.0:1734016147.559627:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334031744 00000100:00100000:2.0:1734016147.559681:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12007 00000100:00100000:2.0:1734016147.559689:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247334031744:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016147.559716:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016147.559740:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117c3c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e77f2 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.559774:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27117b6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e774a expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.559783:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016147.559784:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016147.559788:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117c3c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f2 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.559854:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27117b6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e774a expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.559868:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27117b6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e774a expref: 10 pid: 7683 timeout: 514 lvb_type: 0 00000100:00100000:2.0:1734016147.559882:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335453184:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016147.559930:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00000100:00100000:0.0:1734016147.569759:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016147.570335:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334031872 00000100:00100000:1.0:1734016147.570347:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334031872 00010000:00010000:1.0:1734016147.570383:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27117b6a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e774a expref: 11 pid: 7683 timeout: 514 lvb_type: 0 00000100:00100000:1.0:1734016147.570418:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3287 00000100:00100000:1.0:1734016147.570439:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247334031872:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016147.570457:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016147.570481:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27117b6a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e774a expref: 11 pid: 7683 timeout: 514 lvb_type: 0 00010000:00010000:1.0:1734016147.570492:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27117b6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e774a expref: 11 pid: 7683 timeout: 514 lvb_type: 0 00010000:00010000:1.0:1734016147.570524:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016147.570526:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016147.570531:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117c3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f2 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016147.570541:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117c3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f2 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016147.570579:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117c3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f2 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016147.570591:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335453312:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016147.570664:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00010000:00010000:2.0:1734016147.570790:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27117b6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e774a expref: 11 pid: 7683 timeout: 514 lvb_type: 0 00000100:00100000:2.0:1734016147.570868:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335453184:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016147.570896:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117c3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f2 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.570905:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016147.570957:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247334031744:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11267us (18693us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016147.570967:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12007 00000100:00100000:1.0:1734016147.574270:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335453312:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016147.574302:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016147.574354:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247334031872:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3916us (4603us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016147.574365:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3287 00000100:00100000:0.0:1734016147.575049:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016147.575089:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.575161:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334032000 00000100:00100000:3.0:1734016147.575170:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334032000 00002000:00010000:3.0:1734016147.575206:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (2390667->18446744073709551615) 00002000:00100000:3.0:1734016147.575210:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c5c00 with x1818247334032000 ext(2390667->18446744073709551615) 00002000:00010000:3.0:1734016147.575222:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c5c00. 00000100:00100000:3.0:1734016147.575235:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334032128 00000100:00100000:3.0:1734016147.575237:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334032128 00002000:00010000:3.0:1734016147.575247:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:3.0:1734016147.575249:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c4e00 with x1818247334032128 ext(0->18446744073709551615) 00002000:00010000:3.0:1734016147.575256:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c4e00. 00000100:00100000:3.0:1734016147.575279:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9062 00000100:00100000:3.0:1734016147.575284:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247334032000:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:3.0:1734016147.577058:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 4194304 -> 2390667 00002000:00010000:3.0:1734016147.577067:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016147 -> 1734016148 00002000:00010000:3.0:1734016147.577069:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016146 -> 1734016146 00002000:00010000:3.0:1734016147.577071:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016147 -> 1734016148 00002000:00010000:3.0:1734016147.577074:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 248 -> 216 00000100:00100000:3.0:1734016147.577175:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247334032000:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1883us (2123us total) trans 4294968115 rc 0/0 00000100:00100000:3.0:1734016147.577189:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9062 00002000:00010000:3.0:1734016147.577197:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (2390667->18446744073709551615) 00002000:00100000:3.0:1734016147.577202:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c5c00 with x1818247334032000 ext(2390667->18446744073709551615) 00002000:00010000:3.0:1734016147.577211:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c5c00. 00000100:00100000:3.0:1734016147.577257:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9063 00000100:00100000:3.0:1734016147.577266:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247334032128:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:2.0:1734016147.591864:0:13914:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 3383879 -> 0 00002000:00010000:2.0:1734016147.591876:0:13914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016147 -> 1734016148 00002000:00010000:2.0:1734016147.591879:0:13914:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016147 -> 1734016145 00002000:00010000:2.0:1734016147.591881:0:13914:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016147 -> 1734016148 00002000:00010000:2.0:1734016147.591884:0:13914:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 16 -> 0 00000100:00100000:2.0:1734016147.591987:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247334032128:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 14712us (16887us total) trans 4294969563 rc 0/0 00000100:00100000:2.0:1734016147.592001:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9063 00002000:00010000:2.0:1734016147.592010:0:13914:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:2.0:1734016147.592013:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c4e00 with x1818247334032128 ext(0->18446744073709551615) 00002000:00010000:2.0:1734016147.592021:0:13914:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800750c4e00. 00000100:00100000:0.0:1734016147.599699:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.602927:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334032256 00000100:00100000:2.0:1734016147.602957:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334032256 00000100:00100000:2.0:1734016147.603070:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2406 00000100:00100000:2.0:1734016147.603082:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247334032256:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016147.603130:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016147.603166:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117c43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e77f9 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.603319:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117c4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016147.603335:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016147.603346:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:2.0:1734016147.603382:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 2390667 00000004:00200000:2.0:1734016147.603389:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016147.603416:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016147.603458:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117c43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f9 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.603493:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f9 expref: 17 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.603503:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016147.603506:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016147.603511:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016147.603608:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:10406:x1818247334032256:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 528us (3927us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016147.603616:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2406 00000100:00100000:0.0:1734016147.618375:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.618532:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334032384 00000100:00100000:2.0:1734016147.618549:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334032384 00000100:00100000:2.0:1734016147.618648:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2407 00000100:00100000:2.0:1734016147.618658:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+21:10406:x1818247334032384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016147.618696:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016147.618729:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117c51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7800 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.618924:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117c58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016147.618949:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016147.618966:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:2.0:1734016147.618999:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 2390667 00000004:00200000:2.0:1734016147.619004:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016147.619029:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016147.619065:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117c51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7800 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.619104:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117c58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7800 expref: 22 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.619114:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016147.619119:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016147.619122:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016147.619201:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+22:10406:x1818247334032384:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 545us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016147.619209:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2407 00000100:00100000:0.0:1734016147.624773:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.629109:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334032512 00000100:00100000:2.0:1734016147.629136:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334032512 00000100:00100000:2.0:1734016147.629268:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12008 00000100:00100000:2.0:1734016147.629283:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247334032512:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016147.629322:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016147.629362:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117c5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7807 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016147.629486:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335453440:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016147.629615:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00000100:00100000:0.0:1734016147.632339:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016147.632405:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334032640 00000100:00100000:1.0:1734016147.632418:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334032640 00000100:00100000:1.0:1734016147.632504:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12009 00000100:00100000:1.0:1734016147.632515:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247334032640:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016147.632555:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016147.632587:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27117c66 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e780e expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016147.632684:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335453568:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016147.632788:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00002000:00010000:2.0:1734016147.637322:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016146 -> 1734016147 00000100:00100000:2.0:1734016147.637347:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335453440:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016147.637377:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117c5f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7807 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.637394:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcb40/0x5e3a3adc27117c5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7807 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.637439:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016147.637502:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247334032512:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8225us (12752us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016147.637512:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12008 00002000:00010000:1.0:1734016147.639514:0:7684:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016145 -> 1734016147 00000100:00100000:1.0:1734016147.639559:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:7684:1818247335453568:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016147.639605:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27117c66 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e780e expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016147.639622:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27117c66 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e780e expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016147.639702:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016147.639776:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247334032640:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7262us (7459us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016147.639785:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12009 00000100:00100000:0.0:1734016147.644214:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016147.644289:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016147.644418:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334032768 00000100:00100000:1.0:1734016147.644440:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334032768 00000100:00100000:1.0:1734016147.644508:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334032896 00000100:00100000:1.0:1734016147.644510:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334032896 00000100:00100000:1.0:1734016147.644556:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12010 00000100:00100000:1.0:1734016147.644570:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247334032768:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016147.644610:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016147.644647:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc27117c6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7815 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016147.644751:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075885500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335453696:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016147.645034:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12011 00000100:00100000:2.0:1734016147.645041:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247334032896:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016147.645052:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016147.645067:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117c74 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e781c expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016147.645103:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335453824:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016147.645155:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00000100:00100000:1.0:1734016147.648760:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92e40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016147.654295:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335453824:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016147.654372:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117c74 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e781c expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.654398:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117c74 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e781c expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.654450:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016147.654533:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247334032896:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9488us (10241us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016147.654548:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12011 00000100:00100000:2.0:1734016147.659174:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075885500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335453696:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016147.659220:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc27117c6d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7815 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.659234:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499df80/0x5e3a3adc27117c6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7815 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.659244:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:2.0:1734016147.659300:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247334032768:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 14732us (15111us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016147.659309:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12010 00010000:00010000:3.0:1734016147.659379:0:8958:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1734016147.667476:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.670890:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334033024 00000100:00100000:2.0:1734016147.670915:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334033024 00000100:00100000:2.0:1734016147.671025:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12012 00000100:00100000:2.0:1734016147.671035:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:10406:x1818247334033024:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016147.671072:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016147.671102:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117c7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7823 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.671151:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117c35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77eb expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.671159:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016147.671164:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016147.671168:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117c7b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1929216->1937407] (req 1929216->1937407) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7823 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.671215:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117c35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77eb expref: 7 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.671229:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117c35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77eb expref: 7 pid: 7683 timeout: 514 lvb_type: 0 00000100:00100000:2.0:1734016147.671243:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335453952:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016147.671360:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00000100:00100000:2.0:1734016147.674700:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335453952:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016147.674748:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117c7b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1929216->1937407] (req 1929216->1937407) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7823 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.674770:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016147.674858:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:10406:x1818247334033024:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3822us (7397us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016147.674869:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12012 00000100:00100000:0.0:1734016147.675412:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.675632:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334033152 00000100:00100000:2.0:1734016147.675642:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334033152 00010000:00010000:2.0:1734016147.675690:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117c35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77eb expref: 8 pid: 7683 timeout: 514 lvb_type: 0 00000100:00100000:2.0:1734016147.675725:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3288 00000100:00100000:2.0:1734016147.675733:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1981:x1818247334033152:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016147.675750:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016147.675780:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117c35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77eb expref: 8 pid: 7683 timeout: 514 lvb_type: 0 00010000:00010000:2.0:1734016147.675793:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117c35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77eb expref: 8 pid: 7683 timeout: 514 lvb_type: 0 00010000:00010000:2.0:1734016147.675851:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117c35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77eb expref: 8 pid: 7683 timeout: 514 lvb_type: 0 00010000:00010000:2.0:1734016147.676794:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016147.676830:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016147.676848:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117c7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->1937407) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7823 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.676863:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117c7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->1937407) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7823 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.676929:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117c7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->1937407) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7823 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016147.676946:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335454080:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016147.677047:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706180 going to sleep for 11 seconds 00000100:00100000:0.0:1734016147.703023:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.703313:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334033408 00000100:00100000:3.0:1734016147.703328:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334033408 00002000:00100000:3.0:1734016147.703394:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->2392063) req@ffff880075e50a80 x1818247334033408/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:108/0 lens 488/0 e 0 to 0 dl 1734016158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016147.703406:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50a80 with x1818247334033408 ext(0->2392063) 00002000:00010000:3.0:1734016147.703412:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075e50a80 00000100:00100000:3.0:1734016147.703457:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9064 00000100:00100000:3.0:1734016147.703470:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247334033408:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016147.704656:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335454080:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016147.704681:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016147.704755:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247334033152:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 29021us (29345us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016147.704768:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3288 00000100:00100000:3.0:1734016147.753796:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247334033408:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 50305us (50770us total) trans 0 rc 2392064/2392064 00000100:00100000:3.0:1734016147.753848:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9064 00002000:00100000:3.0:1734016147.753866:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->2392063) req@ffff880075e50a80 x1818247334033408/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:108/0 lens 488/440 e 0 to 0 dl 1734016158 ref 1 fl Complete:/200/0 rc 2392064/2392064 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016147.753876:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075e50a80 with x1818247334033408 ext(0->2392063) 00002000:00010000:3.0:1734016147.753885:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075e50a80 00000100:00100000:0.0:1734016147.764329:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.766143:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334033536 00000100:00100000:2.0:1734016147.766165:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334033536 00000100:00100000:2.0:1734016147.766293:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12013 00000100:00100000:2.0:1734016147.766306:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1984:x1818247334033536:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016147.766344:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016147.766386:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117c82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e782a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.766440:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016147.766443:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016147.766455:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117c82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e782a expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.766479:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117c82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e782a expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.766498:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016147.766599:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1984:x1818247334033536:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 293us (2292us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016147.766608:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12013 00000100:00100000:0.0:1734016147.770407:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.770567:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334033664 00000100:00100000:3.0:1734016147.770580:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334033664 00000100:00100000:3.0:1734016147.771854:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12014 00000100:00100000:3.0:1734016147.771869:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247334033664:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016147.771905:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016147.771936:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27117c89 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7831 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016147.772038:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335454208:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016147.772195:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016147.775139:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335454208:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016147.775222:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27117c89 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7831 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016147.775249:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27117c89 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7831 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016147.775572:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016147.776277:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1983:x1818247334033664:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4405us (5885us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016147.776291:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12014 00000100:00100000:0.0:1734016147.782734:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.793582:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334033792 00000100:00100000:3.0:1734016147.793602:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334033792 00000100:00100000:3.0:1734016147.793710:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12015 00000100:00100000:3.0:1734016147.793720:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:10406:x1818247334033792:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016147.793747:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016147.793777:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117c90 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7838 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.793844:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117c7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1929216->1937407) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7823 expref: 12 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.793855:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117c82 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e782a expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016147.793862:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016147.793865:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016147.793869:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117c90 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [3055616->3063807] (req 3055616->3063807) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7838 expref: 12 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.793915:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117c82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e782a expref: 7 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016147.793933:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117c82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e782a expref: 7 pid: 8216 timeout: 514 lvb_type: 1 00000100:00100000:3.0:1734016147.793946:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335454336:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016147.794082:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117c7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1929216->1937407) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7823 expref: 12 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.794089:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117c7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1929216->1937407) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7823 expref: 12 pid: 8216 timeout: 514 lvb_type: 0 00000100:00100000:3.0:1734016147.794098:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335454464:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016147.794119:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016147.805401:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.805630:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335454336:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016147.805653:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335454464:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016147.805720:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117c90 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [3055616->3063807] (req 3055616->3063807) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7838 expref: 12 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.805750:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016147.805922:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:10406:x1818247334033792:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12201us (23221us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016147.805937:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12015 00000100:00100000:2.0:1734016147.806085:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334033920 00000100:00100000:2.0:1734016147.806099:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334033920 00010000:00010000:2.0:1734016147.806149:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117c82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e782a expref: 8 pid: 8216 timeout: 514 lvb_type: 1 00000100:00100000:2.0:1734016147.806213:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3289 00000100:00100000:2.0:1734016147.806223:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073945c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247334033920:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016147.806254:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016147.806305:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117c82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e782a expref: 8 pid: 8216 timeout: 514 lvb_type: 1 00010000:00010000:2.0:1734016147.806318:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117c82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e782a expref: 8 pid: 8216 timeout: 514 lvb_type: 1 00010000:00010000:2.0:1734016147.806358:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117c82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e782a expref: 8 pid: 8216 timeout: 514 lvb_type: 1 00010000:00010000:2.0:1734016147.806391:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016147.806413:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073945c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334033920:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 191us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016147.806428:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3289 00000100:00100000:0.0:1734016147.807863:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016147.807944:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334034048 00000100:00100000:1.0:1734016147.807959:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334034048 00010000:00010000:1.0:1734016147.808002:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117c7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7823 expref: 12 pid: 8216 timeout: 514 lvb_type: 0 00000100:00100000:2.0:1734016147.809378:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3290 00000100:00100000:2.0:1734016147.809395:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247334034048:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016147.809432:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016147.809483:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117c7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1929216->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7823 expref: 12 pid: 8216 timeout: 514 lvb_type: 0 00010000:00010000:2.0:1734016147.809505:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117c7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1929216->1937407) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7823 expref: 12 pid: 8216 timeout: 514 lvb_type: 0 00010000:00010000:2.0:1734016147.809544:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117c7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1929216->1937407) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7823 expref: 12 pid: 8216 timeout: 514 lvb_type: 0 00010000:00010000:2.0:1734016147.809578:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016147.809582:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016147.809596:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117c90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3063807) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7838 expref: 11 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.809608:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117c90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3063807) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7838 expref: 11 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.809674:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117c90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3063807) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7838 expref: 11 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016147.809691:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335454592:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016147.809841:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016147.813669:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335454592:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016147.813731:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016147.813890:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073946300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247334034048:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4493us (6088us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016147.813906:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3290 00000100:00100000:0.0:1734016147.814832:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.814908:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334034176 00000100:00100000:3.0:1734016147.814921:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334034176 00000100:00100000:3.0:1734016147.814979:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12016 00000100:00100000:3.0:1734016147.814988:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247334034176:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016147.815362:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 2390667 -> 2390667 00002000:00010000:3.0:1734016147.815367:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016148 -> 1734016148 00002000:00010000:3.0:1734016147.815368:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016147 -> 1734016146 00002000:00010000:3.0:1734016147.815369:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016148 -> 1734016147 00002000:00010000:3.0:1734016147.815371:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 216 -> 232 00000100:00100000:3.0:1734016147.815434:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247334034176:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 447us (634us total) trans 4294968116 rc 0/0 00000100:00100000:3.0:1734016147.815441:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12016 00000100:00100000:0.0:1734016147.819961:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.820148:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334034304 00000100:00100000:2.0:1734016147.820168:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334034304 00000100:00100000:2.0:1734016147.820405:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12017 00000100:00100000:2.0:1734016147.820429:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334034304:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016147.820469:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016147.820506:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117c97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e783f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016147.820605:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335454720:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016147.820725:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00002000:00010000:2.0:1734016147.823220:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016146 -> 1734016148 00002000:00010000:2.0:1734016147.823230:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016147 -> 1734016148 00000100:00100000:2.0:1734016147.823258:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335454720:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016147.823320:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117c97 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e783f expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.823337:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117c97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e783f expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.823371:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016147.823451:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1982:x1818247334034304:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3033us (3510us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016147.823463:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12017 00000100:00100000:0.0:1734016147.826413:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.826603:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334034432 00000100:00100000:2.0:1734016147.826613:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334034432 00000100:00100000:2.0:1734016147.826679:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12018 00000100:00100000:2.0:1734016147.826688:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247334034432:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016147.826714:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016147.826752:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117c9e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7846 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016147.826876:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335454848:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016147.826984:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:2.0:1734016147.829322:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335454848:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016147.829370:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117c9e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7846 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.829385:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc900/0x5e3a3adc27117c9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7846 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.829398:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016147.829482:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:1981:x1818247334034432:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2791us (3082us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016147.829493:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12018 00000100:00100000:0.0:1734016147.843442:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.844473:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334034688 00000100:00100000:3.0:1734016147.844497:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334034688 00002000:00100000:3.0:1734016147.844582:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->2392063) req@ffff8800749ad880 x1818247334034688/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:108/0 lens 488/0 e 0 to 0 dl 1734016158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016147.844598:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad880 with x1818247334034688 ext(0->2392063) 00002000:00010000:3.0:1734016147.844609:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800749ad880 00000100:00100000:3.0:1734016147.844644:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9065 00000100:00100000:3.0:1734016147.844656:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247334034688:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016147.876954:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247334034688:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 32277us (33523us total) trans 0 rc 2392064/2392064 00000100:00100000:2.0:1734016147.876978:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9065 00002000:00100000:2.0:1734016147.876998:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->2392063) req@ffff8800749ad880 x1818247334034688/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:108/0 lens 488/440 e 0 to 0 dl 1734016158 ref 1 fl Complete:/200/0 rc 2392064/2392064 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016147.877011:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800749ad880 with x1818247334034688 ext(0->2392063) 00002000:00010000:2.0:1734016147.877019:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800749ad880 00000100:00100000:0.0:1734016147.882176:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.882383:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334034816 00000100:00100000:2.0:1734016147.882397:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334034816 00000100:00100000:2.0:1734016147.882487:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12019 00000100:00100000:2.0:1734016147.882501:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247334034816:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016147.882539:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016147.882572:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117ca5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e784d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016147.882685:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335454976:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016147.882786:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00002000:00010000:2.0:1734016147.886450:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016147 -> 1734016148 00000100:00100000:2.0:1734016147.886505:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335454976:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016147.886574:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117ca5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e784d expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.886599:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117ca5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e784d expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.886636:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016147.886723:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247334034816:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4222us (4567us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016147.886736:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12019 00000100:00100000:0.0:1734016147.889398:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.889582:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334034944 00000100:00100000:2.0:1734016147.889599:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334034944 00000100:00100000:2.0:1734016147.890297:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12020 00000100:00100000:2.0:1734016147.890308:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800749ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247334034944:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016147.890354:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016147.890389:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117cac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7854 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016147.890522:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335455104:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016147.890671:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706600 going to sleep for 11 seconds 00000100:00100000:3.0:1734016147.893522:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335455104:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016147.893588:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117cac lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7854 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016147.893610:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117cac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7854 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016147.893653:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:3.0:1734016147.893742:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800749ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247334034944:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3434us (4362us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016147.893754:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12020 00000100:00100000:1.0:1734016147.902020:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.903290:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334035072 00000100:00100000:3.0:1734016147.903309:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334035072 00000100:00100000:3.0:1734016147.903433:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12021 00000100:00100000:3.0:1734016147.903442:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247334035072:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016147.903472:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016147.903505:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27117cb3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e785b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016147.903599:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335455232:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016147.903720:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016147.915756:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335455232:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016147.915927:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27117cb3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e785b expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016147.915955:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27117cb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e785b expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016147.915989:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016147.916114:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247334035072:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12671us (14121us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016147.916135:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12021 00000100:00100000:0.0:1734016147.924034:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.924128:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334035200 00000100:00100000:3.0:1734016147.924139:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334035200 00000100:00100000:3.0:1734016147.924204:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12022 00000100:00100000:3.0:1734016147.924212:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247334035200:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016147.924240:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016147.924264:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27117cba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7862 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016147.924339:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335455360:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016147.924445:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016147.926604:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335455360:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016147.926663:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27117cba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7862 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016147.926682:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df7cc0/0x5e3a3adc27117cba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7862 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016147.926718:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016147.926791:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247334035200:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2577us (2768us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016147.926843:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12022 00000100:00100000:0.0:1734016147.934189:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.934412:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334035328 00000100:00100000:3.0:1734016147.934433:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334035328 00000100:00100000:3.0:1734016147.934512:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12023 00000100:00100000:3.0:1734016147.934525:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+7:10406:x1818247334035328:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016147.934556:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016147.934588:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117cc1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7869 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.934639:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117c90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3063807) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7838 expref: 11 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.934648:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016147.934649:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016147.934654:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117cc1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1589248->1597439] (req 1589248->1597439) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7869 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.934698:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117c90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3063807) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7838 expref: 11 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.934711:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117c90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3063807) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7838 expref: 11 pid: 7683 timeout: 515 lvb_type: 0 00000100:00100000:3.0:1734016147.934728:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335455488:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016147.935142:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016147.939169:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335455488:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016147.939216:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117cc1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [1589248->1597439] (req 1589248->1597439) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7869 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016147.939245:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016147.939314:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247334035328:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4789us (5152us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016147.939331:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12023 00000100:00100000:0.0:1734016147.950367:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.950562:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334035456 00000100:00100000:2.0:1734016147.950580:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334035456 00010000:00010000:2.0:1734016147.950646:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117c90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3063807) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7838 expref: 12 pid: 7683 timeout: 515 lvb_type: 0 00000100:00100000:2.0:1734016147.950719:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3291 00000100:00100000:2.0:1734016147.950729:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247334035456:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016147.950756:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016147.950793:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117c90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3055616->3063807) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7838 expref: 12 pid: 7683 timeout: 515 lvb_type: 0 00010000:00010000:2.0:1734016147.951041:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117c90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3055616->3063807) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7838 expref: 12 pid: 7683 timeout: 515 lvb_type: 0 00010000:00010000:2.0:1734016147.951085:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117c90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3055616->3063807) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7838 expref: 12 pid: 7683 timeout: 515 lvb_type: 0 00010000:00010000:2.0:1734016147.951828:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016147.951831:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016147.951843:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117cc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1597439) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7869 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.951856:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117cc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1597439) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7869 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.952125:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117cc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1597439) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7869 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016147.952151:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335455616:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016147.952583:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706240 going to sleep for 11 seconds 00000100:00100000:2.0:1734016147.957735:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016147.958163:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335455616:192.168.201.16@tcp:105: 00010000:00010000:0.0:1734016147.958216:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016147.960086:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334035584 00000100:00100000:3.0:1734016147.960114:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334035584 00000100:00100000:0.0:1734016147.960118:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247334035456:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9371us (9753us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016147.960147:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3291 00000100:00100000:3.0:1734016147.960219:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12024 00000100:00100000:3.0:1734016147.960233:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247334035584:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016147.961150:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 2390667 -> 2390667 00002000:00010000:3.0:1734016147.961154:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016148 -> 1734016147 00002000:00010000:3.0:1734016147.961156:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016148 -> 1734016146 00002000:00010000:3.0:1734016147.961159:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016148 -> 1734016147 00002000:00010000:3.0:1734016147.961161:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 232 -> 232 00000100:00100000:3.0:1734016147.961290:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247334035584:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1062us (3582us total) trans 4294968117 rc 0/0 00000100:00100000:3.0:1734016147.961297:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12024 00000100:00100000:0.0:1734016147.970782:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016147.971257:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334035712 00000100:00100000:3.0:1734016147.971278:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334035712 00000100:00100000:3.0:1734016147.971349:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12025 00000100:00100000:3.0:1734016147.971359:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247334035712:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016147.971396:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016147.971433:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27117cc8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7870 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016147.971536:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335455744:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016147.971626:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016147.973556:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.975273:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334035840 00000100:00100000:2.0:1734016147.975289:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334035840 00000100:00100000:2.0:1734016147.975371:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12026 00000100:00100000:2.0:1734016147.975383:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247334035840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016147.975412:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016147.975450:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117ccf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7877 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016147.975887:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335455872:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016147.976005:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00002000:00010000:2.0:1734016147.976990:0:8216:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size: 2390667 -> 6088193 00002000:00010000:2.0:1734016147.976996:0:8216:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime: 1734016147 -> 1734016148 00002000:00010000:2.0:1734016147.977000:0:8216:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016146 -> 1734016148 00002000:00010000:2.0:1734016147.977002:0:8216:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016147 -> 1734016148 00000100:00100000:2.0:1734016147.977037:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335455744:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016147.977110:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27117cc8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7870 expref: 12 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.977130:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27117cc8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7870 expref: 12 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.979656:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:2.0:1734016147.980878:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1984:x1818247334035712:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9509us (10111us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016147.980895:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12025 00000100:00100000:2.0:1734016147.982322:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335455872:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016147.982380:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117ccf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7877 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.982400:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117ccf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7877 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.982414:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016147.982494:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800756edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+10:1984:x1818247334035840:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7112us (8978us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016147.982503:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12026 00000100:00100000:1.0:1734016147.985609:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016147.985697:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.985927:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334035968 00000100:00100000:2.0:1734016147.985947:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334035968 00000100:00100000:2.0:1734016147.986026:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334036096 00000100:00100000:2.0:1734016147.986029:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334036096 00000100:00100000:2.0:1734016147.986068:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12027 00000100:00100000:2.0:1734016147.986081:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247334035968:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016147.986117:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016147.986151:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117cd6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e787e expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016147.986245:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335456000:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016147.986334:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016147.986540:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12028 00000100:00100000:0.0:1734016147.986549:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247334036096:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016147.986559:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016147.986575:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27117cdd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7885 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016147.986611:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012e604e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335456128:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016147.986643:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016147.990371:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012e604e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335456128:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016147.990457:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27117cdd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7885 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016147.990478:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7582640/0x5e3a3adc27117cdd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7885 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1734016147.990605:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335456000:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016147.990635:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117cd6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e787e expref: 12 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.990649:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117cd6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e787e expref: 12 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016147.990668:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016147.990751:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1982:x1818247334035968:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4671us (5163us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016147.990768:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12027 00010000:00010000:0.0:1734016147.991297:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7582640, rc 0) 00000100:00100000:0.0:1734016147.991319:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:1982:x1818247334036096:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4771us (5622us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016147.991325:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12028 00000100:00100000:0.0:1734016147.996269:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016147.996430:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334036224 00000100:00100000:2.0:1734016147.996455:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334036224 00000100:00100000:2.0:1734016147.997147:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12029 00000100:00100000:2.0:1734016147.997161:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+10:10406:x1818247334036224:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016147.997197:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016147.997329:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117ce4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e788c expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.997411:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117c3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f2 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.997438:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016147.997441:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016147.997447:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117ce4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [3350528->3362815] (req 3350528->3362815) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e788c expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.997500:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117c3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f2 expref: 8 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016147.997522:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117c3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f2 expref: 8 pid: 7683 timeout: 515 lvb_type: 0 00000100:00100000:2.0:1734016147.997541:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335456256:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016147.997668:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016148.001434:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335456256:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016148.001497:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117ce4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [3350528->3362815] (req 3350528->3362815) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e788c expref: 11 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.001537:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016148.001615:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:10406:x1818247334036224:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4455us (5372us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016148.001627:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12029 00000100:00100000:0.0:1734016148.003490:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016148.003898:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334036352 00000100:00100000:2.0:1734016148.003911:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334036352 00010000:00010000:2.0:1734016148.004068:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117c3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f2 expref: 9 pid: 7683 timeout: 515 lvb_type: 0 00000100:00080000:1.0:1734016148.004262:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016118 00000100:00100000:2.0:1734016148.004312:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3292 00000100:00100000:2.0:1734016148.004321:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247334036352:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016148.004343:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016148.004370:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117c3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f2 expref: 9 pid: 7683 timeout: 515 lvb_type: 0 00010000:00010000:2.0:1734016148.004385:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117c3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f2 expref: 9 pid: 7683 timeout: 515 lvb_type: 0 00010000:00010000:2.0:1734016148.004426:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117c3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f2 expref: 9 pid: 7683 timeout: 515 lvb_type: 0 00010000:00010000:2.0:1734016148.004962:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016148.004965:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016148.004974:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117ce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3362815) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e788c expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.004985:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117ce4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3362815) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e788c expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.005029:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117ce4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3362815) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e788c expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016148.005044:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335456384:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016148.005132:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016148.010796:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016148.011068:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335456384:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016148.011100:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016148.011700:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334036480 00000100:00100000:3.0:1734016148.011710:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334036480 00000100:00100000:3.0:1734016148.011769:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12030 00000100:00100000:3.0:1734016148.011777:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247334036480:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016148.011817:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016148.011841:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117ceb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7893 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016148.011910:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335456512:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016148.012032:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e605c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247334036352:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 7710us (8551us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016148.012043:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3292 00000100:00100000:3.0:1734016148.012968:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d600 going to sleep for 11 seconds 00002000:00010000:3.0:1734016148.017497:0:8216:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size: 0 -> 3359509 00002000:00010000:3.0:1734016148.017521:0:8216:0:(ofd_lvb.c:301:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:3.0:1734016148.017565:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335456512:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016148.017647:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117ceb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7893 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016148.017672:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117ceb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7893 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016148.018124:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016148.018275:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1982:x1818247334036480:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6496us (7492us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016148.018288:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12030 00000100:00100000:0.0:1734016148.022602:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016148.022794:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334036608 00000100:00100000:3.0:1734016148.022864:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334036608 00000100:00100000:3.0:1734016148.022964:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12031 00000100:00100000:3.0:1734016148.022974:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247334036608:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016148.023018:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016148.023056:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117cf2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e789a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016148.023141:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335456640:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016148.023223:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d600 going to sleep for 11 seconds 00000100:00100000:3.0:1734016148.029070:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335456640:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016148.029145:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117cf2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e789a expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016148.029164:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117cf2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e789a expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016148.029229:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016148.031077:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:1983:x1818247334036608:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8086us (8481us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016148.031091:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12031 00000100:00100000:0.0:1734016148.047523:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016148.047662:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334036736 00000100:00100000:3.0:1734016148.047676:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334036736 00000100:00100000:3.0:1734016148.048409:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12032 00000100:00100000:3.0:1734016148.048425:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+8:10406:x1818247334036736:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016148.048446:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016148.048466:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117cf9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e78a1 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016148.048507:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117ce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3362815) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e788c expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016148.048520:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016148.048523:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016148.048527:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117cf9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [1056768->1060863] (req 1056768->1060863) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a1 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016148.048566:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117ce4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3362815) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e788c expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016148.048579:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117ce4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3362815) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e788c expref: 10 pid: 8216 timeout: 515 lvb_type: 0 00000100:00100000:3.0:1734016148.048591:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335456768:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016148.048661:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d600 going to sleep for 11 seconds 00000100:00100000:0.0:1734016148.057526:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016148.057673:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334036864 00000100:00100000:2.0:1734016148.057688:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334036864 00002000:00100000:2.0:1734016148.057784:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (3350528->3359508) req@ffff88012db09500 x1818247334036864/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:109/0 lens 9472/0 e 0 to 0 dl 1734016159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016148.057796:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db09500 with x1818247334036864 ext(3350528->3359508) 00010000:00010000:2.0:1734016148.057860:0:13914:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117ce4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3362815) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e788c expref: 11 pid: 8216 timeout: 515 lvb_type: 0 00010000:00010000:2.0:1734016148.057881:0:13914:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117ce4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3362815) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e788c expref: 11 pid: 8216 timeout: 515 lvb_type: 0 00002000:00010000:2.0:1734016148.057889:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012db09500 00000100:00100000:2.0:1734016148.057921:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 303 00000100:00100000:2.0:1734016148.057930:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+11:1981:x1818247334036864:12345-192.168.201.16@tcp:4:fsx.0 00000100:00080000:1.0:1734016148.057994:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1734016118 00000100:00100000:3.0:1734016148.058750:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335456768:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016148.058794:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117cf9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [1056768->1060863] (req 1056768->1060863) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a1 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016148.058850:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016148.058924:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:10406:x1818247334036736:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10506us (11412us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016148.058937:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12032 00000100:00100000:2.0:1734016148.064108:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247334036864:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 6158us (6582us total) trans 4294969564 rc 0/0 00000100:00100000:2.0:1734016148.064128:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 303 00002000:00100000:2.0:1734016148.064148:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (3350528->3359508) req@ffff88012db09500 x1818247334036864/t4294969564(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:109/0 lens 9472/448 e 0 to 0 dl 1734016159 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016148.064160:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db09500 with x1818247334036864 ext(3350528->3359508) 00010000:00010000:2.0:1734016148.064176:0:13914:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117ce4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3362815) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e788c expref: 13 pid: 8216 timeout: 515 lvb_type: 0 00010000:00010000:2.0:1734016148.064198:0:13914:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117ce4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3362815) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e788c expref: 13 pid: 8216 timeout: 515 lvb_type: 0 00002000:00010000:2.0:1734016148.064207:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012db09500 00000100:00100000:1.0:1734016148.070876:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016148.071011:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334036992 00000100:00100000:2.0:1734016148.071029:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334036992 00010000:00010000:2.0:1734016148.071083:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117ce4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3362815) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e788c expref: 13 pid: 8216 timeout: 515 lvb_type: 0 00000100:00100000:2.0:1734016148.072810:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3293 00000100:00100000:2.0:1734016148.072823:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075886a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247334036992:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016148.072852:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1734016148.072877:0:9876:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 1 -> 24 00010000:00010000:2.0:1734016148.072886:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117ce4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3350528->3362815) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e788c expref: 13 pid: 8216 timeout: 515 lvb_type: 0 00010000:00010000:2.0:1734016148.072904:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117ce4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3350528->3362815) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e788c expref: 13 pid: 8216 timeout: 515 lvb_type: 0 00010000:00010000:2.0:1734016148.072932:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117ce4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3350528->3362815) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e788c expref: 13 pid: 8216 timeout: 515 lvb_type: 0 00010000:00010000:2.0:1734016148.074128:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016148.074136:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016148.074153:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117cf9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1060863) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a1 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.074165:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117cf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1060863) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a1 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.074220:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117cf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1060863) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a1 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016148.074237:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335456896:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016148.076824:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016148.083438:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335456896:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016148.083483:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016148.083746:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075886a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247334036992:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 10920us (12887us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016148.083765:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3293 00000100:00100000:0.0:1734016148.139878:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016148.139960:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016148.140079:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334037248 00000100:00100000:1.0:1734016148.140101:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334037248 00002000:00100000:1.0:1734016148.140192:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (0->3362815) req@ffff88012db0aa00 x1818247334037248/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:109/0 lens 488/0 e 0 to 0 dl 1734016159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016148.140208:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db0aa00 with x1818247334037248 ext(0->3362815) 00002000:00010000:1.0:1734016148.140215:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db0aa00 00000100:00100000:1.0:1734016148.140268:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334037504 00000100:00100000:1.0:1734016148.140271:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334037504 00000100:00100000:2.0:1734016148.140386:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9066 00000100:00100000:2.0:1734016148.140402:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247334037248:12345-192.168.201.16@tcp:3:fsx.0 00002000:00100000:1.0:1734016148.143120:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff88012db0bb80 x1818247334037504/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:109/0 lens 488/0 e 0 to 0 dl 1734016159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016148.143135:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db0bb80 with x1818247334037504 ext(0->4194303) 00002000:00010000:1.0:1734016148.143144:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db0bb80 00000100:00100000:1.0:1734016148.143197:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9067 00000100:00100000:1.0:1734016148.143208:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247334037504:12345-192.168.201.16@tcp:3:fsx.0 00000100:00080000:0.0:1734016148.147398:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016118 00000100:00100000:1.0:1734016148.187483:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247334037504:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 44249us (47493us total) trans 0 rc 2392064/2392064 00000100:00100000:1.0:1734016148.187505:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9067 00002000:00100000:1.0:1734016148.187530:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff88012db0bb80 x1818247334037504/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:109/0 lens 488/440 e 0 to 0 dl 1734016159 ref 1 fl Complete:/200/0 rc 2392064/2392064 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016148.187542:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db0bb80 with x1818247334037504 ext(0->4194303) 00002000:00010000:1.0:1734016148.187550:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012db0bb80 00000100:00100000:3.0:1734016148.193438:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247334037248:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 53017us (53625us total) trans 0 rc 3362816/3362816 00000100:00100000:3.0:1734016148.193454:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9066 00002000:00100000:3.0:1734016148.193470:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (0->3362815) req@ffff88012db0aa00 x1818247334037248/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:109/0 lens 488/440 e 0 to 0 dl 1734016159 ref 1 fl Complete:/200/0 rc 3362816/3362816 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016148.193481:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012db0aa00 with x1818247334037248 ext(0->3362815) 00002000:00010000:3.0:1734016148.193487:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012db0aa00 00000100:00100000:0.0:1734016148.198979:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016148.201549:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334037632 00000100:00100000:3.0:1734016148.201574:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334037632 00000100:00100000:3.0:1734016148.201969:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12033 00000100:00100000:3.0:1734016148.201984:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:10406:x1818247334037632:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016148.202017:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016148.202061:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d00 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e78a8 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016148.202122:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117cf9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1060863) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a1 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016148.202134:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016148.202137:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016148.202143:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d00 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [4063232->4067327] (req 4063232->4067327) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a8 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016148.202207:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117cf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1060863) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a1 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016148.202226:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117cf9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1060863) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a1 expref: 10 pid: 8216 timeout: 515 lvb_type: 0 00000100:00100000:3.0:1734016148.202243:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335457024:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016148.202369:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d600 going to sleep for 11 seconds 00000100:00100000:3.0:1734016148.209969:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335457024:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016148.210019:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d00 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [4063232->4067327] (req 4063232->4067327) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a8 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016148.210044:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016148.210132:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:10406:x1818247334037632:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8150us (11172us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016148.210144:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12033 00000100:00100000:0.0:1734016148.210912:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016148.211366:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334037760 00000100:00100000:3.0:1734016148.211379:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334037760 00010000:00010000:3.0:1734016148.211430:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117cf9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a1 expref: 10 pid: 8216 timeout: 515 lvb_type: 0 00000100:00100000:3.0:1734016148.211471:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3294 00000100:00100000:3.0:1734016148.211479:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e718a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247334037760:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016148.211498:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016148.211529:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117cf9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a1 expref: 10 pid: 8216 timeout: 515 lvb_type: 0 00010000:00010000:3.0:1734016148.211545:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117cf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1060863) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a1 expref: 10 pid: 8216 timeout: 515 lvb_type: 0 00010000:00010000:3.0:1734016148.211584:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117cf9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1060863) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a1 expref: 10 pid: 8216 timeout: 515 lvb_type: 0 00010000:00010000:3.0:1734016148.211612:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016148.211615:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016148.211625:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4067327) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a8 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016148.211638:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4067327) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a8 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016148.211679:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4067327) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a8 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016148.211697:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335457152:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016148.211743:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d600 going to sleep for 11 seconds 00000100:00100000:3.0:1734016148.219126:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335457152:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016148.219172:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016148.220773:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e718a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247334037760:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 9287us (9857us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016148.220787:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3294 00000100:00100000:0.0:1734016148.223301:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016148.223465:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334037888 00000100:00100000:3.0:1734016148.223485:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334037888 00000100:00100000:3.0:1734016148.224161:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12034 00000100:00100000:3.0:1734016148.224176:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247334037888:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016148.224560:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 3359509 -> 3359509 00002000:00010000:3.0:1734016148.224563:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016148 -> 1734016148 00002000:00010000:3.0:1734016148.224565:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016148 -> 1734016148 00002000:00010000:3.0:1734016148.224567:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016148 -> 1734016148 00002000:00010000:3.0:1734016148.224569:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:3.0:1734016148.224711:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247334037888:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 538us (1426us total) trans 4294969565 rc 0/0 00000100:00100000:3.0:1734016148.224722:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12034 00000100:00100000:0.0:1734016148.229000:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016148.229921:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016148.231684:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334038016 00000100:00100000:1.0:1734016148.231710:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334038016 00000100:00100000:1.0:1734016148.231843:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334038144 00000100:00100000:1.0:1734016148.231847:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334038144 00000100:00100000:1.0:1734016148.231896:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12035 00000100:00100000:1.0:1734016148.231907:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247334038016:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016148.231943:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016148.231982:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc27117d07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e78af expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016148.232092:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075887800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335457280:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016148.232212:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016148.232241:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12036 00000100:00100000:1.0:1734016148.232246:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247334038144:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016148.232260:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016148.232275:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27117d0e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e78b6 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016148.232314:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335457408:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016148.232341:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92a80 going to sleep for 11 seconds 00000100:00080000:0.0:1734016148.232636:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1734016118 00000100:00100000:1.0:1734016148.236786:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075887800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335457280:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016148.236886:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc27117d07 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78af expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016148.236909:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499cb40/0x5e3a3adc27117d07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78af expref: 12 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016148.236943:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499cb40, rc 0) 00000100:00100000:1.0:1734016148.237038:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247334038016:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5131us (8061us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016148.237054:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12035 00000100:00100000:2.0:1734016148.240455:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335457408:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016148.240542:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27117d0e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78b6 expref: 13 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.240572:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499dd40/0x5e3a3adc27117d0e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78b6 expref: 13 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.241108:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:2.0:1734016148.241230:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247334038144:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8977us (11305us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016148.241245:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12036 00000100:00100000:0.0:1734016148.245366:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016148.246349:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334038272 00000100:00100000:2.0:1734016148.246366:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334038272 00000100:00100000:2.0:1734016148.246455:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12037 00000100:00100000:2.0:1734016148.246464:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247334038272:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016148.246493:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016148.246525:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117d15 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e78bd expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016148.246611:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335457536:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016148.246711:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016148.247480:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016148.247574:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334038400 00000100:00100000:0.0:1734016148.247579:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334038400 00000100:00100000:0.0:1734016148.247616:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12038 00000100:00100000:0.0:1734016148.247620:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247334038400:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016148.247632:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016148.247647:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27117d1c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e78c4 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016148.247681:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075608000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335457664:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016148.247714:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1734016148.251793:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075608000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335457664:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016148.251897:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27117d1c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78c4 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016148.251917:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27117d1c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78c4 expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016148.251943:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:2.0:1734016148.253069:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335457536:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016148.253105:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117d15 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78bd expref: 12 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.253115:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117d15 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78bd expref: 12 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.253130:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016148.253167:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+11:1983:x1818247334038272:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6701us (7825us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016148.253185:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12037 00000100:00100000:1.0:1734016148.253329:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247334038400:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5706us (5850us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016148.253337:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12038 00000100:00100000:0.0:1734016148.258479:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016148.258663:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334038528 00000100:00100000:1.0:1734016148.258690:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334038528 00000100:00100000:1.0:1734016148.258871:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12039 00000100:00100000:1.0:1734016148.258884:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+11:10406:x1818247334038528:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016148.258920:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016148.258956:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc27117d23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e78cb expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016148.259028:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117cc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1597439) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7869 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016148.259041:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016148.259043:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016148.259049:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc27117d23 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [536576->548863] (req 536576->548863) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78cb expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016148.259108:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117cc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1597439) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7869 expref: 8 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016148.259127:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117cc1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1597439) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7869 expref: 8 pid: 8216 timeout: 515 lvb_type: 0 00000100:00100000:1.0:1734016148.259148:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335457792:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016148.259275:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016148.263218:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335457792:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016148.263286:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc27117d23 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [536576->548863] (req 536576->548863) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78cb expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016148.263318:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499dd40, rc 0) 00000100:00100000:1.0:1734016148.263404:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:10406:x1818247334038528:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4520us (4951us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016148.263427:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12039 00000100:00100000:0.0:1734016148.265187:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016148.265445:0:13914:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334038656 00000100:00100000:3.0:1734016148.265457:0:13914:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334038656 00002000:00100000:3.0:1734016148.265571:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (6086656->6088192) req@ffff880075609c00 x1818247334038656/t0(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:109/0 lens 2032/0 e 0 to 0 dl 1734016159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016148.265584:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609c00 with x1818247334038656 ext(6086656->6088192) 00010000:00010000:3.0:1734016148.265598:0:13914:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117cc1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7869 expref: 9 pid: 8216 timeout: 515 lvb_type: 0 00010000:00010000:3.0:1734016148.265617:0:13914:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117cc1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7869 expref: 9 pid: 8216 timeout: 515 lvb_type: 0 00002000:00010000:3.0:1734016148.265624:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880075609c00 00000100:00100000:3.0:1734016148.265670:0:13914:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 304 00000100:00100000:3.0:1734016148.265677:0:13914:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247334038656:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016148.267285:0:13914:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247334038656:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 1590us (2091us total) trans 4294968118 rc 0/0 00000100:00100000:3.0:1734016148.267306:0:13914:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 304 00002000:00100000:3.0:1734016148.267322:0:13914:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (6086656->6088192) req@ffff880075609c00 x1818247334038656/t4294968118(0) o4->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:109/0 lens 2032/448 e 0 to 0 dl 1734016159 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016148.267339:0:13914:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075609c00 with x1818247334038656 ext(6086656->6088192) 00010000:00010000:3.0:1734016148.267352:0:13914:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117cc1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7869 expref: 11 pid: 8216 timeout: 515 lvb_type: 0 00010000:00010000:3.0:1734016148.267366:0:13914:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117cc1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7869 expref: 11 pid: 8216 timeout: 515 lvb_type: 0 00002000:00010000:3.0:1734016148.267374:0:13914:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880075609c00 00000100:00100000:0.0:1734016148.279483:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016148.283588:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334038784 00000100:00100000:3.0:1734016148.283611:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334038784 00010000:00010000:3.0:1734016148.283685:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117cc1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7869 expref: 11 pid: 8216 timeout: 515 lvb_type: 0 00000100:00100000:3.0:1734016148.283775:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3295 00000100:00100000:3.0:1734016148.283787:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247334038784:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016148.283876:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1734016148.283918:0:9876:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 232 -> 240 00010000:00010000:3.0:1734016148.283925:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117cc1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1589248->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7869 expref: 11 pid: 8216 timeout: 515 lvb_type: 0 00010000:00010000:3.0:1734016148.283943:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117cc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1589248->1597439) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7869 expref: 11 pid: 8216 timeout: 515 lvb_type: 0 00010000:00010000:3.0:1734016148.283984:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117cc1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1589248->1597439) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7869 expref: 11 pid: 8216 timeout: 515 lvb_type: 0 00010000:00010000:3.0:1734016148.284052:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016148.284056:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016148.284067:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc27117d23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 536576->548863) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78cb expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016148.284077:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc27117d23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 536576->548863) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78cb expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016148.284145:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc27117d23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 536576->548863) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78cb expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016148.284165:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335457920:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016148.284317:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d600 going to sleep for 11 seconds 00000100:00100000:3.0:1734016148.288307:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335457920:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016148.288373:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016148.288474:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247334038784:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 4687us (9004us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016148.288495:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3295 00000100:00100000:2.0:1734016148.289735:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016148.296082:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334038912 00000100:00100000:1.0:1734016148.296102:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334038912 00000100:00100000:1.0:1734016148.296188:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12040 00000100:00100000:1.0:1734016148.296197:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247334038912:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:1.0:1734016148.296641:0:7682:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 6088193 -> 6088193 00002000:00010000:1.0:1734016148.296645:0:7682:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016148 -> 1734016148 00002000:00010000:1.0:1734016148.296647:0:7682:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016148 -> 1734016148 00002000:00010000:1.0:1734016148.296649:0:7682:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016148 -> 1734016148 00002000:00010000:1.0:1734016148.296651:0:7682:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 240 -> 240 00000100:00100000:1.0:1734016148.296765:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247334038912:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 567us (7042us total) trans 4294968119 rc 0/0 00000100:00100000:1.0:1734016148.296774:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12040 00000100:00100000:1.0:1734016148.300025:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016148.300120:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334039040 00000100:00100000:2.0:1734016148.300137:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334039040 00000100:00100000:2.0:1734016148.300228:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12041 00000100:00100000:2.0:1734016148.300238:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247334039040:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016148.300397:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016148.300435:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117d2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e78d2 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016148.300535:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335458048:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016148.300648:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016148.304398:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335458048:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016148.304473:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117d2a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78d2 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.304494:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117d2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78d2 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.304585:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016148.304664:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247334039040:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4424us (4665us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016148.304675:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12041 00000100:00100000:0.0:1734016148.319207:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016148.319385:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334039168 00000100:00100000:2.0:1734016148.319404:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334039168 00000100:00100000:1.0:1734016148.320997:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12042 00000100:00100000:1.0:1734016148.321010:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247334039168:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016148.321044:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016148.321069:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc27117d31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e78d9 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016148.321150:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335458176:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016148.321963:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016148.333768:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335458176:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016148.333839:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc27117d31 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78d9 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016148.333860:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc27117d31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78d9 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016148.333883:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016148.333967:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247334039168:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12958us (14779us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016148.333977:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12042 00000100:00100000:0.0:1734016148.337245:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016148.337730:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334039296 00000100:00100000:1.0:1734016148.337742:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334039296 00000100:00100000:1.0:1734016148.337860:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12043 00000100:00100000:1.0:1734016148.337870:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247334039296:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016148.337899:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016148.337923:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27117d38 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e78e0 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016148.337985:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335458304:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016148.338079:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92900 going to sleep for 11 seconds 00000100:00100000:1.0:1734016148.341430:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335458304:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016148.341513:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27117d38 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78e0 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016148.341534:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27117d38 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78e0 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016148.341559:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016148.341681:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247334039296:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3810us (4450us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016148.341694:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12043 00000100:00100000:2.0:1734016148.355459:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016148.355555:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334039424 00000100:00100000:1.0:1734016148.355567:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334039424 00000100:00100000:1.0:1734016148.355637:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12044 00000100:00100000:1.0:1734016148.355647:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:10406:x1818247334039424:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016148.355672:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016148.355692:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27117d3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e78e7 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016148.355736:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc27117d23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 536576->548863) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78cb expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016148.355745:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016148.355747:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1734016148.355750:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27117d3f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [4395008->4403199] (req 4395008->4403199) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78e7 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016148.355782:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc27117d23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 536576->548863) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78cb expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016148.355794:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc27117d23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 536576->548863) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78cb expref: 12 pid: 7682 timeout: 515 lvb_type: 0 00000100:00100000:1.0:1734016148.355853:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335458432:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016148.355917:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016148.366207:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016148.367205:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334039552 00000100:00100000:3.0:1734016148.367223:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334039552 00010000:00010000:3.0:1734016148.367284:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc27117d23 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 536576->548863) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78cb expref: 13 pid: 7682 timeout: 515 lvb_type: 0 00000100:00100000:1.0:1734016148.367578:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335458432:192.168.201.16@tcp:104: 00010000:00010000:1.0:1734016148.367613:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27117d3f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [4395008->4403199] (req 4395008->4403199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78e7 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016148.367635:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499e400, rc 0) 00000100:00100000:1.0:1734016148.367734:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:10406:x1818247334039424:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12085us (12286us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016148.367747:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12044 00000100:00100000:3.0:1734016148.367832:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3296 00000100:00100000:3.0:1734016148.367839:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247334039552:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016148.367864:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016148.367890:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc27117d23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 536576->548863) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78cb expref: 13 pid: 7682 timeout: 515 lvb_type: 0 00010000:00010000:3.0:1734016148.367902:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc27117d23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 536576->548863) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78cb expref: 13 pid: 7682 timeout: 515 lvb_type: 0 00010000:00010000:3.0:1734016148.368504:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499dd40/0x5e3a3adc27117d23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 536576->548863) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78cb expref: 13 pid: 7682 timeout: 515 lvb_type: 0 00010000:00010000:3.0:1734016148.368543:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016148.368545:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016148.368553:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27117d3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4395008->4403199) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78e7 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016148.368563:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27117d3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4395008->4403199) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78e7 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016148.368606:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27117d3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4395008->4403199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78e7 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016148.368620:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335458560:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016148.368925:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016148.373885:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335458560:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016148.373927:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016148.374028:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007560b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+12:1982:x1818247334039552:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6185us (7837us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016148.374049:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3296 00000100:00100000:0.0:1734016148.403034:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016148.403117:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016148.404592:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334039936 00000100:00100000:1.0:1734016148.404622:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334039936 00002000:00100000:1.0:1734016148.404708:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4399103) req@ffff880075608000 x1818247334039936/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:109/0 lens 504/0 e 0 to 0 dl 1734016159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016148.404721:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075608000 with x1818247334039936 ext(0->4399103) 00002000:00010000:1.0:1734016148.404730:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075608000 00000100:00100000:1.0:1734016148.404874:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334040064 00000100:00100000:1.0:1734016148.404879:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334040064 00002000:00100000:1.0:1734016148.404893:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (4190208->4194303) req@ffff8800750c6680 x1818247334040064/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:109/0 lens 488/0 e 0 to 0 dl 1734016159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016148.404901:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c6680 with x1818247334040064 ext(4190208->4194303) 00002000:00010000:1.0:1734016148.404904:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c6680 00000100:00100000:1.0:1734016148.404928:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9068 00000100:00100000:1.0:1734016148.404940:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247334039936:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016148.406983:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9069 00000100:00100000:0.0:1734016148.407003:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247334040064:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016148.407281:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247334040064:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 282us (4162us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1734016148.407289:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9069 00002000:00100000:0.0:1734016148.411514:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (4190208->4194303) req@ffff8800750c6680 x1818247334040064/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:109/0 lens 488/4536 e 0 to 0 dl 1734016159 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1734016148.411541:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c6680 with x1818247334040064 ext(4190208->4194303) 00002000:00010000:0.0:1734016148.411554:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c6680 00000100:00100000:2.0:1734016148.424017:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016148.424216:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334040320 00000100:00100000:3.0:1734016148.424252:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334040320 00002000:00100000:3.0:1734016148.424352:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->3362815) req@ffff880075547100 x1818247334040320/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:109/0 lens 488/0 e 0 to 0 dl 1734016159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016148.424366:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075547100 with x1818247334040320 ext(0->3362815) 00002000:00010000:3.0:1734016148.424373:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075547100 00000100:00100000:3.0:1734016148.424462:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9070 00000100:00100000:3.0:1734016148.424473:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247334040320:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016148.576181:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247334039936:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 171218us (173152us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016148.576205:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9068 00002000:00100000:1.0:1734016148.576233:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4399103) req@ffff880075608000 x1818247334039936/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:109/0 lens 504/440 e 0 to 0 dl 1734016159 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016148.576246:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075608000 with x1818247334039936 ext(0->4399103) 00002000:00010000:1.0:1734016148.576260:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075608000 00000100:00100000:3.0:1734016148.602466:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247334040320:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 177971us (178451us total) trans 0 rc 3362816/3362816 00000100:00100000:3.0:1734016148.602492:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9070 00002000:00100000:3.0:1734016148.602511:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->3362815) req@ffff880075547100 x1818247334040320/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:109/0 lens 488/440 e 0 to 0 dl 1734016159 ref 1 fl Complete:/200/0 rc 3362816/3362816 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016148.602522:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075547100 with x1818247334040320 ext(0->3362815) 00002000:00010000:3.0:1734016148.602531:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075547100 00000100:00100000:0.0:1734016148.606049:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016148.610381:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334040576 00000100:00100000:3.0:1734016148.610431:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334040576 00002000:00100000:3.0:1734016148.610546:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (4399104->4403199) req@ffff8800750c5500 x1818247334040576/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:109/0 lens 488/0 e 0 to 0 dl 1734016159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016148.610562:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c5500 with x1818247334040576 ext(4399104->4403199) 00002000:00010000:3.0:1734016148.610571:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c5500 00000100:00100000:1.0:1734016148.611717:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9071 00000100:00100000:1.0:1734016148.611732:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800750c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247334040576:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016148.612165:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800750c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247334040576:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 435us (6135us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016148.612173:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9071 00002000:00100000:1.0:1734016148.612179:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (4399104->4403199) req@ffff8800750c5500 x1818247334040576/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:109/0 lens 488/4536 e 0 to 0 dl 1734016159 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016148.612188:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff8800750c5500 with x1818247334040576 ext(4399104->4403199) 00002000:00010000:1.0:1734016148.612192:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800750c5500 00000100:00100000:0.0:1734016148.617151:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016148.619250:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334040704 00000100:00100000:1.0:1734016148.619272:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334040704 00000100:00100000:1.0:1734016148.619381:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12045 00000100:00100000:1.0:1734016148.619392:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247334040704:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016148.619431:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016148.619463:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc27117d46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e78ee expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016148.619512:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016148.619514:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016148.619524:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc27117d46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78ee expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016148.619543:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc27117d46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78ee expref: 13 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016148.619557:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:1.0:1734016148.619634:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247334040704:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 245us (2503us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016148.619642:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12045 00000100:00100000:1.0:1734016148.620908:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016148.620990:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334040832 00000100:00100000:2.0:1734016148.620999:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334040832 00000100:00100000:2.0:1734016148.621044:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12046 00000100:00100000:2.0:1734016148.621050:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247334040832:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016148.621066:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016148.621086:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117d4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e78f5 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016148.621154:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335458688:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016148.621233:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00002000:00010000:2.0:1734016148.623144:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016148 -> 1734016149 00000100:00100000:2.0:1734016148.623171:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335458688:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016148.623204:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117d4d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78f5 expref: 13 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.623221:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117d4d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78f5 expref: 13 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.623251:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016148.623445:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1981:x1818247334040832:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2393us (2549us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016148.623455:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12046 00000100:00100000:0.0:1734016148.627944:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016148.630920:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334040960 00000100:00100000:2.0:1734016148.630950:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334040960 00000100:00100000:2.0:1734016148.632892:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12047 00000100:00100000:2.0:1734016148.632916:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247334040960:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016148.632953:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016148.632994:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117d54 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e78fc expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016148.633099:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335458816:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016148.633234:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016148.644153:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335458816:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016148.645080:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117d54 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78fc expref: 13 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.645107:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117d54 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78fc expref: 13 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.645156:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016148.652934:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1984:x1818247334040960:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 19998us (24982us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016148.652954:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12047 00000100:00100000:2.0:1734016148.654228:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016148.654920:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334041088 00000100:00100000:0.0:1734016148.654932:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334041088 00000100:00100000:0.0:1734016148.655374:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12048 00000100:00100000:0.0:1734016148.655385:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247334041088:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016148.655425:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016148.655450:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27117d5b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7903 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016148.655557:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075a02a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335458944:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016148.656340:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1734016148.660153:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075a02a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335458944:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016148.660227:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27117d5b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7903 expref: 13 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.660255:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580000/0x5e3a3adc27117d5b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7903 expref: 13 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.660289:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:2.0:1734016148.663836:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+12:1983:x1818247334041088:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8409us (9574us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016148.663854:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12048 00010000:00010000:3.0:1734016148.666561:0:6469:0:(ldlm_lockd.c:2841:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1734016148.671542:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016148.671727:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334041216 00000100:00100000:2.0:1734016148.671745:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334041216 00000100:00100000:2.0:1734016148.673563:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12049 00000100:00100000:2.0:1734016148.673585:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:10406:x1818247334041216:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016148.673631:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016148.673687:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117d62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e790a expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.673759:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27117d3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4395008->4403199) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78e7 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.673770:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc27117d46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78ee expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.673779:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016148.673782:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016148.673787:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117d62 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [5509120->5521407] (req 5509120->5521407) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e790a expref: 14 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.673869:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc27117d46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78ee expref: 14 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.673893:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc27117d46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78ee expref: 14 pid: 7682 timeout: 515 lvb_type: 1 00000100:00100000:2.0:1734016148.673909:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335459072:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016148.674034:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27117d3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4395008->4403199) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78e7 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.674043:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27117d3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4395008->4403199) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78e7 expref: 10 pid: 7682 timeout: 515 lvb_type: 0 00000100:00100000:2.0:1734016148.674052:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335459200:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016148.674070:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016148.684343:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016148.685451:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335459072:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016148.685474:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335459200:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016148.685532:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117d62 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [5509120->5521407] (req 5509120->5521407) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e790a expref: 14 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.685563:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016148.685684:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:10406:x1818247334041216:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 12101us (14162us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016148.685700:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12049 00000100:00100000:3.0:1734016148.686707:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334041344 00000100:00100000:3.0:1734016148.686721:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334041344 00010000:00010000:3.0:1734016148.686775:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc27117d46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78ee expref: 14 pid: 7682 timeout: 515 lvb_type: 1 00000100:00100000:3.0:1734016148.686840:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3297 00000100:00100000:3.0:1734016148.686849:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247334041344:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016148.686869:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016148.686899:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc27117d46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78ee expref: 14 pid: 7682 timeout: 515 lvb_type: 1 00010000:00010000:3.0:1734016148.686913:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc27117d46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78ee expref: 14 pid: 7682 timeout: 515 lvb_type: 1 00010000:00010000:3.0:1734016148.686953:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499d440/0x5e3a3adc27117d46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78ee expref: 14 pid: 7682 timeout: 515 lvb_type: 1 00010000:00010000:3.0:1734016148.686999:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016148.687042:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247334041344:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 194us (2730us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016148.687049:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3297 00000100:00100000:1.0:1734016148.691681:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016148.692367:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334041472 00000100:00100000:0.0:1734016148.692384:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334041472 00010000:00010000:0.0:1734016148.692464:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27117d3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4395008->4403199) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78e7 expref: 11 pid: 7682 timeout: 515 lvb_type: 0 00000100:00100000:3.0:1734016148.694608:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3298 00000100:00100000:3.0:1734016148.694635:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247334041472:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016148.694676:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016148.694723:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27117d3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4395008->4403199) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78e7 expref: 11 pid: 7682 timeout: 515 lvb_type: 0 00010000:00010000:3.0:1734016148.694753:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27117d3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4395008->4403199) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78e7 expref: 11 pid: 7682 timeout: 515 lvb_type: 0 00010000:00010000:3.0:1734016148.694797:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499e400/0x5e3a3adc27117d3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4395008->4403199) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78e7 expref: 11 pid: 7682 timeout: 515 lvb_type: 0 00010000:00010000:3.0:1734016148.694841:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016148.694845:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016148.694856:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117d62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5509120->5521407) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e790a expref: 12 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016148.694867:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117d62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5509120->5521407) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e790a expref: 12 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016148.694921:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117d62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5509120->5521407) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e790a expref: 12 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016148.694934:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335459328:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016148.695052:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016148.700041:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335459328:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016148.700088:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:0.0:1734016148.700211:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1734016148.700334:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247334041472:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 5700us (8675us total) trans 0 rc 0/0 00000100:00100000:0.0:1734016148.700359:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3298 00000100:00100000:2.0:1734016148.706578:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334041600 00000100:00100000:2.0:1734016148.706606:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334041600 00000100:00100000:2.0:1734016148.706726:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12050 00000100:00100000:2.0:1734016148.706740:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+13:1981:x1818247334041600:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:3.0:1734016148.707776:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 6088193 -> 6088193 00002000:00010000:3.0:1734016148.707789:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016148 -> 1734016148 00002000:00010000:3.0:1734016148.707792:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016148 -> 1734016148 00002000:00010000:3.0:1734016148.707793:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016148 -> 1734016148 00002000:00010000:3.0:1734016148.707795:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 240 -> 264 00000100:00100000:3.0:1734016148.713854:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247334041600:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 7093us (13745us total) trans 4294968120 rc 0/0 00000100:00100000:3.0:1734016148.713877:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12050 00000100:00100000:0.0:1734016148.722202:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016148.723096:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334041728 00000100:00100000:3.0:1734016148.723114:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334041728 00000100:00100000:3.0:1734016148.723205:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12051 00000100:00100000:3.0:1734016148.723217:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880090354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247334041728:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016148.723253:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016148.723288:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117d69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7911 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016148.723420:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335459456:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016148.723529:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d780 going to sleep for 11 seconds 00002000:00010000:3.0:1734016148.748855:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016148 -> 1734016149 00002000:00010000:3.0:1734016148.748873:0:7683:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016148 -> 1734016149 00000100:00100000:3.0:1734016148.748908:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335459456:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016148.748967:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117d69 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7911 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016148.748985:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117d69 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7911 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016148.750436:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016148.750532:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880090354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247334041728:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 27313us (28753us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016148.750542:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12051 00000100:00100000:2.0:1734016148.753732:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016148.754125:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334041856 00000100:00100000:3.0:1734016148.754139:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334041856 00000100:00100000:0.0:1734016148.755305:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12052 00000100:00100000:0.0:1734016148.755322:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247334041856:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016148.755350:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016148.755378:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7580000/0x5e3a3adc27117d70 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7918 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016148.755476:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075a00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335459584:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016148.755574:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1734016148.765213:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075a00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335459584:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016148.765266:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7580000/0x5e3a3adc27117d70 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7918 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016148.765284:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7580000/0x5e3a3adc27117d70 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7918 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016148.765306:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580000, rc 0) 00000100:00100000:1.0:1734016148.765397:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247334041856:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10076us (11683us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016148.765418:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12052 00000100:00100000:1.0:1734016148.769982:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016148.770034:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334041984 00000100:00100000:2.0:1734016148.770047:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334041984 00000100:00100000:2.0:1734016148.770114:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12053 00000100:00100000:2.0:1734016148.770125:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+12:10406:x1818247334041984:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016148.770146:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016148.770164:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117d77 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e791f expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.770194:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4067327) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a8 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.770202:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016148.770205:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016148.770208:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117d77 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [696320->704511] (req 696320->704511) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e791f expref: 13 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.770238:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4067327) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a8 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.770250:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4067327) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a8 expref: 9 pid: 8216 timeout: 515 lvb_type: 0 00000100:00100000:2.0:1734016148.770264:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335459712:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016148.770333:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016148.780674:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016148.780884:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335459712:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016148.780951:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117d77 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [696320->704511] (req 696320->704511) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e791f expref: 13 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.780992:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016148.781086:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+13:10406:x1818247334041984:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10961us (11118us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016148.781102:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12053 00000100:00100000:1.0:1734016148.781120:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334042112 00000100:00100000:1.0:1734016148.781134:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334042112 00010000:00010000:1.0:1734016148.781180:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4067327) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a8 expref: 10 pid: 8216 timeout: 515 lvb_type: 0 00000100:00100000:1.0:1734016148.781217:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3299 00000100:00100000:1.0:1734016148.781227:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247334042112:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016148.781255:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016148.781296:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4063232->4067327) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a8 expref: 10 pid: 8216 timeout: 515 lvb_type: 0 00010000:00010000:1.0:1734016148.781312:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4063232->4067327) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a8 expref: 10 pid: 8216 timeout: 515 lvb_type: 0 00010000:00010000:1.0:1734016148.781354:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4063232->4067327) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e78a8 expref: 10 pid: 8216 timeout: 515 lvb_type: 0 00010000:00010000:1.0:1734016148.781413:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016148.781416:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016148.781426:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117d77 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 696320->704511) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e791f expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016148.781437:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117d77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 696320->704511) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e791f expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016148.781494:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117d77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 696320->704511) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e791f expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016148.781517:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335459840:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016148.781588:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016148.800790:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016148.800992:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335459840:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016148.801032:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016148.801109:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247334042112:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 19881us (20444us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016148.801127:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3299 00000100:00100000:3.0:1734016148.801248:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334042368 00000100:00100000:3.0:1734016148.801257:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334042368 00002000:00100000:3.0:1734016148.801313:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->3362815) req@ffff880075a03b80 x1818247334042368/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:109/0 lens 488/0 e 0 to 0 dl 1734016159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016148.801325:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075a03b80 with x1818247334042368 ext(0->3362815) 00002000:00010000:3.0:1734016148.801331:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075a03b80 00000100:00100000:3.0:1734016148.801356:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9072 00000100:00100000:3.0:1734016148.801362:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247334042368:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:0.0:1734016148.835143:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016148.836836:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334042624 00000100:00100000:1.0:1734016148.836858:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334042624 00002000:00100000:1.0:1734016148.836929:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff880075a01180 x1818247334042624/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:109/0 lens 488/0 e 0 to 0 dl 1734016159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016148.836942:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075a01180 with x1818247334042624 ext(0->4194303) 00002000:00010000:1.0:1734016148.836949:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075a01180 00000100:00100000:1.0:1734016148.837001:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9073 00000100:00100000:1.0:1734016148.837009:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247334042624:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016148.867427:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+13:1982:x1818247334042368:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 66037us (66623us total) trans 0 rc 3362816/3362816 00000100:00100000:3.0:1734016148.867446:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9072 00002000:00100000:3.0:1734016148.867467:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->3362815) req@ffff880075a03b80 x1818247334042368/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:109/0 lens 488/440 e 0 to 0 dl 1734016159 ref 1 fl Complete:/200/0 rc 3362816/3362816 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016148.867477:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075a03b80 with x1818247334042368 ext(0->3362815) 00002000:00010000:3.0:1734016148.867488:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880075a03b80 00000100:00100000:0.0:1734016148.887457:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016148.887511:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016148.887856:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334042880 00000100:00100000:3.0:1734016148.887864:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334042880 00000100:00100000:3.0:1734016148.887918:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334042752 00000100:00100000:3.0:1734016148.887920:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334042752 00000100:00100000:3.0:1734016148.887937:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12054 00000100:00100000:3.0:1734016148.887945:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247334042880:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016148.887968:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016148.887984:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d7e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e792d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016148.888011:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016148.888013:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016148.888020:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e792d expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016148.888037:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e792d expref: 10 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016148.888047:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4240, rc 0) 00000100:00100000:3.0:1734016148.888098:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247334042880:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 153us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016148.888104:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12054 00000100:00100000:3.0:1734016148.888123:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12055 00000100:00100000:3.0:1734016148.888127:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247334042752:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016148.888134:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016148.888143:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27117d85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7926 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016148.888184:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335459968:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016148.888227:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016148.890831:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247334042624:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 53810us (55699us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1734016148.890844:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9073 00002000:00100000:1.0:1734016148.890858:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff880075a01180 x1818247334042624/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:109/0 lens 488/440 e 0 to 0 dl 1734016159 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016148.890868:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880075a01180 with x1818247334042624 ext(0->4194303) 00002000:00010000:1.0:1734016148.890875:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880075a01180 00000100:00100000:2.0:1734016148.891440:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335459968:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016148.891496:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27117d85 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7926 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.891518:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df7180/0x5e3a3adc27117d85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7926 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.891552:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:2.0:1734016148.891583:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247334042752:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3455us (4071us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016148.891591:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12055 00000100:00100000:0.0:1734016148.902376:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016148.902502:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334043008 00000100:00100000:2.0:1734016148.902518:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334043008 00000100:00100000:2.0:1734016148.902617:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12056 00000100:00100000:2.0:1734016148.902628:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247334043008:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016148.902661:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016148.902700:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117d8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7934 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016148.902874:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335460096:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016148.902999:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016148.907424:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335460096:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016148.907469:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117d8c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7934 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.907484:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117d8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7934 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.911367:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016148.911478:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247334043008:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8844us (9115us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016148.911496:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12056 00000100:00100000:3.0:1734016148.918730:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016148.918856:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334043136 00000100:00100000:2.0:1734016148.918871:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334043136 00000100:00100000:2.0:1734016148.918955:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12057 00000100:00100000:2.0:1734016148.918968:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+13:10406:x1818247334043136:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016148.918997:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016148.919030:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117d93 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e793b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.919085:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117d77 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 696320->704511) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e791f expref: 14 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.919099:0:8216:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d7e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e792d expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.919108:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016148.919110:0:8216:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016148.919114:0:8216:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117d93 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [3829760->3837951] (req 3829760->3837951) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e793b expref: 14 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.919159:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e792d expref: 9 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.919175:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e792d expref: 9 pid: 8216 timeout: 516 lvb_type: 1 00000100:00100000:2.0:1734016148.919193:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335460224:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016148.919311:0:8216:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117d77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 696320->704511) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e791f expref: 14 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.919320:0:8216:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117d77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 696320->704511) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e791f expref: 14 pid: 7682 timeout: 516 lvb_type: 0 00000100:00100000:2.0:1734016148.919328:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335460352:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016148.919349:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016148.928336:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335460224:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016148.930577:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335460352:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016148.930645:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117d93 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [3829760->3837951] (req 3829760->3837951) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e793b expref: 14 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016148.930678:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016148.930784:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+14:10406:x1818247334043136:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 11815us (12071us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016148.930816:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12057 00000100:00100000:0.0:1734016148.936572:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016148.936743:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016148.940429:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334043264 00000100:00100000:1.0:1734016148.940445:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334043264 00010000:00010000:1.0:1734016148.940502:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e792d expref: 10 pid: 8216 timeout: 516 lvb_type: 1 00000100:00100000:1.0:1734016148.940537:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334043392 00000100:00100000:1.0:1734016148.940540:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334043392 00010000:00010000:1.0:1734016148.940552:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117d77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 696320->704511) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e791f expref: 14 pid: 7682 timeout: 516 lvb_type: 0 00000100:00100000:2.0:1734016148.940556:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3300 00000100:00100000:2.0:1734016148.940569:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247334043264:12345-192.168.201.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1734016148.940581:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3301 00000100:00100000:1.0:1734016148.940586:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247334043392:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016148.940599:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016148.940619:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016148.940630:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117d77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 696320->704511) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e791f expref: 14 pid: 7682 timeout: 516 lvb_type: 0 00010000:00010000:2.0:1734016148.940632:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e792d expref: 10 pid: 8216 timeout: 516 lvb_type: 1 00010000:00010000:2.0:1734016148.940648:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e792d expref: 10 pid: 8216 timeout: 516 lvb_type: 1 00010000:00010000:1.0:1734016148.940658:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117d77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 696320->704511) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e791f expref: 14 pid: 7682 timeout: 516 lvb_type: 0 00010000:00010000:2.0:1734016148.940767:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4240/0x5e3a3adc27117d7e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e792d expref: 10 pid: 8216 timeout: 516 lvb_type: 1 00010000:00010000:2.0:1734016148.940812:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016148.940884:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247334043264:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 317us (4328us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016148.940894:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3300 00010000:00010000:1.0:1734016148.943099:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117d77 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 696320->704511) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e791f expref: 14 pid: 7682 timeout: 516 lvb_type: 0 00010000:00010000:1.0:1734016148.943163:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016148.943166:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016148.943175:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117d93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->3837951) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e793b expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016148.943185:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117d93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->3837951) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e793b expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016148.943252:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117d93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->3837951) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e793b expref: 13 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016148.943269:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335460480:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016148.943373:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92900 going to sleep for 11 seconds 00000100:00100000:0.0:1734016148.949114:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016148.949679:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335460480:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016148.949721:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016148.950665:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334043520 00000100:00100000:2.0:1734016148.950679:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334043520 00000100:00100000:2.0:1734016148.950762:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12058 00000100:00100000:2.0:1734016148.950773:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247334043520:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016148.951068:0:8216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 3359509 -> 3359509 00002000:00010000:2.0:1734016148.951072:0:8216:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016148 -> 1734016148 00002000:00010000:2.0:1734016148.951075:0:8216:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016149 -> 1734016148 00002000:00010000:2.0:1734016148.951076:0:8216:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016148 -> 1734016148 00002000:00010000:2.0:1734016148.951078:0:8216:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:1.0:1734016148.951193:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+15:1982:x1818247334043392:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 10603us (14446us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016148.951204:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3301 00000100:00100000:2.0:1734016148.952529:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247334043520:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 1753us (3429us total) trans 4294969566 rc 0/0 00000100:00100000:2.0:1734016148.952540:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12058 00000100:00100000:0.0:1734016148.954931:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016148.954987:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016148.955143:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334043648 00000100:00100000:2.0:1734016148.955154:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334043648 00000100:00100000:2.0:1734016148.955206:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334043776 00000100:00100000:2.0:1734016148.955209:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334043776 00000100:00100000:2.0:1734016148.955230:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12059 00000100:00100000:2.0:1734016148.955239:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247334043648:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016148.955265:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016148.955286:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117d9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7942 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016148.955352:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335460608:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016148.955427:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016148.955463:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12060 00000100:00100000:2.0:1734016148.955467:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247334043776:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016148.955475:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016148.955487:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117da1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7949 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016148.955511:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335460736:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016148.955531:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706f00 going to sleep for 11 seconds 00000100:00100000:2.0:1734016148.963700:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335460608:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016148.963775:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117d9a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7942 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.963792:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117d9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7942 expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.963869:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016148.963951:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247334043648:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8711us (9029us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016148.963960:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12059 00002000:00010000:0.0:1734016148.965260:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016148 -> 1734016149 00002000:00010000:0.0:1734016148.965267:0:7683:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016148 -> 1734016149 00000100:00100000:0.0:1734016148.965282:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335460736:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016148.965307:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117da1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7949 expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016148.965319:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117da1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7949 expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016148.965345:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:0.0:1734016148.965382:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247334043776:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 9913us (10394us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016148.965389:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12060 00000100:00100000:0.0:1734016148.971753:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016148.971861:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016148.971879:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334044032 00000100:00100000:2.0:1734016148.971892:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334044032 00000100:00100000:2.0:1734016148.971944:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334043904 00000100:00100000:2.0:1734016148.971946:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334043904 00000100:00100000:2.0:1734016148.971968:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12061 00000100:00100000:2.0:1734016148.971976:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247334044032:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016148.972002:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016148.972026:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117da8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7957 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016148.972043:0:7684:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12062 00000100:00100000:0.0:1734016148.972050:0:7684:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88008719f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247334043904:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016148.972065:0:7684:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016148.972083:0:7684:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27117daf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7950 expref: -99 pid: 7684 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016148.972111:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335460864:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016148.972122:0:7684:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073b9ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335460992:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016148.972370:0:7684:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016148.972370:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016148.977354:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335460864:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016148.977439:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117da8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7957 expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016148.977456:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117da8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7957 expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1734016148.978781:0:7684:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073b9ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:7684:1818247335460992:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016148.978820:0:7684:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27117daf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7950 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016148.978830:0:7684:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a75821c0/0x5e3a3adc27117daf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7950 expref: 11 pid: 7684 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016148.978982:0:7684:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a75821c0, rc 0) 00000100:00100000:1.0:1734016148.979194:0:7684:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247334043904:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7142us (7330us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016148.979203:0:7684:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12062 00010000:00010000:2.0:1734016148.980113:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016148.980169:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88008719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1984:x1818247334044032:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8190us (8429us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016148.980175:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12061 00000100:00100000:0.0:1734016148.987686:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016148.987883:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334044288 00000100:00100000:1.0:1734016148.987896:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334044288 00002000:00100000:1.0:1734016148.987974:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (2723840->2727935) req@ffff880073b9f800 x1818247334044288/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:109/0 lens 488/0 e 0 to 0 dl 1734016159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016148.987987:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9f800 with x1818247334044288 ext(2723840->2727935) 00002000:00010000:1.0:1734016148.987995:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9f800 00000100:00100000:1.0:1734016148.988036:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9074 00000100:00100000:1.0:1734016148.988044:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1983:x1818247334044288:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016148.988294:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1983:x1818247334044288:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 249us (630us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016148.988303:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9074 00002000:00100000:1.0:1734016148.988312:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (2723840->2727935) req@ffff880073b9f800 x1818247334044288/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:109/0 lens 488/4536 e 0 to 0 dl 1734016159 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016148.988319:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9f800 with x1818247334044288 ext(2723840->2727935) 00002000:00010000:1.0:1734016148.988323:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9f800 00000100:00100000:0.0:1734016148.995377:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016148.995513:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334044544 00000100:00100000:3.0:1734016148.995535:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334044544 00002000:00100000:3.0:1734016148.995606:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->3362815) req@ffff880073b9c700 x1818247334044544/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:109/0 lens 504/0 e 0 to 0 dl 1734016159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016148.995625:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9c700 with x1818247334044544 ext(0->3362815) 00002000:00010000:3.0:1734016148.995632:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9c700 00000100:00100000:3.0:1734016148.995681:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9075 00000100:00100000:3.0:1734016148.995690:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1984:x1818247334044544:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016149.037305:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+14:1984:x1818247334044544:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 41590us (41918us total) trans 0 rc 3358720/3358720 00000100:00100000:2.0:1734016149.037327:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9075 00002000:00100000:2.0:1734016149.037346:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->3362815) req@ffff880073b9c700 x1818247334044544/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:109/0 lens 504/440 e 0 to 0 dl 1734016159 ref 1 fl Complete:/200/0 rc 3358720/3358720 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016149.037358:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9c700 with x1818247334044544 ext(0->3362815) 00002000:00010000:2.0:1734016149.037366:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9c700 00000100:00100000:0.0:1734016149.045797:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.046333:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334044800 00000100:00100000:2.0:1734016149.046353:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334044800 00000100:00080000:0.0:1734016149.046487:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016119 00000100:00100000:2.0:1734016149.047098:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2408 00000100:00100000:2.0:1734016149.047109:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+22:10406:x1818247334044800:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:2.0:1734016149.047202:0:6479:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016149.047249:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117c58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7800 expref: 22 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.047295:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016149.047302:0:6479:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1734016149.047579:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117db6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016149.047601:0:6479:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117c4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f9 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.047608:0:6479:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117db6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016149.047658:0:6479:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f9 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.047677:0:6479:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117c4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f9 expref: 16 pid: 6479 timeout: 516 lvb_type: 0 00000100:00100000:2.0:1734016149.047692:0:6479:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335461120:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016149.047830:0:6479:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016149.054059:0:6479:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075547800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1818247335461120:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016149.054107:0:6479:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117db6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:0.0:1734016149.054741:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016149.054846:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334044928 00000100:00100000:1.0:1734016149.054854:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334044928 00010000:00010000:1.0:1734016149.054910:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117c4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f9 expref: 17 pid: 6479 timeout: 516 lvb_type: 0 00000100:00100000:1.0:1734016149.054956:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3302 00000100:00100000:1.0:1734016149.054965:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:1982:x1818247334044928:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016149.054987:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016149.054993:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117c4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f9 expref: 17 pid: 6479 timeout: 516 lvb_type: 0 00010000:00010000:1.0:1734016149.055008:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f9 expref: 17 pid: 6479 timeout: 516 lvb_type: 0 00010000:00010000:1.0:1734016149.055043:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117c4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e77f9 expref: 17 pid: 6479 timeout: 516 lvb_type: 0 00000100:00080000:0.0:1734016149.055135:0:6476:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1734016119 00010000:00010000:1.0:1734016149.056034:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016149.056040:0:9876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117db6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016149.056052:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117db6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016149.056060:0:9876:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117db6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 00010000:00010000:1.0:1734016149.056104:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016149.056184:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:1982:x1818247334044928:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1218us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016149.056194:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3302 00010000:00010000:2.0:1734016149.056502:0:6479:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117db6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016149.056513:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117db6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000001:00080000:2.0:1734016149.056680:0:6479:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968863 00000004:00010000:2.0:1734016149.056755:0:6479:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880073b9d880 reply state ffff880075a95000 transno 4294968864 ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117db6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000100:00100000:2.0:1734016149.056764:0:6479:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1734016149.056904:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+24:10406:x1818247334044800:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 9797us (11139us total) trans 4294968864 rc 0/0 00000100:00100000:2.0:1734016149.056912:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2408 00000020:00080000:2.0:1734016149.056918:0:6479:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1734016149.060311:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016149.060395:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016149.060446:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334045184 00000100:00100000:0.0:1734016149.060458:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334045184 00002000:00010000:0.0:1734016149.060502:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:0.0:1734016149.060507:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9df80 with x1818247334045184 ext(4194304->18446744073709551615) 00002000:00010000:0.0:1734016149.060521:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9df80. 00000100:00100000:0.0:1734016149.060542:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334045056 00000100:00100000:0.0:1734016149.060544:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334045056 00002000:00010000:0.0:1734016149.060553:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (5089234->18446744073709551615) 00002000:00100000:0.0:1734016149.060555:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9f480 with x1818247334045056 ext(5089234->18446744073709551615) 00002000:00010000:0.0:1734016149.060564:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b9f480. 00000100:00100000:0.0:1734016149.060580:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9076 00000100:00100000:0.0:1734016149.060588:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247334045184:12345-192.168.201.16@tcp:10:fsx.0 00002000:00010000:0.0:1734016149.060862:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 3359509 -> 4194304 00002000:00010000:0.0:1734016149.060867:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016148 -> 1734016149 00002000:00010000:0.0:1734016149.060869:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016149 -> 1734016148 00002000:00010000:0.0:1734016149.060872:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016149 -> 1734016149 00002000:00010000:0.0:1734016149.060873:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:0.0:1734016149.060933:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+15:1981:x1818247334045184:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 345us (632us total) trans 4294969567 rc 0/0 00000100:00100000:0.0:1734016149.060940:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9076 00002000:00010000:0.0:1734016149.060943:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (4194304->18446744073709551615) 00002000:00100000:0.0:1734016149.060945:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9df80 with x1818247334045184 ext(4194304->18446744073709551615) 00002000:00010000:0.0:1734016149.060948:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073b9df80. 00000100:00100000:0.0:1734016149.060965:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9077 00000100:00100000:0.0:1734016149.060969:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247334045056:12345-192.168.201.16@tcp:10:fsx.0 00010000:00010000:2.0:1734016149.061959:0:3490:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117db6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016149.061976:0:3490:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117db6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016149.061984:0:3490:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117db6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016149.061990:0:3490:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88006edbc480 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:2.0:1734016149.061995:0:3490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117db6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016149.062004:0:3490:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117db6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016149.062031:0:3490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016149.062034:0:3490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1734016149.062041:0:3490:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117db6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016149.062046:0:3490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbc480/0x5e3a3adc27117db6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00002000:00010000:3.0:1734016149.064676:0:7687:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 6088193 -> 5089234 00002000:00010000:3.0:1734016149.064684:0:7687:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016148 -> 1734016149 00002000:00010000:3.0:1734016149.064686:0:7687:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016149 -> 1734016148 00002000:00010000:3.0:1734016149.064688:0:7687:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016149 -> 1734016149 00002000:00010000:3.0:1734016149.064690:0:7687:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 264 -> 232 00000100:00100000:3.0:1734016149.065220:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+15:1981:x1818247334045056:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 3821us (4396us total) trans 4294968121 rc 0/0 00000100:00100000:3.0:1734016149.065235:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9077 00002000:00010000:3.0:1734016149.065243:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (5089234->18446744073709551615) 00002000:00100000:3.0:1734016149.065248:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073b9f480 with x1818247334045056 ext(5089234->18446744073709551615) 00002000:00010000:3.0:1734016149.065256:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073b9f480. 00000100:00100000:0.0:1734016149.067733:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.068036:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334045312 00000100:00100000:2.0:1734016149.068051:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334045312 00000100:00100000:2.0:1734016149.068351:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2409 00000100:00100000:2.0:1734016149.068366:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+23:10406:x1818247334045312:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016149.068430:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016149.068470:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117dbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e795e expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.068641:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117dc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016149.068663:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016149.068683:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:2.0:1734016149.068721:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 9283538 00000004:00200000:2.0:1734016149.068726:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1734016149.068751:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:2.0:1734016149.068780:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117dbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e795e expref: 25 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.069570:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e795e expref: 24 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.069584:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:2.0:1734016149.069588:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1734016149.069595:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016149.069726:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+24:10406:x1818247334045312:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 1362us (2006us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016149.069736:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2409 00000100:00100000:0.0:1734016149.074295:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.078608:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334045440 00000100:00100000:2.0:1734016149.078643:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334045440 00000100:00100000:2.0:1734016149.078792:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12063 00000100:00100000:2.0:1734016149.078872:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+15:1981:x1818247334045440:12345-192.168.201.16@tcp:22:fsx.0 00002000:00010000:2.0:1734016149.079393:0:7683:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1734016149.079410:0:7683:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016149 -> 1734016149 00002000:00010000:2.0:1734016149.079413:0:7683:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016148 -> 1734016148 00002000:00010000:2.0:1734016149.079416:0:7683:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016149 -> 1734016149 00002000:00010000:2.0:1734016149.079419:0:7683:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 24 -> 40 00000100:00100000:2.0:1734016149.079532:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+16:1981:x1818247334045440:12345-192.168.201.16@tcp:22:fsx.0 Request processed in 728us (5260us total) trans 4294969568 rc 0/0 00000100:00100000:2.0:1734016149.079545:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12063 00000100:00100000:1.0:1734016149.083440:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016149.083574:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334045568 00000100:00100000:3.0:1734016149.083594:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334045568 00000100:00100000:3.0:1734016149.083695:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2410 00000100:00100000:3.0:1734016149.083709:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+16:10406:x1818247334045568:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016149.083758:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016149.083820:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27117dcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7965 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.084016:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117dd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.084037:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.084051:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:3.0:1734016149.084093:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 9283538 00000004:00200000:3.0:1734016149.084100:0:6479:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016149.084128:0:6479:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.084157:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27117dcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7965 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.084187:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7965 expref: 17 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.084198:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016149.084200:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016149.084205:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7cc0, rc 0) 00000100:00100000:3.0:1734016149.084303:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:10406:x1818247334045568:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 596us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016149.084313:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2410 00000100:00100000:0.0:1734016149.088563:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016149.088647:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.088775:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334045696 00000100:00100000:2.0:1734016149.088792:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334045696 00000100:00100000:2.0:1734016149.089281:0:7684:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334045824 00000100:00100000:2.0:1734016149.089285:0:7684:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334045824 00000100:00100000:3.0:1734016149.089326:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12064 00000100:00100000:3.0:1734016149.089339:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247334045696:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016149.089377:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016149.089415:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117dd9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e796c expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016149.089511:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335461248:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016149.089613:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d780 going to sleep for 11 seconds 00000100:00100000:1.0:1734016149.089679:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12065 00000100:00100000:1.0:1734016149.089687:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247334045824:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016149.089702:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016149.089720:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27117de0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7973 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016149.089755:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335461376:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016149.089785:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92300 going to sleep for 11 seconds 00002000:00010000:3.0:1734016149.092656:0:7683:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016148 -> 1734016149 00000100:00100000:3.0:1734016149.092698:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335461248:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016149.092745:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117dd9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e796c expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016149.092766:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df4900/0x5e3a3adc27117dd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e796c expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016149.092850:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016149.092920:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247334045696:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3581us (4379us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016149.092931:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12064 00002000:00010000:0.0:1734016149.093131:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime: 1734016148 -> 1734016149 00000100:00100000:0.0:1734016149.093149:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335461376:192.168.201.16@tcp:106: 00010000:00010000:0.0:1734016149.093176:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27117de0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7973 expref: 10 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016149.093189:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d440/0x5e3a3adc27117de0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7973 expref: 10 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1734016149.093219:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d440, rc 0) 00000100:00100000:0.0:1734016149.093244:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247334045824:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3555us (4596us total) trans 0 rc 301/301 00000100:00100000:0.0:1734016149.093250:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12065 00000100:00100000:0.0:1734016149.096769:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016149.097546:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016149.097726:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334046080 00000100:00100000:3.0:1734016149.097741:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334046080 00000100:00100000:3.0:1734016149.097828:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334045952 00000100:00100000:3.0:1734016149.097831:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334045952 00000100:00100000:3.0:1734016149.098499:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12066 00000100:00100000:3.0:1734016149.098509:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247334046080:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016149.098536:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016149.098562:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27117de7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7981 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016149.098690:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335461504:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016149.098748:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12067 00000100:00100000:0.0:1734016149.098756:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247334045952:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016149.098770:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016149.098784:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27117dee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e797a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016149.099128:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d780 going to sleep for 11 seconds 00000100:00100000:0.0:1734016149.099295:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880073ad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335461632:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016149.099321:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016149.102105:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880073ad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335461632:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016149.102164:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27117dee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e797a expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016149.102183:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7581b00/0x5e3a3adc27117dee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e797a expref: 11 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016149.102221:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7581b00, rc 0) 00000100:00100000:1.0:1734016149.102295:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247334045952:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3536us (4747us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016149.102305:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12067 00000100:00100000:3.0:1734016149.102504:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335461504:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016149.102532:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27117de7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7981 expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016149.102544:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df4d80/0x5e3a3adc27117de7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7981 expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016149.102560:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016149.102584:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247334046080:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4077us (5826us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016149.102589:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12066 00000100:00100000:0.0:1734016149.108216:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.108459:0:6481:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334046336 00000100:00100000:2.0:1734016149.108475:0:6481:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334046336 00000100:00100000:2.0:1734016149.108675:0:6481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 47 00000100:00100000:2.0:1734016149.108689:0:6481:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c598caf-7141-4c19-8566-0b7731516db9+24:10406:x1818247334046336:12345-192.168.201.16@tcp:35:fsx.0 00000100:00100000:2.0:1734016149.110194:0:6481:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c598caf-7141-4c19-8566-0b7731516db9+25:10406:x1818247334046336:12345-192.168.201.16@tcp:35:fsx.0 Request processed in 1500us (1987us total) trans 4294968865 rc 0/0 00000100:00100000:2.0:1734016149.110207:0:6481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 47 00000100:00100000:2.0:1734016149.112506:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016149.112676:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334046464 00000100:00100000:1.0:1734016149.112694:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334046464 00000100:00100000:1.0:1734016149.112761:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2411 00000100:00100000:1.0:1734016149.112773:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+25:10406:x1818247334046464:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016149.112826:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016149.112904:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc27117df5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7988 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016149.113000:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117dfc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016149.113022:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117dfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016149.113039:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117dfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:1.0:1734016149.113114:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1734016149.113119:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1734016149.113141:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117dfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016149.113171:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499cb40/0x5e3a3adc27117df5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7988 expref: 27 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016149.113201:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499c6c0/0x5e3a3adc27117dfc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7988 expref: 26 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016149.113210:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012a2f6b00) 00010000:00010000:1.0:1734016149.113214:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1734016149.113218:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c6c0, rc 0) 00000100:00100000:1.0:1734016149.113294:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+26:10406:x1818247334046464:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 523us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016149.113303:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2411 00000100:00100000:0.0:1734016149.116518:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016149.116848:0:6479:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334046720 00000100:00100000:3.0:1734016149.116862:0:6479:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334046720 00000100:00100000:3.0:1734016149.116938:0:6479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2412 00000100:00100000:3.0:1734016149.116948:0:6479:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+26:10406:x1818247334046720:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016149.116973:0:6479:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016149.117004:0:6479:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117e03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e798f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.117127:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27117e0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117145:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27117e0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117160:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27117e0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117182:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117e11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117188:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117e11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117193:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117e11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117340:0:6479:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117e18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117348:0:6479:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117e18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117352:0:6479:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117e18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 00000004:00200000:3.0:1734016149.117363:0:6479:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 9283538 00010000:00010000:3.0:1734016149.117509:0:6479:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27117e0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117517:0:6479:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27117e0a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117523:0:6479:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27117e0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117529:0:6479:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4900 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016149.117533:0:6479:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27117e0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117542:0:6479:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27117e0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117557:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012a2f6b00) 00010000:00010000:3.0:1734016149.117561:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016149.117566:0:6479:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27117e0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117572:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27117e0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117605:0:6479:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117e11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117610:0:6479:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117e11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117614:0:6479:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117e11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117617:0:6479:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff880129df4240 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016149.117619:0:6479:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117e11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117622:0:6479:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117e11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117626:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc3ce3da0 (ffff8800b1949900) 00010000:00010000:3.0:1734016149.117627:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016149.117629:0:6479:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117e11 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117633:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117e11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3ce3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 00010000:00010000:3.0:1734016149.117688:0:6479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117e03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e798f expref: 29 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.117702:0:6479:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117e18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e798f expref: 28 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.117709:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016149.117711:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016149.117713:0:6479:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df7180, rc 0) 00000100:00100000:3.0:1734016149.117834:0:6479:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c598caf-7141-4c19-8566-0b7731516db9+28:10406:x1818247334046720:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 885us (1330us total) trans 4294968866 rc 0/0 00000100:00100000:3.0:1734016149.117841:0:6479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2412 00000100:00100000:0.0:1734016149.121597:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016149.121733:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334046848 00000100:00100000:1.0:1734016149.121748:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334046848 00000100:00100000:1.0:1734016149.121863:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 15 00000100:00100000:1.0:1734016149.121871:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+28:1984:x1818247334046848:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016149.121893:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016149.121934:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117e18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e798f expref: 28 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016149.121957:0:9876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016149.121961:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016149.122014:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+27:1984:x1818247334046848:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 144us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016149.122021:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 15 00000100:00100000:0.0:1734016149.122428:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016149.122504:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016149.122537:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334046976 00000100:00100000:3.0:1734016149.122544:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334046976 00000100:00100000:3.0:1734016149.122586:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334047104 00000100:00100000:3.0:1734016149.122591:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334047104 00000100:00100000:3.0:1734016149.122613:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12068 00000100:00100000:3.0:1734016149.122618:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247334046976:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016149.122641:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016149.122667:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117e26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7996 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016149.122741:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335461760:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016149.122787:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016149.123034:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12069 00000100:00100000:2.0:1734016149.123040:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247334047104:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016149.123050:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016149.123065:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117e2d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e799d expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016149.123099:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335461888:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016149.123126:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016149.125760:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:7683:1818247335461760:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016149.125842:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117e26 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7996 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016149.125871:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df5b00/0x5e3a3adc27117e26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7996 expref: 11 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016149.125889:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016149.125946:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247334046976:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3326us (3517us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016149.125958:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12068 00000100:00100000:2.0:1734016149.126155:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335461888:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016149.126181:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117e2d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e799d expref: 10 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.126193:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117e2d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e799d expref: 10 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.126216:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016149.126254:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247334047104:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3214us (3749us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016149.126261:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12069 00000100:00100000:0.0:1734016149.129324:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016149.129390:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.129523:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334047360 00000100:00100000:2.0:1734016149.129538:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334047360 00000100:00100000:2.0:1734016149.129739:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334047232 00000100:00100000:2.0:1734016149.129742:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334047232 00000100:00100000:3.0:1734016149.129781:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12070 00000100:00100000:3.0:1734016149.129790:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247334047360:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016149.129846:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016149.129871:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27117e34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e79ab expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016149.129952:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335462016:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016149.130027:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:2.0:1734016149.130385:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12071 00000100:00100000:2.0:1734016149.130405:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247334047232:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016149.130416:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016149.130428:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117e3b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e79a4 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016149.130471:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335462144:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016149.130495:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:3.0:1734016149.133637:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335462016:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016149.133723:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27117e34 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ab expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016149.133747:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df73c0/0x5e3a3adc27117e34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ab expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016149.133767:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:2.0:1734016149.134048:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335462144:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016149.134082:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117e3b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79a4 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.134093:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117e3b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79a4 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.134114:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:3.0:1734016149.134553:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1982:x1818247334047360:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4760us (5239us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016149.134567:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12070 00000100:00100000:2.0:1734016149.134686:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247334047232:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4289us (5295us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016149.134692:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12071 00000100:00100000:2.0:1734016149.137989:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016149.138249:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334047488 00000100:00100000:0.0:1734016149.138264:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334047488 00000100:00100000:0.0:1734016149.138678:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12072 00000100:00100000:0.0:1734016149.138689:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:10406:x1818247334047488:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016149.138721:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016149.138749:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117e42 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e79b2 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016149.138791:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117d62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5509120->5521407) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e790a expref: 14 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016149.138923:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016149.138926:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1734016149.138930:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117e42 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3870720->3878911] (req 3870720->3878911) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79b2 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016149.138971:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117d62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5509120->5521407) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e790a expref: 14 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1734016149.138984:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117d62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5509120->5521407) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e790a expref: 14 pid: 7683 timeout: 516 lvb_type: 0 00000100:00100000:0.0:1734016149.138995:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800755b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335462272:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016149.139074:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1734016149.146973:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.147095:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800755b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335462272:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016149.147127:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117e42 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [3870720->3878911] (req 3870720->3878911) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79b2 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.147146:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:2.0:1734016149.147191:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:10406:x1818247334047488:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8504us (9220us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016149.147203:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12072 00000100:00100000:3.0:1734016149.147282:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334047616 00000100:00100000:3.0:1734016149.147290:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334047616 00010000:00010000:3.0:1734016149.147317:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117d62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5509120->5521407) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e790a expref: 15 pid: 7683 timeout: 516 lvb_type: 0 00000100:00100000:3.0:1734016149.147348:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3303 00000100:00100000:3.0:1734016149.147355:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+15:1982:x1818247334047616:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016149.147370:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016149.147392:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117d62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5509120->5521407) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e790a expref: 15 pid: 7683 timeout: 516 lvb_type: 0 00010000:00010000:3.0:1734016149.147412:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117d62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5509120->5521407) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e790a expref: 15 pid: 7683 timeout: 516 lvb_type: 0 00010000:00010000:3.0:1734016149.147441:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbdf80/0x5e3a3adc27117d62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5509120->5521407) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e790a expref: 15 pid: 7683 timeout: 516 lvb_type: 0 00010000:00010000:3.0:1734016149.147458:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016149.147461:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016149.147467:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117e42 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3870720->3878911) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79b2 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.147476:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117e42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3870720->3878911) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79b2 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.147516:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117e42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3870720->3878911) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79b2 expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016149.147531:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335462400:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016149.147570:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016149.150736:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6466:1818247335462400:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016149.150778:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016149.151006:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247334047616:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 3647us (4038us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016149.151023:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3303 00000100:00100000:0.0:1734016149.157567:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016149.157763:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334047872 00000100:00100000:3.0:1734016149.157783:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334047872 00002000:00100000:3.0:1734016149.158233:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff880073793b80 x1818247334047872/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:110/0 lens 488/0 e 0 to 0 dl 1734016160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016149.158245:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073793b80 with x1818247334047872 ext(0->4194303) 00002000:00010000:3.0:1734016149.158253:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073793b80 00000100:00100000:3.0:1734016149.158295:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9078 00000100:00100000:3.0:1734016149.158306:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247334047872:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016149.201054:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1984:x1818247334047872:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 42729us (43497us total) trans 0 rc 4194304/4194304 00000100:00100000:2.0:1734016149.201072:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9078 00002000:00100000:2.0:1734016149.201093:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff880073793b80 x1818247334047872/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:110/0 lens 488/440 e 0 to 0 dl 1734016160 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016149.201104:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073793b80 with x1818247334047872 ext(0->4194303) 00002000:00010000:2.0:1734016149.201125:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880073793b80 00000100:00100000:0.0:1734016149.222138:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.222261:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334048000 00000100:00100000:2.0:1734016149.222272:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334048000 00000100:00100000:2.0:1734016149.222338:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12073 00000100:00100000:2.0:1734016149.222346:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247334048000:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016149.222367:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016149.222389:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117e49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e79b9 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016149.222489:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335462528:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016149.222543:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016149.225848:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335462528:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016149.225888:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117e49 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79b9 expref: 10 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.225906:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117e49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79b9 expref: 10 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.226181:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016149.226610:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247334048000:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4261us (4481us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016149.226622:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12073 00000100:00100000:0.0:1734016149.234203:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.235158:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334048128 00000100:00100000:2.0:1734016149.235178:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334048128 00000100:00100000:2.0:1734016149.235271:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12074 00000100:00100000:2.0:1734016149.235282:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247334048128:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016149.235309:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016149.235336:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117e50 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e79c0 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016149.235445:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335462656:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016149.235548:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016149.238083:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335462656:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016149.238144:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117e50 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79c0 expref: 10 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.238164:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117e50 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79c0 expref: 10 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.238200:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016149.238273:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1983:x1818247334048128:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2991us (4092us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016149.238290:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12074 00000100:00100000:0.0:1734016149.244182:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016149.246117:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334048256 00000100:00100000:3.0:1734016149.246137:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334048256 00000100:00100000:3.0:1734016149.246489:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12075 00000100:00100000:3.0:1734016149.246501:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247334048256:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016149.246536:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016149.246566:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117e57 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e79c7 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016149.246665:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335462784:192.168.201.16@tcp:106: 00000100:00100000:3.0:1734016149.247386:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016149.251536:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335462784:192.168.201.16@tcp:106: 00010000:00010000:3.0:1734016149.251599:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117e57 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79c7 expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016149.251618:0:7683:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117e57 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79c7 expref: 10 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016149.251706:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016149.253560:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:1981:x1818247334048256:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7036us (9367us total) trans 0 rc 301/301 00000100:00100000:3.0:1734016149.253580:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12075 00000100:00100000:2.0:1734016149.257905:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016149.258149:0:7683:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334048384 00000100:00100000:3.0:1734016149.258161:0:7683:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334048384 00000100:00100000:3.0:1734016149.258210:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12076 00000100:00100000:3.0:1734016149.258218:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+9:10406:x1818247334048384:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016149.258242:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016149.258267:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117e5e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e79ce expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.258304:0:7683:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117d93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->3837951) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e793b expref: 15 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.258317:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016149.258319:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1734016149.258323:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117e5e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ce expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.258364:0:7683:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117d93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->3837951) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e793b expref: 15 pid: 8216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.258378:0:7683:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117d93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->3837951) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e793b expref: 15 pid: 8216 timeout: 516 lvb_type: 0 00000100:00100000:3.0:1734016149.258392:0:7683:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335462912:192.168.201.16@tcp:104: 00000100:00100000:3.0:1734016149.258829:0:7683:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016149.262527:0:7683:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:7683:1818247335462912:192.168.201.16@tcp:104: 00010000:00010000:3.0:1734016149.262585:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117e5e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ce expref: 10 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.262608:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5440, rc 0) 00000100:00100000:3.0:1734016149.264011:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:10406:x1818247334048384:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5773us (6099us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016149.264030:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12076 00000100:00100000:0.0:1734016149.264539:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016149.264905:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334048512 00000100:00100000:3.0:1734016149.264916:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334048512 00002000:00100000:3.0:1734016149.264975:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (2723840->2732031) req@ffff880073791c00 x1818247334048512/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:110/0 lens 8680/0 e 0 to 0 dl 1734016160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016149.264993:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073791c00 with x1818247334048512 ext(2723840->2732031) 00010000:00010000:3.0:1734016149.265004:0:7687:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117d93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->3837951) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e793b expref: 16 pid: 8216 timeout: 516 lvb_type: 0 00010000:00010000:3.0:1734016149.265019:0:7687:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117d93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->3837951) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e793b expref: 16 pid: 8216 timeout: 516 lvb_type: 0 00002000:00010000:3.0:1734016149.265026:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880073791c00 00000100:00100000:3.0:1734016149.265048:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 305 00000100:00100000:3.0:1734016149.265055:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+16:1982:x1818247334048512:12345-192.168.201.16@tcp:4:fsx.0 00000100:00100000:3.0:1734016149.267502:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247334048512:12345-192.168.201.16@tcp:4:fsx.0 Request processed in 2430us (2952us total) trans 4294969569 rc 0/0 00000100:00100000:3.0:1734016149.267522:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 305 00002000:00100000:3.0:1734016149.267541:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (2723840->2732031) req@ffff880073791c00 x1818247334048512/t4294969569(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:110/0 lens 8680/448 e 0 to 0 dl 1734016160 ref 1 fl Complete:H/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016149.267552:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073791c00 with x1818247334048512 ext(2723840->2732031) 00010000:00010000:3.0:1734016149.267567:0:7687:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117d93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->3837951) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e793b expref: 18 pid: 8216 timeout: 516 lvb_type: 0 00010000:00010000:3.0:1734016149.267589:0:7687:0:(ldlm_lockd.c:586:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117d93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->3837951) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e793b expref: 18 pid: 8216 timeout: 516 lvb_type: 0 00002000:00010000:3.0:1734016149.267597:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880073791c00 00000100:00100000:0.0:1734016149.281581:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016149.281744:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334048640 00000100:00100000:3.0:1734016149.281761:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334048640 00010000:00010000:3.0:1734016149.281898:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117d93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->3837951) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e793b expref: 18 pid: 8216 timeout: 516 lvb_type: 0 00000100:00100000:3.0:1734016149.281945:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3304 00000100:00100000:3.0:1734016149.281955:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247334048640:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016149.281982:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1734016149.282013:0:6466:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 40 -> 56 00010000:00010000:3.0:1734016149.282020:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117d93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3829760->3837951) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e793b expref: 18 pid: 8216 timeout: 516 lvb_type: 0 00010000:00010000:3.0:1734016149.282036:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117d93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3829760->3837951) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e793b expref: 18 pid: 8216 timeout: 516 lvb_type: 0 00010000:00010000:3.0:1734016149.282070:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc240/0x5e3a3adc27117d93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3829760->3837951) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e793b expref: 18 pid: 8216 timeout: 516 lvb_type: 0 00010000:00010000:3.0:1734016149.282099:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016149.282102:0:6466:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016149.282111:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117e5e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 282624->286719) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ce expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.282121:0:6466:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117e5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 282624->286719) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ce expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.282170:0:6466:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117e5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 282624->286719) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ce expref: 9 pid: 7683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016149.282190:0:6466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335463040:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016149.282314:0:6466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:3.0:1734016149.291971:0:6466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6466:1818247335463040:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016149.292012:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016149.292097:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+17:1982:x1818247334048640:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 10141us (10536us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016149.292112:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3304 00000100:00100000:0.0:1734016149.302633:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016149.302728:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334048896 00000100:00100000:3.0:1734016149.302741:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334048896 00002000:00100000:3.0:1734016149.302860:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (0->4194303) req@ffff880073792d80 x1818247334048896/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:110/0 lens 488/0 e 0 to 0 dl 1734016160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016149.302875:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073792d80 with x1818247334048896 ext(0->4194303) 00002000:00010000:3.0:1734016149.302883:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073792d80 00000100:00100000:3.0:1734016149.302924:0:7687:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9079 00000100:00100000:3.0:1734016149.302934:0:7687:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247334048896:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:3.0:1734016149.347070:0:7687:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1981:x1818247334048896:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 44104us (44418us total) trans 0 rc 4194304/4194304 00000100:00100000:3.0:1734016149.347093:0:7687:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9079 00002000:00100000:3.0:1734016149.347112:0:7687:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8:0x0] (0->4194303) req@ffff880073792d80 x1818247334048896/t0(0) o3->84392f61-a30b-4a4c-b6a5-f13f1ae7284e@192.168.201.16@tcp:110/0 lens 488/440 e 0 to 0 dl 1734016160 ref 1 fl Complete:/200/0 rc 4194304/4194304 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1734016149.347123:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff880073792d80 with x1818247334048896 ext(0->4194303) 00002000:00010000:3.0:1734016149.347129:0:7687:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880073792d80 00000100:00100000:0.0:1734016149.353666:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016149.354978:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.355093:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334049024 00000100:00100000:2.0:1734016149.355106:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334049024 00000100:00100000:2.0:1734016149.355484:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334049152 00000100:00100000:2.0:1734016149.355488:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334049152 00000100:00100000:3.0:1734016149.355551:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12077 00000100:00100000:3.0:1734016149.355567:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+14:1984:x1818247334049024:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016149.355608:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016149.355649:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117e65 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e79d5 expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.355688:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016149.355691:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016149.355703:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79d5 expref: 15 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016149.355722:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79d5 expref: 15 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016149.355736:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df73c0, rc 0) 00000100:00100000:3.0:1734016149.356476:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+15:1984:x1818247334049024:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 910us (2829us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016149.356483:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12077 00000100:00100000:3.0:1734016149.356503:0:7683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12078 00000100:00100000:3.0:1734016149.356507:0:7683:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880073793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+17:1984:x1818247334049152:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016149.356515:0:7683:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016149.356525:0:7683:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117e6c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e79dc expref: -99 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.356536:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016149.356538:0:7683:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016149.356540:0:7683:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117e6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79dc expref: 18 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016149.356549:0:7683:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117e6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79dc expref: 18 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1734016149.356554:0:7683:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df5b00, rc 0) 00000100:00100000:3.0:1734016149.356568:0:7683:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880073793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c598caf-7141-4c19-8566-0b7731516db9+18:1984:x1818247334049152:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 61us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016149.356571:0:7683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12078 00000100:00100000:0.0:1734016149.359498:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016149.359624:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334049408 00000100:00100000:1.0:1734016149.359644:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334049408 00000100:00100000:1.0:1734016149.359731:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2413 00000100:00100000:1.0:1734016149.359744:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+17:10406:x1818247334049408:12345-192.168.201.16@tcp:36:fsx.0 00010000:00010000:1.0:1734016149.359920:0:7704:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016149.361310:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7cc0/0x5e3a3adc27117dd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7965 expref: 17 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016149.361345:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:1.0:1734016149.361351:0:7704:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1734016149.361909:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27117e73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016149.361934:0:7704:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117dc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e795e expref: 26 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016149.361942:0:7704:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27117e73 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:1.0:1734016149.361992:0:7704:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e795e expref: 26 pid: 6479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016149.362010:0:7704:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117dc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e795e expref: 26 pid: 6479 timeout: 516 lvb_type: 0 00000100:00100000:1.0:1734016149.362025:0:7704:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335463168:192.168.201.16@tcp:104: 00000100:00100000:1.0:1734016149.363473:0:7704:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016149.369503:0:7704:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7704:1818247335463168:192.168.201.16@tcp:104: 00000100:00100000:0.0:1734016149.369509:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00010000:00010000:1.0:1734016149.369542:0:7704:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27117e73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:3.0:1734016149.369789:0:6466:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334049536 00000100:00100000:3.0:1734016149.370003:0:6466:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334049536 00010000:00010000:3.0:1734016149.370043:0:6466:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117dc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e795e expref: 27 pid: 6479 timeout: 516 lvb_type: 0 00000100:00100000:3.0:1734016149.370088:0:6466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3305 00000100:00100000:3.0:1734016149.370102:0:6466:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+27:1982:x1818247334049536:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016149.370128:0:6466:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016149.370135:0:6466:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117dc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e795e expref: 27 pid: 6479 timeout: 516 lvb_type: 0 00010000:00010000:3.0:1734016149.370148:0:6466:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e795e expref: 27 pid: 6479 timeout: 516 lvb_type: 0 00010000:00010000:3.0:1734016149.370177:0:6466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117dc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e795e expref: 27 pid: 6479 timeout: 516 lvb_type: 0 00010000:00010000:3.0:1734016149.370207:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016149.370213:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27117e73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016149.370224:0:6466:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27117e73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016149.370231:0:6466:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27117e73 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016149.370258:0:6466:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1734016149.370271:0:7704:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27117e73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:0.0:1734016149.370278:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27117e73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:3.0:1734016149.370316:0:6466:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075874380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c598caf-7141-4c19-8566-0b7731516db9+26:1982:x1818247334049536:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 218us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016149.370324:0:6466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3305 00000001:00080000:0.0:1734016149.370436:0:7704:0:(tgt_lastrcvd.c:2087:tgt_txn_stop_cb()) More than one transaction 4294968867 00000004:00010000:3.0:1734016149.370928:0:7704:0:(mdt_handler.c:4296:mdt_save_lock()) ### save lock request ffff880075877100 reply state ffff88007484d000 transno 4294968868 ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27117e73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000100:00100000:3.0:1734016149.370937:0:7704:0:(service.c:191:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1734016149.371703:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:10406:x1818247334049408:12345-192.168.201.16@tcp:36:fsx.0 Request processed in 11958us (12219us total) trans 4294968868 rc 0/0 00000100:00100000:3.0:1734016149.371713:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2413 00000020:00080000:3.0:1734016149.371720:0:7704:0:(tgt_main.c:781:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1734016149.374232:0:3489:0:(ldlm_lock.c:819:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27117e73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016149.374247:0:3489:0:(ldlm_lock.c:877:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27117e73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016149.374254:0:3489:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27117e73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016149.374260:0:3489:0:(ldlm_lockd.c:1942:ldlm_handle_bl_callback()) Lock ffff88008499df80 already unused, calling callback (ffffffffa0ee4950) 00010000:00010000:3.0:1734016149.374266:0:3489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27117e73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016149.374274:0:3489:0:(ldlm_request.c:1305:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27117e73 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016149.374296:0:3489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016149.374299:0:3489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1734016149.374304:0:3489:0:(ldlm_lockd.c:1952:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27117e73 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016149.374309:0:3489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008499df80/0x5e3a3adc27117e73 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7704 initiator: MDT0 00000100:00100000:0.0:1734016149.376205:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.376329:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334049664 00000100:00100000:2.0:1734016149.376348:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334049664 00000100:00100000:2.0:1734016149.376429:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12079 00000100:00100000:2.0:1734016149.376440:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:10406:x1818247334049664:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016149.376467:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016149.376490:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117e7a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e79e3 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.376528:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117e42 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3870720->3878911) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79b2 expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.376537:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117e65 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79d5 expref: 14 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.376545:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016149.376547:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016149.376551:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117e7a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79e3 expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.376587:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79d5 expref: 14 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.376607:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117e65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79d5 expref: 14 pid: 7683 timeout: 516 lvb_type: 1 00000100:00100000:2.0:1734016149.376620:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335463296:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016149.376713:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117e42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3870720->3878911) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79b2 expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.376721:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117e42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3870720->3878911) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79b2 expref: 12 pid: 7682 timeout: 516 lvb_type: 0 00000100:00100000:2.0:1734016149.376729:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335463424:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016149.376750:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:0.0:1734016149.383274:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.383455:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335463296:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016149.383472:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335463424:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016149.383507:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117e7a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79e3 expref: 12 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.383528:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbf180, rc 0) 00000100:00100000:2.0:1734016149.383579:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:10406:x1818247334049664:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7141us (7386us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016149.383589:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12079 00000100:00100000:1.0:1734016149.383930:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334049792 00000100:00100000:1.0:1734016149.383941:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334049792 00010000:00010000:1.0:1734016149.383976:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117e65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79d5 expref: 15 pid: 7683 timeout: 516 lvb_type: 1 00000100:00100000:1.0:1734016149.385592:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3306 00000100:00100000:1.0:1734016149.385604:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+15:1982:x1818247334049792:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016149.385622:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016149.385647:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117e65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79d5 expref: 15 pid: 7683 timeout: 516 lvb_type: 1 00010000:00010000:1.0:1734016149.385659:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79d5 expref: 15 pid: 7683 timeout: 516 lvb_type: 1 00010000:00010000:1.0:1734016149.385679:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129df73c0/0x5e3a3adc27117e65 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79d5 expref: 15 pid: 7683 timeout: 516 lvb_type: 1 00010000:00010000:1.0:1734016149.385704:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016149.386964:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247334049792:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1355us (3697us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016149.386971:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3306 00000100:00100000:0.0:1734016149.387521:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016149.387579:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334049920 00000100:00100000:1.0:1734016149.387586:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334049920 00010000:00010000:1.0:1734016149.387606:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117e42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3870720->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79b2 expref: 12 pid: 7682 timeout: 516 lvb_type: 0 00000100:00100000:1.0:1734016149.387639:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3307 00000100:00100000:1.0:1734016149.387644:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075875500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1981:x1818247334049920:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1734016149.387654:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1734016149.387666:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117e42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3870720->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79b2 expref: 12 pid: 7682 timeout: 516 lvb_type: 0 00010000:00010000:1.0:1734016149.387675:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117e42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3870720->3878911) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79b2 expref: 12 pid: 7682 timeout: 516 lvb_type: 0 00010000:00010000:1.0:1734016149.387689:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7580480/0x5e3a3adc27117e42 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3870720->3878911) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79b2 expref: 12 pid: 7682 timeout: 516 lvb_type: 0 00010000:00010000:1.0:1734016149.387705:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016149.387706:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1734016149.387710:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117e7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79e3 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016149.387718:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117e7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79e3 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1734016149.387743:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006edbf180/0x5e3a3adc27117e7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79e3 expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016149.387751:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335463552:192.168.201.16@tcp:105: 00000100:00100000:1.0:1734016149.387787:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:1.0:1734016149.388837:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9876:1818247335463552:192.168.201.16@tcp:105: 00010000:00010000:1.0:1734016149.388851:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016149.388873:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075875500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247334049920:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 1229us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1734016149.388881:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3307 00000100:00100000:0.0:1734016149.389520:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.389605:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334050048 00000100:00100000:2.0:1734016149.389609:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334050048 00000100:00100000:2.0:1734016149.389645:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12080 00000100:00100000:2.0:1734016149.389649:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:10406:x1818247334050048:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016149.389664:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016149.389680:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117e81 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e79ea expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.389704:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117e5e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 282624->286719) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ce expref: 11 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.389711:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117e6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79dc expref: 17 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.389717:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016149.389718:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016149.389721:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117e81 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ea expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.389743:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117e6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79dc expref: 17 pid: 7683 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.389755:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117e6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79dc expref: 17 pid: 7683 timeout: 516 lvb_type: 1 00000100:00100000:2.0:1734016149.389766:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335463680:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016149.389837:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117e5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 282624->286719) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ce expref: 11 pid: 7683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.389849:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117e5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 282624->286719) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ce expref: 11 pid: 7683 timeout: 516 lvb_type: 0 00000100:00100000:2.0:1734016149.389857:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335463808:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016149.389873:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706b40 going to sleep for 11 seconds 00000100:00100000:2.0:1734016149.391919:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335463680:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016149.391929:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335463808:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016149.391956:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117e81 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ea expref: 11 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.391968:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc900, rc 0) 00000100:00100000:2.0:1734016149.391999:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:10406:x1818247334050048:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2347us (2479us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016149.392006:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12080 00000100:00100000:0.0:1734016149.392098:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.392308:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334050176 00000100:00100000:2.0:1734016149.392313:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334050176 00010000:00010000:2.0:1734016149.392334:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117e6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79dc expref: 18 pid: 7683 timeout: 516 lvb_type: 1 00000100:00100000:2.0:1734016149.392390:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3308 00000100:00100000:2.0:1734016149.392405:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+18:1982:x1818247334050176:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016149.392419:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016149.392438:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117e6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79dc expref: 18 pid: 7683 timeout: 516 lvb_type: 1 00010000:00010000:2.0:1734016149.392448:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117e6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79dc expref: 18 pid: 7683 timeout: 516 lvb_type: 1 00010000:00010000:2.0:1734016149.392468:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5b00/0x5e3a3adc27117e6c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79dc expref: 18 pid: 7683 timeout: 516 lvb_type: 1 00010000:00010000:2.0:1734016149.392677:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1734016149.392760:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c598caf-7141-4c19-8566-0b7731516db9+17:1982:x1818247334050176:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 353us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016149.392767:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3308 00000100:00100000:0.0:1734016149.402113:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.402271:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334050304 00000100:00100000:2.0:1734016149.402289:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334050304 00010000:00010000:2.0:1734016149.402343:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117e5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ce expref: 11 pid: 7683 timeout: 516 lvb_type: 0 00000100:00100000:2.0:1734016149.402384:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3309 00000100:00100000:2.0:1734016149.402400:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247334050304:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1734016149.402426:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1734016149.402451:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117e5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 282624->286719) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ce expref: 11 pid: 7683 timeout: 516 lvb_type: 0 00010000:00010000:2.0:1734016149.402466:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117e5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 282624->286719) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ce expref: 11 pid: 7683 timeout: 516 lvb_type: 0 00010000:00010000:2.0:1734016149.402501:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129df5440/0x5e3a3adc27117e5e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 282624->286719) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ce expref: 11 pid: 7683 timeout: 516 lvb_type: 0 00010000:00010000:2.0:1734016149.402935:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016149.402937:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1734016149.402944:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117e81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ea expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.402953:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117e81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ea expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.402991:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117e81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ea expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016149.403005:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075545500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335463936:192.168.201.16@tcp:105: 00000100:00100000:2.0:1734016149.403075:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00000100:00100000:0.0:1734016149.411589:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016149.411647:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016149.412146:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334050432 00000100:00100000:1.0:1734016149.412165:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334050432 00002000:00010000:1.0:1734016149.412219:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:1.0:1734016149.412224:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15d500 with x1818247334050432 ext(4194304->18446744073709551615) 00002000:00010000:1.0:1734016149.412238:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b15d500. 00000100:00100000:3.0:1734016149.412299:0:7687:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334050560 00000100:00100000:3.0:1734016149.412305:0:7687:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334050560 00002000:00010000:3.0:1734016149.412321:0:7687:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (3158904->18446744073709551615) 00002000:00100000:3.0:1734016149.412325:0:7687:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15dc00 with x1818247334050560 ext(3158904->18446744073709551615) 00002000:00010000:3.0:1734016149.412334:0:7687:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15dc00. 00000100:00100000:3.0:1734016149.412375:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9080 00000100:00100000:3.0:1734016149.412382:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247334050560:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:2.0:1734016149.412586:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075545500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335463936:192.168.201.16@tcp:105: 00010000:00010000:2.0:1734016149.412609:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1734016149.412751:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9081 00000100:00100000:1.0:1734016149.412756:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247334050432:12345-192.168.201.16@tcp:10:fsx.0 00000100:00100000:2.0:1734016149.412984:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1981:x1818247334050304:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 10590us (10887us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016149.412993:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3309 00002000:00010000:1.0:1734016149.414244:0:7689:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 5089234 -> 4194304 00002000:00010000:1.0:1734016149.414250:0:7689:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1734016149 -> 1734016149 00002000:00010000:1.0:1734016149.414253:0:7689:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1734016149 -> 1734016148 00002000:00010000:1.0:1734016149.414255:0:7689:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1734016149 -> 1734016149 00002000:00010000:1.0:1734016149.414257:0:7689:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 232 -> 232 00000100:00100000:1.0:1734016149.414301:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+12:1982:x1818247334050432:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 1543us (2729us total) trans 4294968122 rc 0/0 00000100:00100000:1.0:1734016149.414309:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9081 00002000:00010000:1.0:1734016149.414313:0:7689:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (4194304->18446744073709551615) 00002000:00100000:1.0:1734016149.414316:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15d500 with x1818247334050432 ext(4194304->18446744073709551615) 00002000:00010000:1.0:1734016149.414322:0:7689:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b15d500. 00002000:00010000:3.0:1734016149.415472:0:7688:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 4194304 -> 3158904 00002000:00010000:3.0:1734016149.415480:0:7688:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 1734016149 -> 1734016149 00002000:00010000:3.0:1734016149.415482:0:7688:0:(ofd_lvb.c:336:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 1734016149 -> 1734016149 00002000:00010000:3.0:1734016149.415484:0:7688:0:(ofd_lvb.c:342:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 1734016149 -> 1734016149 00002000:00010000:3.0:1734016149.415486:0:7688:0:(ofd_lvb.c:348:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 56 -> 32 00000100:00100000:3.0:1734016149.415543:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247334050560:12345-192.168.201.16@tcp:10:fsx.0 Request processed in 3157us (3892us total) trans 4294969570 rc 0/0 00000100:00100000:3.0:1734016149.415554:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9080 00002000:00010000:3.0:1734016149.415558:0:7688:0:(ofd_dev.c:2722:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/8 (3158904->18446744073709551615) 00002000:00100000:3.0:1734016149.415560:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b15dc00 with x1818247334050560 ext(3158904->18446744073709551615) 00002000:00010000:3.0:1734016149.415566:0:7688:0:(ofd_dev.c:2727:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b15dc00. 00000100:00100000:2.0:1734016149.419290:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016149.419385:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334050688 00000100:00100000:3.0:1734016149.419407:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334050688 00000100:00100000:3.0:1734016149.419552:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2414 00000100:00100000:3.0:1734016149.419560:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+26:10406:x1818247334050688:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016149.419583:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016149.419602:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117e88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e79f1 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.419696:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117e8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016149.419709:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117e8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016149.419718:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117e8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:3.0:1734016149.419737:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 7353208 00000004:00200000:3.0:1734016149.419740:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016149.419754:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117e8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016149.419774:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df7180/0x5e3a3adc27117e88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79f1 expref: 28 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.419786:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4d80/0x5e3a3adc27117e8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79f1 expref: 27 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.419792:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016149.419795:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016149.419977:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4d80, rc 0) 00000100:00100000:3.0:1734016149.420516:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c598caf-7141-4c19-8566-0b7731516db9+27:10406:x1818247334050688:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 954us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016149.420522:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2414 00000100:00100000:0.0:1734016149.422654:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016149.422720:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016149.422921:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334050816 00000100:00100000:1.0:1734016149.422934:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334050816 00000100:00100000:1.0:1734016149.423234:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334050944 00000100:00100000:1.0:1734016149.423238:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334050944 00000100:00100000:2.0:1734016149.423288:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12081 00000100:00100000:2.0:1734016149.423296:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247334050816:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016149.423319:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016149.423344:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117e96 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e79f8 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016149.423466:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335464064:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016149.423549:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016149.423823:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12082 00000100:00100000:1.0:1734016149.423829:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+17:1982:x1818247334050944:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016149.423839:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016149.423853:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27117e9d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e79ff expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016149.423885:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335464192:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016149.423912:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00002000:00010000:2.0:1734016149.427263:0:7682:0:(ofd_lvb.c:289:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime: 1734016148 -> 1734016149 00000100:00100000:2.0:1734016149.427293:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335464064:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016149.427329:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117e96 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79f8 expref: 15 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.427345:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbcfc0/0x5e3a3adc27117e96 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79f8 expref: 15 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.427695:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcfc0, rc 0) 00000100:00100000:2.0:1734016149.429607:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247334050816:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6299us (6953us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016149.429620:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12081 00000100:00100000:1.0:1734016149.430842:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335464192:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016149.430884:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27117e9d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ff expref: 18 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016149.430902:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499df80/0x5e3a3adc27117e9d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ff expref: 18 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016149.430923:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499df80, rc 0) 00000100:00100000:1.0:1734016149.431539:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+17:1982:x1818247334050944:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7706us (8815us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016149.431548:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12082 00000100:00100000:0.0:1734016149.434506:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016149.434606:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016149.434700:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334051200 00000100:00100000:1.0:1734016149.434713:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334051200 00000100:00100000:1.0:1734016149.434769:0:8216:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334051072 00000100:00100000:1.0:1734016149.434771:0:8216:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334051072 00000100:00100000:1.0:1734016149.434787:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12083 00000100:00100000:1.0:1734016149.434794:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+17:1982:x1818247334051200:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016149.434843:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016149.434868:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27117ea4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7a0d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016149.434938:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335464320:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016149.435003:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016149.435074:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12084 00000100:00100000:2.0:1734016149.435080:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247334051072:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016149.435088:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016149.435099:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117eab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7a06 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016149.435130:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335464448:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016149.435152:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00000100:00100000:2.0:1734016149.438249:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335464448:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016149.438298:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117eab lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a06 expref: 15 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.438313:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbc240/0x5e3a3adc27117eab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a06 expref: 15 pid: 7682 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1734016149.438589:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335464320:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016149.438607:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27117ea4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a0d expref: 18 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016149.438615:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499d680/0x5e3a3adc27117ea4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a0d expref: 18 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016149.438626:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499d680, rc 0) 00000100:00100000:1.0:1734016149.438665:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+17:1982:x1818247334051200:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3871us (4172us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016149.438672:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12083 00010000:00010000:2.0:1734016149.439405:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc240, rc 0) 00000100:00100000:2.0:1734016149.439439:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247334051072:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4357us (4832us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016149.439445:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12084 00000100:00100000:2.0:1734016149.443996:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.444059:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016149.444135:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334051456 00000100:00100000:0.0:1734016149.444147:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334051456 00000100:00100000:0.0:1734016149.444205:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334051328 00000100:00100000:0.0:1734016149.444208:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334051328 00000100:00100000:0.0:1734016149.444240:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12085 00000100:00100000:0.0:1734016149.444250:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+17:1982:x1818247334051456:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:0.0:1734016149.444275:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1734016149.444300:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27117eb2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7a1b expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1734016149.444374:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007583ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335464576:192.168.201.16@tcp:106: 00000100:00100000:0.0:1734016149.444466:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff88007541f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1734016149.444633:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12086 00000100:00100000:1.0:1734016149.444639:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff880075544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247334051328:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016149.444648:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016149.444659:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27117eb9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7a14 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016149.444690:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335464704:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016149.444724:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016149.448845:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007583ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335464576:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016149.448901:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27117eb2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a1b expref: 18 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.448917:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7580480/0x5e3a3adc27117eb2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a1b expref: 18 pid: 7682 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1734016149.449196:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1818247335464704:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016149.449221:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27117eb9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a14 expref: 15 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016149.449230:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008499c900/0x5e3a3adc27117eb9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a14 expref: 15 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016149.449248:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499c900, rc 0) 00000100:00100000:1.0:1734016149.449305:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+14:1981:x1818247334051328:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4663us (5244us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016149.449315:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12086 00010000:00010000:2.0:1734016149.449939:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7580480, rc 0) 00000100:00100000:2.0:1734016149.449964:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff880075544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+17:1982:x1818247334051456:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 5716us (5984us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016149.449970:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12085 00000100:00100000:0.0:1734016149.452678:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:0.0:1734016149.452731:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.453068:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334051712 00000100:00100000:2.0:1734016149.453082:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334051712 00000100:00100000:2.0:1734016149.453505:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334051584 00000100:00100000:2.0:1734016149.453509:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334051584 00000100:00100000:1.0:1734016149.453546:0:8216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12087 00000100:00100000:1.0:1734016149.453555:0:8216:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+17:1982:x1818247334051712:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:1.0:1734016149.453580:0:8216:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1734016149.453598:0:8216:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27117ec0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7a29 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1734016149.453663:0:8216:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335464832:192.168.201.16@tcp:106: 00000100:00100000:1.0:1734016149.453732:0:8216:0:(client.c:2562:ptlrpc_set_wait()) set ffff880129c92000 going to sleep for 11 seconds 00000100:00100000:2.0:1734016149.455658:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12088 00000100:00100000:2.0:1734016149.455672:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247334051584:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016149.455697:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016149.455719:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117ec7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7a22 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016149.455774:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335464960:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016149.455848:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00000100:00100000:1.0:1734016149.457594:0:8216:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a78cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1818247335464832:192.168.201.16@tcp:106: 00010000:00010000:1.0:1734016149.457641:0:8216:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27117ec0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a29 expref: 18 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016149.457659:0:8216:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008499f3c0/0x5e3a3adc27117ec0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a29 expref: 18 pid: 8216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1734016149.457682:0:8216:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008499f3c0, rc 0) 00000100:00100000:1.0:1734016149.457741:0:8216:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c598caf-7141-4c19-8566-0b7731516db9+17:1982:x1818247334051712:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 4185us (5074us total) trans 0 rc 301/301 00000100:00100000:1.0:1734016149.457754:0:8216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12087 00000100:00100000:2.0:1734016149.461470:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335464960:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016149.461535:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117ec7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a22 expref: 15 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.461553:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbe1c0/0x5e3a3adc27117ec7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a22 expref: 15 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.461721:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbe1c0, rc 0) 00000100:00100000:2.0:1734016149.461786:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1982:x1818247334051584:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 6115us (9052us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016149.461795:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12088 00000100:00100000:0.0:1734016149.464299:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016149.464424:0:7704:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334051840 00000100:00100000:3.0:1734016149.464436:0:7704:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334051840 00000100:00100000:3.0:1734016149.464506:0:7704:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 2415 00000100:00100000:3.0:1734016149.464515:0:7704:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+18:10406:x1818247334051840:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:3.0:1734016149.464548:0:7704:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1734016149.464586:0:7704:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117ece lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7a30 expref: -99 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.464704:0:7704:0:(ldlm_lock.c:765:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27117ed5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016149.464721:0:7704:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27117ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016149.464733:0:7704:0:(ldlm_request.c:518:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27117ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00000004:00200000:3.0:1734016149.464768:0:7704:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0xc:0x0]: returning size 7353208 00000004:00200000:3.0:1734016149.464773:0:7704:0:(mdt_handler.c:1602:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1734016149.464791:0:7704:0:(mdt_handler.c:2485:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27117ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7704 initiator: MDT0 00010000:00010000:3.0:1734016149.464873:0:7704:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4240/0x5e3a3adc27117ece lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a30 expref: 20 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.464909:0:7704:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129df4900/0x5e3a3adc27117ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a30 expref: 19 pid: 7704 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.464921:0:7704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff88012a2b0f00) 00010000:00010000:3.0:1734016149.464924:0:7704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1734016149.464927:0:7704:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129df4900, rc 0) 00000100:00100000:3.0:1734016149.464982:0:7704:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+19:10406:x1818247334051840:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 468us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016149.464988:0:7704:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 2415 00000100:00100000:0.0:1734016149.467571:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.467647:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334051968 00000100:00100000:2.0:1734016149.467654:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334051968 00000100:00100000:2.0:1734016149.467698:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12089 00000100:00100000:2.0:1734016149.467704:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+17:10406:x1818247334051968:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016149.467724:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016149.467739:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117edc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7a37 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.467766:0:7682:0:(ldlm_lock.c:678:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117e81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ea expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.467771:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016149.467772:0:7682:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1734016149.467775:0:7682:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117edc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [942080->954367] (req 942080->954367) gid 0 flags: 0x50000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a37 expref: 18 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.467796:0:7682:0:(ldlm_lockd.c:995:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117e81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ea expref: 10 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.467860:0:7682:0:(ldlm_lockd.c:474:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117e81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ea expref: 10 pid: 7682 timeout: 516 lvb_type: 0 00000100:00100000:2.0:1734016149.467869:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335465088:192.168.201.16@tcp:104: 00000100:00100000:2.0:1734016149.467914:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00000100:00100000:0.0:1734016149.470208:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.470361:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335465088:192.168.201.16@tcp:104: 00010000:00010000:2.0:1734016149.470416:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117edc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [942080->954367] (req 942080->954367) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a37 expref: 18 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1734016149.470440:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbc480, rc 0) 00000100:00100000:2.0:1734016149.470501:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+18:10406:x1818247334051968:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 2794us (2935us total) trans 0 rc 0/0 00000100:00100000:2.0:1734016149.470513:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12089 00000100:00100000:3.0:1734016149.470632:0:9876:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334052096 00000100:00100000:3.0:1734016149.470643:0:9876:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334052096 00010000:00010000:3.0:1734016149.470675:0:9876:0:(ldlm_lockd.c:2687:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117e81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ea expref: 11 pid: 7682 timeout: 516 lvb_type: 0 00000100:00100000:3.0:1734016149.470729:0:9876:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 3310 00000100:00100000:3.0:1734016149.470737:0:9876:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+11:1982:x1818247334052096:12345-192.168.201.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1734016149.470755:0:9876:0:(ldlm_lockd.c:1770:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1734016149.470789:0:9876:0:(ldlm_lockd.c:1819:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117e81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ea expref: 11 pid: 7682 timeout: 516 lvb_type: 0 00010000:00010000:3.0:1734016149.470846:0:9876:0:(ldlm_lockd.c:547:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117e81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ea expref: 11 pid: 7682 timeout: 516 lvb_type: 0 00010000:00010000:3.0:1734016149.470888:0:9876:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc900/0x5e3a3adc27117e81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e79ea expref: 11 pid: 7682 timeout: 516 lvb_type: 0 00010000:00010000:3.0:1734016149.470908:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016149.470910:0:9876:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1734016149.470919:0:9876:0:(ldlm_lock.c:706:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117edc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 942080->954367) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a37 expref: 17 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.470929:0:9876:0:(ldlm_resource.c:1684:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117edc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 942080->954367) gid 0 flags: 0x40080000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a37 expref: 17 pid: 7682 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1734016149.470973:0:9876:0:(ldlm_lockd.c:1114:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006edbc480/0x5e3a3adc27117edc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 942080->954367) gid 0 flags: 0x40000000020000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a37 expref: 17 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1734016149.470991:0:9876:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335465216:192.168.201.16@tcp:105: 00000100:00100000:3.0:1734016149.471036:0:9876:0:(client.c:2562:ptlrpc_set_wait()) set ffff8800a7f6d480 going to sleep for 11 seconds 00000100:00100000:0.0:1734016149.476676:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:3.0:1734016149.476882:0:9876:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801369f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9876:1818247335465216:192.168.201.16@tcp:105: 00010000:00010000:3.0:1734016149.476916:0:9876:0:(ldlm_lockd.c:1831:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1734016149.476983:0:9876:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1982:x1818247334052096:12345-192.168.201.16@tcp:103:ldlm_bl.0 Request processed in 6243us (6781us total) trans 0 rc 0/0 00000100:00100000:3.0:1734016149.477001:0:9876:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 3310 00000100:00100000:2.0:1734016149.477217:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334052352 00000100:00100000:2.0:1734016149.477226:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334052352 00002000:00100000:2.0:1734016149.477285:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (942080->946175) req@ffff88007583d500 x1818247334052352/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:110/0 lens 488/0 e 0 to 0 dl 1734016160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016149.477296:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007583d500 with x1818247334052352 ext(942080->946175) 00002000:00010000:2.0:1734016149.477300:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007583d500 00000100:00100000:2.0:1734016149.477339:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9082 00000100:00100000:2.0:1734016149.477347:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+18:1981:x1818247334052352:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016149.477571:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+18:1981:x1818247334052352:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 225us (919us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1734016149.477578:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9082 00002000:00100000:2.0:1734016149.477583:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (942080->946175) req@ffff88007583d500 x1818247334052352/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:110/0 lens 488/4536 e 0 to 0 dl 1734016160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016149.477592:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007583d500 with x1818247334052352 ext(942080->946175) 00002000:00010000:2.0:1734016149.477595:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007583d500 00000100:00100000:0.0:1734016149.480494:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:1.0:1734016149.480559:0:7689:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334052608 00000100:00100000:1.0:1734016149.480570:0:7689:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334052608 00002000:00100000:1.0:1734016149.480612:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (950272->954367) req@ffff88007583c700 x1818247334052608/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:110/0 lens 488/0 e 0 to 0 dl 1734016160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016149.480622:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007583c700 with x1818247334052608 ext(950272->954367) 00002000:00010000:1.0:1734016149.480627:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007583c700 00000100:00100000:1.0:1734016149.480655:0:7689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9083 00000100:00100000:1.0:1734016149.480661:0:7689:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+18:1983:x1818247334052608:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:1.0:1734016149.480847:0:7689:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c598caf-7141-4c19-8566-0b7731516db9+18:1983:x1818247334052608:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 184us (359us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1734016149.480855:0:7689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9083 00002000:00100000:1.0:1734016149.480860:0:7689:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (950272->954367) req@ffff88007583c700 x1818247334052608/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:110/0 lens 488/4536 e 0 to 0 dl 1734016160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1734016149.480866:0:7689:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88007583c700 with x1818247334052608 ext(950272->954367) 00002000:00010000:1.0:1734016149.480869:0:7689:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007583c700 00000100:00100000:0.0:1734016149.483932:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.484126:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334052736 00000100:00100000:2.0:1734016149.484137:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334052736 00000100:00100000:2.0:1734016149.484186:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12090 00000100:00100000:2.0:1734016149.484192:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247334052736:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016149.484210:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016149.484227:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117ee3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7a3e expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016149.484287:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335465344:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016149.484353:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00002000:00010000:2.0:1734016149.489895:0:7682:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime: 1734016149 -> 1734016150 00002000:00010000:2.0:1734016149.489909:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime: 1734016149 -> 1734016150 00000100:00100000:2.0:1734016149.489936:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335465344:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016149.489982:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117ee3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a3e expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.490001:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbdf80/0x5e3a3adc27117ee3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a3e expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.490598:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbdf80, rc 0) 00000100:00100000:2.0:1734016149.494677:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247334052736:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 10465us (10736us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016149.494688:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12090 00000100:00100000:0.0:1734016149.495305:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.495509:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334052864 00000100:00100000:2.0:1734016149.495519:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334052864 00000100:00100000:2.0:1734016149.495569:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12091 00000100:00100000:2.0:1734016149.495575:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247334052864:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016149.495601:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016149.495624:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117eea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7a45 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016149.495691:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335465472:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016149.495770:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00000100:00100000:2.0:1734016149.499305:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335465472:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016149.499363:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117eea lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a45 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.499387:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbd200/0x5e3a3adc27117eea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a45 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.499425:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016149.499498:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1983:x1818247334052864:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 3920us (4193us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016149.499513:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12091 00000100:00100000:0.0:1734016149.502541:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.502694:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334052992 00000100:00100000:2.0:1734016149.502707:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334052992 00000100:00100000:2.0:1734016149.502972:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12092 00000100:00100000:2.0:1734016149.502982:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88007583ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247334052992:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016149.503013:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016149.503037:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117ef1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7a4c expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016149.503131:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335465600:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016149.503213:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00000100:00100000:2.0:1734016149.511213:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335465600:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016149.511291:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117ef1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a4c expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.511317:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117ef1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a4c expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.516110:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016149.516255:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88007583ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247334052992:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 13264us (13725us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016149.516270:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12092 00000100:00100000:0.0:1734016149.524750:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.525328:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334053120 00000100:00100000:2.0:1734016149.525344:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334053120 00000100:00100000:2.0:1734016149.525433:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12093 00000100:00100000:2.0:1734016149.525443:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247334053120:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016149.525481:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016149.525515:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117ef8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7a53 expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016149.525631:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335465728:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016149.525743:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00000100:00100000:2.0:1734016149.533254:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:7682:1818247335465728:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016149.533313:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117ef8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a53 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.533332:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006edbcb40/0x5e3a3adc27117ef8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a53 expref: 11 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.533375:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbcb40, rc 0) 00000100:00100000:2.0:1734016149.533461:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84392f61-a30b-4a4c-b6a5-f13f1ae7284e+10:1984:x1818247334053120:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 8016us (8732us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016149.533476:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12093 00000100:00100000:0.0:1734016149.536703:0:3498:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.539773:0:7682:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334053248 00000100:00100000:2.0:1734016149.539834:0:7682:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334053248 00000100:00100000:2.0:1734016149.539980:0:7682:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 12094 00000100:00100000:2.0:1734016149.539996:0:7682:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff8800758f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1983:x1818247334053248:12345-192.168.201.16@tcp:101:fsx.0 00010000:00010000:2.0:1734016149.540045:0:7682:0:(ldlm_lockd.c:1296:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1734016149.540098:0:7682:0:(ldlm_lockd.c:1368:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117eff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa50fd972cb8e7a5a expref: -99 pid: 7682 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1734016149.540225:0:7682:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335465856:192.168.201.16@tcp:106: 00000100:00100000:2.0:1734016149.540355:0:7682:0:(client.c:2562:ptlrpc_set_wait()) set ffff880073706840 going to sleep for 11 seconds 00002000:00010000:2.0:1734016149.547493:0:7682:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime: 1734016149 -> 1734016150 00002000:00010000:2.0:1734016149.547508:0:7682:0:(ofd_lvb.c:295:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime: 1734016149 -> 1734016150 00000100:00100000:2.0:1734016149.547550:0:7682:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880075544700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:7682:1818247335465856:192.168.201.16@tcp:106: 00010000:00010000:2.0:1734016149.547602:0:7682:0:(ldlm_lockd.c:1538:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117eff lrc: 1/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a5a expref: 15 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.547622:0:7682:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006edbd200/0x5e3a3adc27117eff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.16@tcp remote: 0xa50fd972cb8e7a5a expref: 15 pid: 7682 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1734016149.547663:0:7682:0:(ldlm_lockd.c:1616:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006edbd200, rc 0) 00000100:00100000:2.0:1734016149.547757:0:7682:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff8800758f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c598caf-7141-4c19-8566-0b7731516db9+14:1983:x1818247334053248:12345-192.168.201.16@tcp:101:fsx.0 Request processed in 7763us (11068us total) trans 0 rc 301/301 00000100:00100000:2.0:1734016149.547773:0:7682:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 12094 00000100:00100000:0.0:1734016149.552474:0:3496:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.553291:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334053504 00000100:00100000:2.0:1734016149.553303:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334053504 00002000:00100000:2.0:1734016149.553356:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (1642496->1708031) req@ffff88012d4ae680 x1818247334053504/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:110/0 lens 488/0 e 0 to 0 dl 1734016160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016149.553367:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4ae680 with x1818247334053504 ext(1642496->1708031) 00002000:00010000:2.0:1734016149.553373:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d4ae680 00000100:00100000:2.0:1734016149.554343:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9084 00000100:00100000:2.0:1734016149.554359:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+18:1984:x1818247334053504:12345-192.168.201.16@tcp:3:fsx.0 00000100:00100000:2.0:1734016149.564648:0:7688:0:(service.c:2396:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+18:1984:x1818247334053504:12345-192.168.201.16@tcp:3:fsx.0 Request processed in 10267us (12174us total) trans 0 rc 65536/65536 00000100:00100000:2.0:1734016149.564675:0:7688:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.16@tcp, seq: 9084 00002000:00100000:2.0:1734016149.564700:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (1642496->1708031) req@ffff88012d4ae680 x1818247334053504/t0(0) o3->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:110/0 lens 488/440 e 0 to 0 dl 1734016160 ref 1 fl Complete:/200/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016149.564715:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4ae680 with x1818247334053504 ext(1642496->1708031) 00002000:00010000:2.0:1734016149.564724:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d4ae680 00000100:00100000:0.0:1734016149.575520:0:3497:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.16@tcp (source: 12345-192.168.201.16@tcp) 00000100:00100000:2.0:1734016149.577364:0:7688:0:(service.c:2100:ptlrpc_server_handle_req_in()) unwrap req x1818247334053632 00000100:00100000:2.0:1734016149.577383:0:7688:0:(service.c:2165:ptlrpc_server_handle_req_in()) got req x1818247334053632 00002000:00100000:2.0:1734016149.577459:0:7688:0:(ofd_dev.c:2607:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (942080->1679359) req@ffff88012d4ad880 x1818247334053632/t0(0) o4->8c598caf-7141-4c19-8566-0b7731516db9@192.168.201.16@tcp:110/0 lens 504/0 e 0 to 0 dl 1734016160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1734016149.577470:0:7688:0:(ofd_dev.c:2466:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4ad880 with x1818247334053632 ext(942080->1679359) 00002000:00010000:2.0:1734016149.577478:0:7688:0:(ofd_dev.c:2612:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d4ad880 00000100:00100000:2.0:1734016149.578074:0:7688:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.16@tcp, seq: 9085 00000100:00100000:2.0:1734016149.578084:0:7688:0:(service.c:2344:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c598caf-7141-4c19-8566-0b7731516db9+18:1983:x1818247334053632:12345-192.168.201.16@tcp:4:fsx.0 Debug log: 72273 lines, 72273 kept, 0 dropped, 0 bad.